Principal Software Architect - Backend Systems & Data Infrastructure

Planful Software India Private Limited

Hyderabad

On-site

INR 6,000,000 - 9,000,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Volunteer days
Birthday PTO
Wellness days
Parental leave support
Talkspace access
Remote/home office stipend
Global offsites

Job summary

Planful Software India Private Limited seeks a Principal Architect to design and implement a high-performance OLAP query engine with a semantic layer. You will build a JSON-based DSL, translate requests into optimized SQL for columnar databases such as ClickHouse, SingleStore, and DuckDB, and manage multidimensional data modeling in a microservices environment.

You will lead compiler and DSL efforts, optimize SQL, and design distributed caching with Redis.

Qualifications

  • 15+ years in software engineering, backend systems.
  • Deep knowledge of compilers, ASTs, eBNF, and query planning.
  • Strong SQL, query optimization, and columnar databases.
  • Expert in Java, multi-threading, asynchronous I/O, memory management.
  • Experience designing distributed caching and state across microservices.
  • Ability to decompose complex data problems into scalable components.
  • Clear communication and disciplined documentation.
  • At least 1 year using AI coding agents.
  • Experience with financial systems is a plus.

Responsibilities

  • Architectural design and query execution.
  • Compiler & DSL development: design a custom JSON-based OLAP query language and translation layer.
  • SQL generation & optimization for columnar databases.
  • Semantic layer management for multi-dimensional data models.
  • Custom function logic balancing SQL push-down vs application execution.
  • Concur rency & scaling of high-performance microservices.

Skills

Compilers
ASTs
eBNF
Query planning
Java multithreading
Microservices
Distributed caching
Documentation
Performance benchmarking
AI coding agents
Cloud/DB optimization

Tools

ClickHouse
SingleStore
DuckDB
Redis
Micronaut
Spring Boot
Project Loom

Job description

Principal Architect
About the Role

As a Principal Architect, you will be responsible for the architectural design and end-to-end implementation of a high-performance OLAP query engine and semantic layer. The primary goal is to develop a custom JSON-based query language (DSL) and a translation engine that converts these requests into optimized SQL for columnar databases. This role requires a deep understanding of systems programming, compiler theory, and multi-dimensional data modeling to serve high-concurrency read loads in a microservices environment.

What You'll Do

Architectural Design & Query Execution

Compiler & DSL development: Design a custom JSON-based OLAP query language. Define eBNF grammars and build a translation layer to convert functional formulas and DSL requests into an optimized execution plan.

SQL generation & optimization: Implement and oversee the generation of highly optimized SQL tailored for columnar databases including ClickHouse, SingleStore, and DuckDB.

Semantic layer management: Architect the representation of multi-dimensional data models within columnar structures, ensuring efficient data retrieval and aggregation.

Custom function logic: Implement logic for custom functions, determining the optimal balance between SQL push-down and application-layer execution

Multi-dimensional caching: Envisage and implement a distributed caching strategy for multidimensional data, utilizing shared memory systems like Redis.

Concurrency & scaling: Build and maintain high-performance microservices using Java (Micronaut or Spring Boot) with Project Loom (Virtual Threads) to handle massive concurrent read loads.

Low-level optimization: Manage system-level performance including connection pooling, array pooling, and off-heap memory management.

JVM tuning: Apply expert knowledge of Java Garbage Collectors (including ZGC and Shenandoah) to maintain low-latency response times.

AI-augmented development: Leverage AI coding agents and tools to accelerate the software development lifecycle, from prototyping to debugging.

Technical documentation: Maintain a disciplined approach to software development by documenting architectural decisions, design patterns, and technical specifications.

Technical leadership: Act as the primary technical authority on query engine internals, providing guidance on complex systems-level challenges.

What We're Looking For

15+ years in software engineering with a focus on backend systems and data infrastructure

Strong theoretical and practical knowledge of compilers, ASTs, eBNF, and query planning

In-depth understanding of SQL, query optimization, and the internal workings of columnar databases

Expert proficiency in Java, specifically regarding multi-threading, asynchronous I/O, networking, and memory management

Proven experience in designing distributed caching layers and managing state across microservices

Ability to decompose complex data problems into scalable architectural components

Clear verbal and written communication skills, with a strong tendency to document thoughts and architectural ideas

A rigorous approach to software craftsmanship, including testing, telemetry, and performance benchmarking

Minimum of 1 year of experience using AI coding agents to enhance development productivity

Prior experience developing financial systems such as ERP, EPM, or General Ledger platforms is an added plus

Why this Role

You will own the internals of the query engine at the heart of a next-generation financial planning platform - the layer where compiler theory, columnar database performance, and multi-dimensional semantics converge.

Why Planful

To foster the best in class work we’re so proud of, we’ve created a best in class culture, including:

2 Volunteer days per year, Birthday PTO, and quarterly company Wellness Days

3 months supply of diapers and meal deliveries for the first month of your Maternity/Paternity leave and generous parental leave

Talkspace access and mental health support

Annual company-wide gatherings held in cities like San Diego, Denver, Palm Springs, and Vegas!

Office hubs in San Francisco, Toronto, and London.

We also offer benefits such as home office setup, and monthly wifi and cell phone reimbursements for all employees, in-office or remote.

Employee Resource Groups such as Women of Planful, Parents of Planful, and many more.

We encourage our teammates to bring their authentic selves to the team, and have full support in creating new ERGs & communities along the way.

Experience Level

Senior Level

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Principal Architect
Principal Architect

Planful, Inc. • Hyderabad

On-site
INR 2,500,000 - 4,500,000
Volunteer days
Birthday PTO
Wellness days
+7
Solutions Architect - Customer Excellence Optimization
Solutions Architect - Customer Excellence Optimization

Planful, Inc. • Hyderabad

On-site
INR 2,500,000 - 4,000,000
Volunteer days
Birthday PTO
Wellness days
+2
Technical Lead- Data Engineering
Technical Lead- Data Engineering

Juniper Square • India

Remote
INR 1,200,000 - 2,300,000
Technical Lead (Data) - India
Technical Lead (Data) - India

Juniper Square • India

Remote
INR 350,000 - 520,000
Technical Architect
Technical Architect

Moptra • Bengaluru

Remote
INR 4,500,000 - 6,500,000
Senior Staff Data Engineer
Senior Staff Data Engineer

Meeru AI Inc • Hyderabad

Remote
INR 3,500,000 - 6,000,000
Remote work
Flexible engagement
Principal Engineer - Systems
Principal Engineer - Systems

Freshworks • Hyderabad

On-site
INR 4,200,000 - 6,400,000
Sr. Software Engineer I
Sr. Software Engineer I

Planview • Bengaluru

On-site
INR 2,400,000 - 4,200,000
Unplugged Days
Generous PTO
Region specific benefits
+2
Lead Software Engineer
Lead Software Engineer

Insightsoftware • Hyderabad

On-site
INR 4,000,000 - 7,000,000
Data Architect
Data Architect

Onit, Inc. • Pune District

On-site
INR 3,500,000 - 6,000,000
Health Coverage
Flexible paid time off
Volunteer day
+1