Databricks Architect

Fluidata Analytics LLP; India; Remote; INR 4,000,000 - 7,500,000; Full time

Benefits offered by this job

Fully Remote work setup

Job summary

Fluidata Analytics LLP is actively seeking a Databricks Architect to lead end-to-end data engineering and analytics delivery using Databricks platforms across client environments. The role blends solution architecture, hands-on leadership, client engagement, and mentoring of engineers.

You will define and implement lakehouse architectures, manage data governance and security, and guide teams across AWS, Azure, or GCP with a strong focus on scalable data solutions.

Qualifications

• 6–10 years of experience in Data Engineering / Data Architecture.
• Min. 2 years of experience in Databricks Architecture.
• Strong hands-on experience with Databricks and Apache Spark.
• Strong expertise in PySpark, Python, and SQL.
• Strong experience designing lakehouse and enterprise data architectures.
• Experience with Delta Lake and Unity Catalog.
• Strong understanding of data modelling, ETL/ELT, data governance, security, and data quality.
• Experience with at least one major cloud platform — AWS, Azure, or GCP.
• Experience with Databricks Workflows, Airflow, or similar orchestration tools.
• Professional services / consulting experience with strong client-facing and communication skills.
• Proven experience leading technical teams and mentoring engineers.

Responsibilities

• Lead the architecture and design of end-to-end data solutions using Databricks and lakehouse architectures.
• Design scalable ETL/ELT pipelines, data models, data marts, and data platforms using Databricks, Spark, PySpark, and SQL.
• Define technical architecture across AWS, Azure, or GCP based on client requirements.
• Lead implementation of Delta Lake, Unity Catalog, data governance, security, and access controls.
• Review and optimize data pipelines, Spark workloads, SQL queries, and platform performance.
• Define best practices for data engineering, CI/CD, version control, testing, monitoring, and deployment.
• Work directly with international clients to understand requirements, provide technical guidance, and present solution designs.
• Lead technical discussions, architecture reviews, POCs, and solution demonstrations.
• Mentor and provide technical direction to data engineers and consultants.
• Take ownership of technical delivery, identify risks, and drive solutions across client engagements.

Skills

Databricks

Spark

PySpark

Python

SQL

Lakehouse architecture

Cloud platforms

Leadership & mentoring

Client-facing skills

Data governance & security

Data pipelines

CI/CD practices

Tools

Databricks Workflows

Airflow

Delta Lake

Unity Catalog

CI/CD tooling

Terraform

Job description

Fluidata Analytics is an AI-native data and analytics firm. We design and run data systems for clients across 8 industries and 5 continents.

We design, build, and operate data capabilities that help organizations turn fragmented information into decision-ready systems. Our services span data strategy, data engineering, analytics, governance, managed data teams, and AI integrations, with a growing focus on supply chain decision intelligence through Fluidata OS. Our goal is to deliver effective, high-quality, and highly adoptable data and analytics services that create measurable business outcomes

Our team is made up of people who learn fast, build with intention, and work directly on challenges that shape how organizations operate and make decisions.

About the Role

We’re looking for a Databricks Architect to lead the design and delivery of scalable data engineering and analytics solutions using Databricks Platforms.

This role combines solution architecture, hands-on technical leadership, client engagement, and team mentoring. You will work across different client environments and cloud platforms, translating business requirements into robust and scalable data architectures.

Job Description

• Lead the architecture and design of end-to-end data solutions using Databricks and modern lakehouse architecture.
• Design scalable ETL/ELT pipelines, data models, data marts, and data platforms using Databricks, Spark, PySpark, and SQL.
• Define technical architecture across AWS, Azure, or GCP, based on client requirements.
• Lead implementation of Delta Lake, Unity Catalog, data governance, security, and access controls.
• Review and optimize data pipelines, Spark workloads, SQL queries, and overall platform performance.
• Define best practices for data engineering, CI/CD, version control, testing, monitoring, and deployment.
• Work directly with international clients to understand requirements, provide technical guidance, and present solution designs.
• Lead technical discussions, architecture reviews, POCs, and solution demonstrations.
• Mentor and provide technical direction to data engineers and consultants.
• Take ownership of technical delivery, identify risks, and drive solutions across client engagements.

Required Skills

Must-have

• 6–10 years of experience in Data Engineering / Data Architecture.
• Min. 2 years of experience in Databricks Architecture
• Strong hands-on experience with Databricks and Apache Spark.
• Strong expertise in PySpark, Python, and SQL.
• Strong experience designing lakehouse and enterprise data architectures.
• Experience with Delta Lake and Unity Catalog.
• Strong understanding of data modelling, ETL/ELT, data governance, security, and data quality.
• Strong experience with at least one major cloud platform — AWS, Azure, or GCP.
• Experience with Databricks Workflows, Airflow, or similar orchestration tools.
• Professional services / consulting experience with strong client-facing and communication skills.
• Proven experience leading technical teams and mentoring engineers.
• Strong problem-solving and solution design skills.

Nice to have

• Experience with Terraform, Databricks Asset Bundles, or CI/CD.
• Experience with Structured Streaming / real-time data pipelines.
• Experience with ML/AI workloads on Databricks.
• Experience working across multiple cloud environments.
• Experience owning architecture and delivery for large-scale client engagements.

What We Offer

• Fully Remote work setup.
• Daily collaboration and guidance from the management team.
• Competitive compensation packages that reward high performance.
• Exciting career growth paths toward management and technical leadership.
• Collaborative team-based environment.
• Prominent client base and existing high-value relationships.
• Best-in-class team of consultants to work alongside you.