Sr. Data / Data Solutions Architect - Databricks

Epam Systems; Hyderabad, Chennai District, Bengaluru; On-site; INR 3,500,000 - 7,000,000; Full time

Job summary

Epam Systems is seeking a Senior Data Solutions Architect - Databricks to shape scalable data platforms for analytics and AI initiatives in the cloud.

You will translate business needs into lakehouse and warehouse designs, lead architecture reviews, and guide cross‑functional delivery while ensuring governance and cost controls.

The role requires deep expertise in Databricks, Spark, Delta Lake, and cloud platforms, with strong communication and leadership.

Qualifications

• 12–22 years IT leadership experience spanning data architecture, solution architecture, or data engineering.
• Proven ability to design production‑ready, scalable data architectures for enterprise use cases.
• Hands‑on experience with Azure, AWS, or GCP cloud services and data platforms.
• Deep knowledge of Databricks, Apache Spark, and Delta Lake in real‑world implementations.
• Strong proficiency in SQL and modern data platforms.
• Solid understanding of batch and streaming patterns, ETL/ELT, data modeling, and data governance.
• Excellent communication skills with strong stakeholder management and structured problem‑solving.

Responsibilities

• Translate business requirements into end‑to‑end data solution architectures.
• Design solutions using Data Warehouse, Data Lake, Lakehouse, Lambda, and Kappa architecture patterns.
• Lead architecture design, technical feasibility assessments, and solution reviews.
• Design and support cloud data platforms and data modernization initiatives.
• Drive migration and transformation projects involving Azure Databricks and Databricks Lakehouse.
• Guide data engineering, analytics, cloud, and DevOps teams.
• Ensure solutions meet scalability, performance, security, governance, and cost requirements.

Skills

Databricks

Apache Spark

Delta Lake

SQL

Data governance

Data modeling

ETL/ELT

Batch patterns

Streaming patterns

Cloud platforms

Tools

Azure

AWS

GCP

Azure Data Factory

Informatica MDM

Celonis

Job description

We are seeking a Senior Data Solutions Architect - Databricks to shape scalable, secure data platforms for enterprise analytics and AI programs. You will translate business needs into modern lakehouse and warehouse designs in the cloud, lead architecture reviews, and guide cross‑functional delivery while ensuring governance and cost controls.

Responsibilities

• Translate business requirements into end‑to‑end data solution architectures
• Design solutions using Data Warehouse, Data Lake, Lakehouse, Lambda, and Kappa architecture patterns
• Lead architecture design, technical feasibility assessments, and solution reviews
• Design and support cloud data platforms and data modernization initiatives
• Drive migration and transformation projects involving Azure Databricks and Databricks Lakehouse
• Guide data engineering, analytics, cloud, and DevOps teams
• Ensure solutions meet scalability, performance, security, governance, and cost requirements

Requirements

• Extensive IT leadership experience (12-22 years) spanning data architecture, solution architecture, or data engineering
• Proven ability to design production‑ready, scalable data architectures for enterprise use cases
• Hands‑on experience with Azure, AWS, or GCP cloud services and data platforms
• Deep knowledge of Databricks, Apache Spark, and Delta Lake in real‑world implementations
• Strong proficiency in SQL and modern data platforms
• Solid understanding of batch and streaming patterns, ETL/ELT, data modeling, and data governance
• Excellent communication skills with strong stakeholder management and structured problem‑solving

Nice to have

• Ability to work with Python, Java, or Scala
• Familiarity with Informatica MDM, Celonis, or Azure Data Factory
• Background supporting cloud migration or data and AI platforms