Data Engineering Architect

ADP; Hyderabad; On-site; INR 4,000,000 - 7,000,000; Full time

Job summary

ADP is seeking a hands-on Data Engineering & Reporting Architect to design, build, and scale modern data platforms and BI solutions. You will bridge raw data to actionable insights, owning the full stack from ingestion to executive dashboards.

The role focuses on Databricks-based pipelines, lakehouse architectures, and Power BI reporting, with emphasis on governance, standards, and mentorship within a dynamic data team.

Qualifications

• 8-10+ years of data engineering and BI experience.
• Hands-on proficiency with Spark, Python and SQL.
• Experience building end-to-end data pipelines and data models.

Responsibilities

• Architect and implement end-to-end data pipelines using Databricks (Delta Lake, Delta Live Tables, Workflows).
• Design and optimize lakehouse architectures (Bronze/Silver/Gold).
• Build semantic models and enterprise reporting in Power BI (Dataflows, Datasets, Report Server).
• Define and enforce data modeling standards — Star Schema, Snowflake, Data Vault.
• Collaborate with stakeholders to translate requirements into scalable BI solutions.
• Lead performance tuning of SQL queries, Spark jobs, and Power BI reports/datasets.
• Establish data governance, lineage, and cataloging (Unity Catalog, Purview).
• Mentor junior engineers and promote best practices across the data team.
• Evaluate and recommend tooling across the modern data stack.

Skills

Apache Spark

Python/SQL

Tools

Databricks

Power BI

Delta Lake

Delta Live Tables

Unity Catalog

Purview

Terraform

Job description

Experience Level: 8-10+ years

About the Role

We are looking for a hands-on Data Engineering & Reporting Architect who can design, build, and scale modern data platforms while delivering impactful business intelligence solutions. You will bridge the gap between raw data and actionable insights, owning the full stack from data ingestion to executive dashboards.

Key Responsibilities

• Architect and implement end-to-end data pipelines using Databricks (Delta Lake, Delta Live Tables, Workflows)
• Design and optimize lakehouse architectures (Bronze/Silver/Gold layers)
• Build and maintain semantic models and enterprise reporting solutions in Power BI (Dataflows, Datasets, Report Server)
• Define and enforce data modeling standards — Star Schema, Snowflake Schema, Data Vault
• Collaborate with business stakeholders to translate requirements into scalable BI solutions
• Lead performance tuning of SQL queries, Spark jobs, and Power BI reports/datasets
• Establish data governance, lineage, and cataloging practices (Unity Catalog, Purview)
• Mentor junior engineers and establish best practices across the data team
• Evaluate and recommend tooling across the modern data stack

Required Skills & Experience

• Apache Spark — performance tuning, partitioning, caching strategies
• Python / SQL — strong hands-on proficiency

Reporting & BI

• Power BI — DAX, Power Query (M), composite models, row-level security (RLS)
• Power BI Premium / Fabric capacity management
• Semantic layer design and dataset certification
• Experience with Tabular models or Analysis Services (SSAS) is a plus
• Dimensional modeling
• Data Vault 2.0
• Medallion architecture (lakehouse patterns)
• Schema design for analytical workloads
• Git-based version control (CI/CD for notebooks, Power BI via Deployment Pipelines or Azure DevOps)
• Infrastructure as Code — Terraform or Bicep (nice to have)
• Agile/Scrum delivery experience

Nice to Have

• Exposure to Tableau, Looker, or other BI tools
• Experience with streaming data — Kafka, Event Hubs, Spark Structured Streaming
• Data quality frameworks — Great Expectations, Soda

Soft Skills

• Strong communication — ability to present data architecture decisions to non-technical stakeholders
• Problem-solving mindset with a bias for pragmatic, scalable solutions
• Ownership mentality — comfortable leading initiatives end-to-end
• Collaborative team player who can also work independently