Senior Consultant - Data Engineering Architect

Ernst & Young LLP ( EY India ); Ahmedabad District; On-site; INR 2,500,000 - 4,200,000; Full time

Job summary

EY India is seeking a Senior Consultant - Tech Consulting to join the National CNS - TC - Digital Engineering practice. The role focuses on designing and delivering scalable data platforms on Azure and Databricks, guiding medallion/lakehouse architectures from ingestion to consumption.

You will mentor data engineers, set governance standards, and collaborate with Cyber, Cloud, and IAM teams to ensure secure, compliant solutions across client engagements.

Qualifications

• Deep expertise in Azure Databricks, Delta Lake, Unity Catalog, Spark (PySpark/SQL).
• Strong on Azure services: ADLS Gen2, ADF, Synapse, Key Vault, Entra ID, Event Hubs, Functions.
• Proven experience designing medallion / lakehouse architectures at enterprise scale.
• Solid grounding in data modeling (dimensional, Data Vault, or 3NF) and SQL performance tuning.
• CI/CD, IaC (Terraform/Bicep), Git-based workflows, and DevOps practices.
• Data governance, lineage, security, and privacy controls in regulated environments.

Responsibilities

• Design Lakehouse architectures on Azure Databricks using Delta Lake and Unity Catalog.
• Define medallion (Bronze/Silver/Gold) patterns, data models, and enterprise data products.
• Architect ingestion frameworks (batch, streaming, CDC) using Auto Loader, ADF, Event Hubs, Kafka.
• Establish governance, security, and RBAC via Unity Catalog, Key Vault, and service principals.
• Optimize performance and cost (cluster sizing, Photon, Liquid Clustering, Z-Order, caching).
• Lead CI/CD with Databricks Asset Bundles, Git, and Azure DevOps / GitHub Actions.
• Guide teams on DLT, MLflow, Delta Sharing, and Lakehouse Monitoring.
• Partner with Cyber, Cloud, and IAM teams on approvals, allow-listing, and compliance.
• Mentor data engineers and review designs, code, and production readiness.

Tools

Azure Databricks

Delta Lake

Unity Catalog

Spark (PySpark/SQL)

ADLS Gen2

ADF

Synapse

Key Vault

Event Hubs

Terraform

GitHub Actions

Job description

Senior Consultant - Tech Consulting - National - CNS - TC - Digital Engineering - New Delhi Requisition Id: 1747815 As a global leader in assurance, tax, transaction and advisory services, we hire and develop the most passionate people in their field to help build a better working world. This starts with a culture that believes in giving you the training, opportunities and creative freedom. At EY, we don't just focus on who you are now, but who you can become. We believe that it’s your career and ‘It’s yours to build’ which means potential here is limitless and we'll provide you with motivating and fulfilling experiences throughout your career to help you on the path to becoming your best professional self.

The opportunity : Senior Consultant-National-Tech Consulting-CNS - TC - Digital Engineering - New Delhi National : National comprises of sector agnostic teams working across industries for a well rounded experience. CNS - TC - Digital Engineering : EY Consulting is building a better working world by transforming businesses through the power of people, technology and innovation. Our client-centric approach focuses on driving long-term value for our clients by solving their most strategic problems. EY Consulting is made up of three sub-service lines: Business Consulting (including Performance Improvement and Risk Consulting), Technology Consulting and People Advisory Services. In Tech Consulting, we are transforming businesses through the power of people, technology and innovation. It places humans@center, leverages technology@speed and enables innovation@scale.

Your key responsibilities Technical Excellence We are seeking a Data Engineering Architect to design and lead the delivery of scalable, secure, and governed data platforms on Azure and Databricks. The role owns end-to-end architecture — from source ingestion through the medallion layers to consumption — and drives engineering standards across projects.

• Design Lakehouse architectures on Azure Databricks using Delta Lake and Unity Catalog.
• Define medallion (Bronze/Silver/Gold) patterns, data models, and enterprise data products.
• Architect ingestion frameworks (batch, streaming, CDC) using Auto Loader, ADF, Event Hubs, Kafka.
• Establish governance, security, and RBAC via Unity Catalog, Key Vault, and service principals.
• Optimize performance and cost (cluster sizing, Photon, Liquid Clustering, Z-Order, caching).
• Lead CI/CD with Databricks Asset Bundles, Git, and Azure DevOps / GitHub Actions.
• Guide teams on DLT, MLflow, Delta Sharing, and Lakehouse Monitoring.
• Partner with Cyber, Cloud, and IAM teams on approvals, allow-listing, and compliance.
• Mentor data engineers and review designs, code, and production readiness.

Must-Have Skills

• Deep expertise in Azure Databricks, Delta Lake, Unity Catalog, Spark (PySpark/SQL).
• Strong on Azure services: ADLS Gen2, ADF, Synapse, Key Vault, Entra ID, Event Hubs, Functions.
• Proven experience designing medallion / lakehouse architectures at enterprise scale.
• Solid grounding in data modeling (dimensional, Data Vault, or 3NF) and SQL performance tuning.
• CI/CD, IaC (Terraform/Bicep), Git-based workflows, and DevOps practices.
• Data governance, lineage, security, and privacy controls in regulated environments.

What we look for

People with the ability to work in a collaborative manner to provide services across multiple client departments while following the commercial and legal requirements. You will need a practical approach to solving issues and complex problems with the ability to deliver insightful and practical solutions. We look for people who are agile, curious, mindful, and able to sustain positive energy, while being adaptable and creative in their approach.

What we offer

Fuelled by the brilliance of our people, EY has emerged as the strongest brand and the most attractive employer in our field, with market-leading growth over competitors. Our people work side-by-side with market-leading entrepreneurs, game-changers, disruptors, and visionaries. As an organization, we are investing more time, technology, and money than ever before in skills and learning for our people. At EY, you will have a personalized Career Journey and also the chance to tap into the resources of our career frameworks to better know about your roles, skills, and opportunities. EY is equally committed to being an inclusive employer, and we strive to achieve the right balance for our people—enabling us to deliver excellent client service while allowing our people to build their careers as well as focus on their wellbeing.