Lead Data Engineer - Databricks Lakehouse & dbt Expert

Tata Consultancy Services; Irvine (CA); On-site; USD 120,000 - 200,000; Full time

Job summary

Tata Consultancy Services is seeking a Lead Data Engineer in Irvine to drive data platform migration and modernization using Databricks Lakehouse, dbt, and Python. You will lead a team, shape technical roadmaps, and deliver scalable data pipelines.

The role demands hands-on execution, architecture design, and mentorship to accelerate enterprise data modernization initiatives. Strong communication with analytics teams is essential.

Qualifications

• 8-15 years of data engineering experience in modern data platforms.
• Hands-on experience with Databricks, dbt, and Python required.
• Experience migrating legacy data warehouses and ETL platforms to cloud-native Lakehouse.
• Strong knowledge of ELT/ETL design and data quality frameworks.

Responsibilities

• Design, build, and maintain scalable data pipelines using Databricks, PySpark, SQL, and Python.
• Lead migration of legacy platforms to Databricks Lakehouse and drive modernization efforts.
• Develop and optimize dbt models, tests, and documentation; enable CI/CD for data pipelines.
• Mentor engineers, review code, and enforce engineering standards.
• Collaborate with stakeholders to deliver enterprise-scale data modernization programs.

Skills

Databricks

dbt

Airflow

Python

SQL

Tools

Databricks Lakehouse Platform

Delta Lake

Unity Catalog

Databricks Workflows

Structured Streaming

Job description

Tata Consultancy Services is seeking a Lead Data Engineer in Irvine to drive data platform migration and modernization using Databricks Lakehouse, dbt, and Python. You will lead a team, shape technical roadmaps, and deliver scalable data pipelines.

The role demands hands-on execution, architecture design, and mentorship to accelerate enterprise data modernization initiatives. Strong communication with analytics teams is essential.