Senior Data Engineer, Databricks Lakehouse & Pipelines

Tata Consultancy Services; Irvine (CA); On-site; USD 120,000 - 170,000; Full time

Job summary

Tata Consultancy Services in Irvine is seeking a hands-on Senior Data Engineer to design and operate enterprise-scale data solutions on the Databricks Lakehouse Platform. You will build batch and streaming pipelines, modernize ETL workloads, and deliver trusted data products for analytics and regulatory use cases.

The role emphasizes Databricks, Spark, PySpark, SQL, Python, dbt, Airflow, Delta Lake, Unity Catalog, and cloud data services across AWS/Azure/GCP.

Qualifications

• Experience delivering enterprise-scale data pipelines on Databricks Lakehouse platforms.
• Strong SQL, Python, and Spark (PySpark) proficiency required.
• Experience with ETL modernization, data governance, and data quality.

Responsibilities

• Design and operate batch and streaming data pipelines on the Lakehouse platform.
• Deliver trusted data products for analytics and regulatory use cases.
• Collaborate with data engineering teams to maintain data quality and lineage.

Skills

Databricks

Spark

PySpark

SQL

Python

dbt

Airflow

Delta Lake

Unity Catalog

Cloud data services

Job description

Tata Consultancy Services in Irvine is seeking a hands-on Senior Data Engineer to design and operate enterprise-scale data solutions on the Databricks Lakehouse Platform. You will build batch and streaming pipelines, modernize ETL workloads, and deliver trusted data products for analytics and regulatory use cases.

The role emphasizes Databricks, Spark, PySpark, SQL, Python, dbt, Airflow, Delta Lake, Unity Catalog, and cloud data services across AWS/Azure/GCP.