Data Platform Lead – BAU/L3 Support (Databricks/Spark)

Tata Consultancy Services

Irvine (CA)

On-site

USD 140,000 - 200,000

Full time

3 days ago

Be an early applicant

Application generator

An application made for this job — a tailored resume and cover letter that speak straight to the posting.

Get past ATS filters

Job summary

Tata Consultancy Services in Irvine seeks an experienced Data Engineer Lead to drive enterprise-scale data initiatives, oversee multiple pods, and ensure end-to-end delivery with strong platform stability. You will partner with business and technology leadership to align data delivery with investment and portfolio objectives.

The role emphasizes data governance, performance optimization, and production support readiness across on-site teams and stakeholders.

Qualifications

Strong experience with Databricks, Apache Spark, and performance tuning.
Expertise in Apache Airflow/Astronomer for workflow orchestration and DAG design.
Deep understanding of Data Engineering, ETL/ELT, and large-scale data platforms.
Experience with CI/CD, DevOps, Infrastructure as Code (IaC), and automation.
Strong platform management, monitoring, and incident management experience.
Excellent leadership and stakeholder management skills.

Responsibilities

Lead and manage the Data Engineering Tower, overseeing multiple teams and delivery pods.
Own end-to-end data platform delivery, operational excellence, and SLA adherence.
Drive scalable data pipeline development, data quality, and platform reliability.
Manage cross-functional dependencies, stakeholder communication, and issue escalations.
Ensure high availability, monitoring, alerting, and production support readiness.
Collaborate with business, portfolio management, and technology leadership teams.