Data Engineering Lead - Governance & Platform Reliability

Tata Consultancy Services; Irvine (CA); On-site; USD 110,000 - 150,000; Full time

Job summary

Tata Consultancy Services in Irvine, CA seeks an experienced Data Engineering Tower/Pod Lead with asset management focus to drive enterprise-scale data initiatives across global teams. Responsible for end-to-end data delivery, platform stability, and coordinating multiple pods to align with investment management objectives.

The role emphasizes governance, operational readiness, and performance optimization across data platforms, pipelines, and collaborations with business and technology

Qualifications

• Experience with large-scale data platforms and ETL/ELT pipelines.
• Strong leadership and stakeholder management skills.
• Experience with Databricks and Apache Spark.
• Proficiency in Airflow for workflow orchestration.
• Experience with CI/CD, IaC, and automation.
• Ability to manage platform reliability and incident response.

Responsibilities

• Lead and manage the Data Engineering Tower, overseeing multiple teams and delivery pods.
• Own end-to-end data platform delivery, operational excellence, and SLA adherence.
• Drive scalable data pipeline development, data quality, and platform reliability.
• Manage cross-functional dependencies, stakeholder communication, and issue escalations.
• Ensure high availability, monitoring, alerting, and production support readiness.
• Collaborate with business, portfolio management, and technology leadership teams.

Skills

Databricks

Apache Spark

Performance tuning

Airflow

DAG design

ETL/ELT

CI/CD

IaC

Automation

Platform monitoring

Incident management

Leadership

Stakeholder management

Job description

Tata Consultancy Services in Irvine, CA seeks an experienced Data Engineering Tower/Pod Lead with asset management focus to drive enterprise-scale data initiatives across global teams. Responsible for end-to-end data delivery, platform stability, and coordinating multiple pods to align with investment management objectives.

The role emphasizes governance, operational readiness, and performance optimization across data platforms, pipelines, and collaborations with business and technology