Lead Data Platform Production Engineer (AWS/Databricks)

Tata Consultancy Services; Irvine (CA); On-site; USD 110,000 - 140,000; Full time

Job summary

Tata Consultancy Services in Irvine, CA seeks an experienced DFS Tower Lead to provide L3 production support for mission-critical data platforms and pipelines. You will monitor S3, Athena, CloudWatch, Databricks, and Dremio while leading incident management, RCA, and continuous service improvement.

The role focuses on running complex data workloads, performing RCA, upgrading runtimes, and partnering with Data Engineering to ensure platform stability and data quality across environments.

Qualifications

• Extensive experience in L3 production support for enterprise data platforms.
• Strong incident management and RCA capabilities.
• Expertise with AWS-based data pipelines and Databricks.

Responsibilities

• Provide L3 production support for enterprise data platforms.
• Monitor AWS S3, Athena, CloudWatch; Databricks and Dremio environments.
• Troubleshoot complex production incidents and meet SLAs.
• Perform RCA and implement permanent corrective actions.
• Optimize ETL/ELT workflows with Airflow.
• Maintain Databricks clusters and runtimes.
• Develop SQL and Python scripts for investigation.
• Monitor health and performance; ensure data reliability.

Skills

AWS

S3

Athena

CloudWatch

Airflow

Databricks

Dremio

Python

SQL

GitHub

metadata

profiling

schema

Data quality checks

regression testing

Runtime upgrades

RCA fixes

Job description

Tata Consultancy Services in Irvine, CA seeks an experienced DFS Tower Lead to provide L3 production support for mission-critical data platforms and pipelines. You will monitor S3, Athena, CloudWatch, Databricks, and Dremio while leading incident management, RCA, and continuous service improvement.

The role focuses on running complex data workloads, performing RCA, upgrading runtimes, and partnering with Data Engineering to ensure platform stability and data quality across environments.