L3 Support Engineer (Databricks, Airflow, DAG, DBT)

Tata Consultancy Services Limited; Región Centro; Presencial; MXN 420.000 - 660.000; Jornada completa

Descripción de la vacante

Tata Consultancy Services Limited in Guadalajara seeks an experienced L3 Support Engineer to provide production support and operational excellence for enterprise data platforms built on Databricks, Apache Airflow, DAG-based orchestration and DBT.

You will own incident management, monitor pipelines, optimize performance, perform RCA on outages, and collaborate with engineering, business and operations teams to ensure high availability and reliable data workloads.

Location: Guadalajara, Mexico.

Formación

• Hands-on experience with Databricks, Airflow, and DBT in large-scale data environments.
• Experience troubleshooting production incidents and participating in on-call rotations.
• Strong SQL and Python skills with data warehouse concepts.
• Knowledge of cloud platforms (AWS, GCP) and CI/CD processes.

Responsabilidades

• Provide L3 production support for Data Engineering and Analytics platforms.
• Monitor and support data pipelines, ETL/ELT workflows, and reporting systems.
• Analyze and resolve production incidents within SLA timelines.
• Coordinate deployment activities in Databricks environments.
• Monitor Airflow and DBT workflows; manage DAGs and job scheduling.
• Incident & Problem Management: RCA, post-incident reports, preventive actions.

Conocimientos

Databricks

Apache Airflow

DAG-based workflow orchestration

DBT

PySpark/Spark SQL

Python

SQL

Data Warehouse concepts

AWS

GCP

CI/CD tools

Monitoring/logging tools

SLA Management

Herramientas

Databricks

Apache Airflow

DBT

Descripción del empleo

Guadalajara | 5 - 10 years of experience | 30-Sep-2026

Job Description

We are seeking an experienced L3 Support Engineer to provide production support and operational excellence for enterprise data platforms built on Databricks, Apache Airflow, DAG-based orchestration, and DBT (Data Build Tool). The role involves incident management, problem resolution, monitoring, performance tuning, root cause analysis, and continuous improvement of data pipelines and analytics platforms.

The ideal candidate should have strong troubleshooting expertise, experience supporting large-scale data environments, and the ability to collaborate with engineering, business, and operations teams to ensure high availability and reliability of critical data workloads.

Key Responsibilities

Production & BAU Support

• ProvideL3 production support for Data Engineering and Analytics platforms.
• Monitor and support critical data pipelines, ETL/ELT workflows, and reporting systems.
• Analyze and resolve production incidents within SLA timelines.
• Perform impact assessment and prioritization of incidents.
• Conduct troubleshooting of failed jobs, workflows, and data quality issues.
• Participate in on-call support rotations and major incident management.

Databricks Support

• Support Databricks jobs, notebooks, workflows, and clusters.
• Troubleshoot cluster performance, job failures, and resource utilization issues.
• Optimize Spark SQL, PySpark, and Databricks workloads.
• Monitor cluster health, execution performance, and cost optimization.
• Coordinate deployment and release activities in Databricks environments.

Airflow & DAG Support

• Monitor Apache Airflow environments and scheduler performance.
• Troubleshoot DAG failures, task retries, dependency issues, and scheduling conflicts.
• Analyze execution logs and identify bottlenecks.
• Ensure workflow reliability and performance optimization.
• Manage Airflow operational configurations and upgrades.

DBT Support

• Support DBT models, transformations, and deployments.
• Troubleshoot DBT execution failures and dependency issues.
• Validate data transformation logic and data quality checks.
• Monitor DBT jobs and lineage dependencies.
• Support CI/CD deployment of DBT projects.

Incident & Problem Management

• Perform Root Cause Analysis (RCA) for recurring issues.
• Create post-incident reports and preventive action plans.
• Manage service requests, change requests, and problem tickets.
• Collaborate with development teams for permanent fixes.
• Maintain knowledge base articles and operational runbooks.

Monitoring & Automation

• Implement monitoring dashboards and alerts.
• Identify opportunities for support automation and self-healing solutions.
• Develop scripts for operational efficiency.
• Improve observability and operational metrics.

Required Skills

Technical Skills

• Strong hands-on experience with:
• Databricks
• Apache Airflow
• DAG-based workflow orchestration
• DBT (Data Build Tool)
• Experience with:
• PySpark/ Spark SQL
• Python
• SQL
• Data Warehouse concepts
• Knowledge of cloud platforms:
• AWS
• GCP
• Experience with CI/CD tools and deployment processes.
• Understanding of monitoring and logging tools.

Support Skills

• Problem Management
• Change Management
• SLA Management
• RCA Documentation
• Production Monitoring