Data Senior Engineer

NTT DATA, Inc.; Pune District; On-site; INR 500,000 - 1,200,000; Full time

Job summary

NTT DATA, Inc. in Pune, India is seeking a Data Senior Engineer to provide L1 production support for data pipelines and ETL/ELT workloads. You will monitor pipelines, Airflow DAGs, and job runs, performing initial investigations and following runbooks to restart or rerun tasks.

You will validate data in BigQuery with SQL and escalate unresolved issues to higher engineering tiers. The role requires 2–3 years in Data Engineering or Production Support, knowledge of GCP, Airflow, BigQuery, Python

Qualifications

• 2–3 years of experience in Data Engineering, DataOps, or production support.
• Basic working knowledge of Google Cloud Platform (GCP).
• Familiarity with Google BigQuery and basic SQL querying.
• Understanding of Apache Airflow, DAGs, scheduling and job execution.
• Basic working knowledge of Python, with ability to understand scripts and interpret errors.
• Understanding of ETL/ELT and data pipeline concepts.
• Good analytical and problem-solving skills.
• Ability to follow documented operational procedures and elevate issues appropriately.
• Willingness to work in a production-support environment, including shift/on-call coverage as applicable.

Responsibilities

• Provide L1 production support for data pipelines, ETL/ELT jobs and scheduled data-processing workloads.
• Monitor production pipelines, jobs, alerts and operational dashboards.
• Monitor Apache Airflow DAGs and identify failed, delayed, stuck or missed tasks.
• Perform first-level investigation of pipeline and job failures using available logs and monitoring information.
• Execute documented operational procedures such as job restart, rerun and reprocessing.
• Monitor data loads into BigQuery and perform basic validation of successful processing.
• Use SQL queries to perform basic data validation, record-count and reconciliation checks.
• Perform initial analysis of Python/data-pipeline errors using logs and documented troubleshooting procedures.
• Create and update incidents/tickets with relevant error details, logs and troubleshooting information.
• Escalate unresolved or complex issues to L2/L3 engineering teams with appropriate diagnostic information.
• Follow defined runbooks, SOPs, SLAs and production-support procedures.
• Update operational documentation and knowledge articles based on resolved issues.

Skills

Data Engineering

DataOps

Production Support

GCP Knowledge

BigQuery

SQL

Python Basics

ETL/ELT

Analytical Thinking

On-call/Shift readiness

Tools

Apache Airflow

Google Cloud Platform (GCP)

Google BigQuery

Python

SQL

Job description

We are currently seeking a Data Senior Engineer to join our team in Pune, Mahārāshtra (IN-MH), India (IN).

Key Responsibilities

• Provide L1 production support for data pipelines, ETL/ELT jobs and scheduled data-processing workloads.
• Monitor production pipelines, jobs, alerts and operational dashboards.
• Monitor Apache Airflow DAGs and identify failed, delayed, stuck or missed tasks.
• Perform first-level investigation of pipeline and job failures using available logs and monitoring information.
• Execute documented operational procedures such as job restart, rerun and reprocessing.
• Monitor data loads into BigQuery and perform basic validation of successful processing.
• Use SQL queries to perform basic data validation, record-count and reconciliation checks.
• Perform initial analysis of Python/data-pipeline errors using logs and documented troubleshooting procedures.
• Create and update incidents/tickets with relevant error details, logs and troubleshooting information.
• Escalate unresolved or complex issues to L2/L3 engineering teams with appropriate diagnostic information.
• Follow defined runbooks, SOPs, SLAs and production-support procedures.
• Update operational documentation and knowledge articles based on resolved issues.

Required Skills

• 2–3 years of experience in Data Engineering, DataOps, application support or production support.
• Basic working knowledge of Google Cloud Platform (GCP).
• Familiarity with Google BigQuery and basic SQL querying.
• Understanding of Apache Airflow, DAGs, tasks, scheduling and job execution.
• Basic working knowledge of Python, with the ability to understand scripts and interpret common errors.
• Understanding of ETL/ELT and data pipeline concepts.
• Good analytical and problem-solving skills.
• Ability to follow documented operational procedures and elevate issues appropriately.
• Willingness to work in a production-support environment, including shift/on-call coverage as applicable.

About NTT DATA

NTT DATA is a $30 billion business and technology services leader, serving 75% of the Fortune Global 100. We are committed to accelerating client success and positively impacting society through responsible innovation. We are one of the world's leading AI and digital infrastructure providers, with unmatched capabilities in enterprise-scale AI, cloud, security, connectivity, data centers and application services. our consulting and Industry solutions help organizations and society move confidently and sustainably into the digital future. As a Global Top Employer, we have experts in more than 50 countries. We also offer clients access to a robust ecosystem of innovation centers as well as established and start-up partners.NTT DATA is a part of NTT Group, which invests over $3 billion each year in R&D.

NTT DATA endeavors to make https://us.nttdata.com accessible to any and all users. If you would like to contact us regarding the accessibility of your website or need assistance completing the application process, please contact us at https://us.nttdata.com/en/contact-us . This contact information is for accommodation requests only and cannot be used to inquire about the status of applications. NTT DATA is an equal opportunity employer. Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability or protected veteran status. For our EEO Policy Statement, please click here . If you'd like more information on your EEO rights under the law, please click here . For Pay Transparency information, please click here .

Job Segment: SQL, Database, Consulting, Technical Support, Technology