Data Engineer Senior Consultant

NTT DATA North America; Bengaluru Urban; On-site; INR 1,300,000 - 1,700,000; Full time

Job summary

NTT DATA North America in Bangalore is seeking a Senior Data Migration Engineer to design and implement Python-based EL pipelines, dbt transformations, and Airflow orchestration for a large-scale Informatica PowerCenter migration to a modern data stack.

The role requires hands-on development, testing, and delivery with experience in Python, SQL, dbt, and Airflow. You will collaborate with offshore teams and contribute to CI/CD pipelines and runbooks.

Qualifications

• 5+ years of Informatica PowerCenter experience – mappings, sessions, workflows, and parameterization.
• 3+ years of hands-on dbt Core experience – model layering, macros, tests, incremental materializations.
• 3+ years of Airflow experience – DAG authoring, task dependencies, and scheduling integration.
• 5+ years of Python experience, including production use of parallelism and batch data processing.
• 5+ years of SQL experience – complex joins, window functions, aggregations across large datasets.
• Experience with Oracle Data Pump (expdp/impdp) or SQL Server BCP / BULK INSERT for high-volume data movement.

Responsibilities

• Assess Informatica workflows and translate them into Python EL scripts and dbt transformation models.
• Develop and maintain Python EL pipelines to land high-volume data, including billion-row tables, into the target warehouse using SQLAlchemy, cx_Oracle, pyodbc, and bulk export tools.
• Design and develop dbt transformation models based on Informatica mapping logic, incorporating dbt best practices including model layering, macros, incremental strategies, and snapshot patterns.
• Develop dbt-native tests as well as custom Python unit tests to validate transformation correctness and data quality.
• Develop Airflow DAGs to orchestrate Python EL and dbt scripts end-to-end, producing output that is functionally equivalent to the source Informatica workflows.
• Contribute to GitLab CI/CD pipeline for dbt and Airflow code, including lint gates, automated testing, and deployment to shared NAS.
• Perform peer code reviews and provide constructive technical feedback to fellow engineers.
• Troubleshoot performance issues and data discrepancies during SIT and UAT, including row-count reconciliation between source Oracle/SQL Server systems and the target warehouse.
• Contribute to technical documentation, runbooks, and handover materials.

Skills

Informatica PowerCenter

dbt Core

Airflow

Python

SQL

Oracle Data Pump

SQL Server BCP

Tools

SQLAlchemy

cx_Oracle

pyodbc

Oracle Data Pump

SQL Server BCP

Job description

Job Title: SEI - Data Migration Engineer (IMS) (Expanded Resources)

Location: Bangalore, Karnataka, India (IN-KA)

The Senior Data Migration Engineer serves as a hands‑on technical contributor and delivery anchor, responsible for designing and implementing Python‑based extract/load pipelines, dbt‑based transformations, and Airflow‑based orchestration for a large‑scale migration from Informatica PowerCenter to a modern data stack.

Key Responsibilities

• Assess complex Informatica workflows including sessions, mappings, and parameterizations and translate them into equivalent Python EL scripts and dbt transformation models.
• Develop and maintain Python EL pipelines to land high‑volume data, including billion‑row tables, into the target warehouse using SQLAlchemy, cx_Oracle, pyodbc, and bulk export tools such as Oracle Data Pump and SQL Server BCP.
• Design and develop dbt transformation models based on Informatica mapping logic, incorporating dbt best practices including model layering, macros, incremental strategies, and snapshot patterns.
• Develop dbt‑native tests as well as custom Python unit tests to validate transformation correctness and data quality.
• Develop Airflow DAGs to orchestrate Python EL and dbt scripts end‑to‑end, producing output that is functionally equivalent to the source Informatica workflows.
• Contribute to GitLab CI/CD pipeline for dbt and Airflow code, including lint gates, automated testing, and deployment to shared NAS.
• Perform peer code reviews and provide constructive technical feedback to fellow engineers.
• Troubleshoot performance issues and data discrepancies during SIT and UAT, including row‑count reconciliation between source Oracle/SQL Server systems and the target warehouse.
• Contribute to technical documentation, runbooks, and handover materials.

Required Skills & Experience

• 5+ years of Informatica PowerCenter experience – mappings, sessions, workflows, and parameterization
• 3+ years of hands‑on dbt Core experience – model layering, macros, tests, incremental materializations
• 3+ years of Airflow experience – DAG authoring, task dependencies, and incorporation with scheduling tool
• 5+ years of Python experience, including production use of parallelism and batch data processing
• 5+ years of SQL experience – complex joins, window functions, aggregations across large datasets
• Experience with Oracle Data Pump (expdp/impdp) or SQL Server BCP / BULK INSERT for high‑volume data movement

Preferred

• Experience with SQLAlchemy, cx_Oracle, or pyodbc for Python‑based database connectivity
• Experience mentoring junior and mid‑level engineers in offshore delivery models

Equal Opportunity Employer

NTT DATA is an equal opportunity employer. Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability or protected veteran status. For our EEO Policy Statement, please click here. If you'd like more information on your EEO rights under the law, please click here. For Pay Transparency information, please click here.