Senior Data Migration Engineer: Python, dbt & Airflow

JobDiva, Inc.; Town of Texas (WI); Remote; USD 243,560,000 - 272,214,000; Full time

Job summary

NTT DATA seeks a Data Migration Engineer for a large-scale Informatica to Python/dbt/Airflow migration project. The role focuses on building end-to-end pipelines, transforming Informatica workflows into Python EL scripts, dbt models, and Airflow orchestrations in a production environment.

You will contribute to CI/CD pipelines, perform data quality testing, and troubleshoot performance during SIT/UAT, with remote work options in the US.

Qualifications

• 5+ years of Informatica PowerCenter experience - mappings, sessions, workflows, and parameterization
• 3+ years of hands-on dbt Core experience - model layering, macros, tests, incremental materializations
• 5+ years of Python experience, including production use of parallelism and batch data processing
• 5+ years of SQL experience - complex joins, window functions, aggregations across large datasets
• Experience with Oracle Data Pump (expdp/impdp) or SQL Server BCP / BULK INSERT for high-volume data movement

Responsibilities

• Assess complex Informatica workflows including sessions, mappings, and parameterizations and translate them into equivalent Python EL scripts and dbt transformation models
• Develop and maintain Python EL pipelines to land high-volume data into the target warehouse
• Design and develop dbt transformation models based on Informatica mapping logic with best practices
• Develop dbt-native tests and Python unit tests to validate data quality
• Develop Airflow DAGs to orchestrate Python EL and dbt scripts end-to-end
• Contribute to GitLab CI/CD pipeline for dbt and Airflow code and deployments
• Troubleshoot performance issues and data discrepancies during SIT/UAT and reconciliation

Skills

Informatica PowerCenter

dbt Core

Airflow

Python

SQL

Oracle Data Pump / Bulk INSERT

Tools

SQLAlchemy

cx_Oracle

pyodbc

Job description

NTT DATA seeks a Data Migration Engineer for a large-scale Informatica to Python/dbt/Airflow migration project. The role focuses on building end-to-end pipelines, transforming Informatica workflows into Python EL scripts, dbt models, and Airflow orchestrations in a production environment.

You will contribute to CI/CD pipelines, perform data quality testing, and troubleshoot performance during SIT/UAT, with remote work options in the US.