ETL Migration Engineer - Python EL & dbt Lead

NTT America, Inc.; Indiana; Hybrid; USD 120,000 - 160,000; Full time

Job summary

NTT America, Inc. is seeking a data engineering specialist to translate complex Informatica workflows into Python EL scripts and dbt models. You will land high-volume data into our warehouse using SQLAlchemy, cx_Oracle, pyodbc, and bulk export tools.

You will design dbt transformation models, implement dbt tests and Python unit tests, and build Airflow DAGs to orchestrate end-to-end pipelines. Collaboration on GitLab CI/CD, performance troubleshooting, and thorough documentation are key parts of

Qualifications

• Experience translating Informatica workflows into Python EL scripts and dbt models.
• Strong Python development for data pipelines handling large-scale data.
• Familiarity with Airflow, SQLAlchemy, cx_Oracle, pyodbc, and dbt best practices.

Responsibilities

• Assess complex Informatica workflows and translate them into Python EL scripts and dbt models.
• Develop and maintain Python EL pipelines to land high-volume data into the target warehouse using SQLAlchemy, cx_Oracle, pyodbc, and bulk export tools.
• Design and develop dbt transformation models with best practices including layering, macros, incremental strategies, and snapshots.
• Develop dbt-native tests as well as custom Python unit tests to validate transformation correctness and data quality.
• Develop Airflow DAGs to orchestrate Python EL and dbt scripts end-to-end, matching source workflow outputs.
• Contribute to GitLab CI/CD pipeline for dbt and Airflow with lint gates, tests, and deployment to shared NAS.
• Perform peer code reviews and provide constructive technical feedback to engineers.
• Troubleshoot performance issues and data discrepancies during SIT/UAT, reconciling row counts between source systems and warehouse.
• Contribute to technical documentation, runbooks, and handover materials.

Skills

Python

DS/ETL concepts

Data modeling

Tools

dbt

Airflow

SQLAlchemy

cx_Oracle

pyodbc

Oracle Data Pump

SQL Server

GitLab CI/CD

Job description

NTT America, Inc. is seeking a data engineering specialist to translate complex Informatica workflows into Python EL scripts and dbt models. You will land high-volume data into our warehouse using SQLAlchemy, cx_Oracle, pyodbc, and bulk export tools.

You will design dbt transformation models, implement dbt tests and Python unit tests, and build Airflow DAGs to orchestrate end-to-end pipelines. Collaboration on GitLab CI/CD, performance troubleshooting, and thorough documentation are key parts of