Data & Analytics Principal Consultant

NTT DATA BUSINESS SOLUTIONS; Chennai District; On-site; INR 2,500,000 - 3,800,000; Full time

Job summary

NTT DATA BUSINESS SOLUTIONS in Chennai (India) is seeking a data engineering professional to translate complex Informatica workflows into Python EL scripts and dbt transformation models. You will land high-volume data into the warehouse using SQLAlchemy, cx_Oracle, pyodbc, and bulk export tools; design dbt models with best practices; create tests; and orchestrate end-to-end pipelines with Airflow.

You will contribute to GitLab CI/CD and perform peer code reviews while troubleshooting SIT/UAT and

Qualifications

• Experience translating Informatica workflows to Python EL scripts.
• Hands-on dbt modeling, testing, and best practices.
• Proven ability to build end-to-end data pipelines and maintain data quality.

Responsibilities

• Assess complex Informatica workflows and translate to Python EL scripts.
• Develop and maintain Python EL pipelines to land large data volumes into the warehouse.
• Design dbt models based on Informatica mappings with best practices.
• Develop dbt tests and custom Python unit tests for data quality.
• Create Airflow DAGs to orchestrate Python EL and dbt end-to-end.
• Contribute to GitLab CI/CD for dbt and Airflow, including lint gates and tests.
• Perform peer code reviews and provide constructive feedback.
• Troubleshoot SIT/UAT data discrepancies and reconcile row counts.
• Contribute to technical documentation and runbooks.

Skills

Informatica translation

Python EL

Data engineering

Code reviews

Education

Bachelor’s degree in a technical field

Tools

SQLAlchemy

cx_Oracle

pyodbc

dbt

Airflow

Job description

Responsibilities

• Assess complex Informatica workflows including sessions, mappings, and parameterizations and translate them into equivalent Python EL scripts and dbt transformation models.
• Develop and maintain Python EL pipelines to land high-volume data, including billion-row tables, into the target warehouse using SQLAlchemy, cx_Oracle, pyodbc, and bulk export tools such as Oracle Data Pump and SQL Server BCP.
• Design and develop dbt transformation models based on Informatica mapping logic, incorporating dbt best practices including model layering, macros, incremental strategies, and snapshot patterns.
• Develop dbt-native tests as well as custom Python unit tests to validate transformation correctness and data quality.
• Develop Airflow DAGs to orchestrate Python EL and dbt scripts end-to-end, producing output that is functionally equivalent to the source Informatica workflows.
• Contribute to GitLab CI/CD pipeline for dbt and Airflow code, including lint gates, automated testing, and deployment to shared NAS.
• Perform peer code reviews and provide constructive technical feedback to fellow engineers.
• Troubleshoot performance issues and data discrepancies during SIT and UAT, including row-count reconciliation between source Oracle/SQL Server systems and the target warehouse.
• Contribute to technical documentation, runbooks, and handover materials.