Senior Data Engineer

Varite Inc.; Bengaluru; Presencial; INR 2.500.000 - 4.000.000; Jornada completa

Descripción de la vacante

VARITE INDIA PRIVATE LIMITED is seeking a Data Migration Engineer in Bangalore to translate Informatica mappings into Python EL scripts and dbt models. The role focuses on landing high-volume data into the data warehouse with SQLAlchemy, cx_Oracle, and bulk export tools, and building robust Airflow DAGs to orchestrate the pipelines end-to-end.

You will design dbt transformations, implement tests, and ensure data quality with Python-based unit tests, while leveraging Oracle Data Pump or SQL

Formación

• 5+ years of Informatica PowerCenter experience, including mappings, sessions, workflows, and parameterization.
• 3+ years of hands-on dbt Core experience, including model layering, macros, tests, and incremental materializations.
• Experience with Airflow, including DAG authoring, task dependencies, and integration with scheduling tools.
• 5+ years of Python experience, including production use of parallelism and batch data processing.
• 5+ years of SQL experience, including complex joins, window functions, and aggregations across large datasets.
• Experience with Oracle Data Pump (expdp/impdp) or SQL Server BCP/BULK INSERT for high-volume data movement.

Responsabilidades

• Assess complex Informatica workflows including sessions, mappings, and parameterizations and translate them into equivalent Python EL scripts and dbt transformation models.
• Develop and maintain Python EL pipelines to land high-volume data, including billion-row tables, into the target warehouse using SQLAlchemy, cx_Oracle, pyodbc, and bulk export tools such as Oracle Data Pump and SQL Server BCP.
• Design and develop dbt transformation models based on Informatica mapping logic, incorporating dbt best practices including model layering, macros, incremental strategies, and snapshot patterns.
• Develop dbt-native tests as well as custom Python unit tests to validate transformation correctness and data quality.
• Develop Airflow DAGs to orchestrate Python EL and dbt scripts end-to-end, producing output that is functionally equivalent to the source Informatica workflows.

Herramientas

Informatica PowerCenter

Python

dbt Core

Airflow

SQL

Oracle Data Pump

SQL Server BCP

SQLAlchemy

cx_Oracle

pyodbc

Descripción del empleo

Job Title : Data Migration Engineer

Experience Required : 8 to 14 Year(s) - Immediate joiners only

Location - Bangalore

Openings: 5

Company Name: VARITE INDIA PRIVATE LIMITED

About The Client:

A global IT services and consulting company, multinational information technology (IT), headquartered in Tokyo, Japan. The Client offers a wide array of IT services, including application development, infrastructure management, and business process outsourcing. Their consulting services span business and technology, while their digital solutions focus on transformation and user experience design. It excels in data and intelligence services, emphasizing analytics, AI, and machine learning. Additionally, their cybersecurity, cloud, and application services round out a comprehensive portfolio designed to meet the diverse needs of businesses worldwide.

About The Job:

Data Migration Engineer

Essential Job Functions:

• Assess complex Informatica workflows including sessions, mappings, and parameterizations and translate them into equivalent Python EL scripts and dbt transformation models.
• Develop and maintain Python EL pipelines to land high-volume data, including billion-row tables, into the target warehouse using SQLAlchemy, cx_Oracle, pyodbc, and bulk export tools such as Oracle Data Pump and SQL Server BCP.
• Design and develop dbt transformation models based on Informatica mapping logic, incorporating dbt best practices including model layering, macros, incremental strategies, and snapshot patterns.
• Develop dbt-native tests as well as custom Python unit tests to validate transformation correctness and data quality.
• Develop Airflow DAGs to orchestrate Python EL and dbt scripts end-to-end, producing output that is functionally equivalent to the source Informatica workflows.

Qualifications:

• 5+ years of Informatica PowerCenter experience, including mappings, sessions, workflows, and parameterization.
• 3+ years of hands‑on dbt Core experience, including model layering, macros, tests, and incremental materializations.
• Experience with Airflow, including DAG authoring, task dependencies, and integration with scheduling tools.
• 5+ years of Python experience, including production use of parallelism and batch data processing.
• 5+ years of SQL experience, including complex joins, window functions, and aggregations across large datasets.
• Experience with Oracle Data Pump (expdp/impdp) or SQL Server BCP/BULK INSERT for high-volume data movement.

VARITE is an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees. We do not discriminate on the basis of race, color, religion, sex, sexual orientation, gender identity or expression, national origin, age, marital status, veteran status, or disability status.

Unlock Rewards: Refer Candidates and Earn.

If you're not available or interested in this opportunity, please pass this along to anyone in your network who might be a good fit and interested in our open positions. VARITE offers a Candidate Referral program, where you'll receive a one‑time referral bonus based on the following scale if the referred candidate completes a three-month assignment with VARITE.

• 0 - 2 Yrs. - INR 5,000
• 2 - 6 Yrs. - INR 7,500
• 6 + Yrs. - INR 10,000

About VARITE:

VARITE is a global staffing and IT consulting company providing technical consulting and team augmentation services to Fortune 500 Companies in USA, UK, CANADA and INDIA. VARITE is currently a primary and direct vendor to the leading corporations in the verticals of Networking, Cloud Infrastructure, Hardware and Software, Digital Marketing and Media Solutions, Clinical Diagnostics, Utilities, Gaming and Entertainment, and Financial Services.