Hybrid Data Engineer for Ab Initio to GCP Migration

Motion Recruitment; Charlotte (NC); On-site; USD 110,000 - 150,000; Full time

Job summary

Motion Recruitment represents a leading global banking client hiring an on-site Data Engineer in Charlotte, NC. You will build and modernize enterprise data pipelines across on-prem and Google Cloud, focusing on reliability, governance, and performance.

You’ll migrate legacy ETL patterns to Cloud Composer (Airflow) and implement robust data quality controls with Informatica Data Quality, while partnering with product and analytics teams.

Qualifications

• 4+ years in data engineering with relevant tech stack.
• Proficiency in SQL, PL/SQL on Oracle/Teradata.
• Experience with on-prem and Google Cloud data platforms.

Responsibilities

• Build and maintain scalable batch and near real-time pipelines using AB Initio, Python, PySpark, PL/SQL, SQL.
• Develop and optimize BigQuery transformations and data models.
• Support modernization from Teradata and Ab Initio to GCP/BigQuery with cutovers.
• Implement orchestration using Autosys and migrate to Cloud Composer/Airflow.
• Apply data governance with Dataplex for metadata management and data availability.
• Build data quality controls with Informatica Data Quality.
• Ensure monitoring, incident triage, and continuous improvements.
• Maintain secure data practices and documentation.

Skills

SQL

Python

PySpark

BigQuery

Oracle

Teradata

Ab Initio

ETL design

Data pipelines

Data governance

Tools

Autosys

Airflow

Cloud Composer

Dataplex

Informatica Data Quality

GitHub Copilot

Job description

Motion Recruitment represents a leading global banking client hiring an on-site Data Engineer in Charlotte, NC. You will build and modernize enterprise data pipelines across on-prem and Google Cloud, focusing on reliability, governance, and performance.

You’ll migrate legacy ETL patterns to Cloud Composer (Airflow) and implement robust data quality controls with Informatica Data Quality, while partnering with product and analytics teams.