Remote DataStage Migration & ETL Validation Engineer

ZENITH INFOTEK LLC; United States; Remote; USD 120,000 - 180,000; Full time

Job summary

Zenith Infotek LLC seeks an experienced DataStage Migration Validation & ETL Test Engineer to support migrating legacy IBM InfoSphere DataStage workloads to Databricks. You will validate ETL logic, implement automated testing, and ensure data integrity through PySpark in a cloud-based environment.

Qualifications include 5+ years in ETL/testing or data migration, strong SQL and Python skills, and experience with DataStage, Databricks, and automated testing frameworks like PyTest or Great

Qualifications

• Bachelor's degree in Computer Science, Information Technology, Engineering, or a related field.
• 5+ years of experience in ETL development, testing, or data migration projects.
• Prior experience supporting enterprise-scale DataStage modernization initiatives is highly preferred.

Responsibilities

• Analyze and interpret IBM InfoSphere DataStage jobs, sequences, and workflows.
• Translate legacy ETL business logic into functional documentation for PySpark team.
• Design, develop, and execute automated testing frameworks for large-scale ETL migration validation.
• Perform data reconciliation between DataStage and Databricks environments.
• Develop automated validation scripts to verify schemas, row counts, data quality, and business rule transformations.
• Execute regression testing on migrated PySpark pipelines using historical datasets.
• Identify, analyze, and resolve data discrepancies during migration testing.
• Document validation metrics, testing results, and migration KPIs.
• Collaborate with Data Engineers, Architects, QA teams, and stakeholders to ensure migration quality.
• Provide formal migration validation sign-off prior to production cutover.

Job description

Zenith Infotek LLC seeks an experienced DataStage Migration Validation & ETL Test Engineer to support migrating legacy IBM InfoSphere DataStage workloads to Databricks. You will validate ETL logic, implement automated testing, and ensure data integrity through PySpark in a cloud-based environment.

Qualifications include 5+ years in ETL/testing or data migration, strong SQL and Python skills, and experience with DataStage, Databricks, and automated testing frameworks like PyTest or Great