Remote ETL Modernization Architect - Databricks/DataStage

aKube Inc; United States; Remote; USD 88,000 - 118,000; Full time

Job summary

aKube Inc. is seeking a hands-on senior architect to lead modernization of legacy ETL/ELT pipelines. You will assess IBM DataStage jobs, design scalable Databricks-based data solutions on AWS, and establish governance and CI/CD standards.

You will guide migration planning, testing strategies, and production readiness while driving cutover activities and knowledge transfer to engineering teams.

Qualifications

• Extensive experience designing enterprise ETL/ELT architectures.
• Hands-on experience with IBM DataStage and Databricks modernization projects.
• Strong experience with Databricks, Delta Lake, Unity Catalog, Photon, and Spark.
• Strong knowledge of AWS data services including Glue, Redshift, and Lambda.
• Proficiency in Python and Unix/Linux scripting.
• Experience with Terraform and automated deployment pipelines.
• Knowledge of data governance, observability, lineage, and operational readiness.
• Experience defining testing and production-readiness standards.
• Experience in Agile/Scrum environments and PI planning.

Responsibilities

• Define the architecture and migration strategy for modernizing legacy ETL and ELT pipelines.
• Assess IBM DataStage jobs, databases, and data warehouses for migration readiness.
• Design scalable data solutions using Databricks Spark on AWS.
• Establish architecture standards, reusable frameworks, and governance controls.
• Design CI/CD pipelines for automated builds, testing, and deployment.
• Lead technical design reviews, migration planning, and artifact validation.
• Define parity, functional, UAT, regression, and performance testing strategies.
• Ensure schema validation, data quality, lineage, security, and production readiness.
• Guide cutover, go-live, hypercare, and operational stabilization activities.
• Oversee the decommissioning of legacy DataStage jobs and related components.
• Create operational documentation and conduct knowledge-transfer sessions.
• Provide technical direction to developers and engineering teams.

Job description

aKube Inc. is seeking a hands-on senior architect to lead modernization of legacy ETL/ELT pipelines. You will assess IBM DataStage jobs, design scalable Databricks-based data solutions on AWS, and establish governance and CI/CD standards.

You will guide migration planning, testing strategies, and production readiness while driving cutover activities and knowledge transfer to engineering teams.