Remote Databricks & DataStage Engineer – ETL & Data Quality

Motion Recruitment; Boston (MA); Remote; USD 83,000 - 152,000; Full time

Job summary

Motion Recruitment is seeking a Senior Integration Engineer for a fully remote contract in the United States. You will lead enterprise data integration and analytics initiatives using IBM DataStage, PySpark, Databricks, Python, SQL, and Delta Lake, delivering governed data assets for reporting.

The role emphasizes building reliable pipelines, improving data quality, and contributing to modern Databricks architecture within a large automotive manufacturing environment.

Qualifications

• Hands‑on experience with IBM DataStage and PySpark.
• Strong Python and SQL development skills.
• Experience designing, developing, and supporting ETL and data integration pipelines.
• Experience with Databricks and data ingestion from multiple sources, including files, APIs, and databases.
• Understanding of Bronze, Silver, and Gold data-layer architecture.
• Experience with data transformations, incremental processing, schema enforcement, and data quality.
• Experience troubleshooting production data pipelines and implementing error handling and recovery.
• Familiarity with GitHub, version control, code reviews, and CI/CD practices.

Responsibilities

• Hands‑on development, data pipeline engineering, and troubleshooting.
• Build and optimize end‑to‑end data integration pipelines for reporting and analytics.
• Contribute to Databricks architecture and data quality initiatives.
• Document data flows, mappings, and dependencies; collaborate with platform teams.

Skills

ETL development

Data integration

Data pipelines

Python development

SQL development

CI/CD practices

Tools

IBM DataStage

Databricks

GitHub

Job description

Motion Recruitment is seeking a Senior Integration Engineer for a fully remote contract in the United States. You will lead enterprise data integration and analytics initiatives using IBM DataStage, PySpark, Databricks, Python, SQL, and Delta Lake, delivering governed data assets for reporting.

The role emphasizes building reliable pipelines, improving data quality, and contributing to modern Databricks architecture within a large automotive manufacturing environment.