Databricks Engineer / Remote / Contract

Kelly Services

Boston (MA)

Remote

USD 96,000 - 165,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Motion Recruitment Partners (MRP) is seeking a Senior Integration Engineer for a fully remote contract in the United States. You will design, build, and optimize enterprise data pipelines using IBM DataStage, PySpark, Databricks, Python, SQL, and Delta Lake to transform data into governed assets for reporting and analytics.

The role focuses on production pipeline development, data quality, and modern Databricks architecture within a large automotive manufacturing environment, with a 3-month

Qualifications

  • Hands-on experience with IBM DataStage and PySpark.
  • Strong Python and SQL development skills.
  • Experience designing, developing, and supporting ETL and data integration pipelines.
  • Experience with Databricks and data ingestion from multiple sources (files, APIs, databases).
  • Understanding of Bronze, Silver, and Gold data-layer architecture.
  • Experience with data transformations, incremental processing, schema enforcement, and data quality.
  • Experience troubleshooting production data pipelines and implementing error handling and recovery.
  • Familiarity with GitHub, version control, code reviews, and CI/CD practices.

Responsibilities

  • Build, troubleshoot, and optimize production data pipelines for enterprise data integration.
  • Collaborate on Databricks-based data models and architectures.
  • Ensure data quality, lineage, and governance for reporting assets.
  • Document data flows, target mappings, and dependency diagrams.
  • Support CI/CD pipelines and automated testing for data workflows.

Skills

IBM DataStage
PySpark
Python
SQL
ETL pipelines
Databricks
Bronze Silver Gold data layer
Data quality
GitHub/CI-CD
Error handling

Tools

GitHub
CI/CD

Job description

We are working with a leading automotive manufacturing company seeking a Senior Integration Engineer for a fully remote contract opportunity in the United States. This role will focus on enterprise data integration and analytics using IBM DataStage, PySpark, Databricks, Python, SQL, and Delta Lake. The initial contract is three months, with renewals every three months.

This is an opportunity to work on enterprise-scale data integration initiatives, building reliable pipelines that connect applications and transform data into governed assets for reporting and analytics. The team is looking for a hands‑on engineer who can develop, troubleshoot, and optimize production data pipelines while contributing to modern Databricks architecture, data quality, and automation practices. The role offers exposure to modern data engineering technologies within a large automotive manufacturing environment.

Contract Duration:

3 months, with renewals every 3 months

Required Skills & Experience
  • Hands-on experience with IBM DataStage and PySpark.
  • Strong Python and SQL development skills.
  • Experience designing, developing, and supporting ETL and data integration pipelines.
  • Experience with Databricks and data ingestion from multiple sources, including files, APIs, and databases.
  • Understanding of Bronze, Silver, and Gold data‑layer architecture.
  • Experience with data transformations, incremental processing, schema enforcement, and data quality.
  • Experience troubleshooting production data pipelines and implementing error handling and recovery.
  • Familiarity with GitHub, version control, code reviews, and CI/CD practices.
Desired Skills & Experience
  • Experience with Delta Lake and Spark Declarative Pipelines.
  • Experience integrating data through enterprise transfer services such as Sterling.
  • Familiarity with automated testing, pipeline monitoring, and quarantine patterns.
  • Experience developing governed data products for reporting and analytics.
  • Ability to document solution architecture, data flows, dependencies, and source-to-target mappings.
  • Experience working in large enterprise or automotive manufacturing environments.
What You Will Be Doing
Tech Breakdown
  • 30% IBM DataStage and ETL development
  • 30% PySpark and Databricks
  • 20% Python and SQL transformations
  • 10% Delta Lake and Spark Declarative Pipelines
  • 10% GitHub, CI/CD, testing, and monitoring
Daily Responsibilities
  • 50% Hands‑on development, data pipeline engineering, and troubleshooting
  • 20% Data quality, testing, deployment, and production support
  • 15% Architecture documentation and source-to-target mapping
  • 15% Team collaboration with project and platform teams

Motion Recruitment Partners (MRP) is an Equal Opportunity Employer. All applicants must be currently authorized to work on a full-time basis in the country for which they are applying, and no sponsorship is currently available. Employment is subject to the successful completion of a pre‑employment screening. Accommodation will be provided in all parts of the hiring process as required under MRP’s Employment Accommodation policy. Applicants need to make their needs known in advance.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Databricks Engineer / Remote / Contract
Databricks Engineer / Remote / Contract

Motion Recruitment • United States

Remote
USD 83,000 - 152,000
Databricks Engineer / Remote / Contract
Databricks Engineer / Remote / Contract

Motion Recruitment • Boston (MA)

Remote
USD 83,000 - 152,000
Remote Senior Databricks Engineer – Data Integration
Remote Senior Databricks Engineer – Data Integration

Kelly Services • Boston (MA)

Remote
USD 96,000 - 165,000
Remote Databricks & DataStage Engineer – ETL & Data Quality
Remote Databricks & DataStage Engineer – ETL & Data Quality

Motion Recruitment • Boston (MA)

Remote
USD 83,000 - 152,000
Senior Databricks Engineer - Remote Data Pipelines & ETL
Senior Databricks Engineer - Remote Data Pipelines & ETL

Motion Recruitment • United States

Remote
USD 83,000 - 152,000
Data Engineer (Manufacturing and Operations)
Data Engineer (Manufacturing and Operations)

Comrise • Foster City (CA)

On-site
USD 78,000 - 110,000
Databricks Data Engineer
Databricks Data Engineer

Ethereum Technologies LLC • Dallas (TX)

On-site
USD 120,000 - 170,000
Data Engineer - Fleet Operations
Data Engineer - Fleet Operations

Hireart • Foster City (CA)

On-site
USD 78,000 - 110,000
Pre‑tax commuter benefits
Healthcare benefits
FSA for healthcare costs
+2
Data Engineer - Databricks (Remote)
Data Engineer - Databricks (Remote)

Lumenalta • United States

Remote
MXN 1,426,533 - 2,139,800
Databricks Data Engineer
Databricks Data Engineer

Eliassen Group • Nashville (TN)

Remote
USD 150,000 - 154,000