Remote Senior Databricks Engineer – Data Integration

Kelly Services

Boston (MA)

Remote

USD 96.000 - 165.000

Vollzeit

14 Tage+

Eine vollständige Bewerbung in einer Minute

Maßgeschneiderter Lebenslauf und Anschreiben – versandbereit.

Schaffe es an den ATS-Filtern vorbei

Zusammenfassung

Motion Recruitment Partners (MRP) is seeking a Senior Integration Engineer for a fully remote contract in the United States. You will design, build, and optimize enterprise data pipelines using IBM DataStage, PySpark, Databricks, Python, SQL, and Delta Lake to transform data into governed assets for reporting and analytics.

The role focuses on production pipeline development, data quality, and modern Databricks architecture within a large automotive manufacturing environment, with a 3-month

Qualifikationen

  • Hands-on experience with IBM DataStage and PySpark.
  • Strong Python and SQL development skills.
  • Experience designing, developing, and supporting ETL and data integration pipelines.
  • Experience with Databricks and data ingestion from multiple sources (files, APIs, databases).
  • Understanding of Bronze, Silver, and Gold data-layer architecture.
  • Experience with data transformations, incremental processing, schema enforcement, and data quality.
  • Experience troubleshooting production data pipelines and implementing error handling and recovery.
  • Familiarity with GitHub, version control, code reviews, and CI/CD practices.

Aufgaben

  • Build, troubleshoot, and optimize production data pipelines for enterprise data integration.
  • Collaborate on Databricks-based data models and architectures.
  • Ensure data quality, lineage, and governance for reporting assets.
  • Document data flows, target mappings, and dependency diagrams.
  • Support CI/CD pipelines and automated testing for data workflows.

Kenntnisse

IBM DataStage
PySpark
Python
SQL
ETL pipelines
Databricks
Bronze Silver Gold data layer
Data quality
GitHub/CI-CD
Error handling

Tools

GitHub
CI/CD

Jobbeschreibung

Motion Recruitment Partners (MRP) is seeking a Senior Integration Engineer for a fully remote contract in the United States. You will design, build, and optimize enterprise data pipelines using IBM DataStage, PySpark, Databricks, Python, SQL, and Delta Lake to transform data into governed assets for reporting and analytics.

The role focuses on production pipeline development, data quality, and modern Databricks architecture within a large automotive manufacturing environment, with a 3-month

Hol dir deinen kostenlosen, vertraulichen Lebenslauf-Check.

oder ziehe deine Datei hierhin.

Similar jobs

Ähnliche Jobs, die dir auch gefallen könnten

Senior Databricks Engineer - Remote Data Pipelines & ETL
Senior Databricks Engineer - Remote Data Pipelines & ETL

Motion Recruitment • USA

Remote
USD 83.000 - 152.000
Remote Databricks & DataStage Engineer – ETL & Data Quality
Remote Databricks & DataStage Engineer – ETL & Data Quality

Motion Recruitment • Boston (MA)

Remote
USD 83.000 - 152.000
Databricks Engineer / Remote / Contract
Databricks Engineer / Remote / Contract

Kelly Services • Boston (MA)

Remote
USD 96.000 - 165.000
Databricks Engineer / Remote / Contract
Databricks Engineer / Remote / Contract

Motion Recruitment • USA

Remote
USD 83.000 - 152.000
Databricks Engineer / Remote / Contract
Databricks Engineer / Remote / Contract

Motion Recruitment • Boston (MA)

Remote
USD 83.000 - 152.000
Remote Senior Data Engineer — Databricks & AI
Remote Senior Data Engineer — Databricks & AI

Motion Recruitment • Dallas (TX)

Remote
USD 120.000 - 190.000
Remote Work Environment
Competitive Benefits
Paid Time Off and Holidays
+1
Senior Data Engineer: Remote Databricks & Data Platforms
Senior Data Engineer: Remote Databricks & Data Platforms

Tech in Motion • Chicago (IL)

Remote
USD 120.000 - 180.000
Fully remote
Bonus eligible
401(k) Program
+1
Remote Databricks Engineer: Spark, Delta Lake & ETL
Remote Databricks Engineer: Spark, Delta Lake & ETL

Artingdigital • USA

Remote
USD 120.000 - 180.000
Senior Databricks Engineer – Remote Data Pipelines
Senior Databricks Engineer – Remote Data Pipelines

Princeton IT Services, Inc • USA

Remote
USD 130.000 - 180.000
Remote Senior Data Engineer - Databricks, SQL & Python
Remote Senior Data Engineer - Databricks, SQL & Python

neteffects • St. Louis (MO)

Remote
USD 98.000 - 105.000