Senior Databricks Data Engineer - Azure, Delta Lake expert

Motion Recruitment; Chicago (IL); On-site; USD 120,000 - 170,000; Full time

Benefits offered by this job

Medical, Dental, and Vision Insurance

Vacation Time

Stock Options

Job summary

Motion Recruitment in Chicago is seeking a Data Engineer to support a large-scale cloud data platform. You will build modern data pipelines using Azure Databricks, Python, SQL and Spark in a production environment, collaborating with engineers and business partners to turn raw data into analytics-ready datasets.

This hands-on role emphasizes end-to-end pipeline ownership, data governance, and evolving the platform within an enterprise.

Qualifications

• 6+ years of hands-on data engineering experience.
• Strong experience building pipelines using Databricks.
• Production data processing with Python and SQL.
• Working knowledge of Apache Spark and Delta Lake.
• Experience with cloud data storage (ADLS, object storage).
• Experience with data modeling and schema design.
• Familiarity with Git, CI/CD concepts, and basic testing/monitoring.

Responsibilities

• Own end-to-end data pipelines from ingestion to analytics-ready datasets.
• Collaborate with BI, AI, and product teams to support reporting and insights.
• Contribute to data governance and platform evolution in a cloud environment.

Skills

Databricks

Python

SQL

Spark

Delta Lake

Git

CI/CD

Tools

Azure Databricks

ADLS/Object Storage

Job description

Motion Recruitment in Chicago is seeking a Data Engineer to support a large-scale cloud data platform. You will build modern data pipelines using Azure Databricks, Python, SQL and Spark in a production environment, collaborating with engineers and business partners to turn raw data into analytics-ready datasets.

This hands-on role emphasizes end-to-end pipeline ownership, data governance, and evolving the platform within an enterprise.