Senior Data Engineer

Motion Recruitment; Chicago (IL); On-site; USD 120,000 - 170,000; Full time

Benefits offered by this job

Medical, Dental, and Vision Insurance

Vacation Time

Bonus eligible

Job summary

Motion Recruitment seeks a Senior Databricks Data Engineer to design, build, and optimize enterprise-scale data solutions using Databricks, Azure, PySpark, Delta Lake, SQL, and modern cloud technologies. This full-time role focuses on delivering scalable data products and shaping the data architecture.

You will drive architecture decisions, influence engineering standards, and help build a Lakehouse platform from the ground up alongside talented engineers who value innovation and continuous

Qualifications

• 7+ years of experience in Data Engineering, Data Warehousing, or Data Platform development.
• 3+ years of hands-on Databricks experience in a production environment.
• Strong expertise with PySpark and Apache Spark.
• Advanced SQL development and query optimization skills.
• Experience building ETL/ELT pipelines at enterprise scale.
• Experience working within Azure, AWS, or GCP cloud environments.
• Excellent communication skills and ability to partner with technical and business stakeholders.

Responsibilities

• Tech breakdown: 50% Databricks / PySpark / Spark; 25% Azure Data Platform Services; 25% SQL & Data Modeling.
• Daily responsibilities: 70% Hands On; 30% Team Collaboration.

Skills

Databricks

PySpark

Spark

SQL

ETL/ELT

Cloud environments

Communication

Tools

Airflow

Terraform

ARM templates

Databricks Workflows

Job description

Join a growing, data-driven organization that is investing heavily in its modern cloud data platform and analytics capabilities. We are seeking a Senior Databricks Data Engineer to design, build, and optimize enterprise-scale data solutions using Databricks, Azure, PySpark, Delta Lake, SQL, and modern cloud technologies. This is a full-time opportunity for an engineer who is passionate about building scalable data products and shaping the future of data architecture.

You’ll have the opportunity to drive architecture decisions, influence engineering standards, and help build a best-in-class Lakehouse platform from the ground up. We’re looking for someone who thrives in complex environments, enjoys solving large-scale data challenges, and wants to work alongside talented engineers who value innovation and continuous learning. If you’re seeking a role that offers technical ownership, career growth, exposure to cutting-edge technologies, and strong work-life balance, this is an opportunity worth exploring.

Required Skills & Experience

• 7+ years of experience in Data Engineering, Data Warehousing, or Data Platform development
• 3+ years of hands‑on Databricks experience in a production environment
• Strong expertise with PySpark and Apache Spark
• Advanced SQL development and query optimization skills
• Experience building ETL/ELT pipelines at enterprise scale
• Experience working within Azure, AWS, or GCP cloud environments
• Excellent communication skills and ability to partner with technical and business stakeholders

Desired Skills & Experience

• Azure Data Factory, Azure Synapse, or Microsoft Fabric experience
• Experience with Kafka or event‑driven architectures
• Databricks Workflows, Airflow, or similar orchestration tools
• Infrastructure as Code using Terraform or ARM templates
• Experience supporting AI, Machine Learning, or advanced analytics initiatives
• Prior experience mentoring engineers or leading technical initiatives

What You Will Be Doing

Tech Breakdown

• 50% Databricks / PySpark / Spark
• 25% Azure Data Platform Services
• 25% SQL & Data Modeling

Daily Responsibilities

• 70% Hands On
• 30% Team Collaboration

The Offer

• Bonus eligible

You Will Receive The Following Benefits

• Medical, Dental, and Vision Insurance
• Vacation Time

Applicants must be currently authorized to work in the US on a full-time basis now and in the future.

Posted By: Rose Baldonado