Senior Azure Databricks Data Engineer (Hybrid)

BinaryBees Business Solutions LLC; Chicago (IL); Hybrid; USD 120,000 - 160,000; Full time

Job summary

BinaryBees Business Solutions LLC in Chicago, IL is seeking a Senior Data Engineer to join a hybrid team building a brand-new Azure Databricks platform. You will design and deliver end-to-end pipelines, governance, and models on a greenfield data platform in a direct-hire, full-time role.

This hands-on role requires expert Python, SQL, Spark, and Delta Lake skills, with ownership of pipelines from ingestion through analytics outputs, plus mentoring junior engineers and collaborating with BI and

Qualifications

• Bachelor's degree in a related field.
• Experience building end-to-end data pipelines on modern platforms.
• Hands-on Databricks experience including Delta Lake and Unity Catalog.

Responsibilities

• Lead design and build of scalable data pipelines and models on Azure Databricks
• Own pipelines end-to-end from ingestion to transformation and modeling
• Migrate legacy data warehouses to a centralized Databricks lakehouse
• Write code daily in Python, SQL, and Spark
• Establish CI/CD standards and automated data testing
• Help shape data modeling and governance standards
• Troubleshoot and optimize platform performance
• Mentor junior engineers and collaborate with cross-functional teams

Skills

Azure Databricks

Python

SQL

Spark

ETL/ELT pipelines

Delta Lake

Data modeling

CI/CD

Git workflows

Problem solving

Education

Bachelor's degree in Computer Science, Engineering, Data Science, or related field

Tools

Databricks Workflows

GitHub

Azure DevOps

Terraform

Job description

BinaryBees Business Solutions LLC in Chicago, IL is seeking a Senior Data Engineer to join a hybrid team building a brand-new Azure Databricks platform. You will design and deliver end-to-end pipelines, governance, and models on a greenfield data platform in a direct-hire, full-time role.

This hands-on role requires expert Python, SQL, Spark, and Delta Lake skills, with ownership of pipelines from ingestion through analytics outputs, plus mentoring junior engineers and collaborating with BI and