Senior Data Engineer, Azure Databricks (Hybrid)

Gulf Coast Automation Group

Chicago (IL)

Hybrid

USD 150,000 - 164,000

Full time

2 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Health insurance
401(k)
Paid time off

Job summary

TalentFish seeks a Senior Data Engineer to design and implement a brand-new Azure Databricks platform. You will own end-to-end data pipelines, from ingestion through transformation to downstream outputs for analytics and AI/ML use cases.

You will work in a hybrid Chicago environment, collaborate with cross-functional teams, and set engineering standards for CI/CD, testing, and governance.

Qualifications

  • 6+ years hands-on data engineering with end-to-end pipelines.
  • Strong Databricks experience (Azure preferred).
  • Proficient in Python, SQL, Spark; solid data modeling skills.

Responsibilities

  • Lead design and build of scalable data pipelines and models in Azure Databricks on a brand-new platform.
  • Own pipelines end-to-end from ingestion to modeling for analytics, BI, and AI/ML use cases.
  • Refactor and migrate legacy data warehouses into the Databricks lakehouse.
  • Work daily in Python, SQL, and Spark; build pipelines with Databricks Asset Bundles and Spark workflows.
  • Establish CI/CD standards (GitHub/Azure DevOps), data testing, monitoring and alerting.
  • Mentor junior engineers and enforce data modeling and governance standards.
  • Partner with Data Eng, BI, AI, Finance, and product teams to translate technical work into business impact.

Skills

Databricks
Python
SQL
Apache Spark
ETL pipelines
CI/CD
Git
Azure
Delta Lake
Unity Catalog

Education

Bachelor's degree in CS/Engineering/Data Science

Tools

Databricks
Delta Lake
Unity Catalog
Databricks SQL
Spark Clusters
Workflows/Jobs
GitHub
Azure DevOps

Job description

TalentFish seeks a Senior Data Engineer to design and implement a brand-new Azure Databricks platform. You will own end-to-end data pipelines, from ingestion through transformation to downstream outputs for analytics and AI/ML use cases.

You will work in a hybrid Chicago environment, collaborate with cross-functional teams, and set engineering standards for CI/CD, testing, and governance.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Databricks Data Engineer – Greenfield (Hybrid)
Senior Databricks Data Engineer – Greenfield (Hybrid)

Gulf Coast Automation Group • Chicago (IL)

Hybrid
USD 150,000 - 164,000
Health insurance
401(k)
Paid time off
Senior Data Engineer
Senior Data Engineer

Gulf Coast Automation Group • Chicago (IL)

Hybrid
USD 150,000 - 164,000
Health insurance
401(k)
Paid time off
Senior Data Engineer (Databricks)
Senior Data Engineer (Databricks)

Gulf Coast Automation Group • Chicago (IL)

Hybrid
USD 150,000 - 164,000
Health insurance
401(k)
Paid time off
Senior Data Engineer - Azure Databricks & Python (Hybrid)
Senior Data Engineer - Azure Databricks & Python (Hybrid)

Technology Navigators • Austin (TX)

Hybrid
USD 130,000 - 170,000
Senior Data Engineer - Databricks, Python & Azure
Senior Data Engineer - Databricks, Python & Azure

Motion Recruitment • Chicago (IL)

Remote
USD 120,000 - 180,000
Medical, Dental, and Vision Insurance
Vacation Time
Stock Options
Senior Databricks Lakehouse Engineer - Azure Hybrid Chicago
Senior Databricks Lakehouse Engineer - Azure Hybrid Chicago

Bilink Corp • Chicago (IL)

Hybrid
USD 110,000 - 160,000
401(k) with match
Health and dental insurance
Paid time off
Senior Data Engineer, Azure Databricks Lakehouse (Hybrid)
Senior Data Engineer, Azure Databricks Lakehouse (Hybrid)

Publicis Sapient • Houston (TX)

Hybrid
USD 104,000 - 120,000
Inclusive workplace
Ongoing learning and development
Competitive compensation and benefits
+4
Senior Data Engineer — Remote Databricks on Azure
Senior Data Engineer — Remote Databricks on Azure

Hylant • United States

Remote
USD 120,000 - 160,000
Remote Senior Data Engineer - Azure Databricks & Pipelines
Remote Senior Data Engineer - Azure Databricks & Pipelines

Hylant • Toledo (OH)

Remote
USD 120,000 - 160,000
Senior Data Engineer - Azure Databricks Lakehouse
Senior Data Engineer - Azure Databricks Lakehouse

Consolia • United States

Remote
USD 110,000 - 170,000
Full private health insurance