Data Foundations Lead — Databricks & Lakehouse

The Chamberlain Group LLC; Oak Brook (IL); Hybrid; USD 130,000 - 227,000; Full time

Job summary

The Chamberlain Group seeks a senior data engineering leader to run delivery and operations of data pipelines, Databricks platforms, and data quality within the Data and Analytics Foundations group. You will mentor engineers, manage a blended team of full-time staff and external partners, and ensure reliable, timely data products and dashboards.

Ideal candidates have 5+ years in data/analytics engineering, hands-on Databricks expertise (Delta Lake, Unity Catalog, PySpark), and a track record of

Qualifications

• Bachelor's degree in computer science or equivalent required.
• 5+ years of experience in data or analytics engineering.
• Experience leading technical teams and delivering production data pipelines.
• Hands-on Databricks experience including Delta Lake and PySpark.

Responsibilities

• Lead design, delivery, and operation of batch/streaming pipelines and data products.
• Manage a blended team of data/analytics engineers and external partners.
• Own Databricks platform operations, including Unity Catalog and cost attribution.
• Set standards for data classification, masking, and access control.

Skills

Databricks

Leadership

AI tooling

SQL

Python

Cloud platforms

Education

Bachelor's Degree in Computer Science or equivalent

Tools

Databricks

Unity Catalog

Job description

The Chamberlain Group seeks a senior data engineering leader to run delivery and operations of data pipelines, Databricks platforms, and data quality within the Data and Analytics Foundations group. You will mentor engineers, manage a blended team of full-time staff and external partners, and ensure reliable, timely data products and dashboards.

Ideal candidates have 5+ years in data/analytics engineering, hands-on Databricks expertise (Delta Lake, Unity Catalog, PySpark), and a track record of