Senior Data Engineer — Enterprise Data Platform (Databricks)

Epsilon; Chicago (IL); On-site; USD 89,000 - 165,000; Full time

Benefits offered by this job

Flexible time off

Paid holidays

Comprehensive health coverage

401(k)

Job summary

Epsilon is seeking a Senior Data Engineer to architect and build the CIP data platform powering enterprise intelligence. You will design scalable ingestion pipelines, implement Medallion Architecture, and establish governance to deliver trusted data for executive dashboards and AI copilots.

You will collaborate across Finance, HR, Sales, and Product Engineering, partnering with Databricks specialists to ensure successful CIP capabilities and scalable data solutions.

Qualifications

• Bachelor's degree in Computer Science, Engineering, Information Systems, Data Engineering, or a related technical discipline.
• 5+ years of experience building enterprise-scale data platforms and modern cloud-based analytics solutions.
• Deep expertise with Databricks, Delta Lake, Unity Catalog, and Medallion Architecture design patterns.
• Advanced proficiency using Python, SQL, and data engineering frameworks.
• Experience designing Bronze, Silver, and Gold layer architectures.
• Experience building enterprise ETL/ELT pipelines and scalable data ingestion frameworks.
• Strong data modeling skills including dimensional modeling, semantic modeling, canonical data models, and enterprise taxonomy design.
• Experience implementing data governance, metadata management, lineage tracking, and data quality frameworks.
• Working knowledge of cloud platforms, preferably AWS.
• Strong communication and stakeholder management skills with the ability to translate business requirements into scalable technical solutions.
• Ability to independently lead technical initiatives from architecture through production deployment.

Responsibilities

• Build Enterprise Data Architecture: Bronze, Silver, and Gold data layers using Databricks and Delta Lake architecture patterns; develop reusable ingestion frameworks, transformation pipelines, and governed data products.
• Deliver Enterprise Data Integrations: Build and manage ingestion pipelines from HRIS, Jira, Salesforce, Finance platforms, Resource Forecasting systems, and additional enterprise applications.
• Establish Governance and Data Quality: Implement data quality monitoring, metadata management, lineage tracking, security classifications, masking strategies, governance controls, and certification processes.
• Enable AI and Semantic Layers: Create semantic models, curated datasets, feature layers, and optimized data structures consumed by Databricks Genie, AI applications, executive dashboards, and self-service analytics platforms.

Skills

Databricks

Delta Lake

Unity Catalog

Medallion Architecture

Python

SQL

ETL/ELT pipelines

Data governance

Metadata management

Data modeling

AWS

Education

Bachelor's degree in Computer Science, Engineering, Information Systems, Data Engineering, or related technical discipline

Tools

Databricks Genie

Mosaic AI

AI platforms

Job description

Epsilon is seeking a Senior Data Engineer to architect and build the CIP data platform powering enterprise intelligence. You will design scalable ingestion pipelines, implement Medallion Architecture, and establish governance to deliver trusted data for executive dashboards and AI copilots.

You will collaborate across Finance, HR, Sales, and Product Engineering, partnering with Databricks specialists to ensure successful CIP capabilities and scalable data solutions.