Databricks Lakehouse Engineer — Data Platforms & Pipelines

Quantum Technologies, Inc.; Chicago (IL); On-site; USD 120,000 - 170,000; Full time

Job summary

Quantum Technologies, Inc. in Chicago is seeking an experienced data architect to design and deliver enterprise-scale data platforms using Databricks Lakehouse, PySpark, and AWS.

You will own governance, security, and performance tuning for Life & Annuity analytics, collaborating with data engineers, analysts, and product teams.

The role offers a collaborative environment with opportunities to influence architecture across the organization and drive data-driven decision making.

Qualifications

• Experience in enterprise data architecture and analytics.
• Experience with big data platforms and data governance.
• Ability to coordinate delivery across teams.

Responsibilities

• Design and implement full-stack data platforms.
• Lead Databricks Lakehouse projects and data modeling.
• Ensure security and scalability for Life & Annuity analytics.

Skills

Java

React

Python

Full-stack

Tools

Databricks Lakehouse

Delta Lake

Unity Catalog

MLflow

PySpark

Kong API gateway

Kafka

AWS

PostgreSQL

Spark SQL

Auto Loader

Structured Streaming

CI/CD

AWS S3

Job description

Quantum Technologies, Inc. in Chicago is seeking an experienced data architect to design and deliver enterprise-scale data platforms using Databricks Lakehouse, PySpark, and AWS.

You will own governance, security, and performance tuning for Life & Annuity analytics, collaborating with data engineers, analysts, and product teams.

The role offers a collaborative environment with opportunities to influence architecture across the organization and drive data-driven decision making.