Senior Data Engineer - Databricks Lakehouse & MLOps

Litter-Robot; Auburn Hills (MI); Hybrid; USD 150,000 - 190,000; Full time

Benefits offered by this job

Health insurance

Dental insurance

Vision insurance

401K match

Pet-friendly office

Paid time off

Job summary

Whisker is seeking a Senior Data Engineer to design, build, and maintain scalable data pipelines and platforms in a modern cloud lakehouse environment. You’ll work closely with data science, analytics, and engineering teams to deliver reliable data solutions at scale.

The role focuses on Databricks-based ETL/ELT pipelines, data governance, and ML workflows, with opportunities to mentor engineers and drive architecture discussions. This hybrid role is based at our Auburn Hills, MI headquarters.

Qualifications

• 8+ years of professional software engineering experience.
• Experience leading backend teams and hiring decisions.
• Expertise in data pipelines, analytics platforms, and ML workflows.

Responsibilities

• Designs, builds, and maintains scalable ETL/ELT pipelines using Databricks/Spark.
• Develops data workflows for batch and streaming processing.
• Architects data lakehouse solutions using medallion architecture (bronze/silver/gold).
• Collaborates with data scientists, analysts, and stakeholders to deliver solutions.
• Writes PySpark/SQL code for transformations.
• Builds and maintains ML workflows with MLflow and CI/CD pipelines.
• Implements monitoring and cost-optimization for Databricks clusters and jobs.
• Ensures data quality, governance, and security across pipelines.

Skills

Databricks

Apache Spark

Delta Lake

PySpark

MLflow

DBT

Kubernetes

AWS

Kafka/Kinesis

Data governance

MLOps

CI/CD

Education

BS in Computer Science / Software Engineering

Tools

Databricks

Apache Spark

Delta Lake

MLflow

DBT

AWS

Kubernetes

Job description

Whisker is seeking a Senior Data Engineer to design, build, and maintain scalable data pipelines and platforms in a modern cloud lakehouse environment. You’ll work closely with data science, analytics, and engineering teams to deliver reliable data solutions at scale.

The role focuses on Databricks-based ETL/ELT pipelines, data governance, and ML workflows, with opportunities to mentor engineers and drive architecture discussions. This hybrid role is based at our Auburn Hills, MI headquarters.