Lead MLOps Engineer — Databricks, MLflow & Agentic AI

State Farm; Bloomington, Dunwoody, Richardson, Tempe (IL, GA, TX, AZ); Hybrid; USD 100,000 - 200,000; Full time

Benefits offered by this job

Annual raise & bonus

Health & wellbeing programs

Tuition assistance

Job summary

State Farm’s Applied Innovation Lab is seeking a lead individual contributor who will own data foundations, governance, and cost optimization on Databricks. You’ll design medallion architecture, manage MLflow lifecycle, and drive governance and FinOps across projects.

You’ll collaborate with cross‑functional teams, mentor engineers, and shape how agentic AI is integrated into data validation, testing, and monitoring in a fast‑moving, experimental setting.

Qualifications

• Databricks (Non‑Negotiable) – At least a year running Databricks in production at the application layer.
• You’ve designed and operated medallion architecture, and you know Delta Lake, Unity Catalog, and PySpark.

Responsibilities

• Own the performance, quality, and production-readiness of select Databricks-based projects.
• Set technical direction and raise the bar across teams without managing people.
• Partner with enterprise teams and shape how the platform’s capabilities are used.

Skills

Databricks

Production ML

Agentic‑Native

MLflow 3.0

FinOps

Data Lineage

Production Handoff

Systems Thinking

Python

CI/CD for ML

Tools

Databricks

PySpark

Delta Lake

Unity Catalog

MLflow

Job description

State Farm’s Applied Innovation Lab is seeking a lead individual contributor who will own data foundations, governance, and cost optimization on Databricks. You’ll design medallion architecture, manage MLflow lifecycle, and drive governance and FinOps across projects.

You’ll collaborate with cross‑functional teams, mentor engineers, and shape how agentic AI is integrated into data validation, testing, and monitoring in a fast‑moving, experimental setting.