Senior ML Evaluation & Data Platform Lead

hims & hers; United States; Hybrid; USD 210,000 - 320,000; Full time

Benefits offered by this job

Competitive salary & equity

Unlimited PTO

Health benefits

ESPP

401k

Offsite team retreats

Job summary

Hims & Hers is seeking a Senior Staff Engineer to own the data pipelines and evaluation infrastructure for AI models in a regulated healthcare environment. You will drive the technical direction, from ingestion and feature pipelines to evaluation methodology and reporting surfaces used by clinical and product teams.

You will lead cross-team initiatives, design robust testing and red-team evaluation, and mentor engineers while shaping how teams approach complex AI challenges across the

Qualifications

• 10+ years in ML infrastructure, data engineering, or evaluation/testing systems.
• Hands-on depth in evaluation systems including LLM judges/scorers and regression testing.
• Experience in dataset versioning, labeling workflows, and high-throughput ingestion.

Responsibilities

• Own the evaluation system end-to-end, including design of metrics, judges, and regression logic.
• Lead multi-team projects; replace manual review with automated, statistically sound gates.
• Mentor engineers and raise the statistical bar across teams.

Skills

ML infra

Data pipelines

Evaluation systems

Python

Mentoring

Cross-team leadership

Communication

Tools

Databricks

MLflow

Unity Catalog

Job description

Hims & Hers is seeking a Senior Staff Engineer to own the data pipelines and evaluation infrastructure for AI models in a regulated healthcare environment. You will drive the technical direction, from ingestion and feature pipelines to evaluation methodology and reporting surfaces used by clinical and product teams.

You will lead cross-team initiatives, design robust testing and red-team evaluation, and mentor engineers while shaping how teams approach complex AI challenges across the