Senior ML Evaluation & Data Platform Lead

Devconnectplatform; United States; Remote; USD 180,000 - 240,000; Full time

Benefits offered by this job

Salary + equity

Unlimited PTO

Health benefits

ESPP

401k

Offsite retreats

Job summary

Hims & Hers is seeking a Senior Staff engineer to own and scale our AI evaluation platform. You will shape data pipelines, judges, and regression tests, and drive cross‑team alignment from idea to production.

You will mentor engineers, define standards, and advocate trustworthy AI in a regulated healthcare context. This role requires 10+ years in ML infrastructure, data engineering, or evaluation systems, with hands‑on depth in Python and statistical rigor.

Qualifications

• 10+ years of experience in ML infrastructure or evaluation/testing systems.
• Hands-on depth in data pipelines, dataset versioning, and labeling workflows.
• Experience scaling cross-team platforms and mentoring engineers.

Responsibilities

• Own the evaluation platform end-to-end: metric, judge, and scorer design.
• Design scalable data pipelines and dataset versioning for evaluation use.
• Lead multi-team projects and drive alignment across engineering, product, and AI leaders.
• Develop adversarial and red-team evaluation plans to reduce risk.
• Architect and modernize core systems with broad organizational impact.
• Mentor engineers and raise technical standards across teams.

Skills

ML infrastructure

Data engineering

Evaluation systems

Python

Statistical testing

Tools

Databricks

MLflow

Unity Catalog

Job description

Hims & Hers is seeking a Senior Staff engineer to own and scale our AI evaluation platform. You will shape data pipelines, judges, and regression tests, and drive cross‑team alignment from idea to production.

You will mentor engineers, define standards, and advocate trustworthy AI in a regulated healthcare context. This role requires 10+ years in ML infrastructure, data engineering, or evaluation systems, with hands‑on depth in Python and statistical rigor.