Member of Clinical Staff

Kinetic Systems; San Francisco (CA); On-site; USD 150,000 - 230,000; Full time

Benefits offered by this job

Unlimited PTO

Health, dental, and vision coverage

401(k)

Free lunch + dinner

Job summary

Kinetic Systems in San Francisco seeks a Member of Clinical Staff to advance AI in healthcare through RL environments, data benchmarks, and published work. You will build datasets, calibrate with clinicians, and turn insights into safe, real-world models used by providers and patients.

The role requires a medical degree (MD/DO/MBBS/NP/PA) and 2+ years in a clinical setting; familiarity with EHR concepts and data quality, plus ability to read and modify code and datasets.

Qualifications

• HARD REQUIREMENT: Must have one of the following medical degrees: MD, DO, MBBS, NP, or PA.
• 2+ years of experience working in a real clinical environment.
• Experience in human data, frontier AI lab or human data company.
• Built RL environments, evals, or graders yourself.
• Understand data quality and how it shapes model training.

Responsibilities

• Design and build evaluations reflecting real clinical work.
• Identify gaps in real clinical workflows and create environments and benchmarks.
• Write rubrics and guidelines capturing expert clinical judgment.
• Build gold-standard datasets and pilot tasks with clinician network.
• Lead calibration with clinician raters and adjudicate hard cases.
• Collaborate with ML team to generate clinical data for training and evaluation.
• Publish papers in academic conferences.

Skills

Clinical experience

RL environments

Data quality

Healthcare data

Education

MD/DO/MBBS/NP/PA

Tools

Python

Git

SQL

Job description

Kinetic Systems is a healthcare AI research lab. We partner with frontier labs and healthcare organizations to help make AI models safer and more reliable.

We spun out of the Stanford PhD program in 2025 and are backed by General Catalyst, Conviction, and other great investors.

The Role

As a Member of Clinical Staff, you'll help drive our research agenda towards advancing AI model capabilities on real-world healthcare tasks. You will build reinforcement learning environments, novel datasets and benchmarks, publish academic papers, and post-train models to push the SOTA while staying grounded in the demonstrated needs of our healthcare partners. Your clinical judgment will be encoded into models used by millions of providers and patients every day.

Note: This is a full-time role, required to be in-person in SF.

What You'll Do

• Design and build evaluations that reflect real clinical work
• Find where frontier models fall short on real clinical workflows, and turn those gaps into environments, evals, and benchmarks
• Write the rubrics and guidelines that capture expert clinical judgment, especially where the right answer is subjective or high-stakes
• Build gold-standard datasets, pilot new tasks yourself, and set the quality bar for our clinician network
• Lead calibration with clinician raters and adjudicate the hardest cases
• Work with our ML team to turn training and evaluation needs into high-quality clinical data
• Write and publish papers in academic conferences

Who You Are

• HARD REQUIREMENT: Must have one of the following medical degrees: MD, DO, MBBS, NP, or PA
• 2+ years of experience working in a real clinical environment
• You've done serious work in the human data space, at a frontier AI lab or a human data company (e.g., Scale AI, Surge AI, Mercor, Handshake AI, Turing)
• You've built RL environments, evals, or graders yourself
• You understand how data quality shapes model training, including preference data, rubric design, and rater agreement
• You understand healthcare data (e.g., EHR data structures, interoperability, HIPAA considerations)
• You're comfortable working with code: you can read and modify environment and grader code, write scripts to build and analyze datasets, and dig into model outputs yourself

NICE TO HAVE

• JavaScript/TypeScript, CI/CD, or AWS experience
• Experience shipping production software or digital health products
• Experience with clinical workflow analysis or quality improvement initiatives
• You work in Git alongside engineers (branches, PRs, code review)

Why Us

If you join our team, you will be joining a team with...

• Founding-level impact and ownership
• An opportunity to advance AI research in one of its most meaningful application areas
• Competitive compensation and meaningful equity
• Unlimited PTO
• Comprehensive health, dental, and vision coverage
• 401(k)
• Free lunch + dinner