AI Research Engineer

Mental

San Francisco (CA)

Sur place

USD 180 000 - 240 000

Plein temps

14 jours+

Une candidature complète en une minute

Un CV et une lettre de motivation personnalisés, prêts à envoyer.

Passez les filtres ATS

Résumé du poste

Monograph is seeking an experienced AI/ML engineer to design, train, and deploy the AI therapy system. You will collaborate with clinicians, product, and engineering to improve therapy conversations, safety, and model quality. The role emphasizes building robust eval stacks and production-ready pipelines.

You will iterate quickly, balance quality and speed, and translate clinical requirements into scalable model and system changes for the product.

Qualifications

  • Experience with large language models, fine-tuning, data design, and model selection.
  • Ability to evaluate conversations, metrics, transcripts, and to form grounded hypotheses.
  • Production-level software engineering experience in AI systems.
  • Ability to design and manage data pipelines for training and evals.
  • Strong scientific mindset with hypothesis testing and data analysis.
  • Excellent prioritization to maximize company value and avoid scope creep.
  • Efficient, fast delivery with iterative learning and minimal over-engineering.
  • Clear collaboration with clinicians, product, and engineering.

Responsabilités

  • Own AI system end-to-end, from data to production deployment and monitoring.
  • Improve AI therapy quality and evaluation stacks with robust experiments.
  • Productionize models and pipelines, manage training jobs, deployment, and rollback.
  • Encode clinical guidelines into prompts and safety filters.
  • Shape a focused R&D roadmap and run high-quality experiments.
  • Collaborate with clinicians, product, and engineering to integrate AI capabilities.

Connaissances

LLM depth
Applied ML
Code quality
Data engineering
Scientific mindset
Prioritization
Fast delivery
Strong communication

Description du poste

Note - Below contains the outcomes and competencies for the team. If you bring standout strengths in some areas but not all, you are still encouraged to apply.

Mission

Design, train, ship, iterate on, and innovate on the AI brains behind The Path’s AI Therapist. Combine research, data science, and engineering to create models, orchestration, and evaluation systems that make therapy conversations deeply effective, clinically grounded, and safe.

Outcomes
  1. Improve quality of AI Therapy: Deliver measurable improvements in conversation quality, therapeutic alliance, and user outcomes through fine-tuning strategies, training data curation, building RL environments, new model architectures and other AI innovations.

  2. Improve evaluation of AI quality: Improve on and maintain a robust eval stack that includes scripted tests, LLM-as-judge evaluations, human ratings, and safety checks. Improve automated regression testing, detection of defects, and observability (eg dashboards).

  3. Own AI system. Build, maintain, and iterate on the production codebase that delivers AI therapy and supports the evaluation and iteration of our AI.

  4. Productionize Models and Pipelines. Own The Path from notebook to production: training jobs, model packaging, deployment, monitoring, and rollback strategies. Keep latency, reliability, and cost within agreed budgets while enabling rapid iteration on new ideas.

  5. Improve Safety, Alignment, and Clinical Guardrails Work with clinicians and internal experts to encode clinical guidelines into prompts, reward functions, tools, and filters. Proactively identify and reduce harmful or low-quality behaviors through targeted experiments, red teaming, and mitigations.

  6. Own Research Roadmap and Experiment Velocity Run high-quality experiments from hypothesis to analysis to improve our understanding of what matters and what works. Shape and execute a focused R&D roadmap.

  7. Collaboration with Clinicians, Product, and Engineering. Translate product and clinical requirements into concrete model and system changes. Partner with full-stack product engineers so that new AI capabilities are easy to integrate and maintain in the product.

Competencies
  1. LLM and Applied ML Depth. Demonstrates strong experience with large language models, including fine-tuning, training data design, and model selection. Knows how to move core metrics on conversation quality and user outcomes, rather than chasing generic benchmarks. Can look at evals, transcripts, and metrics and quickly form grounded hypotheses for improvement.

  2. Ships clean, maintainable, quality code. No only do you know how transformers work, but you are also an engineer that has experience shipping production-level code and/or maintaining an AI system in production.

  3. Data Engineering Skills. Can set up production-level data pipelines for training new models, evals, analysis, etc.

  4. Scientific Mindset. You formulate hypotheses, and you are good at evaluating them (eg through experiments, data analysis, etc). You are consistently learning at the cutting edge, and you’re able to leverage and communicate those learnings to make the entire company more successful.

  5. Ruthless Prioritizer. You are keenly aware of how to provide company value and to prioritize projects accordingly. Resistant to nerd-sniping.

  6. Quality Obsessive: Refuses to ship subpar work, continuously improving the codebase.

  7. Fast: Prioritizes speed by leveraging AI, breaking down complex tasks, shipping early, optimizing for learnings, iterating quickly, and avoiding over-engineering.

  8. Strong communicator. You can work collaboratively in a positive way. Sees others perspectives. Strong opinions, loosely held. Focused on user/business value, not ego.

Great to have
  • Personal or other experience with therapy or coaching

  • Domain knowledge of psychology, neuroscience, therapy, or coaching.

Obtenez votre examen gratuit et confidentiel de votre CV.

ou faites glisser et déposez votre fichier ici.

Similar jobs

Postes similaires à comparer

AI Research Engineer
AI Research Engineer

The Path • San Francisco (CA)

Sur place
USD 120 000 - 160 000
Flexible working hours
Opportunity to work with leading experts in AI and therapy
Senior Applied AI Engineer, Patient Experience
Senior Applied AI Engineer, Patient Experience

Bask Health • New York (NY)

Sur place
USD 180 000 - 240 000
Head of Applied AI
Head of Applied AI

Bask Health • États-Unis

À distance
USD 190 000 - 260 000
AI Engineer
AI Engineer

Data • Union City (NJ)

Sur place
USD 120 000 - 150 000
AI/ML Engineer
AI/ML Engineer

Storm3 • Tennessee

Sur place
USD 180 000 - 280 000
Applied AI Engineer, Patient Experience
Applied AI Engineer, Patient Experience

Bask Health • États-Unis

À distance
USD 120 000 - 180 000
Applied AI Researcher (Brazil)
Applied AI Researcher (Brazil)

Articul8 • Palo Alto (CA)

Sur place
USD 120 000 - 160 000
AI Engineer- Remote
AI Engineer- Remote

Sharecare Operating Company • États-Unis

À distance
USD 150 000 - 210 000
Senior Software Engineer — AI Engineering
Senior Software Engineer — AI Engineering

Growthspace • États-Unis

À distance
USD 170 000 - 210 000
Senior Machine Learning Engineer, Evaluation & Reliability
Senior Machine Learning Engineer, Evaluation & Reliability

Bask Health • New York (NY)

Sur place
USD 180 000 - 240 000