AI Reliability & Evaluation Engineer (Healthcare)

Bask Health

Oregon

Hybrid

USD 120.000 - 180.000

Vollzeit

Vor 7 Tagen
Sei unter den ersten Bewerbenden

Erhalte eine Antwort von diesem Arbeitgeber

Dein Lebenslauf und dein Anschreiben, genau auf das zugeschnitten, was gesucht wird.

Schaffe es an den ATS-Filtern vorbei

Zusammenfassung

Bask Health is seeking a Machine Learning Engineer, Evaluation & Reliability to ensure AI-powered features are accurate, dependable, and ready for real-world use. You will build evaluation infrastructure, testing workflows, and performance measurements for language models, retrieval systems, and automated workflows.

You will collaborate with applied AI engineers, backend engineers, product managers, and other stakeholders to define measurable criteria, translate expectations into tests, and

Qualifikationen

  • 3+ years of machine learning engineering or related field.
  • Experience building production ML systems and validation pipelines.
  • Strong programming skills in Python or TypeScript, and familiarity with ML evaluation.

Aufgaben

  • Build and maintain evaluation systems for AI-powered applications.
  • Develop automated testing frameworks for LLMs and AI workflows.
  • Create representative datasets and benchmarks for model evaluation.
  • Develop evaluation pipelines for prompts, retrieval systems, and model configurations.
  • Test AI assistants against realistic user scenarios and collaboration with cross-functional teams.

Kenntnisse

Python
ML engineering
Testing pipelines
Data analysis
Git
Communication

Tools

Git
SQL
LangSmith
OpenAI API
Claude Code

Jobbeschreibung

Bask Health is seeking a Machine Learning Engineer, Evaluation & Reliability to ensure AI-powered features are accurate, dependable, and ready for real-world use. You will build evaluation infrastructure, testing workflows, and performance measurements for language models, retrieval systems, and automated workflows.

You will collaborate with applied AI engineers, backend engineers, product managers, and other stakeholders to define measurable criteria, translate expectations into tests, and

Hol dir deinen kostenlosen, vertraulichen Lebenslauf-Check.

oder ziehe deine Datei hierhin.

Similar jobs

Ähnliche Jobs, die dir auch gefallen könnten

AI Reliability Engineer — Evaluation & Testing
AI Reliability Engineer — Evaluation & Testing

Bask Health • New York (NY)

Vor Ort
USD 120.000 - 190.000
AI Evaluation & Reliability Engineer
AI Evaluation & Reliability Engineer

Bask Health • USA

Remote
USD 140.000 - 200.000
Senior ML Reliability Engineer - AI Evaluation & HealthTech
Senior ML Reliability Engineer - AI Evaluation & HealthTech

Bask Health • New York (NY)

Vor Ort
USD 180.000 - 240.000
Senior ML Engineer, AI Evaluation & Reliability
Senior ML Engineer, AI Evaluation & Reliability

Bask Health • USA

Remote
USD 150.000 - 210.000
AI Quality Assurance Engineer for Healthcare AI
AI Quality Assurance Engineer for Healthcare AI

Bask Health • Oregon

Hybrid
USD 120.000 - 170.000
AI Evaluation & Quality Assurance Engineer
AI Evaluation & Quality Assurance Engineer

Bask Health • New York (NY)

Vor Ort
USD 120.000 - 170.000
Remote Senior LLM Evaluation & Reliability Engineer
Remote Senior LLM Evaluation & Reliability Engineer

Bask Health • USA

Remote
USD 160.000 - 220.000
Healthcare AI Quality Assurance Engineer
Healthcare AI Quality Assurance Engineer

Bask Health • USA

Remote
USD 120.000 - 180.000
AI Quality & Evaluation Engineer — Backend Tools
AI Quality & Evaluation Engineer — Backend Tools

Bask Health • USA

Remote
USD 120.000 - 180.000
AI Quality & Evaluation Engineer
AI Quality & Evaluation Engineer

Bask Health • New York (NY)

Vor Ort
USD 120.000 - 190.000