Senior AI Quality & Evaluation Scientist (Remote)

Ellipsis Health Inc.; San Francisco, Northern (CA, KY); Hybrid; USD 180,000 - 230,000; Full time

Benefits offered by this job

401k matching

Flexible paid time off

Health insurance

Job summary

Ellipsis Health Inc. is seeking a Senior Data Scientist focused on AI quality and evaluation. You will own data science projects end-to-end, build evaluation frameworks, and design datasets to improve AI products and customer onboarding.

You will collaborate with AI/ML engineers and product managers, mentor junior data scientists, and contribute to a fast-paced health-tech environment with remote-friendly options in the U.S.

Qualifications

• 5+ years in data science, ML or related field.
• Degree in CS, Data Science, Stats, Math or related field.
• Strong Python proficiency with data libs.
• Experience with large-scale datasets and data pipelines.
• Familiarity with evaluation metrics and A/B testing.

Responsibilities

• Own data science and AI evaluation projects end-to-end.
• Build data and evaluation infrastructure for AI quality systems.
• Design and implement evaluation frameworks and metrics.
• Create and manage datasets for training and benchmarking.
• Develop scalable data pipelines and dashboards for monitoring.

Skills

Python

Data science

Machine learning

Pydantic

Pandas

NumPy

Scikit-learn

Education

Bachelor's in CS/Data Science

Master's degree preferred

Tools

Databricks

GCP

AWS

Langfuse

Job description

Ellipsis Health Inc. is seeking a Senior Data Scientist focused on AI quality and evaluation. You will own data science projects end-to-end, build evaluation frameworks, and design datasets to improve AI products and customer onboarding.

You will collaborate with AI/ML engineers and product managers, mentor junior data scientists, and contribute to a fast-paced health-tech environment with remote-friendly options in the U.S.