Senior AI Engineer: End-to-End LLM & Production (Remote)

Incredible Health; United States; Remote; USD 180,000 - 260,000; Full time

Benefits offered by this job

Competitive salary

Medical, dental, and vision coverage

401(k) plan

Unlimited vacation

Family leave

Job summary

Incredible Health is seeking a senior software/ML engineer to own end-to-end AI product development, shipping features from prototype to production. You will work on the full stack—Python ML services, Rails and React web app—and drive evals, AB tests, and model improvements that impact healthcare hiring.

This fully remote role spans the US, with a fast-moving, high‑caliber team of engineers, data scientists, and product partners.

Qualifications

• 6+ years of software engineering with 2+ years delivering ML/LLM features to production.
• Strong Python software engineering skills with retrain/embedding pipelines and eval harness.
• Experience evaluating non-deterministic systems with golden datasets and regression tests.
• Foundations in ML—classification, ranking, model evaluation, offline metrics.
• Production LLM experience (prompting, tool calls, structured outputs) and SQL-driven analysis.

Responsibilities

• Lead end-to-end ML product development using foundation models and evals.
• Own matching, search, ranking; model design, offline validation, shadow-score, AB tests.
• Ship production code across Python, Rails, React; diagnose issues like hallucinations.
• Turn ambiguous questions into production data analyses and improve via reviews.

Skills

ML engineering

Python programming

LLM production

Evaluation pipelines

SQL data analysis

Tools

Python/FastAPI

Celery

Rails

React

ElasticSearch

Embeddings

Snowflake

dbt

Job description

Incredible Health is seeking a senior software/ML engineer to own end-to-end AI product development, shipping features from prototype to production. You will work on the full stack—Python ML services, Rails and React web app—and drive evals, AB tests, and model improvements that impact healthcare hiring.

This fully remote role spans the US, with a fast-moving, high‑caliber team of engineers, data scientists, and product partners.