Healthcare AI Engineer: LLMs, Retrieval & RLHF

Discover International; New York (NY); On-site; USD 120,000 - 180,000; Full time

Job summary

Discover International is seeking an ML engineer in New York to advance healthcare AI products. You will adapt and fine-tune LLMs on healthcare data, build retrieval-augmented systems, and design autonomous AI workflows that plan, call tools, and reason through multi-step reviews.

You will work with leadership to set metrics, validate improvements, and ensure secure, cost-effective deployment on sensitive patient information.

Qualifications

• 3+ years building ML or AI systems that real users depend on.
• Production experience with LLM-based agents and retrieval-augmented generation.
• Hands-on fine-tuning with LoRA or similar parameter-efficient methods in PyTorch / Hugging Face.
• Real-world use of RL or preference optimization on language models.
• Excellent Python and engineering discipline, plus a rigorous approach to evaluation.

Responsibilities

• Making models smarter: adapt and fine-tune large language models on specialized healthcare data, and own the training data, runs, and versioning
• Improving learning from experts: turn feedback from in-house medical reviewers into training signal using preference-based methods (DPO, RLHF, reward models)
• Grounding answers in evidence: build retrieval systems so every AI conclusion can be traced back to the document it came from
• Building autonomous workflows: design AI agents that plan, call tools, and reason through multi-step reviews
• Proving it works: set up the metrics and test suites that show whether a change actually helped
• Shipping it: work with engineering and infrastructure teammates to run everything securely, quickly, and cost-effectively on sensitive patient data

Skills

ML systems

LLM agents

Python

RLHF experience

Tools

PyTorch

Hugging Face

Job description

Discover International is seeking an ML engineer in New York to advance healthcare AI products. You will adapt and fine-tune LLMs on healthcare data, build retrieval-augmented systems, and design autonomous AI workflows that plan, call tools, and reason through multi-step reviews.

You will work with leadership to set metrics, validate improvements, and ensure secure, cost-effective deployment on sensitive patient information.