AI Engineer – Healthcare Claims & Agents

Alaffia Health; New York (NY); On-site; USD 170,000 - 230,000; Full time

Benefits offered by this job

Competitive Compensation

Medical, Dental, and Vision benefits

Flexible, paid vacation policy

Flat organizational structure—directly

Job summary

Alaffia Health, a NYC-based healthcare AI startup, is seeking an AI Engineer to build the intelligence behind its AI agents. You will design, implement, and refine agentic systems, including planning, tool use, and multi-step reasoning over claims data and medical records.

You will develop and fine-tune LLMs on healthcare data, build RAG pipelines, and apply RLHF and other RL techniques to improve agent performance.

Qualifications

• 3+ years of experience in applied ML or AI engineering.
• Strong software engineering fundamentals and proficiency in Python.
• Experience developing AI agents and agentic workflows.
• Hands-on experience with LLM fine-tuning (SFT/LoRA) and training pipelines.
• Proven experience building production RAG systems with vector databases.
• Experience with reinforcement learning for LLMs (RLHF, DPO, PPO) and evaluation methodologies.

Responsibilities

• AI Agent Development: design and build single- and multi-agent systems for claim review.
• RAG Development: build and optimize retrieval-augmented generation pipelines over policies and records.
• LLM Development & Fine-Tuning: fine-tune LLMs on domain-specific data and manage datasets.
• Reinforcement Learning: develop RL-based training and alignment methods with human feedback.
• Evaluation & Experimentation: define benchmarks and track experiments rigorously.
• Production Integration: deploy models and agents to production with collaboration across teams.
• Compliance & Safety: ensure PHI handling and HIPAA compliance.

Skills

AI agent development

Python

LLM fine-tuning

Reinforcement learning

RAG systems

Evaluation & experiment tracking

Tools

PyTorch

Hugging Face

LangChain

LangGraph

Weights & Biases

vLLM

Job description

Alaffia Health, a NYC-based healthcare AI startup, is seeking an AI Engineer to build the intelligence behind its AI agents. You will design, implement, and refine agentic systems, including planning, tool use, and multi-step reasoning over claims data and medical records.

You will develop and fine-tune LLMs on healthcare data, build RAG pipelines, and apply RLHF and other RL techniques to improve agent performance.