AI Engineer: LLMs, RAG & Production Systems

Innovaccer Analytics; San Francisco (CA); On-site; USD 140,000 - 210,000; Full time

Benefits offered by this job

Generous PTO

Parental Leave

Rewards & Recognition

Insurance Benefits

Job summary

Innovaccer is hiring an AI Engineer to design, develop, and deploy AI-powered applications at scale. You will work with product, engineering, and data teams to build LLM-based solutions, AI agents, RAG, and intelligent automation workflows.

The role emphasizes hands-on work across experimentation to production deployment, with a focus on system efficiency and product-level accuracy. You will communicate findings to clinicians and operators and contribute to a diverse, inclusive team.

Qualifications

• MS or PhD in Computer Science, Machine Learning, or related quantitative field; exceptional BS candidates considered.
• First-author publications at NeurIPS, ICML, ICLR, ACL, EMNLP, or similar; meaningful open-source ML contributions; AI lab internship or shipped models.
• Fine-tuned an open-weight model yourself; can explain parameter-efficient vs full fine-tuning.
• Strong Python and PyTorch; familiarity with training/serving stacks like HuggingFace, FSDP/DeepSpeed, vLLM.
• Exposure to multi-GPU training; understands sharding strategies and their importance.
• Proven ability to finish projects and ship work.

Responsibilities

• Take ideas from paper to prototype to production and ship end-to-end AI features.
• Build the model layer of a real product, select model sizes, and meet product-level accuracy.
• Write real code in Python; optimize training speed and systems performance.
• Design experiments with hypotheses, ablations, and report results vs expectations.
• Measure and validate results; build evaluation before modeling.
• Explain work to non-AI clinicians and operators and incorporate feedback.

Skills

Python

PyTorch

LLM understanding

Experimentation

System performance

Education

MS or PhD in CS/ML

BS with strong research/open-source work

Tools

HuggingFace

DeepSpeed

vLLM

SGLang

FSDP

Job description

Innovaccer is hiring an AI Engineer to design, develop, and deploy AI-powered applications at scale. You will work with product, engineering, and data teams to build LLM-based solutions, AI agents, RAG, and intelligent automation workflows.

The role emphasizes hands-on work across experimentation to production deployment, with a focus on system efficiency and product-level accuracy. You will communicate findings to clinicians and operators and contribute to a diverse, inclusive team.