Senior AI Engineer - LLMs, Agents & Production Systems

Innovaccer; San Francisco (CA); On-site; USD 180,000 - 240,000; Full time

Benefits offered by this job

Generous PTO

Parental Leave

Rewards & Recognition

Insurance Benefits

Job summary

Innovaccer is seeking a Senior AI Engineer to join our AI team and build production-grade AI systems at scale.

You will collaborate with product, engineering, and data teams to design, develop, and deploy AI-powered applications, including LLM-based solutions, AI agents, and retrieval-augmented generation workflows.

You will drive end-to-end development from experimentation to production, tackle performance and latency, and communicate complex AI concepts to non-technical stakeholders.

Qualifications

• PhD/MS in CS/ML or related quantitative field; exceptional BS with research/open-source work considered.
• First-author publications at NeurIPS/ICML/ICLR/ACL/EMNLP or similar; meaningful open-source ML contributions; modeled shipped to production.
• Fine-tuned open-weight models; explain choice between parameter-efficient vs full fine-tuning; strong Python/PyTorch skills.

Responsibilities

• Take ideas from concept to prototype to production.
• Build the model layer of a real product and meet product-level accuracy targets.
• Write production-grade code in Python; optimize training performance and system design.
• Design experiments, state hypotheses, run ablations, and report results.
• Explain AI work to clinicians and operators; collaborate across teams.
• Mentor or guide other engineers as the team grows.

Skills

Python

PyTorch

Multi-GPU training

Model fine-tuning

Experiment design

Production systems

Education

MS or PhD in CS/ML

Tools

HuggingFace

DeepSpeed

vLLM

SGLang

FSDP

Job description

Innovaccer is seeking a Senior AI Engineer to join our AI team and build production-grade AI systems at scale.

You will collaborate with product, engineering, and data teams to design, develop, and deploy AI-powered applications, including LLM-based solutions, AI agents, and retrieval-augmented generation workflows.

You will drive end-to-end development from experimentation to production, tackle performance and latency, and communicate complex AI concepts to non-technical stakeholders.