Senior AI Engineer: Build Production-Grade AI at Scale

Socket.dev; San Francisco (CA); On-site; USD 170,000 - 260,000; Full time

Benefits offered by this job

Generous PTO

Parental Leave

Rewards & Recognition

Insurance Benefits

Job summary

Innovaccer seeks a Senior AI Engineer to join our AI team and build production-grade AI systems that solve complex problems at scale. You will collaborate with product, engineering, and data teams to design, develop, and deploy AI-powered applications, including LLM-based solutions, AI agents, retrieval-augmented generation (RAG), and intelligent automation workflows.

The ideal candidate is hands-on, curious, and capable of taking ideas from prototype to production, writing Python and PyTorch

Qualifications

• MS or PhD in Computer Science, Machine Learning, or a related quantitative field. Exceptional BS candidates with substantial research or open-source work will be considered.
• First-author publications at NeurIPS, ICML, ICLR, ACL, EMNLP, or similar; meaningful open-source ML contributions; a research internship at an AI lab; or models you trained and shipped that people actually used.
• You have fine-tuned an open-weight model yourself, understand the difference between parameter-efficient and full fine-tuning, and can explain why you chose one.
• Strong Python and PyTorch. Familiarity with the current training and serving stack (HuggingFace, FSDP or DeepSpeed, vLLM or SGLang, or equivalents).
• Some exposure to multi-GPU training, even at lab scale. You should know what a sharding strategy is and why it matters.
• Evidence you can finish things.
• You have post-trained models that ran in production and you know what broke.
• You have built the model layer behind a real product feature, including fine-tuning at more than one model size and composing multiple models into a system that met a production accuracy and latency bar.
• Hands-on multi-node training experience, tens of GPUs at minimum, on models in the tens of billions of parameters or larger.
• You have built or substantially owned a data pipeline that fed a real training run, including the unglamorous parts: dedup, filtering, decontamination, format normalization.
• You can scope an ambiguous problem into a plan and tell the difference between a research question and an engineering task.
• Mentoring or setting direction for other engineers is a plus and will matter more as the team grows.

Responsibilities

• Design, develop, and deploy AI-powered applications including LLM-based solutions, AI agents, retrieval-augmented generation (RAG), and intelligent automation workflows.
• Work closely with product, engineering, and data teams to design, develop, and deploy AI-powered applications.
• Help build intelligent, production-grade AI systems across the full AI development lifecycle—from experimentation to production deployment and optimization.
• You write real code in Python and PyTorch, build model layers, and ensure production readiness.
• Design experiments, state hypotheses, run ablations, and report results that validate or challenge assumptions.
• Explain your work to non-AI stakeholders including clinicians and operators who will use the outputs.

Skills

Python

PyTorch

Experiment design

Production deployment

Multi-GPU training

Data pipelines

Education

MS/PhD in CS/ML

Strong research/open-source work

Tools

HuggingFace

DeepSpeed

FSDP

vLLM

SGLang

Job description

Innovaccer seeks a Senior AI Engineer to join our AI team and build production-grade AI systems that solve complex problems at scale. You will collaborate with product, engineering, and data teams to design, develop, and deploy AI-powered applications, including LLM-based solutions, AI agents, retrieval-augmented generation (RAG), and intelligent automation workflows.

The ideal candidate is hands-on, curious, and capable of taking ideas from prototype to production, writing Python and PyTorch