Senior AI Model Customization & Deployment Engineer

NVIDIA Gruppe; Santa Clara (CA); On-site; USD 184,000 - 288,000; Full time

Benefits offered by this job

Equity

Benefits

Job summary

NVIDIA is seeking a Senior Software Engineer for the NIM Tools team in Santa Clara, CA. You will shape a new product surface for ISVs and CSPs, enabling model selection, fine-tuning, evaluation, deployment, and compliance within a unified lifecycle platform.

You will lead the development of a scalable fine-tuning pipeline, robust evaluation harness, and auditable compliance artifacts while collaborating with cross-functional teams to define durable APIs and drive large-scale deployment.

Qualifications

• Bachelor’s degree in Computer Science, Engineering, or equivalent experience.
• Experience with model customization tools: LoRA, QLoRA, SFT, RL, DPO, and RAG.
• 7+ years of experience with LLM serving infrastructure (vLLM, TRT-LLM, or equivalent).
• Deep understanding of model quantization and fine-tuning workflows.
• Demonstrated history of developing robust platform APIs.
• Strong collaborative skills in cross-functional teams.
• Outstanding problem-solving and attention to detail.

Responsibilities

• Compose and build the fine-tuning handoff pipeline, including LoRA adapter repackaging, re-quantization, and re-validation into NIM.
• Develop the evaluation harness to ensure models meet high standards.
• Implement the observability and attestation layer for auditable compliance artifacts.
• Collaborate with ISVs and CSPs to roll out NVIDIA NIMs at scale.
• Define and improve durable platform APIs, avoiding one-off integrations.
• Ensure flawless project completion with meticulous detail and proven methodologies.

Skills

LLM serving infra

LoRA / QLoRA tooling

SFT / RL / DPO

RAG concepts

API design

Cross-functional teamwork

Education

Bachelor's degree in CS/Engineering

Tools

vLLM

TRT-LLM

Job description

NVIDIA is seeking a Senior Software Engineer for the NIM Tools team in Santa Clara, CA. You will shape a new product surface for ISVs and CSPs, enabling model selection, fine-tuning, evaluation, deployment, and compliance within a unified lifecycle platform.

You will lead the development of a scalable fine-tuning pipeline, robust evaluation harness, and auditable compliance artifacts while collaborating with cross-functional teams to define durable APIs and drive large-scale deployment.