Senior Software Engineer, NIM Model Customization

NVIDIA AI; Santa Clara (CA); On-site; USD 180,000 - 290,000; Full time

Benefits offered by this job

Equity

Generous benefits package

Job summary

NVIDIA AI in Santa Clara is seeking a senior ML platform engineer to build a model customization and deployment lifecycle platform, including fine-tuning pipelines and evaluation harnesses.

You will develop platform APIs and observability layers to ensure auditable compliance for ISVs and CSPs, collaborating across teams to deliver robust LLM serving infrastructure.

Qualifications

• Bachelor's degree in Computer Science or Engineering.
• 7+ years of experience with LLM serving infrastructure.
• Deep expertise in model quantization, fine-tuning workflows (LoRA, SFT), and robust API development.

Responsibilities

• Build a model customization and deployment lifecycle platform.
• Develop platform APIs and observability layers to ensure auditable compliance for ISVs and CSPs.

Skills

LoRA

QLoRA

Supervised Fine-Tuning

Reinforcement Learning

Preference Optimization

Retrieval-Augmented Generation

vLLM

TRT-LLM

Model Quantization

Platform API Development

LLM Serving Infrastructure

Model Evaluation

Observability

Compliance Auditing

Cross-functional Collaboration

Education

Bachelor's degree in Computer Science or Engineering

Job description

Build a model customization and deployment lifecycle platform, including fine-tuning pipelines and evaluation harnesses. Develop platform APIs and observability layers to ensure auditable compliance for ISVs and CSPs.

Requirements:

Requires a Bachelor's degree in Computer Science or Engineering and over 7 years of experience with LLM serving infrastructure. Must have deep expertise in model quantization, fine-tuning workflows (LoRA, SFT), and robust API development.

Key Skills:

• LoRA
• QLoRA
• Supervised Fine-Tuning
• Reinforcement Learning
• Preference Optimization
• Retrieval-Augmented Generation
• vLLM
• TRT-LLM
• Model Quantization
• Platform API Development
• LLM Serving Infrastructure
• Model Evaluation
• Observability
• Compliance Auditing
• Cross-functional Collaboration

Benefits:

• Equity
• Generous benefits package