AI System Software Engineer: Agentic Retrieval on GPUs

NVIDIA Corporation

California

On-site

USD 184,000 - 357,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Equity and benefits
Performance rewards

Job summary

NVIDIA Corporation in California is seeking a System Software Engineer - Agentic Retrieval to develop GPU-accelerated pipelines for indexing and querying multi-modal content, collaborating with top-tier researchers in Generative AI, LLM, and Agentic Retrieval.

The role focuses on building scalable data preparation pipelines, deduplication, filtering, and classification for training corpora, with micro-optimizations, prompt engineering, and production-grade tooling in a fast-moving environment.

Qualifications

  • Bachelor’s or Master’s Degree in Computer Science, Computer Engineering, or related field or equivalent experience.
  • 6+ years of experience in a similar or related role.
  • Experience delivering software in a cloud context and familiarity with cloud infrastructure patterns.
  • Knowledge of MLOps technologies such as Docker-Compose, Containers, Kubernetes, data center deployments, etc.
  • Excellent understanding of NLP, LLM, VLM, Generative AI, and Agentic Retrieval workflows.
  • Self-starter with growth mindset and willingness to share findings.
  • Strong communication skills for distilling complex topics clearly.
  • Ability to work with multi-functional teams across geographies.

Responsibilities

  • Develop and optimize Rust-based data processing frameworks on GPU-accelerated environments.
  • Lead development and optimization of Agentic Retrieval pipelines with GPU acceleration for best models and lower TCO.
  • Collaborate with LLM/ML researchers to build full-stack, GPU-accelerated data prep pipelines and optimize algorithms in Python.
  • Work with teams to build roadmaps for production tools and library features in the LLM ecosystem.
  • Build products to improve employee productivity using Gen-AI and copilots.
  • Create integrated systems for unified experiences across applications and end-to-end user insights.
  • Support CD pipeline to move changes to production quickly and safely with operational standards.
  • Provide peer reviews and promote adoption of new frameworks and technologies.

Skills

Rust
GPU programming
Python
NLP/LLM knowledge
Cloud experience
Team collaboration

Education

Bachelor’s or Master’s Degree in CS/CE or related

Tools

Docker-Compose
Kubernetes
Containers

Job description

NVIDIA Corporation in California is seeking a System Software Engineer - Agentic Retrieval to develop GPU-accelerated pipelines for indexing and querying multi-modal content, collaborating with top-tier researchers in Generative AI, LLM, and Agentic Retrieval.

The role focuses on building scalable data preparation pipelines, deduplication, filtering, and classification for training corpora, with micro-optimizations, prompt engineering, and production-grade tooling in a fast-moving environment.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Agentic Retrieval Systems Engineer – LLM Pipelines
Senior Agentic Retrieval Systems Engineer – LLM Pipelines

NVIDIA Corporation • Santa Clara (CA)

On-site
USD 184,000 - 357,000
Equity
Benefits
Senior System Software Engineer, Agentic Retrieval
Senior System Software Engineer, Agentic Retrieval

NVIDIA Corporation • California

On-site
USD 184,000 - 357,000
Equity and benefits
Performance rewards
Senior System Software Engineer, Agentic Retrieval
Senior System Software Engineer, Agentic Retrieval

NVIDIA Corporation • Santa Clara (CA)

On-site
USD 184,000 - 357,000
Equity
Benefits
Senior Agentic AI Engineer for GPU Software
Senior Agentic AI Engineer for GPU Software

NVIDIA Corporation • United States

On-site
USD 184,000 - 357,000
Senior System Software Engineer, Agentic Retrieval
Senior System Software Engineer, Agentic Retrieval

NVIDIA Corporation • Redmond (WA)

On-site
USD 180,000 - 240,000
Equity
Benefits
Senior AI Platform Engineer – Agentic & RAG
Senior AI Platform Engineer – Agentic & RAG

NVIDIA Corporation • Santa Clara (CA)

On-site
USD 248,000 - 391,000
Equity
Benefits
Agentic AI Systems Engineer — GPU Kernel (Equity)
Agentic AI Systems Engineer — GPU Kernel (Equity)

NVIDIA Corporation • Santa Clara (CA)

On-site
USD 184,000 - 357,000
Equity
Benefits
Agentic AI Kernel Engineer — GPU Automation
Agentic AI Kernel Engineer — GPU Automation

NVIDIA Corporation • Santa Clara (CA)

On-site
USD 184,000 - 357,000
Senior AI Researcher: Agentic Systems at Scale (Equity)
Senior AI Researcher: Agentic Systems at Scale (Equity)

NVIDIA Corporation • Austin (TX)

On-site
USD 188,000 - 364,000
Equity
Benefits
Agentic AI Systems Intern: Research & Engineering
Agentic AI Systems Intern: Research & Engineering

NVIDIA Corporation • Santa Clara (CA)

On-site
USD 28,000 - 129,000
Intern benefits