Senior AI Infrastructure Engineer: LLM Agents

NVIDIA

Austin (TX)

On-site

USD 184,000 - 287,500

Full time

14 days+

Get more replies from employers

Send a job-specific resume in minutes.

Benefits offered by this job

Equity
Benefits

Job summary

NVIDIA is seeking a senior software engineer in Austin, TX to design and scale AI infrastructure for copilots and agentic tools. You will partner with researchers to build production‑grade AI workflows and deploy them at scale.

You will own end‑to‑end engineering—from architecture to deployment—while collaborating across hardware, software, and research teams and mentoring peers to uphold technical excellence.

Qualifications

  • MS or higher degree in Computer Science, Engineering, AI, or related field with 5+ years of hands-on software engineering experience.
  • Strong Python skills for designing, prototyping, and productionizing AI-enabled services and tools.
  • Experience building LLM-powered agents or agentic workflows with coding agents.
  • Fundamentals in system design, API design, testing, CI/CD, observability, security, databases, containers, and distributed systems.
  • Ability to turn repetitive workflows into practical AI-enabled tools and automations.

Responsibilities

  • Design, build, and scale infrastructure to support next-generation AI applications, copilots, and agentic tools.
  • Improve architecture, performance, and reliability for LLMs at scale.
  • Collaborate across hardware, software, and research teams; mentor peers and promote engineering excellence.
  • Stay informed on AI infrastructure advances and drive continuous innovation.

Skills

Python
Production software
LLM-powered agents
CI/CD
System design
Communication

Education

MS or higher degree

Tools

Claude Code
OpenAI Codex
Cursor
GitHub Copilot

Job description

NVIDIA is seeking a senior software engineer in Austin, TX to design and scale AI infrastructure for copilots and agentic tools. You will partner with researchers to build production‑grade AI workflows and deploy them at scale.

You will own end‑to‑end engineering—from architecture to deployment—while collaborating across hardware, software, and research teams and mentoring peers to uphold technical excellence.

Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

Senior AI Infrastructure Engineer — Scalable LLM Agents
Senior AI Infrastructure Engineer — Scalable LLM Agents

NVIDIA • Seattle (WA)

On-site
USD 152,000 - 288,000
Equity
Benefits
Senior AI Engineer - LLMs, Agents & Production Systems
Senior AI Engineer - LLMs, Agents & Production Systems

Innovaccer • San Francisco (CA)

On-site
USD 180,000 - 240,000
Generous PTO
Parental Leave
Rewards & Recognition
+1
Lead AI Infra Architect—GPU-Scale Infrastructure
Lead AI Infra Architect—GPU-Scale Infrastructure

NVIDIA • Austin (TX)

On-site
USD 184,000 - 288,000
AI Infrastructure Architect for Agentic LLM Platforms Equity
AI Infrastructure Architect for Agentic LLM Platforms Equity

NVIDIA • Raleigh (NC)

On-site
USD 184,000 - 288,000
LLM-Powered AI Infrastructure Architect (Equity)
LLM-Powered AI Infrastructure Architect (Equity)

NVIDIA • North Carolina

On-site
USD 152,000 - 288,000
Equity
Benefits
Senior AI Factory Architect - Multi-GPU NCCL Expert
Senior AI Factory Architect - Multi-GPU NCCL Expert

NVIDIA • Austin (TX)

On-site
USD 152,000 - 288,000
Equity
Benefits
Senior AI Systems Engineer - Production LLMs & Agents
Senior AI Systems Engineer - Production LLMs & Agents

Permute • Chicago (IL)

On-site
USD 120,000 - 150,000
Junior AI Engineer - LLMs & Agentic AI in Austin
Junior AI Engineer - LLMs & Agentic AI in Austin

Systems Integration Solutions • Austin (TX)

On-site
USD 85,000 - 120,000
Senior Applied AI Engineer
Senior Applied AI Engineer

NVIDIA • Austin (TX)

On-site
USD 184,000 - 288,000
Equity
Benefits
Senior Applied AI Engineer
Senior Applied AI Engineer

NVIDIA • Hillsboro (OR)

On-site
USD 152,000 - 288,000
Equity
Benefits