Senior AI Platform Engineer — RAG & Agentic AI

Nvidia Corporation in; Santa Clara (CA); On-site; USD 200,000 - 322,000; Full time

Benefits offered by this job

Equity

Benefits

Job summary

NVIDIA is seeking a Senior Software Engineer to lead platform engineering for AI-powered finance solutions. You will architect and build scalable, agent-based AI systems using LLMs, RAG, and multi-agent coordination to transform enterprise workflows.

Collaborate with Cloud, AI/ML teams in a fast-paced, hybrid environment. You will mentor engineers, define best practices for safety, evaluation, and observability, and stay at the cutting edge of agent frameworks and open-source ecosystems.

Qualifications

• 12+ years of experience building large-scale distributed systems and cloud-native apps (Python preferred).
• Strong programming skills across multiple languages and modern software stacks.
• Hands-on experience with test automation, production testing, and automation frameworks.
• Solid understanding of Linux, embedded systems, firmware, and hardware/software integration.
• Deep knowledge of IT Service Management (ITSM) and ServiceNow (HR, Security, Finance modules preferred).
• Strong experience designing and deploying LLM-powered systems, including RAG, tool use, and agent-based architectures.
• Deep understanding of agentic AI paradigms (planning, memory, tool invocation, multi-step reasoning).
• Proven ability to design systems with high reliability, scalability, and performance.
• Hands-on experience deploying applications in Kubernetes environments. Experience building systems in cloud and hybrid environments.
• Proven track record leading complex technical initiatives and mentoring high-performing teams.

Responsibilities

• Collaborate with cross-functional teams to deliver end-to-end intelligent experiences across applications
• Ensure reliability, safety, and performance of autonomous systems operating at scale
• Integrate agents with enterprise data sources, APIs, and internal microservices to enable real-world actions
• Architect and build agentic AI systems that leverage LLMs for reasoning, planning, and tool orchestration across enterprise workflows
• Develop scalable platforms for retrieval-augmented generation (RAG), long-term memory, and contextual reasoning
• Build reusable infrastructure for agent orchestration, tool integration, evaluation, and observability
• Establish best practices for agent evaluation, guardrails, and human-in-the-loop workflows
• Mentor engineers and provide technical leadership in designing complex distributed AI systems
• Stay at the forefront of advancements in LLMs, agent frameworks, tool use, reasoning architectures, and open-source ecosystems

Skills

Multilang programming

Automation frameworks

Kubernetes

Cloud/hybrid environments

ITSM/ServiceNow

LLM/agent frameworks

System design & scalability

Education

Bachelor's or Master's in CS or related

Tools

LangChain

Cloud platforms

Kubernetes

Job description

NVIDIA is seeking a Senior Software Engineer to lead platform engineering for AI-powered finance solutions. You will architect and build scalable, agent-based AI systems using LLMs, RAG, and multi-agent coordination to transform enterprise workflows.

Collaborate with Cloud, AI/ML teams in a fast-paced, hybrid environment. You will mentor engineers, define best practices for safety, evaluation, and observability, and stay at the cutting edge of agent frameworks and open-source ecosystems.