Senior Software Engineer, Agentic AI Libraries

NVIDIA; New York (NY); On-site; USD 184,000 - 288,000; Full time

Job summary

NVIDIA is seeking an experienced Software Engineer to build core libraries for agentic applications. You will contribute to scalable autonomous systems, optimize agent pipelines, and collaborate with researchers to advance agent architectures and tooling.

You will work with open-source libraries, AI-driven workflows, and GPU-accelerated pipelines, delivering robust, high-quality components for next-generation agents. The role emphasizes performance, reliability, and cross-language APIs.

Qualifications

• Bachelor’s or Master’s degree in Computer Science, AI, Applied Math, or related field, or equivalent experience.
• 8+ years experience in Rust, Python, Go, or Node.js, with familiarity in at least one other language.
• Strong understanding of asynchronous programming, callbacks, request lifecycles, and event-driven systems.
• Hands-on experience with evolving agent architectures, multiple agents frameworks and agent harnesses.
• Proficiency in LLM applications, agent workflows, tool calls, and model-provider APIs.
• Ability to design or extend cross-language APIs with consistency, usability, stability, and backwards compatibility.
• Systems-level debugging and performance intuition to trace execution and optimize hot paths.
• Strong interpersonal skills for collaboration with the open source community.

Responsibilities

• Track and understand evolving agent development patterns across NVIDIA and the broader ecosystem.
• Develop open-source libraries and tools that accelerate and optimize agent harnesses and frameworks.
• Benchmark the latest agents to identify bottlenecks and build performance improvements.
• Collaborate with teams building data pipelines, RAG systems, vector databases, and GPU-optimized training/inference workflows.
• Identify gaps in current agent architectures and translate insights into tools that boost developer velocity and agent quality.

Skills

Rust

Python

Go

Node.js

Education

Bachelor’s or Master’s degree in Computer Science / AI / Applied Math

Tools

Tokio

Serde

OpenTelemetry

LLM APIs

Agent frameworks

Job description

NVIDIA is seeking an experienced Software Engineer to build core libraries for agentic applications. You will contribute to scalable autonomous systems, optimize agent pipelines, and collaborate with researchers to advance agent architectures and tooling.

You will work with open-source libraries, AI-driven workflows, and GPU-accelerated pipelines, delivering robust, high-quality components for next-generation agents. The role emphasizes performance, reliability, and cross-language APIs.