Senior AI Inference Architect - Dynamo Platform

NVIDIA; Pennsylvania; On-site; USD 320,000 - 489,000; Full time

Benefits offered by this job

Equity

Benefits package

Job summary

NVIDIA is seeking a Distinguished Engineer to join the Dynamo engineering team to provide deep technical leadership and shape the future of AI inference on NVIDIA hardware. You will drive key initiatives around resiliency, performance, and scalability, and represent Dynamo with customers, partners, and the AI community.

You will contribute to production-grade inference systems, collaborate with storage, networking, hardware, and performance teams, and help ensure Dynamo remains a

Qualifications

• BS, MS, PhD, or equivalent experience in Computer Science, Computer Engineering, Artificial Intelligence or a related field.
• 18+ years of Proven experience in systems software engineering
• Expertise in the AI inference space, such as operating production inference systems at scale, working on inference engines, or similar.
• Experience serving as a senior technical leader in an organization, with the ability to lead through influence.
• Proficiency in programming languages such as Rust, Python, and Go, as well as familiarity with cloud computing platforms (e.g., AWS, GCP, Azure).
• Excellent problem-solving skills, showing proficiency in analyzing complex systems, identifying bottlenecks, and implementing scalable solutions.
• Excellent communication and collaboration skills, demonstrating effectiveness in working with diverse teams and individuals.]
• job_responsibilities_description:["Contribute to the Dynamo family of open source projects.","Serve as a technical expert in AI inferencing, helping to push the frontier of what's possible.","Represent Dynamo and NVIDIA with customers, partners and the AI community.","Lead critical initiatives around resiliency, performance and scalability for Dynamo and AI inference.","Build and drive Dynamo to continue being a production-ready, data center-scale AI inferencing platform.","Collaborate with diverse partner teams at NVIDIA across storage, networking, hardware and performance.","Keep abreast of the latest advancements in AI/ML infrastructure technologies, frameworks, and effective strategies, and promote their implementation within the company."],
• CoT_job_summary_short
• job_summary_short
• contract_type
• location_type
• remote_scope
• perks
• stated_min
• stated_max
• stated_absolute
• salary_estimation_cot
• estimated_low
• estimated_medium
• estimated_high
• currency
• frequency
• bonus
• tax
• application_email
• job_end_date
• contact_person
• hiring_department_name

Responsibilities

• Contribute to the Dynamo family of open source projects.
• Serve as a technical expert in AI inferencing, helping to push the frontier of what's possible.
• Represent Dynamo and NVIDIA with customers, partners and the AI community.
• Lead critical initiatives around resiliency, performance and scalability for Dynamo and AI inference.
• Build and drive Dynamo to continue being a production-ready, data center-scale AI inferencing platform.
• Collaborate with diverse partner teams at NVIDIA across storage, networking, hardware and performance.
• Keep abreast of the latest advancements in AI/ML infrastructure technologies, frameworks, and effective strategies, and promote their implementation within the company.

Skills

Rust

Python

Go

Cloud platforms

Education

BS/MS/PhD in CS/CE/AI or related field

Tools

Inference engines

Production infrastructure

Job description

NVIDIA is seeking a Distinguished Engineer to join the Dynamo engineering team to provide deep technical leadership and shape the future of AI inference on NVIDIA hardware. You will drive key initiatives around resiliency, performance, and scalability, and represent Dynamo with customers, partners, and the AI community.

You will contribute to production-grade inference systems, collaborate with storage, networking, hardware, and performance teams, and help ensure Dynamo remains a