Senior LLM Systems Engineer, NeMo Microservices Platform

NVIDIA; Washington (District of Columbia); On-site; USD 148,000 - 288,000; Full time

Job summary

NVIDIA is seeking a Senior LLM Systems Engineer for their NeMo Microservices Platform in Washington, DC. This role focuses on developing AI solutions for speech and NLP technologies, requiring strong expertise in microservices and cloud applications. Candidates should have a degree in computer science and significant experience in relevant technologies.

Qualifications

• 5+ years of relevant experience required.
• Ability to work independently and manage development efforts.
• Understanding of performance, security, and reliability in distributed systems.

Responsibilities

• Develop distributed cloud applications and microservices.
• Implement core infrastructure for cloud-native AI evaluation.
• Enhance service stability and optimize performance.

Skills

Microservices

Cloud-native applications

Python programming

Performance tuning

Service health analysis

Education

BSc, MSc in computer science or related fields

Job description

NVIDIA District of Columbia, United States

Join or sign in to find your next job

Join to apply for the Senior LLM Systems Engineer, NeMo Microservices Platform role at NVIDIA

NVIDIA District of Columbia, United States

1 day ago Be among the first 25 applicants

Join to apply for the Senior LLM Systems Engineer, NeMo Microservices Platform role at NVIDIA

NVIDIA has been transforming computer graphics, PC gaming, and accelerated computing for more than 25 years. It’s a legacy of innovation fueled by great technology and talented people. Today, NVIDIA is leveraging AI to define the next era of computing, where GPUs enable computers, robots, and self-driving cars to understand the world. We seek visionaries and innovators to join our diverse and supportive environment to make a lasting impact.

Role Overview:

We are seeking a Senior LLM Systems Engineer to develop our NeMo Microservice Platform, building primitives that enable software engineers to train and deploy AI at scale. Our focus is on speech and NLP technologies that address real-world problems, covering all stages of the machine learning lifecycle from conceptualization to deployment.

Responsibilities:

• Develop distributed cloud applications, microservices, and platforms capable of scaling to large models.
• Create microservices for AI cloud services tailored to specific tasks.
• Implement core infrastructure for cloud-native AI evaluation.
• Enhance service stability, observability, and reliability.
• Optimize performance to achieve high-speed processing under heavy load.

Qualifications:

• BSc, MSc, or equivalent in computer science, computer engineering, or related fields.
• 5+ years of relevant experience.
• Ability to work independently, define project goals, engage with open source communities, and manage development efforts.
• Experience with microservices and cloud-native applications using HTTP REST, gRPC, protobuf, JSON, and related technologies.
• Understanding of performance, security, and reliability in complex distributed systems.
• Proficiency in Python programming, including debugging, performance tuning, service health analysis, and testing.

Preferred Skills:

• Experience with enterprise software lifecycle.
• Background in deep learning research, especially model evaluation techniques.
• Knowledge of Rust or Golang.

The base salary range is $148,000 - $287,500, determined by location, experience, and internal pay scales. Additional benefits and equity are offered. NVIDIA accepts applications continuously and values diversity, being an equal opportunity employer.

Additional Details:

• Seniority level: Mid-Senior level
• Employment type: Full-time
• Industries: Computer Hardware Manufacturing, Software Development, Electronics