Staff Software Engineer, AI Inference

ChatGPT Jobs; New York (NY); On-site; USD 180,000 - 240,000; Full time

Benefits offered by this job

Health Insurance

Equity

Job summary

ChatGPT Jobs seeks a leader to drive the design and development of a production inference platform and to define the technical roadmap for inference infrastructure and model serving.

You will build scalable systems for LLM serving and partner with ML engineers to productionize models, influencing cross-team initiatives and architecture decisions.

Qualifications

• Candidates should have significant experience with production AI inference systems and leadership in LLM serving infrastructure.
• A strong background in distributed systems and proficiency in programming languages such as Python, Go, Rust, or C++ is also required.

Responsibilities

• Lead the design and development of a production inference platform and define the technical roadmap for inference infrastructure and model serving.
• Build scalable systems for LLM serving and partner with ML engineers to productionize models.

Skills

AI Inference

Production Systems

Model Serving

Distributed Systems

Python

Go

Rust

C++

GPU Inference

Backend Infrastructure

High-Performance Engineering

Technical Architecture

Communication

Cross-Team Influence

Optimization

Monitoring

Job description

Lead the design and development of a production inference platform while defining the technical roadmap for inference infrastructure and model serving. Build scalable systems for LLM serving and partner with ML engineers to productionize models.

Requirements

Candidates should have significant experience with production AI inference systems and leadership in LLM serving infrastructure. A strong background in distributed systems and proficiency in programming languages such as Python, Go, Rust, or C++ is also required.

Key Skills

• AI Inference
• Production Systems
• Model Serving
• Optimization
• Monitoring
• Distributed Systems
• Backend Infrastructure
• High-Performance Engineering
• GPU Inference
• Python
• Go
• Rust
• C++
• Technical Architecture
• Communication
• Cross-Team Influence

Benefits

• Health Insurance
• Equity