Software Engineer, Model Routing & Inference

Cursor; San Francisco, New York (CA, NY); On-site; USD 140,000 - 210,000; Full time

Job summary

Cursor is hiring a Software Engineer for the Model Routing & Inference team. You will build the inference platform that powers every AI interaction in the product, handling every agent session, tab completion, and chat message through the stack.

You will design high-throughput, low-latency systems, reason about cost/performance tradeoffs at scale, and ship production software that supports millions of requests. You'll collaborate across research and engineering to continuously improve the system.

Qualifications

• Experience building high-throughput, low-latency distributed systems.
• Experience with inference serving and model routing.
• Ability to optimize GPU utilization and provider economics.
• Strong software engineering fundamentals and production systems experience.

Responsibilities

• Own the inference platform powering AI interactions.
• Improve throughput, latency, and reliability at scale.
• Implement cross-provider routing and failover.
• Collaborate with research, product, and engineering teams on architecture.

Skills

Distributed systems

Inference serving

Traffic routing

Real-time data

Cost optimization

Job description

Cursor is hiring a Software Engineer for the Model Routing & Inference team. You will build the inference platform that powers every AI interaction in the product, handling every agent session, tab completion, and chat message through the stack.

You will design high-throughput, low-latency systems, reason about cost/performance tradeoffs at scale, and ship production software that supports millions of requests. You'll collaborate across research and engineering to continuously improve the system.