Rust Migration Lead for Ultra-Fast AI Gateway

LiteLLM; San Francisco (CA); On-site; USD 130,000 - 160,000; Full time

Benefits offered by this job

Competitive salary

Health benefits

Dental benefits

Vision benefits

Job summary

LiteLLM is seeking a Rust Engineer to lead the migration from Python to Rust. In this high-stakes role, you will collaborate directly with the CTO, ensuring a performance-focused transition. You will drive improvements across latency and throughput while maintaining stability for our enterprise clients.

The ideal candidate will have extensive Rust experience and a passion for optimizing performance. LiteLLM offers competitive benefits and a fast-paced growth environment.

Qualifications

• You have years of experience writing production Rust code.
• You have a strong focus on performance.
• You have a track record of balancing ambitious change against reliability.

Responsibilities

• Own the end-to-end migration of LiteLLM from Python to Rust.
• Plan the migration with the CTO to minimize risks.
• Design a gradual rollout prioritizing stability.

Skills

Deep expertise in Rust

Performance optimization

Backend infrastructure knowledge

Tools

PostgreSQL

Redis

Job description

LiteLLM is seeking a Rust Engineer to lead the migration from Python to Rust. In this high-stakes role, you will collaborate directly with the CTO, ensuring a performance-focused transition. You will drive improvements across latency and throughput while maintaining stability for our enterprise clients.

The ideal candidate will have extensive Rust experience and a passion for optimizing performance. LiteLLM offers competitive benefits and a fast-paced growth environment.