Senior Inference Backend Engineer – Scaled AI Cloud

Lambda; San Francisco (CA); On-site; USD 325,000 - 490,000; Full time

Benefits offered by this job

Health, dental, and vision coverage

401k Plan with 2% company match

Flexible Paid Time Off Plan

Job summary

Lambda is seeking a Senior Software Engineer to build and optimize a distributed inference backend for real-time AI model deployment. The role demands presence in the San Francisco office four days a week, focusing on developing high-throughput systems and collaborating with internal ML researchers.

Applicants should have over 5 years of software engineering experience, with strong skills in Go or Python and some machine learning exposure. Competitive salary ranges from $325,000 to $490,000 annually, based on qualifications.

Qualifications

• 5+ years of experience as a software engineer in production services.
• 1+ year of experience in machine learning; inference experience preferred.
• Ability to manage shifting priorities in a rapid deployment environment.
• Willingness to take ownership of projects.

Responsibilities

• Develop and optimize a distributed inference backend for real-time AI.
• Build a high-throughput, low-latency API and routing system.
• Collaborate with ML researchers to enhance inference engines.

Skills

Go

Python

Product-focused engineering

Machine learning

Real-time web traffic management

Tools

Kubernetes

Rust

Job description

Lambda is seeking a Senior Software Engineer to build and optimize a distributed inference backend for real-time AI model deployment. The role demands presence in the San Francisco office four days a week, focusing on developing high-throughput systems and collaborating with internal ML researchers.

Applicants should have over 5 years of software engineering experience, with strong skills in Go or Python and some machine learning exposure. Competitive salary ranges from $325,000 to $490,000 annually, based on qualifications.