Staff Software Engineer, Inference Infrastructure

Cerebras Systems; United States; Remote; USD 140,000 - 210,000; Full time

Job summary

Cerebras Systems is seeking a Software Engineer to build and maintain high-performance, low-latency inference infrastructure.

The role emphasizes deploying scalable inference services with Kubernetes, Docker, and Python tooling, collaborating with cross-functional teams to deliver production-ready ML infrastructure.

Candidates have a Master’s in CS, 1 year of related software experience, and a willingness to work in a fast-paced, highly innovative environment.

Qualifications

• Master’s degree in Computer Science or a closely related field.
• At least 1 year of experience as a Software Developer or related role.
• Experience working in production infrastructure is a plus.

Responsibilities

• Implement infrastructure to support high-performance, low-latency inference service.
• Deploy and configure Kubernetes services to ensure scalability and reliability of inference workloads.
• Develop Python-based scripts and APIs to streamline data preprocessing, inference execution, and post-processing for real-time tasks.
• Collaborate with ML engineers to validate inference accuracy and performance against latency requirements.
• Triage and resolve defects by analyzing logs, metrics, and traces.

Skills

Docker

Kubernetes

Java/C++

ActiveMQ/Kafka

Python/Groovy

JavaScript/TypeScript

Linux

SQL/OracleDB/Redis

Git

Education

Master’s degree in Computer Science or related field

Job description

Cerebras Systems is seeking a Software Engineer to build and maintain high-performance, low-latency inference infrastructure.

The role emphasizes deploying scalable inference services with Kubernetes, Docker, and Python tooling, collaborating with cross-functional teams to deliver production-ready ML infrastructure.

Candidates have a Master’s in CS, 1 year of related software experience, and a willingness to work in a fast-paced, highly innovative environment.