Staff Software Engineer — Real-Time Inference Systems

Cerebras; Sunnyvale (CA); On-site; USD 140,000 - 210,000; Full time

Job summary

Cerebras Systems in Sunnyvale, CA is looking for a Software Engineer to develop and maintain high-performance, low-latency inference infrastructure. You will deploy and optimize scalable inference services and collaborate with cross-functional teams to deliver production-ready ML infrastructure.

Responsibilities include building Kubernetes-based deployments, configuring auto-scaling, integrating with Docker, and ensuring availability across regions.

Qualifications

• Master's degree in Computer Science or a related field.
• One year of experience as software developer or similar role.
• Full-time or equivalent part-time experience accepted.

Responsibilities

• Implement infrastructure to support high-performance, low-latency inference service.
• Deploy and configure Kubernetes services to ensure scalability and reliability of inference workloads.
• Optimize resource allocation and auto-scaling policies to handle variable inference demand while minimizing costs.
• Integrate inference services with containerized environments using Docker and Kubernetes.
• Ensure high availability and fault tolerance by multi-region deployments and disaster recovery.
• Develop Python-based scripts and APIs for preprocessing, inference, and post-processing.
• Collaborate with ML engineers to validate inference accuracy and latency.
• Triage and resolve defects by analyzing logs, metrics, and traces.
• Debug deployment and networking issues; document root causes.
• Collaborate to address performance regressions and integration failures.
• Develop automated scripts to detect failure modes and improve reliability.
• Author detailed infrastructure docs, workflows, and APIs.
• Work with product and UX teams to define requirements for interfaces and monitoring.

Skills

Infrastructure automation

Load balancing

Monitoring

Troubleshooting

Collaboration

Education

Master's degree in Computer Science or related field

Tools

Docker

Kubernetes

ActiveMQ

Kafka

Python

Groovy

JavaScript/TypeScript

Linux

SQL/OracleDB/Redis

Git

Job description

Cerebras Systems in Sunnyvale, CA is looking for a Software Engineer to develop and maintain high-performance, low-latency inference infrastructure. You will deploy and optimize scalable inference services and collaborate with cross-functional teams to deliver production-ready ML infrastructure.

Responsibilities include building Kubernetes-based deployments, configuring auto-scaling, integrating with Docker, and ensuring availability across regions.