Member of Technical Staff (Software Engineer)

Cerebras Systems, Inc.; Sunnyvale (CA); On-site; USD 110,000 - 140,000; Full time

Job summary

Cerebras Systems, Inc. is seeking a Software Engineer in Sunnyvale, California to enhance high-performance, low-latency inference infrastructure. This role involves deploying scalable services, optimizing resource allocation, and integrating with containerized environments like Docker and Kubernetes.

The ideal candidate holds a Master’s in Computer Science and has at least one year of development experience, along with expertise in Docker, Kubernetes, Java, and Python. Join us in building revolutionary AI technology!

Qualifications

• One year of experience in software development or related roles.
• Experience can include internships or technical roles during graduate studies.

Responsibilities

• Implement infrastructure for low-latency inference services.
• Deploy and configure Kubernetes for scalability and reliability.
• Optimize resource allocation and auto-scaling policies.
• Integrate services with Docker and Kubernetes.
• Ensure high availability with multi-region deployments.
• Develop Python scripts for real-time inference tasks.
• Collaborate with engineers to validate performance.
• Document technical configurations and workflows.

Skills

Docker

Kubernetes

Java

C++

ActiveMQ

Kafka

Python

Groovy

JavaScript

TypeScript

Linux

SQL

OracleDB

Redis

Git

Education

Master's degree in Computer Science or a related field

Job description

Cerebras Systems builds the world's largest AI chip, 56 times larger than GPUs. This architecture allows Cerebras to deliver industry-leading training and inference speeds; over 10 times faster than GPU-based hyperscale cloud inference services. The increase in speed is transforming the user experience of AI applications, unlocking real-time iteration and increasing intelligence via additional agentic computation. Cerebras works with leading model labs, global enterprises, and cutting‑edge AI‑native startups. OpenAI recently announced a multi‑year partnership with Cerebras to deploy 750 megawatts of scale, transforming key workloads with ultra‑high‑speed inference.

About The Role

We are seeking a Software Engineer to develop and maintain high-performance, low-latency inference infrastructure. This role focuses on deploying and optimizing scalable inference services, collaborating with cross‑functional teams, and ensuring reliable, production‑ready machine learning infrastructure.

Responsibilities

• Implement infrastructure to support high-performance, low-latency inference service.
• Deploy and configure Kubernetes services to ensure scalability and reliability of inference workloads.
• Optimize resource allocation and auto‑scaling policies to handle variable inference demand while minimizing operational costs.
• Integrate inference services with containerized environments using Docker and Kubernetes for orchestration.
• Ensure high availability and fault tolerance by implementing multi‑region deployments and disaster recovery strategies.
• Develop Python‑based scripts and APIs to streamline data preprocessing, inference execution, and post‑processing for real‑time inference tasks.
• Collaborate with machine learning engineers to validate inference accuracy and performance against functional and latency requirements.
• Triage and resolve defects in the service by analyzing logs, metrics, and distributed traces.
• Debug issues related to model deployment, container orchestration, or networking configurations, documenting steps to reproduce and root‑cause defects.
• Collaborate with cross‑functional teams to address performance regressions, scalability issues, or integration failures in the inference pipeline.
• Develop automated scripts to detect and mitigate common failure modes, improving system reliability.
• Author detailed technical documentation for infrastructure configurations, inference workflows, and APIs, ensuring clarity for internal teams and external customers.
• Work with product management and user experience teams to define requirements for inference service interfaces, including configuration, monitoring, and event logging.
• Document and track defects, enhancements, and release notes using tools like Jira and Git, ensuring version control and traceability.
• Participate in release planning and prioritization discussions to align infrastructure development with customer needs and business objectives.

Skills & Qualifications

Minimum Requirements

• Master's degree (or foreign equivalent) in Computer Science or a related field.
• One year of experience as a Software Developer, Student/Intern (Software Developer), Member of Technical Staff (Software Engineer), Software Engineer, or a related occupation.
• Employer accepts full‑time or equivalent part‑time experience gained before, during, or after graduate studies.

Required Skills

• Docker and Kubernetes;
• Java or C++;
• ActiveMQ and Kafka;
• Python or Groovy;
• JavaScript or TypeScript;
• Linux;
• SQL, OracleDB, and Redis; and
• Git

Why Join Cerebras

People who are serious about software make their own hardware. At Cerebras, we have built a breakthrough architecture that is unlocking new opportunities for the AI industry. With dozens of model releases and rapid growth, we’ve reached an inflection point in our business. Members of our team tell us there are five main reasons they joined Cerebras:

1. Build a breakthrough AI platform beyond the constraints of the GPU.
2. Publish and open‑source their cutting‑edge AI research.
3. Work on one of the fastest AI supercomputers in the world.
4. Enjoy job stability with startup vitality.
5. Our simple, non‑corporate work culture that respects individual beliefs.

Cerebras Systems is committed to creating an equal and diverse environment and is proud to be an equal‑opportunity employer. We celebrate different backgrounds, perspectives, and skills. We believe inclusive teams build better products and companies. We try every day to build a work environment that empowers people to do their best work through continuous learning, growth and support of those around them.

This website or its third‑party tools process personal data. For more details, click here to review our CCPA disclosure notice.