Distributed Software Engineer

Cerebras; United States; On-site; USD 120,000 - 160,000; Full time

Benefits offered by this job

Equal opportunity employer

Inclusive work environment

Opportunities for continuous learning

Non-corporate work culture

Job summary

Cerebras is looking for a skilled engineer to automate hardware and software workflows in large AI supercomputers. The candidate will work on ambient cluster configurations, resource allocation, and monitoring capabilities, contributing to cutting-edge AI technology.

The ideal individual has a solid background in software architecture and development using Kubernetes and distributed systems. Join a forward-thinking team committed to diversity and equal opportunity in the workplace.

Qualifications

• Strong track record of software architecture, system design and development.
• Strong track record of development in distributed cluster.
• Strong understanding of Kubernetes (K8s) software ecosystem.
• Development skills in GoLang, Python, and bash.
• Strong debugging skills with distributed systems.

Responsibilities

• Automate configuration of networking, OS, and applications on large clusters.
• Implement workflows for upgrades, downgrades, and security patching.
• Create orchestration and scheduler system for job management.
• Support both on-premise and cloud deployment.
• Monitor and handle resource failures in clusters.
• Develop user-facing tools for job status and metrics.
• Create administrator tools for managing large clusters.

Skills

Software architecture

System design

Distributed cluster development

Kubernetes ecosystem

Prometheus

Grafana

GoLang

Python

Bash

Debugging distributed systems

Job description

Cerebras Systems builds the world’s largest AI chip, 56 times larger than GPUs. This architecture allows Cerebras to deliver industry-leading training and inference speeds; over 10 times faster than GPU-based hyperscale cloud inference services.

This order of magnitude increase in speed is transforming the user experience of AI applications, unlocking real-time iteration and increasing intelligence via additional agentic computation.

Cerebras works with the leading model labs, global enterprises, and cutting-edge AI-native startups. OpenAI recently announced a multi-year partnership with Cerebras, to deploy 750 megawatts of scale, transforming key workloads with ultra high-speed inference.

About The Role

Cerebras Systems is a pioneer in large-scale AI Supercomputers. These multi-exaflop supercomputers are deployed in some of the biggest datacenters. These supercomputers are built using our Wafer-Scale Cluster technology - a cluster of several Wafer Scale Engine (WSE) chips. The Cluster engineering team is responsible for delivering software that are all-things related to cluster.

Responsibilities

• Automate bare-metal configuration of networking, OS, and application software in large clusters of Cerebras WSE, servers, and switches.

• Additional push button workflows for cluster upgrades, downgrades, and security patching with key metrics to minimize downtime on clusters.

• An orchestration and scheduler system for resource allocation, job submission C placements for a multi-user environment on a cluster.

• Seamless support for both on-premise and cloud mode deployment and operations.

• A robust system for monitoring, detecting and handling failures for a variety of resources on the clusters (including High Availability of clusters).

• Broad cluster and job monitoring and visualization capabilities, along with alerting systems.

• User facing tools to monitor the status of jobs and collect metrics.

• Administrator facing tools to manage and operate large clusters.

Skills & Qualifications

• Strong track record of software architecture, system design and development.

• Strong track record of development in distributed cluster.

• Strong understanding of Kubernetes (K8s) software ecosystem, Prometheus and Grafana.

• Strong development skills in GoLang, Python, bash.

• Strong debugging skills with distributed systems.

• Strong skill to develop tests for the new features and regress old features.

Why Join Cerebras

1. Build a breakthrough AI platform beyond the constraints of the GPU.

2. Publish and open source their cutting-edge AI research.

3. Work on one of the fastest AI supercomputers in the world.

4. Enjoy job stability with startup vitality.

5. Our simple, non-corporate work culture that respects individual beliefs.

Cerebras Systems is committed to creating an equal and diverse environment and is proud to be an equal opportunity employer. We celebrate different backgrounds, perspectives, and skills. We believe inclusive teams build better products and companies. We try every day to build a work environment that empowers people to do their best work through continuous learning, growth and support of those around them.

This website or its third-party tools process personal data. For more details, click here to review our CCPA disclosure notice.