Cluster Operations Software Engineer

Cerebras

Toronto

On-site

CAD 120,000 - 190,000

Full time

14 days+
Application generator

Don’t send a generic resume — generate a resume and cover letter tailored to this exact role.

Get past ATS filters

Job summary

Cerebras Systems seeks an AI Cluster Operations Engineer to manage the world's largest AI compute clusters, including the Wafer-Scale Engine. You will ensure health, performance, and availability of infrastructure, maximize capacity, and support AI initiatives.

The role requires Linux expertise, Docker/Kubernetes, and experience with monitoring, automation, and distributed systems. You will work with a fast-paced, on-call team to deliver reliable, scalable platforms for cutting-edge AI workloads.

Qualifications

  • 6-8 years of experience managing and operating complex compute infrastructure, preferably with ML/HPC context.
  • Proficient in Python and Go, with experience building operational platforms and reliability tooling.
  • Deep knowledge of Linux-based compute systems and CLI tools.
  • Extensive Docker experience and orchestration via Kubernetes.
  • Experience with monitoring and alerting systems and troubleshooting complex issues.

Responsibilities

  • Deploy, configure, and debug container-based services using Docker.
  • Build and own software that powers cluster operations, including dashboards and reliability tooling.
  • Collaborate with cross-functional teams to translate requirements into scalable OM platforms.
  • Develop APIs, automation services, and integrations for visibility and fleet management.
  • Manage and operate multiple advanced AI compute clusters.
  • Monitor cluster health and proactively resolve issues to maximize compute capacity.
  • Provide 24/7 monitoring and hands-on troubleshooting as needed.
  • Handle escalations and collaborate to resolve complex challenges.
  • Stay up-to-date with advancements in AI compute infrastructure.

Skills

6-8 years experience
Python
Go
Distributed systems
Linux
Docker
Kubernetes
Troubleshooting
Monitoring/alerts
On-call rotation
Communication

Tools

Docker
Kubernetes

Job description

Cerebras Systems builds the world's largest AI chip, 56 times larger than GPUs. This architecture allows Cerebras to deliver industry-leading training and inference speeds; over 10 times faster than GPU-based hyperscale cloud inference services.

This order of magnitude increase in speed is transforming the user experience of AI applications, unlocking real-time iteration and increasing intelligence via additional agentic computation.

Cerebras works with the leading model labs, global enterprises, and cutting-edge AI-native startups. OpenAI recently announced a multi-year partnership with Cerebras, to deploy 750 megawatts of scale, transforming key workloads with ultra high-speed inference.

The Role

We are seeking a highly skilled and experienced AI Cluster Operations Engineer to manage and operate our cutting-edge machine learning compute clusters. These clusters would provide the candidate with an opportunity to work with the world's largest computer chip, the Wafer-Scale Engine (WSE), and the systems that harness its unparalleled power.

You will play a critical role in ensuring the health, performance, and availability of our infrastructure, maximizing compute capacity, and supporting our growing AI initiatives. This role requires a deep understanding of Linux-based systems, containerization technologies, and experience with monitoring and troubleshooting complex distributed systems. The ideal candidate is a proactive problem-solver with expertise in large-scale compute infrastructure, dependable and an advocate for customer success.

Responsibilities
  • Deploy, configure, and debug container-based services using Docker.
  • Build and own software solutions that power cluster operations, including monitoring platforms, workflow automation systems, operational dashboards, and reliability tooling.
  • Collaborate with cross-functional teams to translate operational requirements into scalable O&M products and platform capabilities.
  • Develop APIs, automation services, and integrations that improve operational visibility, incident response, and fleet management across global AI infrastructure.
  • Manage and operate multiple advanced AI compute infrastructure clusters.
  • Monitor and oversee cluster health, proactively identifying and resolving potential issues.
  • Maximize compute capacity through optimization and efficient resource allocation.
  • Provide 24/7 monitoring and support, leveraging automated tools and performing hands‑on troubleshooting as needed.
  • Handle engineering escalations and collaborate with other teams to resolve complex technical challenges.
  • Stay up-to-date with the latest advancements in AI compute infrastructure and related technologies.
Skills And Requirements
  • 6-8 years of relevant experience in managing and operating complex compute infrastructure, preferably in the context of machine learning or high-performance computing.
  • Proficient in Python and Go, with experience building operational platforms, workflow automation systems, and reliability tooling for large-scale infrastructure environments.
  • Experience and Expertise in distributed systems is a must.
  • Deep understanding of Linux-based compute systems and command-line tools.
  • Extensive knowledge of Docker containers and container orchestration platforms like k8s.
  • Proven ability to troubleshoot and resolve complex technical issues in a timely and efficient manner.
  • Experience with monitoring and alerting systems.
  • Should have a proven track record to own and drive challenges to completion.
  • Excellent communication and collaboration skills.
  • Ability to work effectively in a fast‑paced environment.
  • Willingness to participate in a 24/7 on‑call rotation.
Preferred Skills And Requirements
  • Operating and Managing large scale AI clusters.
  • Knowledge of technologies like Ethernet, RoCE, TCP/IP, etc. is desired.
  • Knowledge of cloud computing platforms (e.g., AWS, GCP, Azure).
Location
  • SF Bay Area.
  • Toronto, Canada.
  • Bangalore, India.
Why Join Cerebras
About

People who are serious about software make their own hardware. At Cerebras, we have built a breakthrough architecture that is unlocking new opportunities for the AI industry. With dozens of model releases and rapid growth, we’ve reached an inflection point in our business. Members of our team tell us there are five main reasons they joined Cerebras:

  • Build a breakthrough AI platform beyond the constraints of the GPU.
  • Publish and open source their cutting‑edge AI research.
  • Work on one of the fastest AI supercomputers in the world.
  • Enjoy job stability with startup vitality.
  • Our simple, non‑corporate work culture that respects individual beliefs.

Cerebras Systems is committed to creating an equal and diverse environment and is proud to be an equal opportunity employer. We celebrate different backgrounds, perspectives, and skills. We believe inclusive teams build better products and companies. We try every day to build a work environment that empowers people to do their best work through continuous learning, growth and support of those around them.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Distributed Software Engineer
Distributed Software Engineer

Engg • Toronto

On-site
CAD 140,000 - 210,000
AI Fleet Platform Software Engineer
AI Fleet Platform Software Engineer

Foundation Capital • Toronto

Hybrid
CAD 180,000 - 240,000
AI Fleet Platform Software Engineer
AI Fleet Platform Software Engineer

Cerebras Systems • Toronto

On-site
CAD 120,000 - 180,000
Software Engineer - Tools & Infrastructure / DevOps
Software Engineer - Tools & Infrastructure / DevOps

Cerebras • Toronto

On-site
CAD 120,000 - 180,000
Software Engineer, Inference Platform
Software Engineer, Inference Platform

Foundation Capital • Toronto

On-site
CAD 256,000 - 370,000
Software Engineer, Inference Platform
Software Engineer, Inference Platform

Cerebras • Toronto

Hybrid
CAD 120,000 - 180,000
Software Engineer - Tools & Infrastructure / DevOps
Software Engineer - Tools & Infrastructure / DevOps

Foundation Capital • Toronto

On-site
CAD 110,000 - 170,000
Sr. Staff Software Engineer, Inference Platform
Sr. Staff Software Engineer, Inference Platform

Cerebras • Toronto

On-site
CAD 140,000 - 210,000
DevOps Engineer Intern - PEY
DevOps Engineer Intern - PEY

Precision Labs • Toronto

Hybrid
CAD 45,000 - 65,000
Senior Software Development Engineer in Test (SDET) - AI Cluster
Senior Software Development Engineer in Test (SDET) - AI Cluster

Cerebras • Toronto

On-site
CAD 120,000 - 190,000