AI Fleet Platform Software Engineer

Cerebras Systems

Toronto

On-site

CAD 120,000 - 180,000

Full time

6 days ago
Be an early applicant
Application generator

An application made for this job — a tailored resume and cover letter that speak straight to the posting.

Get past ATS filters

Job summary

Cerebras Systems is seeking a senior software engineer to build platforms and tools that monitor and manage AI clusters at scale. You will own backend services, operational tooling, and user-facing applications, collaborating with Cluster Operations, infrastructure, inference, security, and data center teams.

You will partner with users of the platform to understand their needs and make practical product and engineering decisions, leading projects from design to production with measurable impact.

Qualifications

  • 12+ years of industry experience building and operating production software for distributed systems or large-scale infrastructure.
  • Strong Go or Python skills and experience designing services and APIs.
  • Expertise in control planes, fleet management systems, or operational platforms.

Responsibilities

  • Build and operate software for managing large fleets of AI clusters.
  • Give operators clear, actionable views of cluster health, capacity, performance, and ongoing issues.
  • Develop services and integrations that bring together data and workflows from multiple infrastructure systems.
  • Automate repetitive work and improve the tools teams use to investigate incidents and restore service.
  • Design systems that remain reliable as the fleet grows and continue to function through component and site failures.
  • Work closely with users of the platform to understand their needs and make practical product and engineering decisions.
  • Lead projects from initial design to production, measure their impact, and use operational feedback to guide improvements.

Skills

Go
Python
APIs design
Distributed systems
Reliability/Observability
Leadership
Big-picture thinking

Tools

Kubernetes
Docker
Linux
Event streaming

Job description

Cerebras Systems builds the world's largest AI chip, 56 times larger than GPUs. This architecture allows Cerebras to deliver industry-leading training and inference speeds; over 10 times faster than GPU-based hyperscale cloud inference services. This order of magnitude increase in speed is transforming the user experience of AI applications, unlocking real-time iteration and increasing intelligence via additional agentic computation. Cerebras works with the leading model labs, global enterprises, and cutting-edge AI-native startups. OpenAI recently announced a multi-year partnership with Cerebras, to deploy 750 megawatts of scale, transforming key workloads with ultra high-speed inference.

The Role

Cerebras operates AI clusters across a growing number of data centers.

As the fleet expands, the software used to monitor and manage it must scale with it. We are seeking a senior software engineer to build the platforms and tools that help our teams understand fleet health, respond to issues, and keep compute capacity available. You will own substantial engineering work across backend services, operational tools, and user-facing applications.

You will partner with Cluster Operations, infrastructure, inference, security, and data center teams to turn real operational challenges into software that works reliably at scale.

Responsibilities
  • Build and operate software for managing large fleets of AI clusters
  • Give operators clear, actionable views of cluster health, capacity, performance, and ongoing issues.
  • Develop services and integrations that bring together data and workflows from multiple infrastructure systems.
  • Automate repetitive work and improve the tools teams use to investigate incidents and restore service.
  • Design systems that remain reliable as the fleet grows and continue to function through component and site failures.
  • Work closely with users of the platform to understand their needs and make practical product and engineering decisions.
  • Lead projects from initial design to production, measure their impact, and use operational feedback to guide improvements.
Skills and requirements
  • 12+ years of industry experience building and operating production software for distributed systems or large-scale infrastructure.
  • Strong Go or Python skills and experience designing services and APIs.
  • Expertise in control planes, fleet management systems, or operational platforms.
  • Experience with Linux, containers, Kubernetes, and handling failures across distributed systems.
  • Experience designing systems that handle asynchronous work, retries, and partial failures.
  • Experience with event streaming, workflow automation, or time-series telemetry.
  • Strong judgment in reliability, security, and observability.
  • Ability to lead ambiguous projects and work effectively across engineering and operations teams.
Preferred Experience
  • Building software for incident response, hardware health, or capacity management.
  • Developing dashboards and applications for infrastructure operators.
  • Working with AI clusters and their compute, networking, and hardware systems.
Location
  • SF Bay Area.
  • Toronto, Canada.
Why Join Cerebras

People who are serious about software make their own hardware. At Cerebras, we have built a breakthrough architecture that is unlocking new opportunities for the AI industry. With dozens of model releases and rapid growth, we’ve reached an inflection point in our business. Members of our team tell us there are five main reasons they joined Cerebras:

  1. Build a breakthrough AI platform beyond the constraints of the GPU.
  2. Publish and open source their cutting-edge AI research.
  3. Work on one of the fastest AI supercomputers in the world.
  4. Enjoy job stability with startup vitality.
  5. Our simple, non-corporate work culture that respects individual beliefs.

Cerebras Systems is committed to creating an equal and diverse environment and is proud to be an equal opportunity employer. We celebrate different backgrounds, perspectives, and skills. We believe inclusive teams build better products and companies. We try every day to build a work environment that empowers people to do their best work through continuous learning, growth and support of those around them.

This website or its third-party tools process personal data. For more details, click here to review our CCPA disclosure notice.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

AI Fleet Platform Software Engineer
AI Fleet Platform Software Engineer

Foundation Capital • Toronto

Hybrid
CAD 180,000 - 240,000
Software Engineer, Inference Platform
Software Engineer, Inference Platform

Foundation Capital • Toronto

On-site
CAD 256,000 - 370,000
Software Engineer - Tools & Infrastructure / DevOps
Software Engineer - Tools & Infrastructure / DevOps

Foundation Capital • Toronto

On-site
CAD 110,000 - 170,000
Distributed Software Engineer
Distributed Software Engineer

Engg • Toronto

On-site
CAD 140,000 - 210,000
Software Engineer - Tools & Infrastructure / DevOps
Software Engineer - Tools & Infrastructure / DevOps

Cerebras • Toronto

On-site
CAD 120,000 - 180,000
AI Inference Core - Senior SW Engineer for Platform & DevOps
AI Inference Core - Senior SW Engineer for Platform & DevOps

Cerebras • Toronto

On-site
CAD 120,000 - 180,000
Software Engineer, Inference Platform
Software Engineer, Inference Platform

Cerebras • Toronto

Hybrid
CAD 120,000 - 180,000
Sr. Staff Software Engineer, Inference Platform
Sr. Staff Software Engineer, Inference Platform

Cerebras • Toronto

On-site
CAD 140,000 - 210,000
Cluster Operations Software Engineer
Cluster Operations Software Engineer

Cerebras • Toronto

On-site
CAD 120,000 - 190,000
FPGA Engineer
FPGA Engineer

Cerebras • Toronto

On-site
CAD 120,000 - 160,000