Senior Runtime Engineer

Cerebras Systems; Toronto; On-site; CAD 100,000 - 130,000; Full time

Job summary

A cutting-edge AI technology company based in Toronto is looking for an experienced engineer to develop high-performance software for their innovative distributed system architecture. The role requires expertise in low-level programming such as C/C++, multithreading, and performance optimization. You'll tackle challenges related to processing large model and training data, leveraging hardware resources to scale neural networks with over 100 trillion parameters. Join us to be at the forefront of AI advancements while enjoying a supportive work culture.

Benefits

Opportunity to publish and open source AI research

Work on one of the fastest AI supercomputers

Job stability with startup environment

Supportive and inclusive workplace culture

Qualifications

• 3+ years of experience in engineering roles.
• Strong programming skills in C/C++ and multithreading.
• Experience with large, complex system software.

Responsibilities

• Develop high-performance code for a distributed system.
• Optimize data structures and algorithms for hardware resources.
• Build software with concurrency across threads and systems.

Skills

Low-level programming (C/C++)

Multi-threading

Performance optimization

Exposure to Assembly-level programming

Knowledge of basic compiler internals

Experience with distributed systems

Python knowledge (especially in ML contexts)

Track record on large complex systems software

Custom hardware programming

Job description

Cerebras Systems builds the world's largest AI chip, 56 times larger than GPUs. Our novel wafer-scale architecture provides the AI compute power of dozens of GPUs on a single chip, with the programming simplicity of a single device. This approach allows Cerebras to deliver industry-leading training and inference speeds and empowers machine learning users to effortlessly run large-scale ML applications, without the hassle of managing hundreds of GPUs or TPUs.

Cerebras' current customers include global corporations across multiple industries, national labs, and top-tier healthcare systems. In January, we announced a multi-year, multi-million-dollar partnership with Mayo Clinic, underscoring our commitment to transforming AI applications across various fields. In August, we launched Cerebras Inference, the fastest Generative AI inference solution in the world, over 10 times faster than GPU-based hyperscale cloud inference services.

About the Role

You will develop high-performance code running the distributed system consisting of the CS-2 and multiple heterogenous servers. Feeding model and training data to the CS-2 in the Weight Streaming regime, as well as CPU-side processing of this data, is a huge challenge that requires optimized data structures and algorithms that take full advantage of the available hardware resources, including CPU, memory, storage, and network bandwidth.

The software must be built with a high degree of concurrency across threads, processes, cores, and systems. It is central to the Cerebras Weight Streaming architecture which scales to brain-sized neural networks with over 100T parameters.

Skills And Qualifications

• Experienced engineer with 3+ years of experience.
• Strong low-level programming: C/C++, multi-threading, performance optimization, exposure to Assembly-level programming.
• Assets: Knowledge of basic compiler internals, experience with distributed systems and protocol design, Python knowledge (especially in ML contexts).
• Track record of working on large, complex system software.
• Prior projects where custom HW is given, write SW to unlock potential of HW.

Why Join Cerebras

• Build a breakthrough AI platform beyond the constraints of the GPU.
• Publish and open source their cutting-edge AI research.
• Work on one of the fastest AI supercomputers in the world.
• Enjoy job stability with startup vitality.
• Our simple, non-corporate work culture that respects individual beliefs.

Read our blog: Five Reasons to Join Cerebras in 2025.

Apply today and become part of the forefront of groundbreaking advancements in AI!

Cerebras Systems is committed to creating an equal and diverse environment and is proud to be an equal opportunity employer. We celebrate different backgrounds, perspectives, and skills. We believe inclusive teams build better products and companies. We try every day to build a work environment that empowers people to do their best work through continuous learning, growth and support of those around them.

This website or its third-party tools process personal data. For more details, click here to review our CCPA disclosure notice.