ML Runtime and Kernel Engineer - Core ML

Cerebras

Sunnyvale (CA)

On-site

USD 180,000 - 280,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Cerebras Systems in Sunnyvale, CA seeks an engineer to bridge novel Core ML ideas with efficient execution on the Cerebras Wafer-Scale Engine. You will work across ML frameworks, compilers, runtimes, and kernels to implement new capabilities and turn research into robust demonstrations.

Your work may emphasize runtime capabilities, kernel development for ML operations, or a mix of both, collaborating with researchers and engineers to push end-to-end performance.

Qualifications

  • Bachelor's, Master's, PhD, or equivalent practical experience in CS/EE or related field.
  • Experience developing high-performance systems software, ML systems, runtimes, or kernels.
  • Strong C++ and Python programming skills.
  • Solid understanding of parallel programming, memory management, and optimization.
  • Ability to debug and profile complex software across layers.
  • Familiarity with PyTorch or JAX and modern ML architectures.

Responsibilities

  • Design and implement runtime components and high-performance kernels for Core ML algorithms.
  • Translate research prototypes into efficient Cerebras platform implementations.
  • Profile and debug performance across ML framework, compiler, runtime, and kernel layers.
  • Optimize computation, memory movement, and concurrency for large-scale training and low-latency inference.
  • Develop benchmarks, instrumentation, and tests to validate functionality and numerical correctness.
  • Collaborate with Core ML researchers and engineers to evaluate design options and deliver capabilities.
  • Contribute to software architecture and roadmap decisions by identifying bottlenecks.

Skills

C++
Python
Parallel programming
ML systems
Debugging
PyTorch/JAX
Research collaboration

Education

CS/EE degree

Tools

CUDA
Triton
Kernels
Distributed runtimes

Job description

Cerebras Systems builds the world's largest AI chip, 56 times larger than GPUs. This architecture allows Cerebras to deliver industry-leading training and inference speeds; over 10 times faster than GPU-based hyperscale cloud inference services.

This order of magnitude increase in speed is transforming the user experience of AI applications, unlocking real-time iteration and increasing intelligence via additional agentic computation.

Cerebras works with the leading model labs, global enterprises, and cutting-edge AI-native startups. OpenAI recently announced a multi-year partnership with Cerebras, to deploy 750 megawatts of scale, transforming key workloads with ultra high-speed inference.

About The Role

The Core ML team develops novel machine learning algorithms that take advantage of the unique capabilities of the Cerebras Wafer-Scale Engine. Our work spans efficient LLM training and inference, parallel and diffusion-based generation, sparsity, scaling laws, and training dynamics.

We are looking for an engineer to bridge the gap between promising research ideas and efficient execution on Cerebras systems. You will work across ML frameworks, compilers, runtimes, and low-level kernels to implement new algorithmic capabilities, diagnose performance bottlenecks, and turn research prototypes into robust, high-performance demonstrations.

Depending on your background, your work may emphasize runtime capabilities such as token orchestration, scheduling, communication, and distributed execution; low-level kernel development for novel ML operations; or a combination of both.

Responsibilities
  • Design and implement runtime components and high-performance kernels required by novel Core ML algorithms.

  • Translate research prototypes into efficient implementations for the Cerebras platform, including reference implementations and comparisons on GPUs where useful.

  • Profile and debug performance across the ML framework, compiler, runtime, communication, and kernel layers.

  • Optimize computation, memory movement, communication, and concurrency for large-scale training and low-latency inference.

  • Develop benchmarks, instrumentation, and automated tests that validate functionality, performance, and numerical correctness.

  • Collaborate closely with Core ML researchers and compiler, runtime, kernel, and inference engineers to evaluate design alternatives and deliver end-to-end capabilities.

  • Contribute to software architecture and roadmap decisions by identifying recurring limitations and high-leverage platform improvements.

Skills & Qualifications
  • Bachelor's, Master's, PhD, or equivalent practical experience in Computer Science, Computer Engineering, Electrical Engineering, or a related field.

  • Experience developing high-performance systems software, ML systems, runtimes, compilers, or computational kernels.

  • Strong programming skills in C++ and Python.

  • Solid understanding of parallel programming, memory management, concurrency, data structures, and performance optimization.

  • Proven ability to debug and profile complex software across multiple layers of a system.

  • Familiarity with modern machine learning architectures and frameworks such as PyTorch or JAX.

  • Ability to work effectively with researchers and translate evolving algorithmic requirements into reliable software.

Preferred Skills & Qualifications
  • Experience with CUDA, Triton, low-level assembly, accelerator programming, or a C-like domain-specific language.

  • Experience with compiler internals, distributed runtimes, custom hardware interfaces, or HPC systems.

  • Understanding of machine learning fundamentals and ML systems, with the ability to reason about how algorithmic choices affect accuracy, systems implementation and performance.

  • Familiarity with LLM training or inference, including attention, KV-cache management, parallel generation, or distributed execution.

  • Experience developing software in an industrial or academic research environment where requirements evolve through experimentation.

  • Contributions to significant open-source systems, ML frameworks, compilers, or kernel libraries.

Why Join Cerebras

People who are serious about software make their own hardware. At Cerebras, we have built a breakthrough architecture that is unlocking new opportunities for the AI industry. With dozens of model releases and rapid growth, we've reached an inflection point in our business. Members of our team tell us there are five main reasons they joined Cerebras:

  1. Build a breakthrough AI platform beyond the constraints of the GPU.

  2. Publish and open source their cutting-edge AI research.

  3. Work on one of the fastest AI supercomputers in the world.

  4. Enjoy job stability with startup vitality.

  5. Our simple, non-corporate work culture that respects individual beliefs.

Find out more about what it's like to work at Cerebras here!

Cerebras Systems is committed to creating an equal and diverse environment and is proud to be an equal opportunity employer. We celebrate different backgrounds, perspectives, and skills. We believe inclusive teams build better products and companies. We try every day to build a work environment that empowers people to do their best work through continuous learning, growth and support of those around them.

This website or its third-party tools process personal data. For more details, click here to review our CCPA disclosure notice.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

ML Algorithm Mapping and Performance Engineer, Core ML
ML Algorithm Mapping and Performance Engineer, Core ML

Cerebras • Sunnyvale (CA)

On-site
USD 180,000 - 260,000
Principal ML Investigator
Principal ML Investigator

Cerebras • Sunnyvale (CA)

On-site
USD 250,000 - 450,000
Advanced Technology: AI/ML Research Scientist
Advanced Technology: AI/ML Research Scientist

Cerebras Systems, Inc. • Sunnyvale (CA)

On-site
USD 120,000 - 160,000
Kernel Engineer
Kernel Engineer

Cerebras • Sunnyvale (CA)

On-site
USD 180,000 - 240,000
Staff Kernel Optimzation Engineer
Staff Kernel Optimzation Engineer

Cerebras • Sunnyvale (CA)

On-site
USD 180,000 - 240,000
Senior Software Engineer, ML API – AI Inference
Senior Software Engineer, ML API – AI Inference

Cerebras Systems • Sunnyvale (CA)

On-site
USD 210,000 - 270,000
Kernel Engineer - New Grad
Kernel Engineer - New Grad

Cerebras • Sunnyvale (CA)

On-site
USD 180,000 - 260,000
Senior Runtime Engineer
Senior Runtime Engineer

Cerebras • United States

On-site
USD 120,000 - 160,000
Job stability with startup vitality
Opportunity to work on advanced AI platforms
Open source AI research
ML Software Tool Development Engineer
ML Software Tool Development Engineer

Cerebras • Sunnyvale (CA)

On-site
USD 180,000 - 260,000
ML Inference Performance Architect
ML Inference Performance Architect

Cerebras • United States

On-site
USD 100,000 - 130,000