ML Software Tool Development Engineer

Cerebras; Sunnyvale (CA); On-site; USD 180,000 - 260,000; Full time

Job summary

Cerebras Systems is seeking a highly capable software/systems engineer to design and implement system-level debugging, validation, and observability platforms. You will develop automated data analysis and visualization tools to diagnose numerical and execution anomalies, and extend tooling to support profiling, instrumentation, and improved reliability.

You will partner with compiler, hardware, firmware, runtime, and infra teams to drive preventative actions and repeatable success.

Qualifications

• Experience building high-performance systems in C++ and Python.
• Proven ability to debug complex hardware/software systems.
• Experience analyzing system-level data structures and graphs.
• Ability to design visualization and analysis tools for complex data.
• Familiarity with compiler internals or low-level interfaces.
• Strong written and verbal communication skills.

Responsibilities

• Lead the design and implementation of system-level debugging, validation, and observability platforms.
• Develop automated systems for collecting and analyzing numerical and execution anomalies.
• Create visualization and analysis tools for efficient root-cause investigation.
• Build frameworks for failure classification, regression detection, and anomaly monitoring.
• Extend compilers, runtimes, and programming interfaces to support profiling and instrumentation.
• Improve system bring-up, low-level debug, and validation workflows.
• Partner cross-functionally with compiler, hardware, firmware, runtime, and infrastructure teams.
• Establish best practices for debuggability, reliability, and operational excellence.
• Lead high-impact initiatives.
• Support incident response and drive long-term corrective actions.

Skills

C++ proficiency

Python proficiency

System debugging

Data analysis

Visualization tools

Compiler internals

Communication

Leadership

Job description

Cerebras Systems builds the world's largest AI chip, 56 times larger than GPUs. This architecture allows Cerebras to deliver industry-leading training and inference speeds; over 10 times faster than GPU-based hyperscale cloud inference services.

This order of magnitude increase in speed is transforming the user experience of AI applications, unlocking real-time iteration and increasing intelligence via additional agentic computation.

Cerebras works with the leading model labs, global enterprises, and cutting-edge AI-native startups. OpenAI recently announced a multi-year partnership with Cerebras, to deploy 750 megawatts of scale, transforming key workloads with ultra high-speed inference.

Responsibilities

• Lead the design and implementation of system-level debugging, validation, and observability platforms.
• Develop automated systems for collecting and analyzing numerical, and execution anomalies.
• Create visualization and analysis tools to enable efficient root-cause investigation.
• Build frameworks for failure classification, regression detection, and anomaly monitoring.
• Extend compilers, runtimes, and programming interfaces to support advanced profiling and instrumentation.
• Improve system bring-up, low-level debug, and validation workflows.
• Partner cross-functionally with compiler, hardware, firmware, runtime, and infrastructure teams.
• Establish best practices for debuggability, reliability, and operational excellence.
• Lead high-impact initiatives.
• Support incident response and drive long-term corrective actions.

Skills & Qualifications

• Strong proficiency in C++ and Python, with a track record of building reliable, high-performance systems and tooling.
• Demonstrated experience debugging complex hardware/software systems and driving issues to root cause.
• Experience analyzing system-level data structures, execution graphs, or dependency networks for diagnostics and validation.
• Proven ability to design and build intuitive visualization and analysis tools for complex technical data.
• Experience with compiler internals, custom hardware interfaces, or low-level protocol design.
• Strong written and verbal communication skills, with the ability to explain technical concepts to diverse stakeholders.
• Ability to work independently and lead complex technical projects end-to-end.

Preferred Skills & Qualifications

• Familiarity with machine learning training and inference pipelines, especially distributed training and large-model scaling.
• Prior work on high-performance clusters, HPC systems, or custom hardware/software co-design.

Why Join Cerebras

People who are serious about software make their own hardware. At Cerebras, we have built a breakthrough architecture that is unlocking new opportunities for the AI industry. With dozens of model releases and rapid growth, we’ve reached an inflection point in our business. Members of our team tell us there are five main reasons they joined Cerebras:

• Build a breakthrough AI platform beyond the constraints of the GPU.
• Publish and open source their cutting-edge AI research.
• Work on one of the fastest AI supercomputers in the world.
• Enjoy job stability with startup vitality.
• Our simple, non-corporate work culture that respects individual beliefs.

Find out more about what it's like to work at Cerebras here!

Cerebras Systems is committed to creating an equal and diverse environment and is proud to be an equal opportunity employer. We celebrate different backgrounds, perspectives, and skills. We believe inclusive teams build better products and companies. We try every day to build a work environment that empowers people to do their best work through continuous learning, growth and support of those around them.