Senior Software Development Engineer in Test (SDET) - AI Cluster

FDE Times

Sunnyvale (CA)

On-site

USD 180,000 - 240,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Cerebras Systems in Sunnyvale, CA, is seeking a Senior Software Development Engineer in Test to elevate the reliability of thousands of nodes in large AI deployments. You will design and execute tests for AI infrastructure, automate validation, and build test strategies.

The role requires deep knowledge of distributed ML training, Kubernetes, Prometheus, Grafana, and hardware-software interactions. Join a fast-moving team delivering breakthrough AI hardware.

Qualifications

  • Bachelor's or master's in engineering, CS, AI, data science or related field.
  • 5+ years testing enterprise software, distributed systems, or datacenter hardware/software.
  • Strong coding skills in Python, Go, or C/C++.
  • Experience debugging large distributed systems, hardware, and software.
  • Knowledge of OS internals, memory, file systems, security and performance.

Responsibilities

  • Innovate and execute tests on cutting-edge AI infrastructure.
  • Define optimized test strategies and methodologies.
  • Adapt to rapid tech changes and diverse skill sets.
  • Pursue 100% automated testing for cluster features.
  • Validate cluster software and hardware components end-to-end.
  • Ensure uptime and observability for large deployments.

Skills

Distributed systems testing
Python
Go (Golang)
C/C++
Debugging tools
Kubernetes
Test automation

Education

Bachelor's or master's in engineering or related field

Tools

Grafana
Prometheus
GDB
PDB
Docker
Kubernetes

Job description

Cerebras Systems builds the world's largest AI chip, 56 times larger than GPUs. This architecture allows Cerebras to deliver industry-leading training and inference speeds; over 10 times faster than GPU-based hyperscale cloud inference services.

This order of magnitude increase in speed is transforming the user experience of AI applications, unlocking real-time iteration and increasing intelligence via additional agentic computation.

Cerebras works with the leading model labs, global enterprises, and cutting-edge AI-native startups. OpenAI recently announced a multi-year partnership with Cerebras, to deploy 750 megawatts of scale, transforming key workloads with ultra high-speed inference.

In AI infrastructure organization, simplifying large hardware deployments with push button, single pane of glass for observability/monitoring and software capabilities for build-in resiliency are some of the key focus areas. As senior software development engineer in Test, we are looking for a candidate who can make a big impact on how we test and validate thousands of nodes in large deployments to ensure the cluster is 99.999% reliable.

Responsibilities
  • You will be hired to innovate and execute tests on cutting edge AI infrastructure. Be a thinker, define optimized test strategies and methodologies.
  • Cerebras is growing and innovating at a rapid pace and so is the ML community and AI models. Be a quick learner, adapt to new technologies, and bring your expertise. We are looking to hire a team with a diverse skill set.
  • Deep understanding of how large-scale distributed ML training and inference works. Build a strong understanding of how to break these large distributed systems challenge into smaller components that can be unit tested.
  • Automate first approach - In large scale deployment, automation drives efficiency and scalability. Aim for 100% automated tests to test all cluster features in areas of high availability, failure scenarios, performance, stress and security.
  • Champion cluster security, reliability for uptime of 99.9999% and ease of use with observability.
  • Test all components of AI cluster including but not limited to cluster software involving kubernetes, prometheus and grafana. Cluster hardware components like ML wafer scale accelerators, CPU runtime nodes, High speed swarmx interconnect, High speed data transfer of weights through memoryx interconnect.
Qualifications
  • Bachelor's or master's degree in engineering in computer science, electrical, AI, data science or related field.
  • 5+ years of experience in testing one of areas like enterprise software, distributed systems, datacenter hardware and software.
  • Strong coding skills in one of the programming languages like python, golang and C/C++.
  • Strong debugging skills to debug issues in large distributed systems, hardware, and software. Experience with debugging tools like pdb, gdb, strace and network monitors.
  • Strong understanding of operating systems internals like memory management, file system working, security and performance.
  • Strong understanding of datacenter layout, device performance characteristics like Servers, Memory, BIOS, PCIe, networking and storage.
  • Experience with cloud technologies like AWS, kubernetes and dockers. Monitoring tools like grafana, prometheus is huge plus.
  • Understanding and experience of ML model training and inference is a huge plus.
  • Understand of ML hardware accelerators like GPU, custom accelerator ASIC is a huge plus.
Why Join Cerebras

People who are serious about software make their own hardware. At Cerebras, we have built a breakthrough architecture that is unlocking new opportunities for the AI industry. With dozens of model releases and rapid growth, we’ve reached an inflection point in our business. Members of our team tell us there are five main reasons they joined Cerebras:

  • Build a breakthrough AI platform beyond the constraints of the GPU.
  • Publish and open source their cutting-edge AI research.
  • Work on one of the fastest AI supercomputers in the world.
  • Enjoy job stability with startup vitality.
  • Our simple, non-corporate work culture that respects individual beliefs.

Cerebras Systems is committed to creating an equal and diverse environment and is proud to be an equal opportunity employer. We celebrate different backgrounds, perspectives, and skills. We believe inclusive teams build better products and companies. We try every day to build a work environment that empowers people to do their best work through continuous learning, growth and support of those around them.

This website or its third-party tools process personal data. For more details, click here to review our CCPA disclosure notice.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Software Development Engineer in Test (SDET) - AI Cluster
Senior Software Development Engineer in Test (SDET) - AI Cluster

Cerebras • Sunnyvale (CA)

On-site
USD 170,000 - 230,000
Senior Software Development Engineer in Test (SDET) - AI Cluster
Senior Software Development Engineer in Test (SDET) - AI Cluster

Cerebras • Sunnyvale (CA)

Hybrid
USD 180,000 - 260,000
Senior SDET – AI Infrastructure, Automation & Reliability
Senior SDET – AI Infrastructure, Automation & Reliability

Cerebras • Sunnyvale (CA)

On-site
USD 170,000 - 230,000
Software Engineer - Tools & Infrastructure / DevOps
Software Engineer - Tools & Infrastructure / DevOps

Cerebras • Sunnyvale (CA)

On-site
USD 140,000 - 210,000
Staff Software Engineer - Tools & Infrastructure / DevOps
Staff Software Engineer - Tools & Infrastructure / DevOps

Cerebras • Sunnyvale (CA)

On-site
USD 180,000 - 260,000
Senior Inference ML API SDET
Senior Inference ML API SDET

Cerebras • Sunnyvale (CA)

Hybrid
USD 150,000 - 210,000
AI Inference Core - Senior SDET, Release Integration Testing
AI Inference Core - Senior SDET, Release Integration Testing

Cerebras Systems • Sunnyvale (CA)

Hybrid
USD 140,000 - 190,000
Software Engineer, Cluster Deployment
Software Engineer, Cluster Deployment

Cerebras • Sunnyvale (CA)

On-site
USD 150,000 - 190,000
AI Inference Core - Senior Infrastructure Software Engineer
AI Inference Core - Senior Infrastructure Software Engineer

FDE Times • Sunnyvale (CA)

On-site
USD 140,000 - 220,000
AI Inference Core - SDET Technical Lead, Release Integration Testing
AI Inference Core - SDET Technical Lead, Release Integration Testing

Precision Labs • Sunnyvale (CA)

Hybrid
USD 180,000 - 240,000