Senior Staff Engineer, AI Inference & Resilience

Cerebras; Sunnyvale (CA); On-site; USD 180,000 - 240,000; Full time

Job summary

Cerebras Systems is seeking a Sr. Member of Technical Staff to design and develop software ensuring resiliency and high availability for distributed AI inference services.

You will build scalable cloud workflows, automate deployments, and collaborate across engineering teams to deliver reliable software. You'll implement Python tooling, containerize components with Docker, and define Kubernetes strategies to scale on AWS.

Qualifications

• Proficiency in Python, Node.js, JavaScript, and Flask.
• Experience with cloud deployment, automation, and monitoring.
• Strong understanding of distributed systems and microservices.

Responsibilities

• Design and develop software features for system resiliency and high availability across distributed environments.
• Develop and maintain cloud-based deployment workflows for AI inference software using AWS tools and services to support low-latency and scalable system performance.
• Develop Python-based scripts and APIs to streamline data preprocessing, inference execution, and post-processing for real-time inference tasks.
• Use parallel programming techniques to maximize resource efficiency on AWS compute instances.
• Develop software components to support visualization and analysis of system performance metrics, enhancing the monitoring and usability of inference services.
• Develop inference software in Docker containers and define Kubernetes orchestration strategies that ensure software reliability and efficient scaling.
• Develop automated scripts to detect and mitigate common failure modes, improving software system reliability.
• Debug issues related to model deployment, container orchestration, and networking configurations, documenting steps to reproduce and root-cause defects.
• Triage and resolve defects in the software service by analyzing logs, metrics, and distributed traces using tools like AWS CloudWatch, Grafana, or custom Python scripts.
• Work with Product Management and User Experience teams to define requirements for inference service interfaces, including configuration, monitoring, and event logging.
• Author detailed technical documentation for infrastructure configurations, inference workflows, and APIs, ensuring clarity for internal teams and external customers.
• Document and track defects, enhancements, and release notes using tools like Jira and Git, ensuring version control and traceability.

Skills

Python

Node.js

JavaScript

Flask

Distributed computing

Education

Master's degree in Computer Science or related field

Tools

Terraform

AWS CloudFormation

AWS CDK

Ansible

Docker

Kubernetes

AWS EKS

AWS ECS

AWS Fargate

Helm

AWS EC2

AWS Lambda

Auto Scaling Groups

AWS CloudWatch

AWS X-Ray

ELK

Prometheus

Grafana

PostgreSQL

Redis

NFS

Jenkins

Git

Job description

Cerebras Systems is seeking a Sr. Member of Technical Staff to design and develop software ensuring resiliency and high availability for distributed AI inference services.

You will build scalable cloud workflows, automate deployments, and collaborate across engineering teams to deliver reliable software. You'll implement Python tooling, containerize components with Docker, and define Kubernetes strategies to scale on AWS.