AI Eval Architect for Ultra-Fast Inference

Cerebras Systems, Inc.; Sunnyvale (CA); On-site; USD 120,000 - 160,000; Full time

Job summary

Cerebras Systems, Inc. in Sunnyvale, California, is seeking a talented individual to own model quality and performance for its inference offerings. You will define what 'good' looks like for the models, utilizing AI agents to create custom evaluation suites and automate quality processes. This position requires strong experience in AI systems and a background in math and statistics.

The role is vital as it supports engineering, product, and customer-facing teams. Join us at Cerebras and be part of groundbreaking advancements in AI!

Qualifications

• Experience shipping real systems with AI agents.
• Background in mathematics and statistics.
• Proficiency in Docker and Git automation designs.

Responsibilities

• Design eval suites with AI agents in the loop.
• Build custom evals for target customers.
• Automate eval execution end-to-end with AI-driven pipelines.
• Forecast and benchmark model performance for top customers.
• Develop tooling that synthesizes quality and performance data.

Skills

Experience building AI agents

Strong math/stats background

Comfort with Docker, Git, and standard automation stack

Taste for tooling design

Job description

Cerebras Systems, Inc. in Sunnyvale, California, is seeking a talented individual to own model quality and performance for its inference offerings. You will define what 'good' looks like for the models, utilizing AI agents to create custom evaluation suites and automate quality processes. This position requires strong experience in AI systems and a background in math and statistics.

The role is vital as it supports engineering, product, and customer-facing teams. Join us at Cerebras and be part of groundbreaking advancements in AI!