Agent Optimization Engineer — AI Platform & Evaluation

CurationsLA; California; On-site; USD 110,000 - 325,000; Full time

Benefits offered by this job

Comprehensive Healthcare Benefits and

401k with Employer Match

Global Benefit programs that fit your 

Family Planning Support

Gender‑Affirming Care

Mental Health & Coaching Benefits

Flexible Vacation & Paid VolunteerTime

Generous Paid Parental Leave

Job summary

Reddit is seeking a Software Engineer, Agent Optimization & Evaluation to lead the design and implementation of an agent optimization platform that measures and improves the impact of AI agents on engineering velocity.

You will own production systems, orchestration, and evaluation environments, partnering with Platform Engineering, Infrastructure, and Developer Productivity teams to apply AI capabilities across Reddit's workflows.

Qualifications

• 5–12+ years of engineering experience.
• Experience building large-scale production software systems.
• Experience designing evaluation, experimentation, benchmarking, or measurement systems for AI or distributed platforms.
• Strong understanding of modern LLMs, AI agents, and deployment systems.
• Experience optimizing across quality, latency, reliability, and cost.
• Ability to operate independently in ambiguous environments and drive technical direction.

Responsibilities

• Design and build Reddit's agent optimization harness for evaluating, benchmarking, and improving AI agents across software workflows.
• Develop Reddit-specific evaluation environments to measure agent performance.
• Build systems for offline replay, automated evaluation, synthetic task generation, regression detection, and human-in-the-loop feedback.
• Design model routing and orchestration strategies optimizing quality, latency, and cost.
• Define metrics and experimentation frameworks to measure developer productivity and velocity.
• Build tooling to analyze agent behavior, investigate failures, and accelerate iteration.
• Collaborate with Platform Engineering, Infrastructure, and Developer Productivity teams to integrate agent capabilities into workflows.
• Help shape Reddit's long-term strategy for a model-agnostic agent platform.

Skills

Extensive engineering experience

Large-scale production software

AI/evaluation systems

LLMs and AI agents

Cross-functional collaboration

Tools

LLM concepts

Distributed systems

Job description

Reddit is seeking a Software Engineer, Agent Optimization & Evaluation to lead the design and implementation of an agent optimization platform that measures and improves the impact of AI agents on engineering velocity.

You will own production systems, orchestration, and evaluation environments, partnering with Platform Engineering, Infrastructure, and Developer Productivity teams to apply AI capabilities across Reddit's workflows.