Remote Software Engineer, Agent Optimization & Evaluation

Reddit; United States; Remote; USD 110,000 - 325,000; Full time

Benefits offered by this job

Healthcare benefits

401(k) with employer match

Global benefits

Family planning support

Mental health resources

Job summary

Reddit is seeking a Software Engineer for Agent Optimization & Evaluation to lead the development of an agent optimization and evaluation platform. You will build systems to measure how AI agents affect engineering velocity, create production-grade evaluation environments, and own orchestration and feedback loops in a hands-on role.

You will work with Platform Engineering, Infrastructure, and Developer Productivity teams to integrate agent capabilities into Reddit's workflows, focusing on

Qualifications

• 5–12+ years of engineering experience.
• Experience building and shipping large-scale production software systems.
• Experience designing evaluation, experimentation, benchmarking, or measurement systems for AI or distributed platforms.
• Strong understanding of modern LLMs, AI agents, and deployment systems.
• Ability to work independently and drive technical direction.

Responsibilities

• Design and build Reddit's agent optimization and evaluation platform.
• Develop evaluation environments that measure agent performance on engineering tasks.
• Build systems for offline replay, automated evaluation, and regression detection.
• Define metrics and experimentation frameworks to measure productivity and velocity.
• Collaborate with Platform Engineering, Infrastructure, and Developer Productivity teams.

Skills

Engineering experience

Production systems

AI/LLM awareness

System design

Cross-functional collaboration

Job description

Reddit is seeking a Software Engineer for Agent Optimization & Evaluation to lead the development of an agent optimization and evaluation platform. You will build systems to measure how AI agents affect engineering velocity, create production-grade evaluation environments, and own orchestration and feedback loops in a hands-on role.

You will work with Platform Engineering, Infrastructure, and Developer Productivity teams to integrate agent capabilities into Reddit's workflows, focusing on