Remote Software Engineer, Agent Optimization & Evaluation
A complete application in a minute
Tailored resume and cover letter, ready to send.
Benefits offered by this job
Job summary
Reddit is seeking a Software Engineer for Agent Optimization & Evaluation to lead the development of an agent optimization and evaluation platform. You will build systems to measure how AI agents affect engineering velocity, create production-grade evaluation environments, and own orchestration and feedback loops in a hands-on role.
You will work with Platform Engineering, Infrastructure, and Developer Productivity teams to integrate agent capabilities into Reddit's workflows, focusing on
Qualifications
- 5–12+ years of engineering experience.
- Experience building and shipping large-scale production software systems.
- Experience designing evaluation, experimentation, benchmarking, or measurement systems for AI or distributed platforms.
- Strong understanding of modern LLMs, AI agents, and deployment systems.
- Ability to work independently and drive technical direction.
Responsibilities
- Design and build Reddit's agent optimization and evaluation platform.
- Develop evaluation environments that measure agent performance on engineering tasks.
- Build systems for offline replay, automated evaluation, and regression detection.
- Define metrics and experimentation frameworks to measure productivity and velocity.
- Collaborate with Platform Engineering, Infrastructure, and Developer Productivity teams.
Skills
Job description
Reddit is seeking a Software Engineer for Agent Optimization & Evaluation to lead the development of an agent optimization and evaluation platform. You will build systems to measure how AI agents affect engineering velocity, create production-grade evaluation environments, and own orchestration and feedback loops in a hands-on role.
You will work with Platform Engineering, Infrastructure, and Developer Productivity teams to integrate agent capabilities into Reddit's workflows, focusing on
'/%3e%3cpath%20d='M101.744%2012.4726L102.894%2016.1947L99.0021%2013.2201L101.744%2012.4726ZM105.3%208.40937H100.488L99.0026%203.59473L97.5116%208.41047L92.7%208.40385L96.5965%2011.3834L95.1055%2016.1942L99.0021%2013.2196L101.408%2011.3834L105.3%208.40992V8.40937Z'%20fill='white'/%3e%3cdefs%3e%3clinearGradient%20id='paint0_linear_5593_1381'%20x1='90'%20y1='9.44471'%20x2='99'%20y2='9.44471'%20gradientUnits='userSpaceOnUse'%3e%3cstop%20stop-color='%2300AD70'/%3e%3cstop%20offset='0.998594'%20stop-color='%2300B67A'/%3e%3cstop%20offset='1'%20stop-color='%23DCDCE6'/%3e%3c/linearGradient%3e%3c/defs%3e%3c/svg%3e){kind=small}
