Remote DevOps Engineer for AI Model Evaluation
mercor
A complete application in a minute — tailored resume and cover letter, ready to send.
Job summary
Mercor is seeking a DevOps / SRE / Cloud Engineer (Coding Agent Experience) for a remote contract role. You will use frontier AI coding agents to tackle infrastructure tasks across cloud platforms, Kubernetes, CI/CD, observability, and infrastructure automation, while evaluating model outputs for reliability.
Responsibilities include reviewing model-generated implementations, identifying edge cases and failure modes, and comparing outputs from multiple frontier models to guide engineering
Qualifications
- 2+ years of professional DevOps, SRE, or cloud engineering experience.
- Experience with AWS, Azure, or GCP and Kubernetes.
- Regular use of AI coding agents such as Cursor, Claude Code, Codex, Windsurf, Gemini CLI, or similar tools.
- Ability to evaluate model-generated infrastructure and reliability solutions.
Responsibilities
- Use frontier AI coding agents to complete and evaluate complex infrastructure tasks.
- Review model-generated implementations involving cloud platforms, Kubernetes, CI/CD, observability, and infra automation.
- Identify bugs, edge cases, reliability issues, and failure modes in model outputs.
- Compare outputs from multiple frontier models to assess strengths and weaknesses.
- Apply professional engineering judgment to realistic infrastructure engineering scenarios.
Skills
Tools
Job description
Mercor is seeking a DevOps / SRE / Cloud Engineer (Coding Agent Experience) for a remote contract role. You will use frontier AI coding agents to tackle infrastructure tasks across cloud platforms, Kubernetes, CI/CD, observability, and infrastructure automation, while evaluating model outputs for reliability.
Responsibilities include reviewing model-generated implementations, identifying edge cases and failure modes, and comparing outputs from multiple frontier models to guide engineering
'/%3e%3cpath%20d='M101.744%2012.4726L102.894%2016.1947L99.0021%2013.2201L101.744%2012.4726ZM105.3%208.40937H100.488L99.0026%203.59473L97.5116%208.41047L92.7%208.40385L96.5965%2011.3834L95.1055%2016.1942L99.0021%2013.2196L101.408%2011.3834L105.3%208.40992V8.40937Z'%20fill='white'/%3e%3cdefs%3e%3clinearGradient%20id='paint0_linear_5593_1381'%20x1='90'%20y1='9.44471'%20x2='99'%20y2='9.44471'%20gradientUnits='userSpaceOnUse'%3e%3cstop%20stop-color='%2300AD70'/%3e%3cstop%20offset='0.998594'%20stop-color='%2300B67A'/%3e%3cstop%20offset='1'%20stop-color='%23DCDCE6'/%3e%3c/linearGradient%3e%3c/defs%3e%3c/svg%3e){kind=small}
