AI Benchmark Engineer

Clera; Singapore; On-site; SGD 128,000 - 218,000; Full time

Benefits offered by this job

Visa sponsorship

Job summary

Clera in Singapore is seeking a developer to join a small, technical research and engineering team building rigorous benchmarks for evaluating AI agents on domain-specific workflows.

You will own benchmark design and implementation, build scalable evaluation infrastructure, develop metrics, and document workflows and results for research and engineering audiences.

This on-site role in Singapore offers visa sponsorship and a competitive USD salary range.

Qualifications

• 2–4 years of experience in software or ML engineering or research.
• Hands-on experience with AI benchmarks or agent environments.
• Strong Python, Docker, and Linux proficiency.
• Ability to model workflows with SMEs and write clear technical reports.

Responsibilities

• Design, implement, and maintain benchmarks for evaluating AI agents on domain-specific tasks.
• Collaborate with subject‑matter experts to turn real workflows into tasks and evaluation criteria.
• Build reliable infrastructure to run models and agents against evaluation tasks at scale.
• Develop metrics and analyses to assess benchmark difficulty, reliability, and failure modes.
• Validate how benchmark results relate to real-world performance and evaluation needs.
• Write clear technical documentation and reports for research and engineering audiences.

Skills

Benchmark design

Experience in ML engineering or resear

Technical writing

Independent work

Tools

Python

Docker

Linux

Job description

Clera in Singapore is seeking a developer to join a small, technical research and engineering team building rigorous benchmarks for evaluating AI agents on domain-specific workflows.

You will own benchmark design and implementation, build scalable evaluation infrastructure, develop metrics, and document workflows and results for research and engineering audiences.

This on-site role in Singapore offers visa sponsorship and a competitive USD salary range.