Remote AI Evaluation Engineer for Coding Agents

Joblet-AI; Abu Dhabi; Remote; AED 734,000 - 955,000; Full time

Job summary

micro1 is seeking an AI Research Engineer (Remote) to advance evaluation and development of frontier coding agents. The role sits at the intersection of AI research, software engineering, and model evaluation, shaping benchmarks, methodologies, and data systems for next-generation coding models.

You will design evaluation frameworks, lead end-to-end research initiatives, and build datasets, protocols, and tooling to enable reliable assessment of frontier coding systems, collaborating with

Qualifications

• 3+ years of experience in software engineering, ML, AI research, or related technical disciplines.
• Experience designing, reviewing, or validating benchmarks, coding tasks, or evaluation methodologies.
• Familiarity with large language models, coding agents, reinforcement learning, model evaluation, or related AI systems.
• Proven ability to build tooling, automate workflows, and improve technical processes through systematic experimentation.
• Strong analytical and communication skills; able to explain complex findings clearly.

Responsibilities

• Design and own evaluation frameworks for coding agents, including benchmarks and scoring.
• Lead end-to-end research on coding model performance across software engineering tasks.
• Develop datasets, golden examples, and evaluation protocols for reliable assessment.
• Analyze model behavior to identify weaknesses and translate findings into improvements.
• Build tooling and infrastructure to support large-scale experimentation and evaluation pipelines.
• Establish best practices for coding-agent assessment with rigor and reproducibility.
• Collaborate with researchers and engineers to design experiments and evaluate model capabilities.
• Contribute to technical reports, benchmark studies, and client-facing research initiatives.

Skills

Python

C++

Software engineering

Machine learning

AI research

Evaluation methodologies

Job description

micro1 is seeking an AI Research Engineer (Remote) to advance evaluation and development of frontier coding agents. The role sits at the intersection of AI research, software engineering, and model evaluation, shaping benchmarks, methodologies, and data systems for next-generation coding models.

You will design evaluation frameworks, lead end-to-end research initiatives, and build datasets, protocols, and tooling to enable reliable assessment of frontier coding systems, collaborating with