Remote AI Research Engineer — Benchmark & Evaluation Lead

Joblet-AI; Dubai; Remote; AED 734,000 - 955,000; Full time

Benefits offered by this job

Equity compensation

Performance-based bonuses

Health-insurance premium reimbursement

401(k) plan with company match

Job summary

micro1 is seeking an AI Research Engineer (Remote) to advance evaluation and development of frontier coding agents. You will design benchmarks, methodologies, and data systems shaping how coding models are measured and improved.

The role sits at the intersection of AI research, software engineering, and model evaluation, requiring strong software engineering skills and experience with ML systems. This is a remote, full-time position with equity and performance bonuses.

Qualifications

• 3+ years of experience in software engineering, machine learning, or AI research.
• Experience designing benchmarks or evaluation methodologies.
• Familiarity with large language models and coding agents.
• Proven ability to build tooling and automate workflows.
• Excellent written and verbal communication skills.

Responsibilities

• Design and own evaluation frameworks for coding agents, including benchmark specifications, scoring methodologies, rubrics, and quality standards.
• Lead end-to-end research initiatives focused on measuring and improving coding model performance across diverse software engineering tasks.
• Develop high-quality datasets, golden examples, and evaluation protocols that enable reliable assessment of frontier coding systems.
• Analyze model behavior and failure modes, identifying systematic weaknesses and translating findings into actionable improvements for training and evaluation.
• Build tooling and infrastructure that support large-scale experimentation, data generation, review workflows, and evaluation pipelines.
• Establish best practices for coding-agent assessment, ensuring methodological rigor, reproducibility, and measurement quality.
• Partner closely with researchers, engineers, and applied AI teams to design experiments and evaluate emerging model capabilities.
• Contribute to technical reports, benchmark studies, and client-facing research initiatives that communicate model performance and insights.

Skills

Python

C++

Software engineering

ML research

Evaluation benchmarks

Job description

micro1 is seeking an AI Research Engineer (Remote) to advance evaluation and development of frontier coding agents. You will design benchmarks, methodologies, and data systems shaping how coding models are measured and improved.

The role sits at the intersection of AI research, software engineering, and model evaluation, requiring strong software engineering skills and experience with ML systems. This is a remote, full-time position with equity and performance bonuses.