Frontier Coding Agent Research Engineer (Remote)

Joblet-AI; Ireland; Remote; EUR 181,000 - 236,000; Full time

Benefits offered by this job

Equity compensation

Health-insurance reimbursement

Paid time off

401(K) plan with company match

Job summary

micro1 is seeking a Member of Technical Staff to advance evaluation and development of frontier coding agents. You will design benchmarks, methodologies, and data systems to measure and improve next-generation coding models.

Responsibilities include leading research, building datasets and evaluation protocols, and creating tooling for large-scale experimentation. A strong software engineering background and experience with AI model evaluation are essential.

Qualifications

• Strong software engineering background with Python or C++ experience.
• Experience designing, reviewing, or validating benchmarks or evaluation methods.
• Familiarity with large language models, coding agents, or RL/evaluation systems.
• Proven ability to build tooling and automate workflows for large-scale experiments.

Responsibilities

• Design and own evaluation frameworks for coding agents, including benchmarks and rubrics.
• Lead end-to-end research on measuring and improving coding model performance.
• Develop datasets, golden examples, and evaluation protocols for frontier coding systems.
• Analyze model behavior to identify weaknesses and improvements for training and evaluation.
• Build tooling and infrastructure to support large-scale experimentation and pipelines.
• Establish best practices for coding-agent assessment to ensure rigor and reproducibility.
• Collaborate with researchers and engineers to design experiments and share insights.
• Contribute to technical reports and benchmark studies communicated to clients.

Skills

Python

C++

Software engineering

ML research

Evaluation design

Automation tooling

Communication

Ambiguity handling

Job description

micro1 is seeking a Member of Technical Staff to advance evaluation and development of frontier coding agents. You will design benchmarks, methodologies, and data systems to measure and improve next-generation coding models.

Responsibilities include leading research, building datasets and evaluation protocols, and creating tooling for large-scale experimentation. A strong software engineering background and experience with AI model evaluation are essential.