Coding Research Evaluation Engineer

Remotebridge; United States; Remote; USD 200,000 - 260,000; Full time

Benefits offered by this job

Equity compensation

Bonus eligibility

Health-insurance reimbursement

401(k) with company match

Remote-first workforce benefits

Job summary

micro1 seeks a Member of Technical Staff to advance evaluation and development of frontier coding agents. This remote role sits at the intersection of AI research, software engineering, and model evaluation, and you will design benchmarks, methodologies, and data systems that shape how coding models are measured and improved.

You will build evaluation frameworks, lead research initiatives, develop datasets and protocols, analyze model behavior, and create tooling for large-scale experiments.

Qualifications

• Strong software engineering background with expertise in Python, C++, or comparable programming languages.
• 3+ years of experience in software engineering, machine learning, AI research, evaluation, or related technical disciplines.
• Experience designing, reviewing, or validating technical assessments, benchmarks, coding tasks, or evaluation methodologies.
• Familiarity with large language models, coding agents, reinforcement learning, model evaluation, or related AI systems.
• Proven ability to build tooling, automate workflows, and improve technical processes through systematic experimentation.
• Strong analytical skills with the ability to investigate model behavior and derive insights from complex technical systems.
• Excellent written and verbal communication skills, including the ability to clearly articulate technical findings to diverse audiences.
• Comfortable operating in fast-moving research environments with significant ambiguity and evolving priorities.

Responsibilities

• Design and own evaluation frameworks for coding agents, including benchmark specifications, scoring methodologies, rubrics, and quality standards.
• Lead end-to-end research initiatives focused on measuring and improving coding model performance across diverse software engineering tasks.
• Develop high-quality datasets, golden examples, and evaluation protocols that enable reliable assessment of frontier coding systems.
• Analyze model behavior and failure modes, identifying systematic weaknesses and translating findings into actionable improvements for training and evaluation.
• Build tooling and infrastructure that support large-scale experimentation, data generation, review workflows, and evaluation pipelines.
• Establish best practices for coding-agent assessment, ensuring methodological rigor, reproducibility, and measurement quality.
• Partner closely with researchers, engineers, and applied AI teams to design experiments and evaluate emerging model capabilities.
• Contribute to technical reports, benchmark studies, and client-facing research initiatives that communicate model performance and insights.

Skills

Python

C++

Software engineering

Machine learning

Research

Job description

micro1 seeks a Member of Technical Staff to advance evaluation and development of frontier coding agents. This remote role sits at the intersection of AI research, software engineering, and model evaluation, and you will design benchmarks, methodologies, and data systems that shape how coding models are measured and improved.

You will build evaluation frameworks, lead research initiatives, develop datasets and protocols, analyze model behavior, and create tooling for large-scale experiments.