Remote Staff Engineer - Coding Agent Evaluation & Research

micro1 Inc.

United States

Remote

USD 200,000 - 260,000

Full time

9 days ago

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Equity compensation
Health insurance premium reimbursement
401(k) with company match
Remote-first workforce

Job summary

micro1 Inc. is hiring a Member of Technical Staff to lead evaluation and development of frontier coding agents. You will design benchmarks, datasets, and evaluation pipelines at the intersection of AI research and software engineering.

This remote role requires 3+ years in software/ML, strong Python/C++, and experience building scalable tooling. You will collaborate across research and applied AI teams and contribute to reports and client-facing research.

Qualifications

  • 3+ years of software engineering, machine learning, or AI research experience.
  • Experience designing, reviewing, or validating benchmarks and evaluation methodologies.
  • Strong knowledge of large language models and coding agents.

Responsibilities

  • Design and own evaluation frameworks for coding agents, including benchmark specs, scoring, rubrics, and quality standards.
  • Lead end-to-end research initiatives to measure and improve coding model performance across tasks.
  • Develop high-quality datasets, golden examples, and evaluation protocols for reliable assessment.
  • Analyze model behavior and failure modes to derive actionable training/evaluation improvements.
  • Build tooling and infrastructure to support large-scale experimentation and evaluation pipelines.
  • Establish best practices for coding-agent assessment, ensuring rigor and reproducibility.
  • Collaborate with researchers, engineers, and applied AI teams to design experiments and evaluate capabilities.
  • Contribute to technical reports, benchmark studies, and client-facing research.

Skills

Python
C++
Software engineering

Job description

micro1 Inc. is hiring a Member of Technical Staff to lead evaluation and development of frontier coding agents. You will design benchmarks, datasets, and evaluation pipelines at the intersection of AI research and software engineering.

This remote role requires 3+ years in software/ML, strong Python/C++, and experience building scalable tooling. You will collaborate across research and applied AI teams and contribute to reports and client-facing research.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Remote Staff Scientist, Coding Agent Evaluation & Benchmarks
Remote Staff Scientist, Coding Agent Evaluation & Benchmarks

Remotebridge • United States

Remote
USD 200,000 - 260,000
Equity compensation
Performance-based bonuses
Health-insurance premium reimbursement
+2
AI Research Engineer - Coding Agents Evaluation (Remote)
AI Research Engineer - Coding Agents Evaluation (Remote)

Joblet-AI • United States

Remote
GBP 151,000 - 197,000
Equity compensation
Performance-based bonuses
Health-insurance reimbursement
+2
Coding Research Evaluation Engineer
Coding Research Evaluation Engineer

Remotebridge • United States

Remote
USD 200,000 - 260,000
Equity compensation
Bonus eligibility
Health-insurance reimbursement
+2
Member of Technical Staff, Coding Agent Research & Evaluations
Member of Technical Staff, Coding Agent Research & Evaluations

Frontier AI Lab • United States

Remote
USD 200,000 - 260,000
Equity compensation
Performance-based bonuses
Health-insurance premium reimbursement
+2
Member of Technical Staff, Coding Research
Member of Technical Staff, Coding Research

Remotebridge • United States

Remote
USD 200,000 - 260,000
Equity compensation
Bonus eligibility
Health-insurance reimbursement
+2
Member of Technical Staff, Coding Agent Research & Evaluations
Member of Technical Staff, Coding Agent Research & Evaluations

micro1 Inc. • United States

Remote
USD 200,000 - 260,000
Equity compensation
Health insurance premium reimbursement
401(k) with company match
+1
AI Research Engineer (Remote)
AI Research Engineer (Remote)

Joblet-AI • United States

Remote
GBP 151,000 - 197,000
Equity compensation
Performance-based bonuses
Health-insurance reimbursement
+2
Member of Technical Staff, Coding Agent Research & Evaluations
Member of Technical Staff, Coding Agent Research & Evaluations

Confidential • United States

Remote
USD 200,000 - 260,000
Equity compensation
Performance-based bonuses
Health-insurance premium reimbursement
+2
Senior Software Engineer, AI Evaluation & Coding Agents
Senior Software Engineer, AI Evaluation & Coding Agents

24 Mag • New York (NY)

Remote
USD 138,000 - 207,000
Remote Lead, Coding-Agent Evaluation & Benchmarking
Remote Lead, Coding-Agent Evaluation & Benchmarking

Confidential • United States

Remote
USD 200,000 - 260,000
Equity compensation
Performance-based bonuses
Health-insurance premium reimbursement
+2