Remote AI Systems Engineer - Agent Evaluation & Benchmarks

Gradient Consulting; Time; A distancia; NOK 1.890.000 - 2.363.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Equity compensation

Health insurance reimbursement

401(K) plan with company match

Remote-first workforce

Descripción de la vacante

micro1 is seeking a Member of Technical Staff for Cortex Lab (applied AI research) in a remote role. You will develop, evaluate, and improve AI agents and LLM-powered systems used in real-world enterprise workflows.

You will design evaluation frameworks, run rapid experiments, and collaborate with researchers, engineers, and customers to push the boundaries of reliable AI systems. Equity and robust benefits are offered.

Formación

• Strong background in applied AI research, research engineering, ML, or LLM-based systems.
• Hands-on experience designing evaluations for AI agents and end-to-end workflows.
• Strong Python programming and building evaluation pipelines.

Responsabilidades

• Design evaluation frameworks, benchmarks, and datasets for LLM-powered agents.
• Identify and analyze model and workflow failures in production.
• Run rapid experiments to validate hypotheses and improve agent reliability.
• Partner with customers and researchers to evaluate, deploy, and optimize AI systems.
• Develop training data, task specs, and feedback mechanisms to improve performance.
• Build Python-based evaluation pipelines and lightweight research infra.
• Collaborate across research, engineering, and customer teams on evaluation strategies.
• Contribute to reports, benchmarks, and insights for future system improvements.

Conocimientos

Applied AI research

Python programming

Experimental design

Team collaboration

Herramientas

Python

Evaluation tooling

ML infrastructure

Descripción del empleo

micro1 is seeking a Member of Technical Staff for Cortex Lab (applied AI research) in a remote role. You will develop, evaluate, and improve AI agents and LLM-powered systems used in real-world enterprise workflows.

You will design evaluation frameworks, run rapid experiments, and collaborate with researchers, engineers, and customers to push the boundaries of reliable AI systems. Equity and robust benefits are offered.