Lead AI Quality Engineer - Remote, Equity, 35 PTO

AI Chopping Block, Inc.; Lisboa; Híbrido; EUR 110 000 - 160 000; Tempo integral

Vantagens oferecidas por esta oferta de emprego

Equity grants

35 days PTO

Remote-only

Company retreats

Resumo da oferta

Circle offers a remote‑only, globally distributed team focused on AI-powered product quality. Lead Engineer to design evaluation, observability, and diagnostic infrastructure for Circle's AI agents, guiding a growing team while staying hands‑on.

The role emphasizes speedy experimentation, cross‑functional collaboration, and cost‑efficient model choices. You will work with AI Core engineers to ensure changes improve quality, not just ship features, and help scale production systems across diverse

Qualificações

• 7+ years shipping production software with tool‑using systems.
• Experience with LLM-powered agents and orchestration.
• Strong background in evaluation frameworks and observability.
• Proven ability to design datasets for ML/AI evaluation.
• Fast learner, hands-on leader in dynamic environments.

Responsabilidades

• Build and own evaluation infrastructure, pipelines, scores, and datasets.
• Diagnose where quality breaks down across agent pipelines.
• Grow annotation workflows and AI-generated data for evaluation.
• Run experiments across prompts, models, and agent harness.
• Lead and grow the AI Quality engineering team.
• Partner with AI Core engineering to improve quality.

Conhecimentos

Production software

LLM-powered agents

Observability infra

Experimentation

Code hands-on

Ferramentas

Braintrust

LangSmith

Descrição da oferta de emprego

Circle offers a remote‑only, globally distributed team focused on AI-powered product quality. Lead Engineer to design evaluation, observability, and diagnostic infrastructure for Circle's AI agents, guiding a growing team while staying hands‑on.

The role emphasizes speedy experimentation, cross‑functional collaboration, and cost‑efficient model choices. You will work with AI Core engineers to ensure changes improve quality, not just ship features, and help scale production systems across diverse