Senior AI Agent Engineer: Build & Evaluate Multi-Step Agents

FirstIgnite; As Catro Rúas; Presencial; EUR 70.000 - 95.000; Jornada completa

Descripción de la vacante

FirstIgnite is hiring a Senior AI Agent Engineer to build multi-step, tool-using agents that work with long, document-heavy inputs. You will design, implement, and evaluate agent workflows, wrapping external APIs and ensuring precise, auditable outputs that can be reviewed before any action is taken.

You will work with product and the full-stack team to tighten evaluation, improve accuracy, and hand off to humans at the right moment.

Formación

• 3+ years engineering experience with LLM or agent systems touched by real users.
• Evaluated agents, not just models, and understand multi-step runs beyond single-turn accuracy.
• Integrated against external APIs and translated them into reliable agent-callable interfaces.
• Comfortable with document pipelines: extraction, normalization, and matching to truth sources.
• Familiar with at least one LLM evaluation framework and in-house tooling.

Responsabilidades

• Design and ship long-running, multi-step, tool-using agents across multiple AI SDKs.
• Wrap APIs and partner APIs as tools a agent can call over MCP, including translation when needed.
• Extract structured data from long documents and match against existing records.
• Set up eval suites and measure tool-use correctness and trajectory quality.
• Create citations and confidence signals to speed human review and enable safe handoffs.
• Collaborate with product and domain experts to turn vague quality goals into measurable targets.
• Instrument production traffic and generate golden datasets for regression tests.
• Compare models and prompts across OpenAI, Anthropic, and open-weight options.
• Bootstrap quality signals with synthetic data for new features.
• Write templates and docs to help the team run evals.

Conocimientos

LLM/Agent systems

API integration

Document processing

Evaluation frameworks

Prompt engineering

Herramientas

OpenAI SDK

Anthropic SDK

Vercel AI SDK

LangGraph

Temporal Cloud

Descripción del empleo

FirstIgnite is hiring a Senior AI Agent Engineer to build multi-step, tool-using agents that work with long, document-heavy inputs. You will design, implement, and evaluate agent workflows, wrapping external APIs and ensuring precise, auditable outputs that can be reviewed before any action is taken.

You will work with product and the full-stack team to tighten evaluation, improve accuracy, and hand off to humans at the right moment.