Senior AI Agent Engineer - Remote, Precision-Focused

FirstIgnite; España; Presencial; EUR 90.000 - 130.000; Jornada completa

Descripción de la vacante

FirstIgnite, a company building software for university tech transfer offices, seeks a Senior AI Agent Engineer. The role focuses on building agents that process long, structured documents and generate review-ready outputs.

You will operate across multiple AI SDKs, wrap external APIs as tools, and design evaluation frameworks to ensure accuracy and traceability in every run. Based remotely across compatible time zones, you will collaborate with product and engineering teams to transform vague

Formación

• 3+ years of engineering experience with LLM or agent systems touched by real users.
• You've evaluated agents, not just models, and understand multi-step runs.
• You've integrated APIs, even poorly documented ones, into agent-callable interfaces.
• You’re comfortable with document pipelines and matching against a truth source.
• You've used an LLM evaluation framework, including in-house tools.
• You understand bias and drift in LLM-as-judge methods and mitigation strategies.
• You can read transcripts, identify failures, and ship fixes with evals.

Responsabilidades

• Design and ship long-running, multi-step, tool-using agents across AI SDKs and tooling.
• Wrap APIs as tools an agent can call, including translation for old systems.
• Extract structured data from long documents and reconcile with existing records.
• Build eval suites to measure tool-use correctness and trajectory quality.
• Create citations and confidence signals to speed review and handoffs.
• Simplify vague goals into measurable quality outcomes with domain input.
• Instrument production traffic and generate golden datasets for regression tests.
• Compare models and prompts, analysing latency and quality tradeoffs.
• Bootstrap synthetic data for features lacking production traffic and edge cases.
• Write templates, docs, and tooling for the team to run evals independently.

Conocimientos

LLM systems

Agent orchestration

API integration

Document processing

Experiment design

Evaluation frameworks

Clear communication

Herramientas

OpenAI Agents SDK

LangGraph

Temporal Cloud

MCP tools

Descripción del empleo

FirstIgnite, a company building software for university tech transfer offices, seeks a Senior AI Agent Engineer. The role focuses on building agents that process long, structured documents and generate review-ready outputs.

You will operate across multiple AI SDKs, wrap external APIs as tools, and design evaluation frameworks to ensure accuracy and traceability in every run. Based remotely across compatible time zones, you will collaborate with product and engineering teams to transform vague