Senior AI Agent Engineer — Remote

Wizeline; Salamanca; Presencial; EUR 60.000 - 90.000; Jornada completa

Descripción de la vacante

Wizeline, a global AI-native technology solutions provider, is hiring a Senior AI Agent Engineer to design and ship long-running, tool-using agents and build evaluation suites. You will extract structured data from long documents, perform entity resolution, and ensure precise handoffs to humans when needed.

The role emphasizes accuracy, traceability, and collaboration with product and engineering teams. Remote work from Spain with a 3-month contract and potential extension, reporting to Head of

Formación

• 3+ years of engineering experience with LLM or agent systems touched by real users.
• Evaluated agents, not only models, understanding multi-step runs matter.
• Integrated against external APIs and made them reliable for agents.
• Comfortable with document pipelines: extract, normalize, verify vs source of truth.
• Used at least one LLM evaluation framework (in-house tooling included).
• Understanding LLM-as-judge biases (position/verbosity/judge drift) and strategies to mitigate.
• Able to distinguish regression from noise and design experiments answering the right question.
• Able to read customer transcripts, identify failures, and ship fixes with evals.
• Writes clearly; engineers act on eval results they trust.
• Based between NY ET and WEU time zones; Italy is the furthest east acceptable.

Responsabilidades

• Design and ship long-running, multi-step, tool-using agents across AI SDKs and tooling.
• Wrap internal and partner APIs as tools callable by agents.
• Perform entity resolution and fuzzy matching on long documents against records.
• Stand up eval suites and measure tool-use correctness and trajectory quality.
• Generate citations and confidence signals to enable fast human reviews.
• Collaborate with product and domain experts to turn vague goals into measurable outcomes.
• Instrument production traffic and create golden datasets for regression tests.
• Compare models and costs across OpenAI, Anthropic, and open-weight ecosystems.
• Generate synthetic documents and test cases to bootstrap features with no traffic.
• Create templates and tooling to enable the team to run evals independently.

Conocimientos

LLM experience

Agent systems

API integration

Document pipelines

LLM evaluation

Experiment design

Clear writing

Time-zone alignment

Educación

Bachelor's or Master's in CS/Engineering/Data Science

Herramientas

OpenAI Agents SDK

Anthropic Agent SDK

Vercel AI SDK

LangGraph

MCP

Temporal Cloud

Descripción del empleo

Wizeline, a global AI-native technology solutions provider, is hiring a Senior AI Agent Engineer to design and ship long-running, tool-using agents and build evaluation suites. You will extract structured data from long documents, perform entity resolution, and ensure precise handoffs to humans when needed.

The role emphasizes accuracy, traceability, and collaboration with product and engineering teams. Remote work from Spain with a 3-month contract and potential extension, reporting to Head of