AI Agent Architect for Compliance & Document AI

Xebia Group; Polska; Hybrid; PLN 90,000 - 130,000; Full time

Job summary

Xebia Group is seeking a hands-on AI/agent systems engineer to design and implement multi‑role decision workflows, model routing, and Document AI capabilities for credit and compliance use cases.

You will build retrieval and context capabilities with embeddings, ensure data residency, and collaborate across prototype and production streams to deliver scalable AI solutions within EU data guidelines.

Qualifications

• Hands‑on experience building AI or agent‑based solutions.
• Experience designing or implementing LLM/AI agent workflows.
• Experience with model integration and routing, including cost, latency and risk considerations.
• Experience designing controlled tool interfaces for AI agents.
• Knowledge of MCP‑based tool interfaces or similar permissioned agent‑tool integrations.
• Practical experience with Document AI capabilities such as OCR, structured extraction, PII detection or masking.
• Experience with retrieval architectures using embeddings and vector or lexical search.
• Experience designing evaluation approaches for AI systems, including model or prompt evaluation.
• Understanding of observability requirements for agent behaviour.
• Ability to design AI solutions that operate through permissioned, logged and auditable interfaces.
• Ability to collaborate across prototype and production streams.
• Available to join within 2 weeks.

Responsibilities

• Building agents supporting credit, KYC/compliance, document handling and exception triage.
• Implementing multi‑role decision patterns for high‑impact cases, including analyst, critic and guardian roles.
• Developing a model gateway capable of routing requests between models according to cost, risk and latency.
• Supporting self‑hosted models where data residency requirements make this necessary.
• Building MCP tool interfaces that restrict agent actions to permissioned and logged tools.
• Developing Document AI capabilities covering OCR, information extraction, PII detection and masking.
• Building retrieval and context capabilities using embeddings, vector search, lexical search and a knowledge graph.
• Developing an evaluation framework for AI behaviour, including evals, A/B testing of models and prompts, and observability.
• Working with the Foundation and Lab streams to ensure AI concepts can be implemented on the target platform.

Skills

AI agent development

LLM workflows

Model routing

Agent tools

MCP interfaces

Document AI

Embeddings retrieval

AI evaluation

Observability

Audit trails

Cross‑team collaboration

Availability

Job description

Xebia Group is seeking a hands-on AI/agent systems engineer to design and implement multi‑role decision workflows, model routing, and Document AI capabilities for credit and compliance use cases.

You will build retrieval and context capabilities with embeddings, ensure data residency, and collaborate across prototype and production streams to deliver scalable AI solutions within EU data guidelines.