AI Ops Agent – Engineer

Jobtailor; Dublin; On-site; EUR 70,000 - 110,000; Full time

Job summary

Jobtailor is seeking a skilled AI automation engineer to map and automate complex business processes. You will architect, build, and integrate autonomous AI agents into our existing suite, primarily using Python and Pydantic AI, with n8n for orchestration.

You will design robust, measurable evaluations of agent performance, ensure system observability via Langfuse, and implement resilient failure handling and human escalation where needed.

Qualifications

• Deep, practical command of LLM behavior, including prompt design, tool and function calling, structured outputs, context management, failure modes, and model selection.
• Strong Python skills and ability to write maintainable code.
• Ability to quickly understand unfamiliar business processes and identify what can be automated.
• Familiarity with deployment processes and CI/CD pipelines is beneficial.

Responsibilities

• Map manual business processes with function owners and decompose them into automatable steps.
• Architect, plan, build, and integrate AI agents into Arbitr's existing agent suite.
• Build automations and AI agents using Python, mainly Pydantic AI, and n8n.
• Integrate agents with MCP tools built by tool developers.
• Create evaluations measuring agent accuracy, cost, and latency.
• Instrument agents with Langfuse tracing.
• Design failure handling, including autonomy boundaries and graceful degradation during outages.
• Keep prompts, payloads, and system instructions model-agnostic to enable provider changes.
• Hand over deployment requirements to IT & Infrastructure without owning deployment or operations.
• Remove high-value manual work across Production, Sales, Marketing, Finance, HR, and Customer Success

Skills

Python programming

AI agent integration

LLM behavior understanding

Automation of business processes

Observability & tracing

Tools

Pydantic AI

n8n

Langfuse

MCP Tools

CI/CD pipelines

Job description

• Map manual business processes with function owners and decompose them into automatable steps
• Architect, plan, build, and integrate AI agents into Arbitr's existing agent suite
• Build automations and AI agents using Python, mainly Pydantic AI, and n8n
• Integrate agents with MCP tools built by tool developers
• Create evaluations measuring agent accuracy, cost, and latency
• Instrument agents with Langfuse tracing
• Design failure handling, including autonomy boundaries, human escalation, and graceful degradation during external API outages
• Keep prompts, payloads, and system instructions model-agnostic to enable provider changes
• Hand over clear deployment requirements to the IT & Infrastructure team without owning infrastructure deployment or operations
• Remove high-value manual work across Production, Sales, Marketing, Finance, HR, and Customer Success

Requirements

• Deep, practical command of LLM behavior, including prompt design, tool and function calling, structured outputs, context management, failure modes, and model selection
• Strong Python skills and ability to write maintainable code
• Ability to quickly understand unfamiliar business processes and identify what can be automated
• Bias toward shipping working, high-impact solutions
• Experience with building eval frameworks and systematically measuring agent quality is beneficial
• Experience with autonomous, self-healing systems, including retries, fallbacks, and recovery without human intervention, is beneficialFamiliarity with deployment processes and CI/CD pipelines is beneficial
• Familiarity with Model Context Protocol (MCP) is beneficial
• Experience fine-tuning small or open-weight models for bounded, high-volume tasks is beneficial
• Familiarity with observability and tracing tools such as Langfuse is beneficial
• Willingness/ability to work with some early-morning calls due to Auckland team overlap
• Employment contract based in Ireland

Core Competencies

Demonstrates expertise in Python programming and AI agent integration, with a strong focus on automating business processes and evaluating agent performance. Proficient in designing resilient systems that handle failures and ensure operational continuity.

Highest-signal resume keywords

• Python Programming
• AI Agent Integration
• LLM Behavior Understanding
• Automation of Business Processes
• Observability and Tracing Tools

Hard Skills

• Python
• Pydantic AI
• Automation
• LLM Behavior
• Prompt Design
• Eval Frameworks
• Self-Healing Systems
• Model Context Protocol
• CI/CD Pipelines
• Agent Evaluation

Soft Skills

• Problem-Solving
• Adaptability
• Collaboration

Industry Keywords

• Business Process Automation
• AI Agents
• Observability
• Tracing
• Deployment Processes

Tools & Technologies

• N8n
• Langfuse
• MCP Tools