Founding AI Engineer: LLM Infra, Evals & Observability

Jobtailor; Amsterdam; On-site; EUR 120,000 - 180,000; Full time

Job summary

Jobtailor is seeking a senior software engineer to design and own LLM infrastructure, routing across multiple frontier providers, and building eval harnesses that ground AI recommendations in real pricing outcomes.

You will ensure EU data residency compliance, extend MCP servers for programmatic control, and develop observability to surface trust signals for human reviewers, while communicating complex concepts to non-technical stakeholders.

Qualifications

• 8+ years of software engineering experience with strong, recent production LLM depth.
• Shipping and owning LLM-powered features in production.
• Built evals and observability for LLM systems.
• Proficient in TypeScript/Python, FastAPI, GCP, and modern LLM tooling.
• Excellent communicator to explain non-deterministic concepts to non-technical stakeholders.

Responsibilities

• Design and build eval harnesses and benchmarks that use tracked pricing outcomes as ground truth for AI recommendations.
• Own LLM infrastructure and model routing across multiple frontier providers with explicit cost/latency/quality tradeoffs.
• Maintain EU data-residency boundaries for EU customer model calls, ensuring compliance with applicable data regulations.
• Extend an MCP server so LLM agents — including customers' own agents — can programmatically drive the platform.
• Build observability and feedback loops that surface where the AI earns or loses trust from human reviewers.
• Bridge non-deterministic engineering concepts clearly to less technical stakeholders (sales, customer success, leadership).

Skills

LLM Infrastructure Ownership

Production LLM Depth

Eval Harness Development

Full Stack Development

Strong Communication Skills

Tools

GCP

Modern LLM Tooling

Job description

Jobtailor is seeking a senior software engineer to design and own LLM infrastructure, routing across multiple frontier providers, and building eval harnesses that ground AI recommendations in real pricing outcomes.

You will ensure EU data residency compliance, extend MCP servers for programmatic control, and develop observability to surface trust signals for human reviewers, while communicating complex concepts to non-technical stakeholders.