Senior AI Platform Engineer - LLM & Agent Workflows

Toast Tab, Inc.; Dublin; Hybrid; EUR 95,000 - 150,000; Full time

Benefits offered by this job

Hybrid work model (in-office 2 days)

Competitive compensation

Benefits package

Job summary

Toast is seeking a Senior Software Engineer on the AI Agent & Experience team to design and ship backend infrastructure for LLM proxy, AI key management, and observability pipelines.

You will build autonomous agents that participate in the SDLC, extend the internal plugin marketplace, and collaborate across engineering, product, and platform teams to deliver reliable, scalable AI-powered tooling.

Qualifications

• Bachelor's Degree with relevant experience of 5+ years in designing and implementing scalable backend services.
• Demonstrated experience building, deploying, or operating LLM-powered agents or AI-assisted developer tooling.
• Familiarity with AI coding assistants and an interest in extending them through custom plugins or hooks.
• Experience with MCP (Model Context Protocol) or similar agentic integration frameworks.
• Working knowledge of prompt engineering and how LLM behavior responds to context and instructions.
• Strong foundation in Java, Kotlin, or another OO language.
• Experience with distributed systems, REST APIs, and cloud-native infrastructure.
• Strong customer empathy and drive to improve developer experience through platform solutions.

Responsibilities

• Design, build, and ship features across AI platform infrastructure, including the LLM proxy, AI key management, and observability pipelines.
• Develop and extend autonomous agents that participate in the SDLC, such as the AI Review GitHub App and Developer Platform MCP integrations.
• Build on and contribute to the internal plugin marketplace, encoding Toast's architectural standards into AI assistant behavior.
• Implement MCP services and templates that streamline AI-powered workflows across Toast teams.
• Write high-quality, well-tested code and participate in design and code reviews.
• Collaborate with engineers, product managers, and platform teams to translate developer needs into platform solutions.
• Contribute to adoption of agentic development practices and tooling.
• Leverage cutting-edge AI tools to enhance development velocity and innovation.

Skills

Java

Kotlin

Distributed systems

REST APIs

Cloud-native

Prompt engineering

AI tooling

Code reviews

Team collaboration

Education

Bachelor's degree

Tools

LLM Proxy

AI Key Management

Observability pipelines

Langfuse

DataDog

Job description

Toast is seeking a Senior Software Engineer on the AI Agent & Experience team to design and ship backend infrastructure for LLM proxy, AI key management, and observability pipelines.

You will build autonomous agents that participate in the SDLC, extend the internal plugin marketplace, and collaborate across engineering, product, and platform teams to deliver reliable, scalable AI-powered tooling.