Senior AI Platform Engineer - LLM & Agent Workflows

Toast, Inc.

Dublin

Hybrid

EUR 95,000 - 150,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Hybrid work model (in-office 2 days)
Competitive compensation
Benefits package

Job summary

Toast is seeking a Senior Software Engineer on the AI Agent & Experience team to design and ship backend infrastructure for LLM proxy, AI key management, and observability pipelines.

You will build autonomous agents that participate in the SDLC, extend the internal plugin marketplace, and collaborate across engineering, product, and platform teams to deliver reliable, scalable AI-powered tooling.

Qualifications

  • Bachelor's Degree with relevant experience of 5+ years in designing and implementing scalable backend services.
  • Demonstrated experience building, deploying, or operating LLM-powered agents or AI-assisted developer tooling.
  • Familiarity with AI coding assistants and an interest in extending them through custom plugins or hooks.
  • Experience with MCP (Model Context Protocol) or similar agentic integration frameworks.
  • Working knowledge of prompt engineering and how LLM behavior responds to context and instructions.
  • Strong foundation in Java, Kotlin, or another OO language.
  • Experience with distributed systems, REST APIs, and cloud-native infrastructure.
  • Strong customer empathy and drive to improve developer experience through platform solutions.

Responsibilities

  • Design, build, and ship features across AI platform infrastructure, including the LLM proxy, AI key management, and observability pipelines.
  • Develop and extend autonomous agents that participate in the SDLC, such as the AI Review GitHub App and Developer Platform MCP integrations.
  • Build on and contribute to the internal plugin marketplace, encoding Toast's architectural standards into AI assistant behavior.
  • Implement MCP services and templates that streamline AI-powered workflows across Toast teams.
  • Write high-quality, well-tested code and participate in design and code reviews.
  • Collaborate with engineers, product managers, and platform teams to translate developer needs into platform solutions.
  • Contribute to adoption of agentic development practices and tooling.
  • Leverage cutting-edge AI tools to enhance development velocity and innovation.

Skills

Java
Kotlin
Distributed systems
REST APIs
Cloud-native
Prompt engineering
AI tooling
Code reviews
Team collaboration

Education

Bachelor's degree

Tools

LLM Proxy
AI Key Management
Observability pipelines
Langfuse
DataDog

Job description

Toast is seeking a Senior Software Engineer on the AI Agent & Experience team to design and ship backend infrastructure for LLM proxy, AI key management, and observability pipelines.

You will build autonomous agents that participate in the SDLC, extend the internal plugin marketplace, and collaborate across engineering, product, and platform teams to deliver reliable, scalable AI-powered tooling.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Software Engineer, AI Agent Platform & Tools
Senior Software Engineer, AI Agent Platform & Tools

Toast • Ireland

On-site
EUR 100,000 - 140,000
Peer recognition programs
Unlimited Vacation
Sabbatical after five years
+6
Senior Software Engineer (AI Agent & Experience Team)
Senior Software Engineer (AI Agent & Experience Team)

Toast • Ireland

On-site
EUR 100,000 - 140,000
Peer recognition programs
Unlimited Vacation
Sabbatical after five years
+6
Senior Engineering Manager, AI Foundations & Internal Agents
Senior Engineering Manager, AI Foundations & Internal Agents

Toast, Inc. • Dublin

Hybrid
EUR 140,000 - 180,000
Senior AI Architect: Multi-Agent LLM & Platform Design
Senior AI Architect: Multi-Agent LLM & Platform Design

Accenture PLC • Dublin

On-site
EUR 120,000 - 180,000
Staff Software Engineer & Intelligence Platform Lead
Staff Software Engineer & Intelligence Platform Lead

Toast • Ireland

On-site
EUR 140,000 - 200,000
Unlimited Vacation
Sabbatical after five years
Wellness stipend
+5
Senior Production AI Agent Engineer
Senior Production AI Agent Engineer

HS Financial Technologies • Cork

Hybrid
EUR 120,000 - 160,000
Full private medical insurance
Permanent health insurance/income
Life insurance
+8
Principal AI Engineer - LLM & Agentic Systems Lead
Principal AI Engineer - LLM & Agentic Systems Lead

Rapid7 • Dublin

Remote
EUR 140,000 - 210,000
Director, AI Foundations Engineering
Director, AI Foundations Engineering

Toast • Dublin

Hybrid
EUR 140,000 - 190,000
Senior AI Engineer — Remote Production LLMs & Orchestration
Senior AI Engineer — Remote Production LLMs & Orchestration

Jobgether • Ireland

On-site
EUR 120,000 - 180,000
Home-office budget
Learning budget
Senior Software Engineer - AI/LLM-Driven Platform & Systems
Senior Software Engineer - AI/LLM-Driven Platform & Systems

Snowflake • Ireland

On-site
EUR 110,000 - 150,000
Top locations