Senior AI/ML Engineer: Scalable LLMs & Real-Time AI

Triwill Group

Lisbon (ME)

Hybrid

USD 180,000 - 260,000

Full time

10 days ago

Get more replies from employers

Send a job-specific resume in minutes.

Benefits offered by this job

Equity
ESPP
Retirement plan
Vacation
Paid holidays
Wellness days
Parental leave
Volunteer time off
Hack weeks
Mental wellness programs

Job summary

PagerDuty is seeking a Senior AI/ML Engineer to design and ship production AI systems that scale across real-time incident management. You’ll own the lifecycle from problem framing to reliable serving, focusing on LLM-powered agents, retrieval, and event intelligence within a high-throughput platform.

You’ll partner with platform, product and research teams to define “good” AI and integrate it cleanly into existing services while maintaining reliability and observability in a fast-paced

Qualifications

  • 5+ years of software engineering in distributed systems.
  • Hands-on production AI systems experience (LLM-powered apps, agents, retrieval).
  • Strong programming fundamentals across systems and AI code.
  • Knowledge of prompting, retrieval, agent patterns, and guardrails for LLMs.
  • Experience with cloud infra (AWS/GCP/Azure), containers, and orchestration (Kubernetes).
  • Reliability-minded, scalable systems design with clear trade-offs.
  • Excellent communication and collaboration.

Responsibilities

  • Design and ship AI-powered features like LLM agents and retrieval in real-time streams.
  • Architect and own prompts orchestration, retrieval pipelines, and low-latency inference at scale.
  • Ensure consistency, throughput, fault tolerance, and cost across services.
  • Move AI features from prototype to production with robust evaluation and observability loops.
  • Collaborate with platform, product, and research teams to integrate AI into services.
  • Mentor teammates and help shape the team's technical direction.

Skills

Distributed systems
Production AI
Cloud (AWS/GCP/Azure)
Kubernetes
Strong coding
Reliability mindset
Communication

Tools

LangChain
LlamaIndex
Kafka
Airflow
Spark

Job description

PagerDuty is seeking a Senior AI/ML Engineer to design and ship production AI systems that scale across real-time incident management. You’ll own the lifecycle from problem framing to reliable serving, focusing on LLM-powered agents, retrieval, and event intelligence within a high-throughput platform.

You’ll partner with platform, product and research teams to define “good” AI and integrate it cleanly into existing services while maintaining reliability and observability in a fast-paced

Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

Senior AI Platform Engineer: Secure, Scalable ML Ops
Senior AI Platform Engineer: Secure, Scalable ML Ops

RealPage, Inc. • Richardson (TX)

Hybrid
USD 105,000 - 181,000
Health, dental, vision insurance
Senior AI/ML Engineer: Production LLMs & Agents (Remote)
Senior AI/ML Engineer: Production LLMs & Agents (Remote)

CyberCoders • California (MO)

Remote
USD 130,000 - 190,000
Remote work
Unlimited vacation
Comprehensive benefits
+3
Senior AI/ML Engineer: Scale LLMs & Real-World Impact
Senior AI/ML Engineer: Scale LLMs & Real-World Impact

United States Digital Space LLC • Boston (MA)

On-site
USD 150,000 - 210,000
Senior AI Platform Engineer: LLMs & Production Systems
Senior AI Platform Engineer: LLMs & Production Systems

CV in • Northern (KY)

Hybrid
USD 140,000 - 200,000
Senior AI/ML Engineer
Senior AI/ML Engineer

Triwill Group • Lisbon (ME)

Hybrid
USD 180,000 - 260,000
Equity
ESPP
Retirement plan
+7
Senior AI Full-Stack Engineer: Scale with LLMs & RAG
Senior AI Full-Stack Engineer: Scale with LLMs & RAG

ASAL TECHNOLOGIES • Palestine (TX)

On-site
USD 120,000 - 180,000
Senior AI Engineer: Build Production-Grade LLM Systems
Senior AI Engineer: Build Production-Grade LLM Systems

Innovaccer Analytics • San Francisco (CA)

On-site
USD 230,000 - 340,000
PTO benefits
Parental leave
Rewards & recognition
+1
Senior AI Engineer: Architect Scalable LLM Pipelines
Senior AI Engineer: Architect Scalable LLM Pipelines

Millennium • Miami (FL)

On-site
USD 140,000 - 210,000
AI/ML Engineer
AI/ML Engineer

Triwill Group • Lisbon (ME)

Hybrid
USD 110,000 - 150,000
Competitive salary
Benefits package
Flexible work arrangements
+2
Senior AI Engineer: Production ML & LLMs (Remote)
Senior AI Engineer: Production ML & LLMs (Remote)

Pragmatike • Los Angeles (CA)

On-site
USD 200,000 - 350,000