Senior AI Engineer - Production-Scale LLM Systems

Plaud

Palo Alto (CA)

Hybrid

USD 159,000 - 239,000

Full time

4 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Ownership & impact
Competitive compensation
Comprehensive benefits
401(k) plan matching
Unlimited PTO
New parent leave
Hybrid office
Equipment provided
Team offsites

Job summary

Plaud Inc. is building the real-world AI interface for professionals to amplify intelligence and productivity. We seek experienced backend engineers to design and run LLM-powered services, with a focus on reliability and scale, in a hybrid office setting in Palo Alto.

You will work on generation pipelines, model routing, and production-grade systems that handle millions of users while optimizing quality, latency, and cost. Join a fast-growing, impactful team driving human-AI interaction.

Qualifications

  • 5+ years of backend engineering experience, with strong production skills in Python or Go.
  • Hands-on experience building and running LLM- or ML-powered services in production, including model integration and graceful fallback across providers. Prototypes and internal tooling alone do not qualify.
  • Proven experience scaling high-volume, asynchronous distributed systems for availability and performance.
  • Experience measuring and improving AI output quality with data, e.g. automated evaluation, judges calibrated against human ratings, or controlled experiments.
  • Strong judgment on tradeoffs between AI quality, latency and cost.

Responsibilities

  • Design and build the AI services that turn recordings into summaries and notes, from LLM orchestration and model routing to delivering results reliably to millions of users.
  • Build generation pipelines that adapt to each recording's content, context and user preferences, choosing the right models, strategies and level of detail for each one.
  • Solve hard scaling problems: keep AI generation highly available across multiple model providers, absorb large and spiky workloads, and keep results fast at any size.
  • Turn real-world usage and evaluation signals into continuous, measurable quality gains, so that model, prompt and pipeline changes improve the product release after release without regressions.
  • Partner with AI research and evaluation teams to take new models and capabilities from experiment to production, and use AI tooling to speed up your own development.

Skills

Backend engineering
Python
Go
LLM services
Distributed systems
AI evaluation
Latency/cost tradeoffs

Tools

GPUs
Cloud-native infra
Multi-region deployment

Job description

Plaud Inc. is building the real-world AI interface for professionals to amplify intelligence and productivity. We seek experienced backend engineers to design and run LLM-powered services, with a focus on reliability and scale, in a hybrid office setting in Palo Alto.

You will work on generation pipelines, model routing, and production-grade systems that handle millions of users while optimizing quality, latency, and cost. Join a fast-growing, impactful team driving human-AI interaction.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Production AI Engineer for LLMs and Multi-Agent Apps
Production AI Engineer for LLMs and Multi-Agent Apps

IntelliPro Group • Palo Alto (CA)

On-site
USD 180,000 - 240,000
Senior AI Engineer — Scale Gen AI Pipelines (Hybrid)
Senior AI Engineer — Scale Gen AI Pipelines (Hybrid)

Plaud • East Palo Alto (CA)

Hybrid
USD 159,000 - 239,000
Ownership & Impact
Competitive Compensation
Comprehensive Benefits
+6
Senior AI Engineer, Production LLM Agents
Senior AI Engineer, Production LLM Agents

Adobe (old) • San Jose (CA)

On-site
USD 178,000 - 258,000
Senior AI Platform Engineer - Production Systems
Senior AI Platform Engineer - Production Systems

People in AI • San Francisco (CA)

Hybrid
USD 140,000 - 200,000
Backend AI Engineer – LLM & Real-Time Systems
Backend AI Engineer – LLM & Real-Time Systems

Embedding VC • Palo Alto (CA)

On-site
USD 140,000 - 200,000
Senior AI Production Engineer: LLMs & Agent Workflows
Senior AI Production Engineer: LLMs & Agent Workflows

Acceler • United States

Remote
USD 140,000 - 190,000
Senior AI Engineer — Production-Grade LLM Applications
Senior AI Engineer — Production-Grade LLM Applications

Diverse Lynx, LLC • Long Beach (CA)

On-site
USD 96,000 - 165,000
Senior AI Engineer
Senior AI Engineer

Brainfullstack Ltd. • San Francisco (CA)

Remote
USD 185,000 - 235,000
Senior Generative AI Engineer — LLM Production & Backend
Senior Generative AI Engineer — LLM Production & Backend

Robotics Technologies • Plano (TX)

On-site
USD 150,000 - 210,000
Senior AI/ML Engineer: Production LLMs & Orchestration
Senior AI/ML Engineer: Production LLMs & Orchestration

CyberCoders, Inc. • United States

Remote
USD 180,000 - 240,000
Remote work
Unlimited vacation
Comprehensive benefits
+2