Senior AI Systems Engineer: RAG, Agents & Production ML

Pendo

New York (NY)

Hybrid

USD 209,000 - 235,000

Full time

14 days+
Application generator

Turn this role into an interview — a resume and cover letter built around what this employer wants.

Get past ATS filters

Benefits offered by this job

Highly competitive employer-heavy coverage
401(k) match
Equity
Flexible time off

Job summary

Pendo is hiring a Sr. AI Software Engineer in New York to develop AI-native experiences. You’ll design and implement LLM-powered systems while making technical decisions and owning deployment. This role requires strong system design and MLOps experience, with a focus on model evaluation and full-stack product shipping. Compensation is competitive, ranging from $209,000 to $235,000, with robust benefits in a hybrid work environment.

Qualifications

  • Deep hands-on experience building and shipping LLM-powered systems.
  • Strong technical depth in system design.
  • Experience owning technical quality beyond your own features.
  • Strong command of model evaluation principles.
  • Solid understanding of modern model architectures.
  • Production MLOps experience.
  • Strong full-stack fundamentals.
  • Exceptional communication skills.
  • Demonstrated product thinking.

Responsibilities

  • Design and build AI systems from prototype through production.
  • Make principled technical decisions.
  • Instrument and evaluate model outputs rigorously.
  • Own model deployment and monitoring.
  • Contribute across the stack to ship AI-powered experiences.
  • Partner with product and design teams.

Skills

Building and shipping LLM-powered systems
System design
Technical quality ownership
Model evaluation
Understanding modern model architectures
Production MLOps experience
Full-stack fundamentals
Exceptional communication skills
Product thinking

Job description

Pendo is hiring a Sr. AI Software Engineer in New York to develop AI-native experiences. You’ll design and implement LLM-powered systems while making technical decisions and owning deployment. This role requires strong system design and MLOps experience, with a focus on model evaluation and full-stack product shipping. Compensation is competitive, ranging from $209,000 to $235,000, with robust benefits in a hybrid work environment.
Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

Senior AI Engineer — Build Production-Ready AI Systems
Senior AI Engineer — Build Production-Ready AI Systems

Pendo.io • New York (NY)

Hybrid
USD 209,000 - 235,000
Senior AI Software Engineer - RAG & Production AI (Hybrid)
Senior AI Software Engineer - RAG & Production AI (Hybrid)

Pendo • New York (NY)

Hybrid
USD 209,000 - 235,000
$0 premium health options
Strong 401(k) match
Equity
+1
Staff AI Engineer: Build Production-Grade AI Systems
Staff AI Engineer: Build Production-Grade AI Systems

Pendo • New York (NY)

On-site
USD 250,000 - 280,000
Highly competitive benefits
$0 premium options
Strong 401(k) match
+2
Staff AI Engineer — AI-Native Platform Builder
Staff AI Engineer — AI-Native Platform Builder

Pendo.io • New York (NY)

On-site
USD 130,000 - 180,000
Staff AI Engineer: Production-Grade LLM Systems (Hybrid)
Staff AI Engineer: Production-Grade LLM Systems (Hybrid)

Pendo • New York (NY)

Hybrid
USD 245,000 - 275,000
Highly competitive benefits
Strong 401(k) match
Flexible time off
Senior AI Engineer: Agent Systems & Production ML (Equity)
Senior AI Engineer: Agent Systems & Production ML (Equity)

Oakwell Hampton Group • New York (NY)

On-site
USD 170,000 - 250,000
Senior ML Engineer — Real-Time AI Agents & RAG
Senior ML Engineer — Real-Time AI Agents & RAG

Cresta • United States

Remote
USD 205,000 - 270,000
Comprehensive medical, dental, and vision coverage
Flexible PTO
Paid parental leave
+4
Senior ML Engineer - Production AI Agents Leader
Senior ML Engineer - Production AI Agents Leader

Scale AI, Inc. • New York (NY)

On-site
USD 218,000 - 273,000
Comprehensive health, dental and vision coverage
Retirement benefits
Learning and development stipend
+2
Senior AI/ML Engineer — RAG & LLM Systems Lead
Senior AI/ML Engineer — RAG & LLM Systems Lead

Vizient, Inc • Chicago (IL)

Hybrid
USD 102,000 - 179,000
Comprehensive benefits plan
Incentive eligibility
Professional development opportunities
Senior AI Engineer — Production LLM Systems
Senior AI Engineer — Production LLM Systems

CyberCoders • New York (NY)

On-site
USD 220,000 - 280,000
Unlimited PTO
Wellhub Platinum membership
Comprehensive health, dental, and vis​
+1