Senior AI Systems Engineer - End-to-End LLM Ops | Equity

Zello

Austin, Northern (TX, KY)

Hybrid

USD 140,000 - 190,000

Full time

4 days ago
Be an early applicant
Application generator

A complete application in a minute — tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Zello is seeking an experienced software engineer to join the AI & Data team, building agent systems that power frontline workers.

You will design eval suites, ship end-to-end ML-enabled features, review PRs, monitor production, and coach teammates to raise engineering standards. This IC role emphasizes impact over titles, with focus on robust, testable systems and practical solutions. You'll collaborate across product and platform teams, triage failures, and ensure code quality and reliability.

Qualifications

  • You learned to program properly and can reason about code you did not write.
  • You build things nobody asked you to build.
  • You treat tests and evals as part of shipping, not cleanup afterward.
  • You give code review feedback people act on and coach rather than direct.
  • You connect engineering standards to outcomes rather than to taste.
  • You hold a high bar without making people feel small.
  • You have operated production systems that others depended on.

Responsibilities

  • Build LLM-backed systems end to end and put them in front of people who are not engineers.
  • Design eval suites and monitoring before shipping, not after something breaks.
  • Review agent pull requests and explain why a design will or will not hold up.
  • Operate what you ship: triage drift, chase down silent failures, fix root causes.
  • Set engineering conventions the team actually adopts - testing, structure, error handling.
  • Pair with and coach teammates who are strong analysts and newer to software craft.
  • Tell us when AI is the wrong tool for a problem, before we build it.

Job description

Zello is seeking an experienced software engineer to join the AI & Data team, building agent systems that power frontline workers.

You will design eval suites, ship end-to-end ML-enabled features, review PRs, monitor production, and coach teammates to raise engineering standards. This IC role emphasizes impact over titles, with focus on robust, testable systems and practical solutions. You'll collaborate across product and platform teams, triage failures, and ensure code quality and reliability.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Staff AI Systems Engineer - LLM, Evaluation, Equity
Staff AI Systems Engineer - LLM, Evaluation, Equity

Maven • San Jose (CA)

On-site
USD 180,000 - 240,000
Physical Health Benefits
Mental Health Benefits
Emotional Health Benefits
+5
Senior AI Software Engineer — Production LLM Features
Senior AI Software Engineer — Production LLM Features

Zof AI, Inc. • San Francisco (CA)

On-site
USD 180,000 - 240,000
AI Product Engineer — End-to-End LLM Systems
AI Product Engineer — End-to-End LLM Systems

Chris Baily • New York (NY)

Hybrid
USD 91,000 - 254,000
Unlimited vacation policy
Monthly Phone Stipend
Medical, Dental, Vision insurance
+5
Senior AI Engineer — Remote, Build End-to-End LLM Agents
Senior AI Engineer — Remote, Build End-to-End LLM Agents

Aimlroles • Northern (KY)

Hybrid
USD 250,000 - 300,000
Remote work US/Canada
Annual bonus
Staff AI Platform Engineer - LLM & Agent Runtime (Equity)
Staff AI Platform Engineer - LLM & Agent Runtime (Equity)

Gusto • Denver (CO), California (MO)

Hybrid
USD 180,000 - 240,000
Senior AI Agents Engineer — Scalable LLM Systems & Equity
Senior AI Agents Engineer — Scalable LLM Systems & Equity

Arcadia • New York (NY)

On-site
USD 150,000 - 230,000
Senior AI/ML Engineer — End-to-End AI & LLM Solutions
Senior AI/ML Engineer — End-to-End AI & LLM Solutions

The Solutions Group Llc • Annapolis (MD)

On-site
USD 196,000 - 252,000
Ample PTO
Diversity of medical plans
Generous 401(k)
+1
Senior AI Engineer: End-to-End LLM Apps & Production Systems
Senior AI Engineer: End-to-End LLM Apps & Production Systems

arosplatforms | AI Consulting & Services • North Township (IN)

On-site
USD 120,000 - 170,000
Senior AI Platform Engineer – LLM Agents (Remote)
Senior AI Platform Engineer – LLM Agents (Remote)

tldr • United States

Remote
USD 250,000 - 300,000
Remote across US/Canada
Biannual team offsites
Flexible PTO
+5
Senior AI Software Engineer — LLM & Agentic AI
Senior AI Software Engineer — LLM & Agentic AI

Verint Systems Inc. • California (MO)

Hybrid
USD 143,000 - 155,000