Senior AI Engineer - LLM Agents & Platform (Remote)

Smartsheet

United States

Remote

USD 175,000 - 245,000

Full time

14 days+
Application generator

Turn this role into an interview — a resume and cover letter built around what this employer wants.

Get past ATS filters

Benefits offered by this job

Teleworking options from US registered
Udemy online courses access
Parental leave

Job summary

Smartsheet seeks an experienced AI/ML engineer to design, build, and operate production-grade LLM-powered agents and workflows within SmartAssist, collaborating with Engineering and AI Platform teams to advance an Agent Development Lifecycle.

You will own prompts, RAG pipelines, model governance, and evaluation frameworks, mentor peers, and translate business needs into scalable AI solutions deployed on cloud infrastructure (AWS/GCP/Azure), with a strong focus on reliability and responsible AI.

Qualifications

  • Minimum 8 years of software experience with 2+ years in production LLMs.
  • Deep hands-on prompt engineering and context design skills.
  • Strong knowledge of RAG, embeddings, and retrieval evaluation.
  • Experience building or extending LLM evaluation frameworks.
  • Fluency in agent system design and strong Python skills.

Responsibilities

  • Design and build production-grade LLM-powered agents and workflows.
  • Develop prompts, RAG pipelines, and agent reasoning patterns.
  • Implement end-to-end AI systems on cloud infrastructure (AWS/GCP/Azure).
  • Collaborate with engineering, product, and AI platform teams to deliver impact.
  • Mentor engineers on ML best practices and production considerations.
  • Establish best practices for AI development and model governance.

Skills

LLM experience
Prompt engineering
Python
RAG architectures
Agent system design
Model governance
Cross-functional collaboration
Evaluation frameworks
Databricks/Delta

Education

BS or MS in Computer Science

Tools

MLflow
CI pipelines
Multi-agent frameworks

Job description

Smartsheet seeks an experienced AI/ML engineer to design, build, and operate production-grade LLM-powered agents and workflows within SmartAssist, collaborating with Engineering and AI Platform teams to advance an Agent Development Lifecycle.

You will own prompts, RAG pipelines, model governance, and evaluation frameworks, mentor peers, and translate business needs into scalable AI solutions deployed on cloud infrastructure (AWS/GCP/Azure), with a strong focus on reliability and responsible AI.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior AI Engineer — LLM Agents & Production Systems (Remote)
Senior AI Engineer — LLM Agents & Production Systems (Remote)

Smartsheet • United States

Remote
USD 175,000 - 245,000
Medical/Dental/Vision coverage
401k match
Parental leave (up to 24 weeks)
+3
Senior AI Engineer - LLM & Agent Platform (Remote)
Senior AI Engineer - LLM & Agent Platform (Remote)

Smartsheet • Bellevue (WA)

Remote
USD 175,000 - 245,000
401k Match
Monthly stipend
Life insurance
+7
Senior AI Platform Engineer: LLM Workflows & Production
Senior AI Platform Engineer: LLM Workflows & Production

SB Energy • Redwood City (CA)

On-site
USD 160,000 - 190,000
Medical, Dental & Vision
401(k) Match
Paid Time Off & Holidays
+6
Sr. Software Engineer II - AI Engineering (Remote Eligible)
Sr. Software Engineer II - AI Engineering (Remote Eligible)

Smartsheet • United States

Remote
USD 175,000 - 245,000
Teleworking options from US registered
Udemy online courses access
Parental leave
Senior AI Platform Engineer – LLM Agents (Remote)
Senior AI Platform Engineer – LLM Agents (Remote)

tldr • United States

Remote
USD 250,000 - 300,000
Remote across US/Canada
Biannual team offsites
Flexible PTO
+5
Senior Applied AI Engineer — Build LLM Agents (Remote)
Senior Applied AI Engineer — Build LLM Agents (Remote)

Matcha • Northern (KY)

Hybrid
USD 250,000 - 300,000
Home Office Stipend
Learning & Development Stipend
Health benefits
+4
Senior AI Platform Engineer — LLM Agents
Senior AI Platform Engineer — LLM Agents

Justworks • International Falls (MN)

Hybrid
USD 120,000 - 180,000
Senior AI Systems Engineer - Build LLM Agents (Remote)
Senior AI Systems Engineer - Build LLM Agents (Remote)

tldr.tech • United States

Remote
USD 250,000 - 360,000
Health benefits
Home office stipend
Paid parental leave
+3
Senior AI/ML Engineer - LLM Agent Orchestration
Senior AI/ML Engineer - LLM Agent Orchestration

Prodapt • St. Louis (MO)

On-site
USD 130,000 - 210,000
Senior AI PM: Agents & Evaluation Platform (Remote)
Senior AI PM: Agents & Evaluation Platform (Remote)

Smartsheet • United States

On-site
USD 140,000 - 200,000
Employee Stock Purchase
401k Match
Stipend for work
+7