Senior LLM Platform Engineer — AI Tooling & Observability

AllSpice.io

San Francisco (CA)

Hybrid

USD 160,000 - 190,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Equity
Health, dental, vision benefits
Flexible work arrangements
Home office stipend

Job summary

AllSpice.io is seeking a senior software engineer at the intersection of AI platform development, data engineering, and full‑stack product development. You will own the tooling, evaluation systems, and data platforms that empower AllSpice's Generative AI team, with internal users of engineers and product managers and opportunities to build customer-facing experiences.

You will collaborate with engineers and PMs to identify bottlenecks, design end-to-end solutions, and drive adoption.

Qualifications

  • 4+ years of software eng experience with tooling/data platforms or full‑stack web development.
  • Strong SQL skills and data pipeline design experience.
  • Proficiency in Python scripting and automation for data pipelines and tools.
  • Experience building web apps or customer-facing tools with modern frameworks (Vue/React/TypeScript).
  • Experience shipping or maintaining LLM-enabled systems and related infra (evaluation pipelines, observability).
  • Excellent communication to translate technical findings for engineers, PMs, and customers.
  • Customer-first mindset focused on end-user experience and feedback.
  • Project management skills to lead and collaborate with stakeholders.
  • Comfort with ambiguity, autonomy, and fast-moving environments.
  • Bachelor's degree or higher in tech, or equivalent experience.
  • (Preferred) Hybrid work availability at SF/Boston offices.

Responsibilities

  • Own tooling, evaluation systems, and data platforms for AllSpice's AI team.
  • Build internal apps and self-service tools for engineers and PMs; extend to customer-facing experiences as needed.
  • Develop data pipelines and scripts linking internal systems, LLMs, and MCP tools; ensure data quality and privacy.
  • Write documentation and communicate findings to technical and non-technical audiences.
  • Champion code quality, testing, and reliability across the tooling stack.

Skills

Python
TypeScript
SQL

Education

Bachelor's degree or higher in a tech field

Job description

AllSpice.io is seeking a senior software engineer at the intersection of AI platform development, data engineering, and full‑stack product development. You will own the tooling, evaluation systems, and data platforms that empower AllSpice's Generative AI team, with internal users of engineers and product managers and opportunities to build customer-facing experiences.

You will collaborate with engineers and PMs to identify bottlenecks, design end-to-end solutions, and drive adoption.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

AI Platform Engineer - Hardware DevOps & Tools
AI Platform Engineer - Hardware DevOps & Tools

allspice • United States

On-site
USD 180,000 - 240,000
LLM Platform Engineer
LLM Platform Engineer

allspice • United States

On-site
USD 180,000 - 240,000
Sr. Software Engineer - Platform Engineering
Sr. Software Engineer - Platform Engineering

Grubhub • New York (NY)

On-site
USD 180,000 - 260,000
Equity
401k
Medical insurance
+8
Senior AI Platform Architect & Lead, LLM Systems
Senior AI Platform Architect & Lead, LLM Systems

Inspira Financial • New York (NY)

On-site
USD 250,000 - 350,000
AI Systems Architect & LLM Engineer
AI Systems Architect & LLM Engineer

Sphere Software • United States

Remote
USD 120,000 - 170,000
Staff AI Platform Engineer – End-to-End LLM Platform
Staff AI Platform Engineer – End-to-End LLM Platform

Fanatics Inc. • San Francisco (CA)

On-site
USD 190,000 - 280,000
Platform Engineer — AI-Powered Internal Tooling
Platform Engineer — AI-Powered Internal Tooling

Span • United States

On-site
USD 140,000 - 200,000
Senior Data & AI Platform Engineer (Internal Tools)
Senior Data & AI Platform Engineer (Internal Tools)

Unchain Data • Los Angeles (CA)

Hybrid
USD 200,000 - 238,000
AI Engineer: LLM Apps & Scalable AI Solutions
AI Engineer: LLM Apps & Scalable AI Solutions

Steampunk, Inc. • McLean (VA)

On-site
USD 115,000 - 145,000
Senior AI Platform Engineer - Full-Stack & LLM
Senior AI Platform Engineer - Full-Stack & LLM

Stout • New York (NY)

On-site
USD 87,000 - 195,000
Benefits package