LLM Platform Engineer

Schemata Inc.

San Francisco, Northern (CA, KY)

Hybrid

USD 140,000 - 210,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Competitive salary
Meaningful equity stake
Comprehensive health coverage
401(k) plan
Paid parental leave
High visibility and real impact

Job summary

Schemata Inc. is seeking a highly skilled LLM Platform Engineer to design, build and optimize AI systems that turn diverse data into real-time guidance for training and maintenance applications.

You will own end-to-end deployment across cloud, on-premises and air-gapped environments, ensuring low latency and reliable performance in regulated industries. This senior role emphasizes production-grade ML systems and cross-functional collaboration.

Qualifications

  • 4+ years of software engineering experience.
  • Experience building production LLM systems (RAG pipelines, agents, or LLM-powered products).
  • Hands-on experience with knowledge ingestion and retrieval systems.
  • Strong Python and backend engineering fundamentals.
  • Experience deploying and operating production systems: CI/CD, release management, monitoring.

Responsibilities

  • Design and build multimodal knowledge base ingestion pipelines.
  • Improve retrieval-augmented generation (RAG) systems including chunking, indexing, and grounding.
  • Build knowledge base lifecycle with versioning, SME corrections, and validation.
  • Scale the feedback loop using user signals to improve retrieval and content.
  • Own deployment and delivery lifecycle across cloud, on-premises and air-gapped environments.
  • Strengthen AI feature reliability and latency through profiling, caching, and graceful degradation.
  • Collaborate with spatial computing, mobile, and product engineers to connect knowledge base with 3D scene representations.
  • Lead the end-to-end from evaluation to production inference and optimization.
  • 4+ years of software engineering experience, with at least 1–2 years building production LLM systems.

Skills

LLM system design
RAG pipelines
multimodal retrieval
Python programming
backend systems
cloud computing
metrics-driven development
production systems
CI/CD
monitoring

Tools

AWS
CI/CD pipelines
GPU serving

Job description

Help us build the world's best spatial intelligence products

Location
Employment Type

Full time

Location Type

On-site

Department

About Schemata

At Schemata, we are transforming the $400 B virtual‑training and simulation market by fusing 3D computer vision, neural rendering and large multimodal models inside highly regulated industries. Our platform delivers photorealistic, intelligent 3D experiences, demanding robust spatial reasoning, high‑performance data pipelines and seamless integration between traditional graphics and AI‑driven perception.

About the Role

We are seeking a highly skilled LLM Platform Engineer to join our team full‑time. You will play a foundational role in designing, building and optimizing the AI systems that turn heterogeneous knowledge — technical documentation, video, imagery, voice, and 3D scene data — into grounded, real‑time guidance for next‑generation training and maintenance applications.

This is a high‑impact, cross‑functional role: you will work end‑to‑end from evaluating emerging methods to production inference and performance optimization, ensuring our platform retrieves the right knowledge, reasons over it reliably, and responds in real time across diverse deployment environments.

Core Responsibilities

Design and build multimodal knowledge base ingestion: pipelines that convert documents, video, images, audio, and structured data into a unified, queryable semantic layer with rich embeddings and metadata, including bringing in external sources and messy real‑world formats as they arise.

Improve our retrieval‑augmented generation (RAG) systems: chunking and indexing strategies, hybrid retrieval, reranking, grounding controls, and context assembly for multimodal queries.

Build the knowledge base lifecycle: handle versioned documentation updates, incorporate SME corrections and annotations, and design validation and freshness mechanisms so the knowledge base improves continuously.

Scale the feedback loop: capture user signals (ratings, corrections, query patterns), route them into measurable improvements to retrieval and content, and build a durable picture of how the AI is performing in the field.

Own the deployment and delivery lifecycle of AI system updates across cloud, on‑premises, and air‑gapped environments: packaging, release management, configuration, and monitoring.

Strengthen the reliability and latency of AI features: profiling inference paths, caching, fallback behavior, and graceful degradation in production.

Collaborate with spatial computing, mobile, and product engineers to connect the knowledge base with 3D scene representations and ship mission‑critical features.

4+ years of software engineering experience, with at least 1–2 years building production LLM systems (RAG pipelines, agents, or LLM‑powered products with real users).

Hands‑on experience designing knowledge ingestion and retrieval systems: embedding models, vector and hybrid search, chunking strategies, and semantic data modeling across more than one modality.

Strong Python and backend engineering fundamentals: APIs, data pipelines, async systems, and working in a cloud environment (AWS preferred).

A metrics‑driven approach: experience building evals or benchmarks for LLM systems and using them to drive iteration, not just report scores.

Demonstrated ability to take ambiguous problems from prototype to reliable, maintainable production services.

Experience deploying and operating production systems: CI/CD, release management, and monitoring.

Nice to Have

Experience fine‑tuning open-weight models (LoRA/PEFT, distillation) or deploying quantized models for offline, edge, or on‑premises environments.

Research background or publications in retrieval, multimodal learning, or agentic systems, or a track record of translating recent research into shipped capabilities.

Voice pipeline experience: streaming STT/TTS, latency optimization for real‑time conversational systems.

Familiarity with 3D or spatial data (scene graphs, point clouds, 3DGS) and grounding language models in spatial representations.

MLOps and inference infrastructure experience: GPU serving, model versioning, cost/latency optimization at scale.

Defense, aerospace, energy or other regulated‑industry experience; active or ability to obtain U.S. security clearance.

Why Join Us?
  • Competitive salary that reflects your experience and track record
  • Meaningful equity stake in a high-growth, venture-backed defense tech startup, so you share in the upside you help create
  • Comprehensive health coverage: medical, dental, and vision insurance
  • 401(k) plan
  • Paid parental leave
  • High visibility and real impact: Collaborate with world‑class engineers and researchers in a high-ownership environment.

Experience the future of spatial intelligence

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Spatial Computing Engineer
Spatial Computing Engineer

Schemata Inc. • San Francisco (CA)

On-site
USD 140,000 - 200,000
Competitive salary
Equity stake
Comprehensive health coverage
+2
Spatial Computing Research Engineer
Spatial Computing Research Engineer

Schemata • San Francisco (CA)

On-site
USD 185,000 - 240,000
Equity stake
Health coverage
Competitive salary
+3
Principal LLM Application Engineer
Principal LLM Application Engineer

system_two • Palo Alto (CA)

Remote
USD 180,000 - 260,000
Medical, Dental, Vision
Equity in the company
Mobile Engineer
Mobile Engineer

Schemata Inc. • San Francisco (CA)

On-site
USD 120,000 - 180,000
Competitive salary
Meaningful equity stake
Comprehensive health coverage
+2
Senior Machine Learning Engineer (LLMs)
Senior Machine Learning Engineer (LLMs)

Albiware Inc. • Chicago (IL)

On-site
USD 140,000 - 210,000
Competitive salary
Generous PTO
Medical, dental, and vision coverage
+2
Founding Deployment Strategist, Defense
Founding Deployment Strategist, Defense

Schemata • Washington

On-site
USD 180,000 - 250,000
Competitive salary
Equity stake
Health coverage
+1
People Operations Coordinator
People Operations Coordinator

Schemata • Washington

On-site
USD 65,000 - 90,000
Staff Engineer, AI/LLM Platform
Staff Engineer, AI/LLM Platform

Simulations Plus • United States

Remote
USD 100,000 - 120,000
Fully remote work
Flexible schedules
Generous vacation policy
+2
LLM Platform Engineer
LLM Platform Engineer

AllSpice.io • San Francisco (CA)

Hybrid
USD 160,000 - 190,000
Equity
Health, dental, vision benefits
Flexible work arrangements
+1
Software Engineer, ML Infrastructure
Software Engineer, ML Infrastructure

Realm Labs • Sunnyvale (CA)

On-site
USD 210,000 - 350,000
Market aligned compensation
Founding engineer equity
Medical, Dental, Vision, and Life insurance
+2