Senior AI Engineer (Xora Portfolio Company)

Xora Innovation

San Diego (CA)

Hybrid

USD 180,000 - 240,000

Full time

3 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

ELEMYNT, an early-stage startup by Xora Innovation, seeks a senior engineer to own the LLM systems powering our platform. You will ship agents and fine-tuned models that run in customers’ environments, balancing performance, cost, and safety.

The role covers end-to-end development, from model internals to deployed services. You will design multi-step agents, build robust retrieval and parallel training pipelines, and ensure strong governance with tracing and evaluation.

Qualifications

  • 5+ years building and shipping production software with LLM-powered systems.
  • Strong Python and shipping reliable services: async, HTTP and streaming APIs, testing, code review.
  • Prompting, context engineering, tool calling, structured output, latency and cost optimization.
  • Designing and shipping agents: loop, tools, memory, and failure handling.
  • Experience building RAG systems: embeddings, chunking, hybrid search, reranking.
  • Fine-tuning open-weight models (LoRA/QLoRA/full-parameter) on multi-GPU.
  • LLM evaluation and guardrails: automated scoring, regression tracking, tracing.

Responsibilities

  • Build and ship LLM-powered capabilities end to end, from prototype to production services.
  • Design agents that plan and execute multi-step work with tool calls and structured outputs.
  • Develop retrieval and context pipelines: ingestion, embeddings, hybrid search, reranking.
  • Fine-tune open-weight models, curate training data, and manage compute budgets.
  • Create evaluation loops and tracing to ensure reliability and debuggability.
  • Turn LLM capabilities into clean APIs and reusable tooling for engineers to build on.

Skills

Python
LLM systems
Prompting & context engineering
Tool calling
Structured outputs
RAG systems
Embeddings
Multigpu training
Tracing & eval
Open-weight models

Education

Bachelor's or Master's in CS or related engineering

Tools

LangGraph
Pydantic
JSON Schema
OpenAI-compatible interfaces
vLLM / TGI / SGLang

Job description

About Elemynt

ELEMYNT is an early-stage startup built by Xora Innovation. We develop applied intelligence that brings AI into the real world. Our platform combines advanced machine learning, high-performance simulation, and modern software engineering to accelerate the design, validation, and deployment of new materials. Our work sits at the intersection of AI, physics, and large-scale computation. The problems are hard, the stakes are high, and the impact is tangible.

About Elemynt

ELEMYNT is an early-stage startup built by Xora Innovation. We develop applied intelligence that brings AI into the real world. Our platform combines advanced machine learning, high-performance simulation, and modern software engineering to accelerate the design, validation, and deployment of new materials. Our work sits at the intersection of AI, physics, and large-scale computation. The problems are hard, the stakes are high, and the impact is tangible.

About The Role

This role owns the LLM systems behind our platform: the agents and fine-tuned models that ship as product, and the engineering that keeps them reliable — evaluation, tracing, and production-quality services. It's deeply hands‑on, from model internals to shipped software. The platform runs inside our customers' own secure environments: their compute, their cloud, or a hybrid. So the LLM layer has to work with commercial APIs and self-hosted models alike, and carry its own safeguards wherever it lands. Every LLM capability we ship stands on this work.

What You Will Do
  • Build and ship LLM-powered capabilities end to end: prototype, evaluate, deploy, and iterate them into production services users rely on.
  • Design agents that plan and carry out multi-step work: tool calling, structured outputs, durable state, and the judgment to know when an agent is the wrong tool.
  • Build retrieval that gives models the right context: ingestion, chunking, embeddings, hybrid search, reranking.
  • Fine-tune open-weight models with LoRA, QLoRA, or full-parameter tuning on multi-GPU, curating the training data and choosing the method by task, compute budget, and target.
  • Build evaluation loops that gate what ships: automated scoring, LLM-as-judge, and regression tracking against curated test sets.
  • Instrument model calls and tool use with tracing, so quality, cost, and failures stay debuggable in production.
  • Turn LLM capabilities into clean APIs and reusable tooling that other engineers build on.
What We Are Looking For
  • Bachelor's or Master's degree in Computer Science or a related engineering field, and 5+ years building and shipping production software, including deep hands‑on work building LLM-powered systems in production.
  • Strong Python and a track record of shipping reliable services: async, HTTP and streaming APIs, testing, code review.
  • Production experience with LLMs: prompting and context engineering, tool calling, structured output, and the latency and cost work that keeps them usable.
  • Hands‑on experience designing and shipping agents: the loop, the tools, context, memory, and where they fail. A framework such as LangGraph or equivalent; structured outputs in Pydantic or JSON Schema.
  • Experience building RAG systems: embeddings, chunking, hybrid search, reranking, and a feel for what actually moves retrieval quality.
  • Direct experience fine‑tuning open-weight models (LoRA, QLoRA, or full-parameter) on multi‑GPU, including curating and formatting the training data.
  • Experience with LLM evaluation and guardrails: LLM-as-judge or automated scoring, regression tracking, and tracing over agent runs.
  • Experience building shared LLM tooling or platform components that other engineers build on, and comfort owning ambiguous systems end to end in an early‑stage environment.
NICE TO HAVE
  • Self‑hosted inference with vLLM, TGI, or SGLang, served behind an OpenAI-compatible interface.
  • Interoperability standards for tools and agents, such as MCP.
  • Retrieval over structured data: knowledge graphs, hybrid search, reranking at scale.
  • LLMs applied to scientific or other technical data; experience making APIs and tool surfaces easy for agents to call reliably.
  • Contributions to open-source AI/ML: agent frameworks, eval tooling, RAG, fine-tuned models.
LOCATION

Singapore or United States. We're hiring in both to reach the right person. Work model is on‑site or hybrid, set per location.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior AI Engineer (Remote, Contract)
Senior AI Engineer (Remote, Contract)

Remote • San Francisco (CA)

Remote
USD 180,000 - 240,000
Fully remote work format
Paid time off and sick leave
Reduced summer hours
LLM / GenAI Engineer
LLM / GenAI Engineer

Evlo AI • Miami (FL)

On-site
USD 120,000 - 180,000
Senior Machine Learning Engineer
Senior Machine Learning Engineer

Arionkoder • United States

Remote
USD 150,000 - 230,000
Monthly USD Service Fee
Paid Agreed Time Off
Caregiver Time Off
+2
Sr AI Engineer II - Global Commercial Services Technology
Sr AI Engineer II - Global Commercial Services Technology

American Express Company • United States

On-site
USD 180,000 - 260,000
Senior LLM Engineer for Production AI Systems (Hybrid)
Senior LLM Engineer for Production AI Systems (Hybrid)

Xora Innovation • San Diego (CA)

Hybrid
USD 180,000 - 240,000
LLM / GenAI Engineer
LLM / GenAI Engineer

Evlo AI • Minneapolis (MN)

On-site
USD 140,000 - 190,000
Senior Machine Learning Engineer (LLMs)
Senior Machine Learning Engineer (LLMs)

Albiware Inc. • Chicago (IL)

On-site
USD 140,000 - 210,000
Competitive salary
Generous PTO
Medical, dental, and vision coverage
+2
AI Engineer, Multimodal LLMs
AI Engineer, Multimodal LLMs

Latitude • San Francisco (CA)

On-site
USD 140,000 - 200,000
AI Engineer Remote Worker - N/A View role (opens in a new tab)
AI Engineer Remote Worker - N/A View role (opens in a new tab)

Phoenixoutcomes • United States

Remote
USD 180,000 - 260,000
Senior AI Engineer
Senior AI Engineer

Equs, Inc. • United States

Remote
USD 180,000 - 240,000