LLM / GenAI Engineer

Latitude

Seattle (WA)

On-site

USD 150,000 - 230,000

Full time

5 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Latitude is seeking a software engineer to build production-grade GenAI systems in Seattle. You will design end-to-end RAG pipelines, develop agentic LLM applications, and implement robust evaluation frameworks for real user deployments.

The role emphasizes parameter-efficient fine-tuning, cost-aware inference optimization, and integration with vector databases at scale. Collaboration with product and backend teams is essential.

Qualifications

  • 3–6 years of software engineering experience, with at least 1–2 years building LLM/GenAI systems in production.
  • Strong Python skills and hands-on experience with PyTorch; comfort with async programming, REST APIs, and cloud infrastructure (AWS, GCP, or Azure).
  • Proven experience building RAG or agentic systems that served real users, not just prototypes.
  • Working knowledge of embedding models, vector search, and semantic retrieval tradeoffs in production environments.
  • Experience with LLM fine-tuning (instruction tuning, PEFT/LoRA) or serving optimized open-weight models.
  • MS in Computer Science, or equivalent practical experience; strong written communication and system design fundamentals.
  • Bonus: Kubernetes and GPU inference (vLLM, Triton), RLHF or preference optimization, observability tooling for LLM apps (LangSmith, LangFuse), or contributions to open-source LLM projects.

Responsibilities

  • Design and implement RAG pipelines end-to-end: chunking strategies, embedding selection, hybrid retrieval, reranking, and context assembly
  • Build agentic workflows and tool-using LLM applications with LangChain, LlamaIndex, or custom orchestration, including guardrails and failure handling
  • Develop systematic evaluation frameworks: golden datasets, LLM-as-judge pipelines, regression test suites, and online A/B measurement of output quality
  • Run parameter-efficient fine-tuning (LoRA, QLoRA) and distillation on domain datasets, managing the full experiment tracking and model registry lifecycle
  • Optimize inference performance and cost: quantization, batching, caching strategies, and self-hosted vs. API-based model tradeoffs across OpenAI, Anthropic, and open-weight models (Llama, Mistral)
  • Integrate vector databases (Pinecone, Weaviate, pgvector) and streaming data pipelines to keep retrieval indices fresh at production scale
  • Collaborate with product and backend engineers to ship GenAI features, participating in design reviews and setting engineering standards for LLM reliability

Skills

Python
PyTorch
REST APIs
Async programming
Cloud infra
RAG pipelines
Agentic systems
Vector search
Embeddings
Fine-tuning
PEFT/LoRA
Kubernetes
GPU inference
System design

Education

MS in Computer Science
Equivalent practical experience

Tools

LangChain
LlamaIndex

Job description

About The Role

The role builds production-grade LLM and generative AI systems: RAG architectures, agentic workflows, fine-tuning pipelines, and evaluation frameworks that move models from demo to dependable. This team sits at the intersection of applied research and platform engineering. You will ship GenAI features that real users depend on, where latency, cost, and output quality are all first-class constraints.

Key Responsibilities
  • Design and implement RAG pipelines end-to-end: chunking strategies, embedding selection, hybrid retrieval, reranking, and context assembly
  • Build agentic workflows and tool-using LLM applications with LangChain, LlamaIndex, or custom orchestration, including guardrails and failure handling
  • Develop systematic evaluation frameworks: golden datasets, LLM-as-judge pipelines, regression test suites, and online A/B measurement of output quality
  • Run parameter-efficient fine-tuning (LoRA, QLoRA) and distillation on domain datasets, managing the full experiment tracking and model registry lifecycle
  • Optimize inference performance and cost: quantization, batching, caching strategies, and self-hosted vs. API-based model tradeoffs across OpenAI, Anthropic, and open-weight models (Llama, Mistral)
  • Integrate vector databases (Pinecone, Weaviate, pgvector) and streaming data pipelines to keep retrieval indices fresh at production scale
  • Collaborate with product and backend engineers to ship GenAI features, participating in design reviews and setting engineering standards for LLM reliability
What We Are Looking For
  • 3–6 years of software engineering experience, with at least 1–2 years building LLM/GenAI systems in production
  • Strong Python skills and hands-on experience with PyTorch; comfort with async programming, REST APIs, and cloud infrastructure (AWS, GCP, or Azure)
  • Proven experience building RAG or agentic systems that served real users, not just prototypes
  • Working knowledge of embedding models, vector search, and semantic retrieval tradeoffs in production environments
  • Experience with LLM fine-tuning (instruction tuning, PEFT/LoRA) or serving optimized open-weight models
  • MS in Computer Science, or equivalent practical experience; strong written communication and system design fundamentals
  • Bonus: experience with Kubernetes and GPU inference (vLLM, Triton), RLHF or preference optimization, observability tooling for LLM apps (LangSmith, LangFuse), or contributions to open-source LLM projects
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

LLM / GenAI Engineer
LLM / GenAI Engineer

Evlo AI • Minneapolis (MN)

On-site
USD 140,000 - 190,000
LLM / GenAI Engineer
LLM / GenAI Engineer

Evlo AI • United States

Remote
USD 140,000 - 200,000
Senior AI Engineer - GenAI + Data Platform - AWS
Senior AI Engineer - GenAI + Data Platform - AWS

Compunnel Inc. • Los Angeles (CA)

On-site
USD 120,000 - 160,000
Senior LLMOps Engineer
Senior LLMOps Engineer

UNAVAILABLE • McLean (VA)

On-site
USD 180,000 - 240,000
Senior LLM Engineer
Senior LLM Engineer

Turing • United States

Remote
USD 26,000 - 44,000
Senior AI EngineerWoodland Hills
Senior AI EngineerWoodland Hills

TechDigital Group • Los Angeles (CA)

On-site
USD 120,000 - 160,000
Lead- AI Engineer
Lead- AI Engineer

Emplay • United States

Remote
USD 140,000 - 190,000
Gen. AI Engineer
Gen. AI Engineer

KALEIDOSCOPE Innovation • Charlotte (NC)

On-site
USD 150,000 - 210,000
Gen AI Architect
Gen AI Architect

Covetus • United States

On-site
USD 180,000 - 240,000
Lead AI Engineer
Lead AI Engineer

Mudals Technologies Private Limited • United States

Remote
USD 180,000 - 240,000