Senior ML Engineer: LLM Systems & RAG Pipelines

Oscar

Greater London

On-site

GBP 120,000 - 180,000

Full time

7 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Central London office
Competitive compensation
Impactful work with financial services
Collaborative environment

Job summary

Oscar is seeking a Senior Software Engineer to design, build and operate LLM-powered workflows for an AI work-execution platform. You will work in Python/FastAPI with LangGraph and LangChain across model providers, focusing on low latency, auditability and cost control.

You will own production RAG pipelines, graph retrieval, and mentor engineers while collaborating with the Executive Committee. Role is based in London’s King’s Cross office with competitive compensation and a strong focus on

Qualifications

  • 5+ years of software engineering experience.
  • 2+ years running LLM/ML systems in production.
  • Hands-on experience with an agent framework (LangGraph/LangChain).
  • Production RAG experience with embeddings and vector databases.

Responsibilities

  • Build multi-step agentic workflows with tool-calling and human-in-the-loop patterns.
  • Integrate models from Anthropic, OpenAI and Bedrock, managing routing and cost.
  • Own production RAG pipelines and GraphRAG on Neo4j.
  • Measure latency, cost and quality for every model call.
  • Apply GDPR-compliant guardrails and ship with FastAPI and PostgreSQL.

Skills

Python
LangGraph
LangChain
LLM systems
RAG pipelines

Education

Bachelor's degree in engineering or computer science

Tools

Neo4j
PostgreSQL
Qdrant
Weaviate
pgvector

Job description

Oscar is seeking a Senior Software Engineer to design, build and operate LLM-powered workflows for an AI work-execution platform. You will work in Python/FastAPI with LangGraph and LangChain across model providers, focusing on low latency, auditability and cost control.

You will own production RAG pipelines, graph retrieval, and mentor engineers while collaborating with the Executive Committee. Role is based in London’s King’s Cross office with competitive compensation and a strong focus on

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior ML Engineer: LLMs & Production Systems
Senior ML Engineer: LLMs & Production Systems

Oscar Technology • Greater London

On-site
GBP 95,000 - 120,000
Lead ML Engineer – LangChain & LLM Systems
Lead ML Engineer – LangChain & LLM Systems

Maxwell Bond • Greater London

On-site
GBP 150,000 - 175,000
Senior ML Engineer – LangChain & RAG Systems
Senior ML Engineer – LangChain & RAG Systems

Maxwell Bond • Camden Town

On-site
GBP 150,000 - 175,000
In-office (3-5 days/week)
ML Engineer: LLM Systems for Investment AI (London Office)
ML Engineer: LLM Systems for Investment AI (London Office)

Descrial • Greater London

On-site
GBP 90,000 - 150,000
Senior ML Engineer - LLM/NLP for Enterprise (London, On-site)
Senior ML Engineer - LLM/NLP for Enterprise (London, On-site)

Oscar Technology • City Of London

On-site
GBP 95,000 - 120,000
Machine Learning Engineer
Machine Learning Engineer

Oscar • Greater London

On-site
GBP 120,000 - 180,000
Central London office
Competitive compensation
Impactful work with financial services
+1
Agentic AI Engineer - LLMs, RAG & Production Systems
Agentic AI Engineer - LLMs, RAG & Production Systems

Oscar • Manchester

On-site
GBP 45,000 - 75,000
Generous benefits package
Machine Learning Engineer
Machine Learning Engineer

Descrial • Greater London

On-site
GBP 90,000 - 150,000
Production AI Engineer: Build Scalable LLM Systems
Production AI Engineer: Build Scalable LLM Systems

Radley James • Greater London

On-site
GBP 60,000 - 80,000
Senior LLM Serving Platform Engineer
Senior LLM Serving Platform Engineer

Scale AI • Greater London

On-site
GBP 90,000 - 130,000