AI Engineer: Production LLM Systems & Orchestration

Indicium AI; Greater London; On-site; GBP 90,000 - 130,000; Full time

Benefits offered by this job

Career growth

Competitive salary & bonus

Collaborative environment

Financial backing and expansion

Gear provided

Learning budget

Job summary

Indicium AI in London seeks an experienced AI Engineer to design, build, and deploy production-grade AI systems powered by large language models. This role focuses on creating reliable, scalable applications and multi-agent orchestration, not model training.

You'll work with cutting-edge LLM technologies, implement robust data pipelines, evaluative frameworks, and production-grade tooling, while balancing latency, cost, and quality across providers.

Qualifications

• Hands-on experience building applications with LLM APIs and deep understanding of their capabilities, limitations, and failure modes.
• Practical implementation of RAG architectures, vector databases, knowledge graphs and prompt engineering.
• Experience building multi-step LLM workflows and agentic systems using frameworks (e.g. SDK, Strands, Claude Agents SDK, LangGraph, etc.) or custom implementations where needed.
• Strong Python (or other modern programming language) proficiency with production API/service development experience and cloud platform knowledge (AWS, GCP, Azure).
• Understanding of distributed systems, CI/CD, testing frameworks, and deployment pipelines.
• Solid foundations and understanding of production-grade, cloud-native platform and infrastructure requirements, design, and implementation.
• Strong data manipulation skills (pandas, SQL) and understanding of evaluation strategies for LLM-based systems.
• Ability to work with ambiguity and optimise non-deterministic systems through a process of experimentation and evaluation while balancing latency/cost/quality tradeoffs.

Responsibilities

• Design and implement production AI systems integrating LLMs, RAG pipelines, vector databases, and agentic frameworks.
• Create evaluation frameworks to measure and monitor system performance, accuracy, and reliability
• Build and maintain production-grade AI applications with clean code, appropriate error handling, APIs, and data pipelines
• Experience implementing, maintaining and evaluating retrieval systems (vector/graph databases, ingestion pipelines, chunking strategies, retrieval techniques such as HyDE)
• Implement feedback loops and observability to continuously improve system performance
• Craft effective prompts and optimize for latency, cost, and quality across different model providers and configurations

Skills

LLM APIs

RAG architectures

Vector databases

Knowledge graphs

Prompt engineering

Python

Cloud platforms

Distributed systems

CI/CD

SQL/Pandas

Tools

SDKs

LangGraph

Claude Agents SDK

Job description

Indicium AI in London seeks an experienced AI Engineer to design, build, and deploy production-grade AI systems powered by large language models. This role focuses on creating reliable, scalable applications and multi-agent orchestration, not model training.

You'll work with cutting-edge LLM technologies, implement robust data pipelines, evaluative frameworks, and production-grade tooling, while balancing latency, cost, and quality across providers.