Senior Python Engineer for AI-Driven LLM Platforms

Ncounter Limited; City Of London; On-site; GBP 70,000 - 110,000; Full time

Job summary

Ncounter Limited is seeking a Python Engineer to join its AI engineering capability, helping public sector clients by turning ideas from discovery into reliable, scalable production services. The role focuses on building robust backends, APIs, and LLM-powered features using modern tooling.

You will work in multidisciplinary teams to design production-grade Python applications, leveraging FastAPI, async patterns, and vector-based document intelligence, while collaborating with consultants and

Qualifications

• 5+ years' commercial Python engineering experience, including production backend systems.
• Demonstrable experience integrating LLMs into real applications, not just experiments.
• Strong Docker, Kubernetes/OpenShift, CI/CD and pytest knowledge; experience with large codebases.

Responsibilities

• Engineer Python backend services and APIs using FastAPI and asynchronous development patterns.
• Design and integrate LLM capabilities using OpenAI, Azure OpenAI or comparable foundation models.
• Build practical RAG, enterprise search and document intelligence solutions using embeddings and vector databases.
• Develop prompt strategies while managing production considerations including latency, cost, retries and rate limits.
• Explore agentic workflows and LLM orchestration using LangChain or similar frameworks.
• Work with consultants and customer stakeholders to translate operational problems into practical AI solutions.
• Improve security, testing, observability and reliability across deployed applications.

Skills

Python development

FastAPI

Async Python

LLM integration

REST APIs

PostgreSQL

CI/CD

pytest

LangChain

Tools

Docker

Kubernetes/OpenShift

Redis

pgvector

Chroma

FAISS

Terraform

Prometheus/OpenTelemetry

OAuth/OIDC

Job description

Ncounter Limited is seeking a Python Engineer to join its AI engineering capability, helping public sector clients by turning ideas from discovery into reliable, scalable production services. The role focuses on building robust backends, APIs, and LLM-powered features using modern tooling.

You will work in multidisciplinary teams to design production-grade Python applications, leveraging FastAPI, async patterns, and vector-based document intelligence, while collaborating with consultants and