Senior Software Engineer (AI & ML)

CFC

Greater London

On-site

GBP 110,000 - 150,000

Full time

2 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

CFC is seeking a Senior Software Engineer (AI & ML) in London to shape agent-based underwriting systems. You’ll design and run production AI agents, build the runtime, APIs, and data services, and implement guardrails with observability.

You’ll partner with ML engineers to keep production quality high and robust. The role requires 5+ years of software development experience, strong Python skills, and expertise in asynchronous programming, distributed microservices, and cloud infrastructure with

Qualifications

  • Hands-on experience building LLM-based agents or agentic systems in production.
  • Experience with orchestration frameworks such as LangGraph or LangChain, or equivalent systems.
  • Strong understanding of failure modes in agent-based systems and how to engineer around them.
  • 5+ years’ professional software development experience in Python or other backend languages.
  • Experience with asynchronous and concurrent programming and unit/integration testing.
  • Experience delivering software with AI coding agents in production.
  • Experience designing end-to-end systems, including service boundaries and data flows.
  • Strong relational database and data modelling experience (PostgreSQL).
  • Experience with distributed, asynchronous microservices using message brokers (Azure Service Bus).
  • Experience building clear RESTful APIs (FastAPI).
  • Cloud and IaC: Azure and Terraform; hands-on IaC essential.
  • Experience with Docker and production container platforms (Azure Container Apps, Kubernetes GKE/ECS).
  • CI/CD workflows and YAML pipelines.

Responsibilities

  • Design, build and run production AI agents that automate underwriting decisions over unstructured data.
  • Build the agent runtime with orchestration, durable state, retries and long-running workflows.
  • Develop tools, APIs and data services that agents call with clear contracts and auditability.
  • Engineer guardrails and human-in-the-loop checkpoints for high-stakes automated decisions.
  • Instrument, monitor and troubleshoot agents and services in production with tracing, cost, latency and decision logs.
  • Drive system design and architectural decisions for agents and surrounding services.
  • Design and evolve data models and database schemas supporting submissions, agent runs, decisions and audit trails.
  • Provision and manage cloud infrastructure through Terraform and raise production standards across agent-generated code and tests.
  • Collaborate with business, product and engineering teams to set delivery cadence and pragmatic quality improvements.
  • Support engineers through code reviews, best-practice guidance and knowledge sharing.

Skills

LLM-based agents
Agentic systems in production
Python
Async programming
Distributed systems
RESTful APIs
Cloud/Azure
Mentoring
Communication
System design

Tools

LangGraph
LangChain
Azure
Terraform
Docker
Kubernetes
Databricks
FastAPI
Azure Service Bus
CI/CD

Job description

Senior Software Engineer (AI & ML)

Department: Data & AI

Employment Type: Permanent - Full Time

Location: UK - London

Reporting To: Takashi Nakamura

Description

We’re building AI systems that sit at the heart of how CFC makes complex underwriting decisions. Our Data & AI unit is developing autonomous, multi-step agents that reason over unstructured data, assess risk and deliver real business outcomes, creating the kind of complex engineering problems where great software engineering really matters.

Making agentic AI work reliably in production means solving challenges traditional software doesn’t always face: non-deterministic behaviour, tool failures, long-running workflows, high-stakes decisions and outputs that need to be observable and auditable. That’s where you come in.

As a Senior Software Engineer (AI & ML), you’ll help shape how these systems are designed and built, working across agent orchestration, APIs, tool integrations, durable state, guardrails, observability and cloud infrastructure. You’ll partner closely with Senior Machine Learning Engineers on the same agents, bringing the engineering depth needed to make them robust, testable and maintainable in production.

About the role
  • Design, build and run production AI agents that automate multi-step underwriting decisions over unstructured data.
  • Build the agent runtime, including orchestration, durable state, retries and long-running workflows that recover cleanly from failure.
  • Develop the tools, APIs and data services that agents call, creating clear contracts, predictable failure modes and full auditability.
  • Engineer guardrails, human-in-the-loop checkpoints and fallbacks for high-stakes automated decisions.
  • Instrument, monitor and troubleshoot agents and services in production, including tracing, cost, latency and decision logs, working with ML engineers to turn those insights into evaluations and improvements.
  • Help drive system design and architectural decisions for our agents and the services around them.
  • Design and evolve the data models and database schemas supporting submissions, agent runs, decisions and audit trails.
  • Provision and manage cloud infrastructure through Terraform and contribute to a high production standard across agent-generated code and tests.
  • Work closely with business, product and engineering teams to set delivery cadence, manage expectations and make pragmatic decisions about where additional engineering quality adds the most value.
  • Support the development of other engineers through code reviews, best-practice guidance and knowledge sharing
About you

We’re looking for someone who combines strong software engineering fundamentals with hands‑on experience taking agentic AI beyond prototypes and into production.

You’ll bring:

  • Hands‑on experience building LLM‑based agents or agentic systems in production, ideally using orchestration frameworks such as LangGraph or LangChain, or equivalent systems you’ve built yourself.
  • A strong understanding of how agents fail in the real world, from non-determinism and tool failures to runaway loops, cost and latency issues, and how to engineer around them.
  • 5+ years’ professional software development experience in Python or another backend language such as Go, Java or C#. Our stack is Python, so you’ll need enough working knowledge to transfer your skills quickly if it isn’t already your main language.
  • Strong experience with asynchronous and concurrent programming, alongside a rigorous approach to unit and integration testing.
  • Day-to-day experience delivering software with AI coding agents, while maintaining a high bar for the code they produce.
  • Experience designing systems end to end, including service boundaries, data flows and failure modes, with the judgement to make and explain architectural trade‑offs.
  • Strong relational database and data modelling experience. We use PostgreSQL, covering areas including schema design, query performance, transactions, concurrency and safe schema migrations.
  • Experience building distributed, asynchronous microservices using message brokers such as Azure Service Bus, with an understanding of at-least-once delivery, idempotency and dead-letter handling.
  • Experience building clear, well‑documented RESTful APIs. We use FastAPI.
  • Strong cloud and infrastructure-as-code experience. Our environment uses Azure and Terraform, and hands‑on IaC experience is essential for this role.
  • Experience with Docker and production container platforms such as Azure Container Apps, Kubernetes GKE or ECS, alongside CI/CD workflows and YAML pipeline definitions.
  • Clear communication, pragmatic judgement and the confidence to work independently, influence technical decisions and mentor other engineers.

Experience building agents for high‑stakes or regulated decision‑making, working with data scientists on non-deterministic systems, using Databricks, or working within insurance would be useful, but these are nice‑to-haves rather than requirements.

Core Values

Love what you do: We show up each day ready to take on the world. Our passion and intensity set us apart and makes the difference to our colleagues, customers, brokers and carriers.

Challenge everything: We’re never afraid to question the way that things are done and we constantly challenge ourselves and others to make things better.

Have fun, be good: Insurance is a serious business, but we don’t take ourselves too seriously. We make it fun to work at CFC, we welcome all viewpoints, and we treat everyone how we would expect to be treated.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Software Engineer (AI & ML)
Senior Software Engineer (AI & ML)

CFC • City Of London

On-site
GBP 90,000 - 130,000
Senior Software Engineer (AI & ML)
Senior Software Engineer (AI & ML)

CFC Underwriting • Royal Borough of Greenwich

On-site
GBP 110,000 - 160,000
Senior Machine Learning Engineer
Senior Machine Learning Engineer

CFC • Greater London

On-site
GBP 120,000 - 160,000
Senior Machine Learning Engineer
Senior Machine Learning Engineer

CFC • City Of London

On-site
GBP 110,000 - 150,000
Data Scientist
Data Scientist

CFC • Greater London

On-site
GBP 65,000 - 90,000
Data Scientist
Data Scientist

CFC • City Of London

On-site
GBP 60,000 - 90,000
Data Scientist
Data Scientist

CFC Underwriting • Greater London

On-site
GBP 70,000 - 110,000
Senior Forward Deployed Engineer - Vice President
Senior Forward Deployed Engineer - Vice President

Citi • Greater London

Hybrid
GBP 110,000 - 150,000
27 days annual leave
Discretional annual bonus
Private Medical Care & Life Insurance
+4
AI Engineer
AI Engineer

Aimlroles • Greater London

Hybrid
GBP 80,000 - 130,000
Holiday
Company pension
Flexible working
+1
Software Engineer
Software Engineer

CFC • City Of London

On-site
GBP 60,000 - 90,000