Senior Applied AI Engineer: Production, Evaluation & Impact

Scale AI; City Of London; In loco; GBP 90.000 - 150.000; Tempo pieno

Descrizione del lavoro

Scale AI is seeking a Senior Applied AI Engineer to own the AI behaviour of production systems for public sector clients. You will lead workstreams, integrate agents and backend services, and ensure reliable, auditable performance on live data.

You will mentor engineers, design evaluations, and work directly with clients to explain model behaviour and trade-offs, including governance and security considerations.

Competenze

• Experience taking AI/ML systems into production and keeping them reliable.
• Ability to own AI behaviour end-to-end in production systems.
• Hands-on design of evaluations linking model behaviour to real-world outcomes.

Mansioni

• Own the AI layer of production systems for public sector clients, including agents, model integration, and backend services.
• Build production agents from established architectural patterns, with reliable tool calling, guardrails, and observability.
• Select and adapt evaluation methods, and design new evaluations for client-specific risks.
• Apply context engineering, retrieval-augmented generation, model adaptation, or inference optimisation.
• Investigate regressions in the systems you own, lead root-cause analysis, and implement preventative changes.
• Lead project planning for your workstream and manage client expectations on scope, risk, and delivery.
• Codify recurring client work into reusable tooling, evaluation components, or guidance that other engineers adopt.
• Mentor engineers through code review, pairing, and delegated ownership.

Conoscenze

Backend engineering

AI system ownership

Evaluation design

Client-facing communication

Auditability

Root-cause analysis

Descrizione del lavoro

Scale AI is seeking a Senior Applied AI Engineer to own the AI behaviour of production systems for public sector clients. You will lead workstreams, integrate agents and backend services, and ensure reliable, auditable performance on live data.

You will mentor engineers, design evaluations, and work directly with clients to explain model behaviour and trade-offs, including governance and security considerations.