Senior Prompt Engineer: LLM Production & Evaluation

AutoThink Group; Rochdale; Hybrid; GBP 45,000 - 65,000; Full time

Job summary

AutoThink Group in Rochdale, United Kingdom, is seeking an experienced software engineer to build production prompts and agent loops across multiple product lines, ensuring reliable prompt behavior in production.

You will design evaluation datasets to quantify quality per feature, create structured-output pipelines with strict schema conformance, and automate regression detection on every prompt change.

Qualifications

• 3+ years software engineering experience.
• Deep intuition for what LLMs can and can't do — from production work.
• Fluent in Python or TypeScript.
• Rigorous about evaluation, not just vibes.
• Right to work in the UK.

Responsibilities

• Build production prompts and agent loops across multiple product lines.
• Create evaluation datasets that quantify quality per feature.
• Develop structured-output pipelines with reliable schema conformance.
• Automate regression detection on every prompt change.

Skills

Python

TypeScript

Software engineering

Production experience

Job description

AutoThink Group in Rochdale, United Kingdom, is seeking an experienced software engineer to build production prompts and agent loops across multiple product lines, ensuring reliable prompt behavior in production.

You will design evaluation datasets to quantify quality per feature, create structured-output pipelines with strict schema conformance, and automate regression detection on every prompt change.