Senior Software Engineer - AI Prompting & DevOps Delivery

TESTQ Technologies LTD.; Sheffield; On-site; GBP 55,000 - 75,000; Part time

Job summary

TESTQ Technologies LTD. is seeking a contract Software Engineering Delivery specialist to design, build, and ship production-grade services onsite with a client.

You will optimise CICD pipelines, implement observability, and develop prompts for a range of LLM use cases, including tool calling and multi-turn conversations. The role demands hands-on experience with Java/Spring Boot, React, PostgreSQL/Redis, Kafka, and DevOps tooling.

Qualifications

• Strong proficiency in Java Spring Boot, REST APIs and secure, performant services.
• Solid React development skills and API integration experience.
• Experience with relational and in-memory databases (PostgreSQL, Redis).
• Experience with messaging/streaming (Kafka or equivalent).
• Hands-on prompt engineering for production LLM apps and tooling (PromptFlow, LangSmith, Braintrust).
• Understanding tokenisation, context windows, temperature tuning, model-specific behaviour across major LLM providers.
• Experience structuring prompts for tool/function calling and multi-turn conversations.
• Familiarity with DevOps and Kubernetes deployments, Helm, Kustomize, RBAC.

Responsibilities

• Design, build, and ship production-grade services within existing controls.
• Develop and optimise DecOps pipelines for CI/CD and observability.
• Design, iterate, and optimise prompts for LLM use cases including structured output and reasoning tasks.
• Build and manage prompt libraries with versioning as first-class artifacts.
• Collaborate with product/domain teams to translate requirements into precise prompt specs.
• Implement agentic AI LLM integration and maintain agentic systems.

Skills

Java Spring Boot

REST APIs

Event-driven

Security

Performance optimization

React development

API integration

PostgreSQL

Redis

Kafka

Prompt Engineering

LangSmith

Prompt evaluation frameworks

Tokenisation concepts

Tool/function calling

DevOps

Kubernetes

CI/CD pipelines

Job description

TESTQ Technologies LTD. is seeking a contract Software Engineering Delivery specialist to design, build, and ship production-grade services onsite with a client.

You will optimise CICD pipelines, implement observability, and develop prompts for a range of LLM use cases, including tool calling and multi-turn conversations. The role demands hands-on experience with Java/Spring Boot, React, PostgreSQL/Redis, Kafka, and DevOps tooling.