Software Engineering Delivery

TESTQ Technologies LTD.; Sheffield; On-site; GBP 55,000 - 75,000; Part time

Job summary

TESTQ Technologies LTD. is seeking a contract Software Engineering Delivery specialist to design, build, and ship production-grade services onsite with a client.

You will optimise CICD pipelines, implement observability, and develop prompts for a range of LLM use cases, including tool calling and multi-turn conversations. The role demands hands-on experience with Java/Spring Boot, React, PostgreSQL/Redis, Kafka, and DevOps tooling.

Qualifications

• Strong proficiency in Java Spring Boot, REST APIs and secure, performant services.
• Solid React development skills and API integration experience.
• Experience with relational and in-memory databases (PostgreSQL, Redis).
• Experience with messaging/streaming (Kafka or equivalent).
• Hands-on prompt engineering for production LLM apps and tooling (PromptFlow, LangSmith, Braintrust).
• Understanding tokenisation, context windows, temperature tuning, model-specific behaviour across major LLM providers.
• Experience structuring prompts for tool/function calling and multi-turn conversations.
• Familiarity with DevOps and Kubernetes deployments, Helm, Kustomize, RBAC.

Responsibilities

• Design, build, and ship production-grade services within existing controls.
• Develop and optimise DecOps pipelines for CI/CD and observability.
• Design, iterate, and optimise prompts for LLM use cases including structured output and reasoning tasks.
• Build and manage prompt libraries with versioning as first-class artifacts.
• Collaborate with product/domain teams to translate requirements into precise prompt specs.
• Implement agentic AI LLM integration and maintain agentic systems.

Skills

Java Spring Boot

REST APIs

Event-driven

Security

Performance optimization

React development

API integration

PostgreSQL

Redis

Kafka

Prompt Engineering

LangSmith

Prompt evaluation frameworks

Tokenisation concepts

Tool/function calling

DevOps

Kubernetes

CI/CD pipelines

Job description

TQUSI0906_5904 - Software Engineering Delivery

Job Type: Contract

Work Mode: Onsite (Client)

• oDesign Build and ship production quality services within our current business controls
• oBuild and Optimise DecOps pipelines enhancing CICD processing including testing and platformprocess observability
• oDesign iterate and optimise prompts for a wide range of LLM use cases instruction following structured output generation classification summarisation code generation and reasoning tasks
• oBuild and manage prompt libraries and versioning strategies treating prompts as firstclass engineering artefacts
• oCollaborate with product and domain teams to translate business requirements into precise wellstructured prompt specifications
• Agentic AI LLM Integration
• Architect and implement maintain agentic systems autonomous agents multiagent pipelines tooluse workflows planning loops and memoryaugmented reasoning
• Implement LLM observability logging tracing evaluation pipelines and guardrails to maintain quality and reliability in production AI systems
• Advise on responsible AI deployment including output validation humanintheloop design and risk mitigation for agentic workflows
• Strong proficiency in Java Spring Boot REST APIs eventdriven services security and performance optimisation
• Solid React development skills and API integration
• Experience with relational and in memory databases PostgreSQL Redis
• Messaging and streaming platforms Kafka or equivalent
• Prompt Engineering
• Demonstrable handson experience engineering prompts for production LLM applications not just prototypes
• Familiarity with prompt evaluation frameworks and tooling PromptFlow LangSmith Braintrust or custom eval pipelines
• Understanding of tokenisation context limits temperature tuning and modelspecific behaviours across major LLM providers
• Experience structuring prompts for toolfunction calling structured JSON output and multiturn conversations
• DevOps Infrastructure
• Kubernetes deployments services ingress Helm Kustomize HPA and RBAC
• CICD pipelines GitHub Actions GitLab CI Jenkins or equivalent