Senior Python Automation Tester for AI & LLM Systems

Resillion; Birmingham; Hybrid; GBP 50,000 - 70,000; Full time

Job summary

Resillion is seeking a Senior Automation Tester (Python) to develop and maintain automation frameworks for validating AI systems, including chatbots and agentic workflows. Applicants should have strong Python skills, experience in test automation, and familiarity with CI/CD pipelines. This role involves close collaboration with cross-functional teams to deliver high-quality AI products. The position offers a hybrid work model ideal for passionate individuals interested in automation engineering and AI technologies.

Qualifications

• 3+ years of experience in automation engineering and testing AI/LLM systems.
• Strong knowledge of building automation frameworks.
• Experience with CI/CD tools and practices.

Responsibilities

• Develop and maintain a Python-based automation framework for validating AI agents.
• Design and execute automated tests for LLM responses and conversational flows.
• Integrate automated tests into CI/CD pipelines.

Skills

Python development

Test automation

AI/LLM systems testing

CI/CD pipeline implementation

Source code management (Git)

Tools

Docker

Kubernetes

Jenkins

GitHub Actions

Job description

Resillion is seeking a Senior Automation Tester (Python) to develop and maintain automation frameworks for validating AI systems, including chatbots and agentic workflows. Applicants should have strong Python skills, experience in test automation, and familiarity with CI/CD pipelines. This role involves close collaboration with cross-functional teams to deliver high-quality AI products. The position offers a hybrid work model ideal for passionate individuals interested in automation engineering and AI technologies.