Lead QA engineers (AI)

LA International; Croydon; Hybrid; GBP 40,000 - 60,000; Full time

Job summary

A leading technology services firm is seeking an AI Tester to work remotely with occasional travel to Croydon. The role involves testing AI applications, focusing on machine learning and Generative AI systems. The ideal candidate should have strong software testing experience and proficiency in programming languages such as Python. Familiarity with AI frameworks and effective communication skills to collaborate with cross-functional teams are essential for success in this role.

Qualifications

• Strong understanding of use cases such as classification and text generation.
• Experience with model evaluation and testing of AI Machine Learning models.
• Familiarity with cloud computing platforms like AWS and Azure.

Responsibilities

• Test AI applications and models while planning AI test strategies.
• Collaborate with cross-functional teams including developers and data scientists.
• Evaluate models for quality, robustness, and performance.

Skills

Strong understanding of machine learning concepts

Software testing experience focusing on AI testing

Proficiency in programming languages such as Python

Experience testing Generative AI systems

Effective communication

Tools

TensorFlow

PyTorch

GIT

Job description

Role: AI Tester
Rate: Inside IR35
Location: Remote with occasional travel to Croydon
Duration: 6‑months initially
SC Clearance or Eligible

Job Spec for AI Tester

• Strong understanding of machine learning concepts, algorithms and deep learning models to effectively test AI applications.
• Strong understanding of use cases such as classification, text generation, text summarisation.
• Good understanding of data quality and pipelines (Data and ML Pipelines).
• Software testing experience focusing on AI testing, AI test planning including creation of AI test strategies and test plans.
• Experience with testing Generative AI and Natural Language Processing (NLP) systems.
• Experience in model evaluation and model testing.
• Experience with model stacking and model integration testing of AI Machine Learning models for quality, robustness, and performance.
• Experience of Machine Learning testing for anomaly detection using Python libraries.
• Familiarity with AI frameworks and tools like TensorFlow, PyTorch, Keera or similar.
• Proficiency in programming languages such as Python, Java or others used in AI.
• Experience testing with models such as BERT, Meta LLAMA and XGBOOST.
• Strong understanding of model evaluations including model overfitting and underfitting.
• Experience with API testing on endpoints and data exchange formats.
• Experience with version control systems like GIT to manage and track changes to AI codebase.
• Familiarity with metrics related to model classifications and an ability to analyse dashboards provided by cloud native services.
• Understanding of cloud computing platforms like AWS and Azure.
• Effective communication to work collaboratively with cross‑functional teams including developers and data scientists.

Key AI areas & models used in Automation Centre

• Azure models specific to Classification: XGBOOST
• AWS SageMaker specific to Summarisation: Meta LLAMA 30B
• Hugging Face models on Azure
• BERT for text generation or data creation

LA International welcomes applications from all sections of the community and from people with diverse experience and backgrounds.