Lead QA engineers (AI)

LA International; Greater London; Hybrid; GBP 50,000 - 70,000; Full time

Job summary

An established ICT consultancy is seeking an experienced Ai Tester with a strong background in machine learning and software testing for AI applications. This role involves developing test strategies, evaluating AI models, and collaborating with cross-functional teams. Familiarity with Python and AI frameworks is essential. The position allows for remote work with occasional travel to Croydon. The ideal candidate will have strong communication skills and the ability to analyze cloud-based metrics.

Qualifications

• Experience testing AI applications, understanding machine learning algorithms.
• Familiarity with AI frameworks and version control systems like GIT.
• Ability to collaborate with cross-functional teams.

Responsibilities

• Test AI applications using deep learning models.
• Create AI test strategies and test plans.
• Evaluate machine learning models for quality and performance.

Skills

Strong understanding of machine learning concepts

Software testing experience with focus on AI testing

Experience with Generative AI and NLP systems

Proficiency in Python

Understanding of cloud computing platforms

Effective communication

Tools

TensorFlow

Pytorch

GIT

Job description

Role: Ai Tester

Rate: Inside IR35

Location: Remote with occasional travel to Croydon

Duration: 6 - months initially

SC Clearance or Eligible

Job Spec for AI Tester

• Strong understanding of machine learning concepts, algorithms and deep learning models to effectively test AI applications.
• Strong understanding of use cases such as classification, text generation, text summarisation.
• Good understanding of data quality and pipelines (Data and ML Pipelines).
• Software testing experience with focus on AI testing, AI test planning including creation of AI test strategies and test plans.
• Experience with testing Generative AI and Natural Language Processing (NLP) systems.
• Experience in model evaluation and model testing.
• Experience with model stacking and model integration testing of AI Machine Learning models for Quality, Robustness, and Performance.
• Experience of Machine Learning testing for anomaly detection using Python libraries.
• Familiarity with AI frameworks and tools like TensorFlow, Pytorch, Keera or similar.
• Proficiency in programming languages such as Python, Java or others used in AI.
• Experience testing with models such as BERT, Meta LLAMA and XGBOOST.
• Strong understanding of model evaluations including model overfitting and underfitting.
• Experience with API testing on endpoints and data exchange formats.
• Experience with version control systems like GIT to manage and track changes to AI codebase.
• Familiarity with metrics related to model classifications and an ability to analyse dashboard provided by cloud native services.
• Understanding of cloud computing platforms like AWS and Azure.
• Effective communication to work collaboratively with cross functional teams including developers and data scientists.

Key AI areas & models used in Automation Centre

• Azure models specific to Classification: XGBOOST
• AWS Sagemaker specific to Summarisation: Meta LLAMA 30B
• Hugging face models on Azure
• BERT for text generation or data creation

About LA International

LA International is a HMG approved ICT Recruitment and Project Solutions Consultancy, operating globally from the largest single site in the UK as an IT Consultancy or as an Employment Business & Agency depending upon the precise nature of the work, for security cleared jobs or non-clearance vacancies, LA International welcome applications from all sections of the community and from people with diverse experience and backgrounds.

Award Winning LA International, winner of the Recruiter Awards for Excellence, Best IT Recruitment Company, Best Public Sector Recruitment Company and overall Gold Award winner, has now secured the most prestigious business award that any business can receive, The Queens Award for Enterprise: International Trade, for the second consecutive period.