AI Tester

Sourceworx; Johannesburg; Hybrid; ZAR 800,000 - 1,100,000; Full time

Job summary

A leading tech solutions provider in Johannesburg is seeking an AI Tester responsible for validating AI-driven systems and applications. The ideal candidate will have 5-7 years of test engineering experience, familiarity with various AI tools, and significant expertise in automation tools. Candidates must excel in a collaborative Agile environment and possess strong analytical skills. This role offers the opportunity to innovate within a dynamic team.

Qualifications

• 5 - 7 years of experience in test engineering.
• Expertise in prompt engineering and knowledge of GPT-4.0 or other LLMs.
• Strong grasp on continuous integration and deployment tools.

Responsibilities

• Testing and evaluating AI models.
• Analyzing test results and identifying trends.
• Collaborating with Development and Integration teams.

Skills

AI Tools familiarity

Automation Tools expertise

CI/CD Integration understanding

Quality Assurance principles

Tools

Selenium

JMeter

AzureDevOps

Job description

Job Purpose:

The AI Tester will be responsible for validating the functionality, performance, and reliability of AI-driven systems and applications. This includes designing and executing test cases for machine learning models, automation flows, and intelligent features integrated into enterprise platforms.

Mandatory skills:

• Experience: At least 5 - 7 years in the field of test engineering.
• AI Tools: Familiarity with the Microsoft Responsible AI Toolbox, AI Foundry, and Guardrail. Knowledge of GPT-4.0 or other LLMs, as well as expertise in prompt engineering, is highly beneficial.
• Automation Tools: Significant expertise in automation tools such as Selenium, JMeter, LoadRunner, or Appium for automating web, mobile, and performance testing.
• CI/CD Integration: A strong grasp on continuous integration and continuous deployment tools such as Jenkins, Bamboo, or GitLab CI/CD to automate build and deployment processes.
• Quality Assurance: Thorough understanding of Quality Assurance principles, testing methodologies, and best practices. The ability to develop robust automation frameworks to ensure the highest standards of quality in our products.

Preferred Skills:

• Experience in the Fintech/BFSI domain
• Availability for remote or onsite work
• Proficiency in automation and framework
• Expertise in validating data correction and hallucination
• Expertise in AzureDevOps or Jira
• Industry Standards: Understanding of software development methodologies like Agile, Scrum, and DevOps practices.

Roles and Responsibilities:

• Role Focus: Testing and evaluating AI models
• Skills Required: Proficiency in testing and evaluating technology
• Work Environment: Agile model, collaboration with Development and Integration teams
• Independence: Ability to work independently and bring innovative ideas
• Daily and weekly test reporting
• Defect tracking
• Attending daily stand-up and retrospective meetings
• Problem-solving and root cause analysis
• Automation scripts and test case accuracy
• Analytical Skills: Ability to analyze test results, identify trends, and derive meaningful insights
• Desired Traits: Detail-oriented, innovative, analytical

Soft Skills:

• Communication: Excellent verbal and written communication skills to articulate complex technical concepts to diverse stakeholders.
• Collaboration: Ability to work effectively within cross functional teams, including developers, QA engineers, and product managers.
• Adaptability: Flexibility to adapt to changing technologies, processes, and project requirements.
• Leadership: Capability to mentor junior team members, provide guidance, and lead automation initiatives.