Jobs in Pretoria, South Africa
AI Evaluation Scenarios Engineer - Project-Based
Mindrift
Software Engineer - FinTech, .NET Microservices (Remote)
Mukuru
Remote Physical Sciences Educator for FET – CAPS Online
Optimi Holdings (Pty) Ltd
Online School Educator: Physical Sciences (FET Phase)
Optimi Holdings (Pty) Ltd
Remote Growth Lead — Data-Driven DTC Scaling
Manta Sleep
Discover more opportunities than anywhere else. Find more jobs nowRemote Business Studies & Economics Educator
Optimi Holdings (Pty) Ltd
Online School Educator: Business Studies/Economic Management Studies
Optimi Holdings (Pty) Ltd
Connect with headhunters to apply for similar jobsRegional Lead Evaluator for SRHR/HIV Knows No Borders
International Organization for Migration
Final Evaluation Lead Consultant - Category B
International Organization for Migration
Debt Tracer: Commission-Based, Flexible Hours & Training
Real People (Pty) Ltd
Tracer- Bronkhorstpruit
Real People (Pty) Ltd
Digital Project Manager (Permanent Position Remote)
Druff Interactive
Virtual assistant
ITM Tanzania Limited
Remote Executive Assistant & Operations Specialist
ITM Tanzania Limited
Delivery-Driven Implementation Lead
Haldren
Implementation Manager (Remote)
Haldren
Remote Digital Project Manager (South Africa)
Druff Interactive
AI Evaluation Scenarios Engineer - Project-Based
Job summary
A tech staffing agency is looking for software engineers for project-based AI testing roles. Ideal candidates should have over 3 years of Python development experience and skills in creating structured test cases. This opportunity offers flexibility in work hours, with tasks expected to take 6-10 hours to complete. Pay rates vary, reaching up to $24/hour depending on expertise. English proficiency at B2 level is also required. Join a fast-paced environment focused on enhancing AI systems while working remotely.
Qualifications
- 3+ years of software development experience, ideally focused on Python.
- Experience with version control using Git.
- Comfortable with structured formats like JSON/YAML.
Responsibilities
- Create structured test cases simulating human workflows.
- Define gold-standard behavior for evaluating actions.
- Analyze agent logs and decision paths.
Skills
* The salary benchmark is based on the target salaries of market leaders in their relevant sectors. It is intended to serve as a guide to help Premium Members assess open positions and to help in salary negotiations. The salary benchmark is not provided directly by the company, which could be significantly higher or lower.