AI Trainer

MCI Careers; Wes-Kaap; On-site; ZAR 350,000 - 550,000; Full time

Job summary

MCI Careers is seeking an AI Trainer to join our team. You will help improve AI systems through structured training, data preparation, and evaluation across multiple projects.

Collaboration with engineers, data annotators, and product teams is essential to ensure high-quality outputs that align with business goals. The role emphasizes rigorous attention to detail, strong communication, and the ability to handle large datasets while following established processes and quality standards.

Qualifications

• Bachelor's degree in Linguistics, Communications, Psychology, Computer Science, Information Systems, Data Science, Business, or related field.
• Minimum 2 years of experience in AI training, content evaluation, data annotation, quality assurance, research, or related field.
• Strong written and verbal communication skills.
• Excellent attention to detail and analytical thinking abilities.
• Ability to evaluate large volumes of content consistently and accurately.
• Experience following detailed processes, guidelines, and quality standards.
• Strong problem-solving and critical-thinking skills.
• Proficiency in Microsoft Office or Google Workspace.
• Ability to collaborate effectively with technical and non-technical stakeholders.

Responsibilities

• AI Training & Model Improvement: Support development and enhancement of AI systems through training and evaluation activities.
• Data Preparation & Annotation Support: Create and review high-quality datasets for AI training; collaborate with annotation teams.
• Prompt Evaluation & Optimization: Assist in improving AI performance via prompt analysis and testing; evaluate effectiveness across use cases.
• Quality Assurance & Performance Monitoring: Conduct structured evaluations of AI outputs; monitor against benchmarks; document findings.
• Documentation & Continuous Improvement: Maintain training guidelines and contribute to evaluation frameworks; stay informed on AI developments.

Skills

AI training

Data annotation

Quality assurance

Attention to detail

Analytical thinking

Communication

Team collaboration

Problem solving

Staying organized

Education

Bachelor's degree

Tools

Microsoft Office

Google Workspace

Job description

POSITION OVERVIEW

MCI is one of the fastest-growing tech-enabled business services companies in the USA, with a strong call center footprint and operations that extend across multiple countries. We deliver Customer Experience (CX), Business Process Outsourcing (BPO), and Anything-as-a-Service (XaaS) cloud technology solutions across a wide range of industries, including healthcare, retail, government, education, telecom, technology e-commerce, and financial services. Our contact centers are powered by both on-site and remote agents, leveraging advanced technologies to enhance customer journeys, drive scalability and reduce costs.

At MCI we are committed to fostering an environment where professionals can build meaningful careers, access continuous learning and development opportunities and contribute to the success of a globally expanding, industry-leading organization.

We are seeking a detail-oriented and analytical AI Trainer to help improve the performance, accuracy, and effectiveness of AI systems and Large Language Models (LLMs). This role is responsible for evaluating AI outputs, creating training datasets, refining model behavior, and supporting the continuous improvement of AI-powered products and services.

The successful candidate will work closely with AI engineers, prompt engineers, data annotators, and product teams to ensure AI systems consistently deliver high-quality, accurate, and business-aligned outcomes.

POSITION RESPONSIBILITIES

Key Responsibilities:

AI Training & Model Improvement

• Support the development and enhancement of AI systems through structured training and evaluation activities.
• Train AI systems using defined methodologies and processes.
• Evaluate AI-generated responses for quality, relevance, and accuracy.
• Identify trends, weaknesses, and areas for model improvement.
• Contribute to the refinement of model behaviors and outputs.

Data Preparation & Annotation Support

• Help create and maintain high-quality datasets that support AI training initiatives.
• Develop and review training datasets and examples.
• Collaborate with data annotation teams to ensure quality standards.
• Validate labeled data and training materials.
• Support dataset management and maintenance activities.

Prompt Evaluation & Optimization

• Assist in improving AI performance through prompt analysis and testing.
• Evaluate prompt effectiveness across multiple use cases.
• Identify opportunities to improve AI response quality.
• Support prompt testing and experimentation initiatives.
• Collaborate with prompt engineering teams on optimization efforts.

Quality Assurance & Performance Monitoring

• Ensure AI systems meet organizational quality expectations.
• Conduct structured evaluations of AI outputs.
• Monitor performance against established benchmarks.
• Document findings and recommendations.
• Support quality improvement initiatives.

Documentation & Continuous Improvement

• Contribute to the ongoing development of AI training practices.
• Maintain documentation, guidelines, and training standards.
• Assist with creating evaluation frameworks and procedures.
• Stay informed about AI and Generative AI developments.
• Recommend improvements to training processes and methodologies.

CANDIDATE QUALIFICATIONS

WONDER IF YOU ARE A GOOD FIT FOR THIS POSITION?

All positive, and driven applicants are encouraged to apply. The Ideal candidates for this position are highly motivated and dedicated and should possess the below qualities:

• Bachelor's Degree in Linguistics, Communications, Psychology, Computer Science, Information Systems, Data Science, Business, or a related field.
• Minimum 2 years of experience in AI training, content evaluation, data annotation, quality assurance, research, or a related field.
• Strong written and verbal communication skills.
• Excellent attention to detail and analytical thinking abilities.
• Ability to evaluate large volumes of content consistently and accurately.
• Experience following detailed processes, guidelines, and quality standards.
• Strong problem-solving and critical-thinking skills.
• Comfortable working with large datasets and structured information.
• Ability to provide constructive feedback and recommendations.
• Strong organizational and time-management abilities.
• Proficiency in Microsoft Office or Google Workspace.
• Ability to collaborate effectively with technical and non-technical stakeholders.

Nice to Have

• Experience working with Large Language Models (LLMs).
• Experience in AI training, chatbot evaluation, or prompt testing.
• Knowledge of Generative AI technologies.
• Experience with annotation or AI evaluation platforms.
• Familiarity with NLP concepts.
• Experience working within technology, SaaS, or BPO environments.
• Understanding of AI governance and responsible AI principles.
• Exposure to machine learning workflows.

PHYSICAL REQUIREMENTS

This job operates in a professional office environment. While performing the duties of this job, the employee will be largely sedentary and will be required to sit/stand for long periods while using a computer and telephone headset. The employee will be regularly required to operate a computer and other office equipment, including a phone, copier, and printer. The employee may occasionally be required to move about the office to accomplish tasks; reach in any direction; raise or lower objects, move objects from place to place, hold onto objects, and move or exert force up to forty (40) pounds.

CONDITIONS OF EMPLOYMENT

All MCI Locations

• Must be authorized to work in the country where the job is based.

Subject to the program and location of the position

• Must be willing to submit up to a LEVEL II background and/or security investigation with a fingerprint. Job offers are contingent on background/security investigation results.
• Must be willing to submit to drug screening. Job offers are contingent on drug screening results. (Does not apply in Canada)

REASONABLE ACCOMMODATION

Consistent with the Americans with Disabilities Act (ADA), it is the policy of MCI and its affiliates to provide reasonable accommodations when requested by a qualified applicant or employee with a disability unless such accommodations would cause undue hardship. The policy regarding requests for reasonable accommodation applies to all aspects of employment. If reasonable accommodations are needed, please contact Human Resources.

EQUAL OPPORTUNITY EMPLOYER

At MCI and its subsidiaries, we embrace differences and believe diversity is a benefit to our employees, our company, our customers, and our community. All aspects of employment at MCI are based solely on a person's merit and qualifications. MCI maintains a work environment free from discrimination, one where employees are treated with dignity and respect. All employees share in the responsibility for fulfilling MCI's commitment to a diverse and equal opportunity work environment.

MCI does not discriminate against any employee or applicant on the basis of age, ancestry, color, family or medical care leave, gender identity or expression, genetic information, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran status, race, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable laws, regulations, and ordinances. MCI will consider for employment qualified applicants with criminal histories in a manner consistent with local and federal requirements.

MCI will not tolerate discrimination or harassment based on any of these characteristics. We adhere to these principles in all aspects of employment, including recruitment, hiring, training, compensation, promotion, benefits, social and recreational programs, and discipline. In addition, it is the policy of MCI to provide reasonable accommodation to qualified employees who have protected disabilities to the extent required by applicable laws, regulations, and ordinances where an employee works.