Technical AI Quality Coordinator

RWS; Colombia; Presencial; COP 90.000.000 - 130.000.000; Jornada completa

Descripción de la vacante

RWS in Colombia is seeking a Technical AI Quality Coordinator to join our Data Services team. You will blend QA expertise with scripting and automation to shape our quality strategy and design testing frameworks for AI data pipelines.

You will monitor data integrity across annotation, RLHF, and model evaluation workflows, collaborate with Data Engineering, AI Engineering, and Solutions teams, and help drive continuous quality improvements with measurable metrics.

Formación

• 3+ years of experience in Quality Assurance, Data Quality, or AI Operations.
• Working knowledge of Python and SQL for data analysis, reporting, and automation.
• Experience supporting AI/ML data projects, including data annotation, evaluation, or training data programs.
• Strong analytical skills with the ability to identify quality issues, trends, and opportunities for improvement.
• Excellent English communication skills and experience collaborating with global, cross-functional teams.

Responsabilidades

• Support quality assurance across AI data projects by improving processes, automating quality checks, and monitoring data accuracy.
• Develop and maintain testing frameworks, evaluation datasets, and quality metrics to ensure consistent project outcomes.
• Investigate quality issues, identify root causes, and implement corrective actions to improve performance.
• Help establish and maintain quality standards, frameworks, and auditing processes across projects.
• Monitor contributor and team performance, providing insights and recommendations to drive quality improvements.
• Partner with cross-functional teams including Data Engineering, AI Engineering, and Solutions teams to embed quality controls and reporting into workflows.
• Track key quality and performance metrics, identify risks, and support continuous improvement initiatives.
• Stay informed on AI industry trends and contribute ideas to enhance quality programs and best practices.

Conocimientos

Quality Assurance

Python

SQL

AI data projects

Analytical skills

English communication

Educación

Data Analytics degree

Herramientas

Power BI

Tableau

Looker

Descripción del empleo

The Technical AI Quality Coordinator is an integral part of our Data Services team, blending a strong Quality Assurance background with practical scripting and automation skills. In this role, quality is your primary compass—you will help define our quality strategy, design technical testing frameworks, and evaluate the output quality of our distributed workforce.

You will play a key role in ensuring top-notch data integrity across AI annotation, RLHF (Reinforcement Learning from Human Feedback), and model evaluation pipelines through a combination of data analysis, light coding, and programmatic quality design.

About Generate

We help our customers Generate better content, at scale

Key Responsibilities

Job Overview

• Support quality assurance across AI data projects by improving processes, automating quality checks, and monitoring data accuracy.
• Develop and maintain testing frameworks, evaluation datasets, and quality metrics to ensure consistent project outcomes.
• Investigate quality issues, identify root causes, and implement corrective actions to improve performance.Help establish and maintain quality standards, frameworks, and auditing processes across projects.
• Monitor contributor and team performance, providing insights and recommendations to drive quality improvements.
• Partner with cross-functional teams including Data Engineering, AI Engineering, and Solutions teams to embed quality controls and reporting into workflows.
• Track key quality and performance metrics, identify risks, and support continuous improvement initiatives.
• Stay informed on AI industry trends and contribute ideas to enhance quality programs and best practices.

Skills & Experience

• 3+ years of experience in Quality Assurance, Data Quality, or AI Operations.
• Working knowledge of Python and SQL for data analysis, reporting, and automation.
• Experience supporting AI/ML data projects, including data annotation, evaluation, or training data programs.
• Strong analytical skills with the ability to identify quality issues, trends, and opportunities for improvement.
• Excellent English communication skills and experience collaborating with global, cross-functional teams.

Nice to Have

• Degree in Data Analytics, Computer Science, Statistics, Linguistics, Psychology, or a related field.
• Experience with reporting and visualization tools such as Power BI, Tableau, or Looker.
• Familiarity with remote or crowdsourced workforce management.

Life at RWS

Life at RWS If you like the idea of working with smart people who are passionate about growing the value of ideas, data and content by making sure organizations are understood , then you’ll love life at RWS.

Our purpose is to unlock global understanding. This means our work fundamentally recognizes the value of every language and culture. So, we celebrate difference, we are inclusive and believe that diversity makes us strong. We want every employee to grow as an individual and excel in their career.

In return, we expect all our people to live by the values that unite us: to partner, putting clients fist and winning together, to pioneer, innovating fearlessly and leading with vision and courage, to progress, aiming high and growing through actions and to deliver, owning the outcome and building trust with our colleagues and clients.

RWS embraces DEI and promotes equal opportunity, we are an Equal Opportunity Employer and prohibit discrimination and harassment of any kind. RWS is committed to the principle of equal employment opportunity for all employees and to providing employees with a work environment free of discrimination and harassment. All employment decisions at RWS are based on business needs, job requirements and individual qualifications, without regard to race, religion, nationality, ethnicity, sex, age, disability, or sexual orientation. RWS will not tolerate discrimination based on any of these characteristics.

RWS Values

Get the 3Ps right – Partner, Pioneer, Progress – and we´ll Deliver together as RWS.