AI/ML Quality Assurance Engineer

Gugu Robotics

Colombia

On-site

COP 60,000,000 - 90,000,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Robots & Pencils in Colombia is seeking a Testing Engineer to build and maintain quality across software features and AI/ML systems. You’ll own automated tests, validate model outputs, and integrate QA into delivery, working with a cross-functional team to ship reliable AI-enabled software.

You’ll contribute to quality strategy, participate in sprint ceremonies, and help scale testing across UI, API, and ML pipelines while advancing best practices in CI/CD and data validation.

Qualifications

  • 2+ years of experience in test automation or AI/ML testing.
  • Proficiency in Python, JavaScript, Java, or similar, with the ability to write and maintain test code independently.
  • Experience with test automation frameworks for UI, API, or ML workflows.
  • Understanding of AI/ML concepts and the ML lifecycle, with the ability to validate model outputs against defined criteria.
  • Experience with CI/CD pipelines and version control.
  • Working knowledge of API testing and data validation.
  • Solid understanding of SDLC/STLC and Agile methodologies.
  • Proficiency with bug-tracking and test management tools.
  • Familiarity with testing AI/ML systems, including LLM evaluation, RAG retrieval quality, model drift monitoring, and AI safety considerations.

Responsibilities

  • Write and maintain automated test scripts for UI, API, and integration testing.
  • Validate ML model outputs including accuracy, consistency, and expected behavior.
  • Test data pipelines and AI workflows, performing dataset validation and data quality checks.
  • Execute automated test suites, analyze results, document and track defects.
  • Integrate automated tests into CI/CD pipelines to support continuous quality.
  • Support model evaluation processes and assist in testing AI workflows end-to-end.
  • Test AI/ML systems, including LLM evaluation and safety checks.

Skills

Python
JavaScript
Java
Test automation
AI/ML testing
CI/CD
API testing
Bug tracking

Tools

Selenium
Cypress
Playwright
PyTest

Job description

Robots & Pencils in Colombia is seeking a Testing Engineer to build and maintain quality across software features and AI/ML systems. You’ll own automated tests, validate model outputs, and integrate QA into delivery, working with a cross-functional team to ship reliable AI-enabled software.

You’ll contribute to quality strategy, participate in sprint ceremonies, and help scale testing across UI, API, and ML pipelines while advancing best practices in CI/CD and data validation.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

AI/ML Testing Engineer — Production Quality & Automation
AI/ML Testing Engineer — Production Quality & Automation

Robots and Pencils • Colombia

On-site
COP 190,803,000 - 286,205,000
AI/ML Testing Engineer — Validate & Ship QA Automation
AI/ML Testing Engineer — Validate & Ship QA Automation

Robots & Pencils • Puerto Bogotá

On-site
COP 190,967,000 - 286,451,000
QA Engineer: Manual & Automated Testing with AI
QA Engineer: Manual & Automated Testing with AI

Inetum • Bogotá

On-site
COP 40,000,000 - 70,000,000
QA Analyst: AI-Driven Testing for Enterprise Apps
QA Analyst: AI-Driven Testing for Enterprise Apps

CI&T • Colombia

On-site
COP 40,000,000 - 70,000,000
Health and dental insurance
Meal and food allowance
Childcare assistance
+2
Remote QA Engineer - AI/ML Automation & CI/CD
Remote QA Engineer - AI/ML Automation & CI/CD

AgileEngine, LLC. • Perímetro Urbano Bucaramanga

Hybrid
COP 120,462,576 - 200,770,960
Professional growth opportunities
Competitive USD-based compensation
Flextime for work-life balance
Senior QA Automation Engineer – Remote, AI Platform Impact
Senior QA Automation Engineer – Remote, AI Platform Impact

Intellias • Colombia

Remote
COP 55,800,000 - 133,920,000
Health, life, funerary and pet insurance
Training and certifications
Internet subsidy
+1
QA Engineer (EST hours) ID35731
QA Engineer (EST hours) ID35731

AgileEngine, LLC. • Perímetro Urbano Santiago de Cali

On-site
COP 120,144,173 - 200,240,288
Professional growth opportunities
Competitive USD-based compensation
Flexible working schedule
+1
Lead QA Automation Engineer - Playwright, AI & TS
Lead QA Automation Engineer - Playwright, AI & TS

GlobalLogic Inc. • Bogotá

On-site
COP 180,000,000 - 240,000,000
Exciting Projects
Collaborative Environment
Work-Life Balance
+2
Senior Quality Engineer / QE Technical Lead Engineer - AA, Remote: Colombia - Costa Rica, Full Time
Senior Quality Engineer / QE Technical Lead Engineer - AA, Remote: Colombia - Costa Rica, Full Time

Gorilla Logic • Colombia

On-site
COP 194,698,000 - 389,395,000
Senior QA Engineer - Remote AI-Driven Testing Leader
Senior QA Engineer - Remote AI-Driven Testing Leader

Encora Inc. • Bogotá ciudad

Remote
COP 192,406,000 - 320,677,000