AI/ML Testing Engineer — Production Quality & Automation

Robots and Pencils; Colombia; On-site; COP 190,803,000 - 286,205,000; Full time

Job summary

Robots & Pencils is seeking a Testing Engineer to build and maintain quality across software features and AI/ML systems. You will own testing across automation and AI, contribute to quality strategy, and take on responsibilities from day one.

Join a cross-functional team, write automated tests, validate AI/ML outputs, and embed quality practices into delivery. The role emphasizes shipping reliable AI-enabled systems with speed and craft.

Qualifications

• 2+ years in test automation or AI/ML testing.
• Experience with UI, API, or ML workflow testing.
• Understanding of ML lifecycle and model outputs.

Responsibilities

• Write and maintain automated tests for UI, API, and ML components.
• Validate AI/ML outputs against defined criteria and report defects.
• Test data pipelines and AI workflows for data quality and integrity.
• Integrate tests into CI/CD pipelines and monitor results.
• Collaborate with developers and data scientists to align quality with delivery goals.

Skills

Test automation

AI/ML testing

CI/CD pipelines

Bug tracking

Web/mobile testing

Tools

Selenium

Cypress

Playwright

Jira

TestRail

Job description

Robots & Pencils is seeking a Testing Engineer to build and maintain quality across software features and AI/ML systems. You will own testing across automation and AI, contribute to quality strategy, and take on responsibilities from day one.

Join a cross-functional team, write automated tests, validate AI/ML outputs, and embed quality practices into delivery. The role emphasizes shipping reliable AI-enabled systems with speed and craft.