QA Engineer (EST hours) ID35731

AgileEngine, LLC.; Perímetro Urbano Medellín; Hybrid; COP 120,462,576 - 200,770,960; Full time

Benefits offered by this job

Professional growth opportunities

Competitive compensation

Flextime options

Job summary

A leading technology company in Medellín is seeking a QA Engineer. You will design and execute testing strategies, validate AI model performance, and work with CI/CD pipelines. Ideal candidates have a degree in Computer Science, 3+ years in QA, and experience with automation frameworks like Selenium and Postman. The role offers competitive compensation and flexible work options.

Qualifications

• 3+ years of experience in QA, Test Engineering, or related roles.
• Solid understanding of SDLC, Agile methodologies, and software quality principles.
• Hands-on experience with automation frameworks.

Responsibilities

• Design and execute automated and manual test strategies.
• Validate AI model performance.
• Automate quality processes across data pipelines.

Skills

QA methodologies

Automation frameworks (Pytest, Selenium, Cypress, Postman)

Upper-Intermediate English

REST APIs

Detail-oriented

CI/CD tools

Education

Bachelor’s degree in Computer Science, Engineering, or equivalent

Tools

Selenium

Postman

Cypress

Job description

Overview

Join to apply for the QA Engineer (EST hours) ID35731 role at AgileEngine.

AgileEngine is an Inc. 5000 company that creates award-winning software for Fortune 500 brands and trailblazing startups across 17+ industries. We rank among the leaders in areas like application development and AI/ML, and our people-first culture has earned us multiple Best Place to Work awards.

What you will do

• Design and execute both automated and manual end-to-end test strategies across all layers of the testing pyramid;


• Validate AI model performance, including accuracy, confidence thresholds, and fallback behavior;


• Automate quality processes from data ingestion to extraction and classification, with a focus on speed, repeatability, and resilience;


• Test and validate integration points between AI components and core business logic;


• Support and enhance CI/CD pipelines by maintaining test infrastructure and defining quality gates, automated scripts, and synthetic data;


• Define and track quality metrics that matter to the business (e.g., turnaround time, confidence scores, correction rates);


• Stay on the cutting edge—continuously learn and apply the latest AI and QA practices to make the impossible possible for our customers.

Must Haves

• Bachelor’s degree in Computer Science, Engineering, Information Systems, or equivalent experience;


• 3+ years of experience in QA, Test Engineering, or related roles with a strong grasp of QA methodologies;


• Solid understanding of SDLC, Agile methodologies, and software quality principles;


• Hands-on experience with automation frameworks like Pytest, Selenium, Cypress, Postman, etc.;


• Comfortable working with REST APIs, data pipelines, and backend services;


• Familiarity with cloud platforms (AWS or Azure) and CI/CD tools;


• Detail-oriented mindset with a sharp eye for edge cases and a strong sense of ownership;


• Quick, proactive learner—especially important in the fast-evolving world of AI;


• Upper-Intermediate English level.

Nice to Have

• Experience testing AI/ML systems in production environments;


• Familiarity with GenAI model evaluation metrics;


• Experience setting up monitoring/alerting for model drift, workflow failures, or performance issues.

Perks and Benefits

• Professional growth: Accelerate your professional journey with mentorship, TechTalks, and personalized growth roadmaps.


• Competitive compensation: We match your ever-growing skills, talent, and contributions with competitive USD-based compensation and budgets for education, fitness, and team activities.


• A selection of exciting projects: Join projects with modern solutions development and top-tier clients that include Fortune 500 enterprises and leading product brands.


• Flextime: Tailor your schedule for an optimal work-life balance, by having the options of working from home and going to the office – whatever makes you the happiest and most productive.

Details

• Seniority level: Mid-Senior level


• Employment type: Full-time


• Industries: IT Services and IT Consulting