QA Engineer (EST hours) ID35731

AgileEngine, LLC.; Perímetro Urbano Santiago de Cali; Presencial; COP 120.144.173 - 200.240.288; Tempo integral

Benefícios oferecidos por esta vaga

Professional growth opportunities

Competitive USD-based compensation

Flexible working schedule

Exciting projects with top-tier clients

Resumo da vaga

A tech firm in Colombia is seeking a Quality Assurance Engineer to design and execute testing strategies, validate AI models, and automate processes. The ideal candidate has over 3 years of QA experience with a strong understanding of automation frameworks and CI/CD tools. This full-time position offers competitive compensation and professional growth opportunities.

Qualificações

• 3+ years of experience in QA, Test Engineering, or related roles.
• Solid understanding of SDLC, Agile methodologies, and software quality principles.
• Hands-on experience with automation frameworks.

Responsabilidades

• Design and execute automated and manual test strategies.
• Validate AI model performance including accuracy and fallback behavior.
• Automate quality processes from data ingestion to extraction.

Conhecimentos

QA methodologies

Automation frameworks (Pytest, Selenium, Cypress, Postman)

REST APIs

Cloud platforms (AWS, Azure)

Detail-oriented mindset

Proactive learner

Upper-Intermediate English

Formação

Bachelor’s degree in Computer Science or equivalent

Ferramentas

CI/CD tools

Descrição da vaga

Overview

AgileEngine is an Inc. 5000 company that creates award-winning software for Fortune 500 brands and trailblazing startups across 17+ industries. We rank among the leaders in areas like application development and AI/ML, and our people-first culture has earned us multiple Best Place to Work awards.

Why join us

If you're looking for a place to grow, make an impact, and work with people who care, we'd love to meet you!

What you will do

• Design and execute both automated and manual end-to-end test strategies across all layers of the testing pyramid;
• Validate AI model performance, including accuracy, confidence thresholds, and fallback behavior;
• Automate quality processes from data ingestion to extraction and classification, with a focus on speed, repeatability, and resilience;
• Test and validate integration points between AI components and core business logic;
• Support and enhance CI/CD pipelines by maintaining test infrastructure and defining quality gates, automated scripts, and synthetic data;
• Define and track quality metrics that matter to the business (e.g., turnaround time, confidence scores, correction rates);
• Stay on the cutting edge—continuously learn and apply the latest AI and QA practices to make the impossible possible for our customers.

Must haves

• Bachelor’s degree in Computer Science, Engineering, Information Systems, or equivalent experience;
• 3+ years of experience in QA, Test Engineering, or related roles with a strong grasp of QA methodologies;
• Solid understanding of SDLC, Agile methodologies, and software quality principles;
• Hands-on experience with automation frameworks like Pytest, Selenium, Cypress, Postman, etc.;
• Comfortable working with REST APIs, data pipelines, and backend services;
• Familiarity with cloud platforms (AWS or Azure) and CI/CD tools;
• Detail-oriented mindset with a sharp eye for edge cases and a strong sense of ownership;
• Quick, proactive learner—especially important in the fast-evolving world of AI;
• Upper-Intermediate English level.

Nice to have

• Experience testing AI/ML systems in production environments;
• Familiarity with GenAI model evaluation metrics;
• Experience setting up monitoring/alerting for model drift, workflow failures, or performance issues.

Perks and benefits

• Professional growth: Accelerate your professional journey with mentorship, TechTalks, and personalized growth roadmaps.
• Competitive compensation: We match your ever-growing skills, talent, and contributions with competitive USD-based compensation and budgets for education, fitness, and team activities.
• A selection of exciting projects: Join projects with modern solutions development and top-tier clients that include Fortune 500 enterprises and leading product brands.
• Flextime: Tailor your schedule for an optimal work-life balance, by having the options of working from home and going to the office – whatever makes you the happiest and most productive.

Seniority level

• Mid-Senior level

Employment type

• Full-time

Industries

• IT Services and IT Consulting

Get notified about new Quality Assurance Engineer jobs in Cali, Valle del Cauca, Colombia.