QA Automation Engineer

Alvys

Colombia

On-site

COP 60,000,000 - 90,000,000

Full time

3 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Alvys is seeking a Senior QA Engineer to own quality across the codebase, design test architectures, and build scalable automation with Playwright for our multi-tenant SaaS platform in freight logistics.

You will lead CI/CD quality, implement contract and performance tests, harness AI agents for testing, and collaborate with product, engineering, and customer success to ship reliable software.

Qualifications

  • 4+ years in software or test engineering.
  • Experience building Playwright-based QA frameworks adopted by teams.
  • Experience owning CI/CD quality pipelines with parallelization and monitoring.
  • Experience defining test strategy with risk-based priorities.

Responsibilities

  • Architect automation and quality infrastructure for your product area.
  • Own the CI/CD quality pipeline end-to-end: sharding, parallelization, flake SLOs, dashboards.
  • Apply contract testing, performance testing, synthetic monitoring and chaos engineering where risk justifies them.
  • Define the test strategy, data, and environment isolation for deterministic tests.
  • Lead AI-driven testing and evaluate AI-powered features and results.
  • Improve release processes and quality gates; lead post-incident quality reviews.

Skills

Playwright-based test automation
CI/CD quality pipeline ownership
AI testing proficiency
Test strategy
Contract testing
Performance testing
Chaos engineering
Mentoring test engineers

Education

Bachelor's degree in Computer Science or related field

Tools

Jira
Azure DevOps
TestRail

Job description

Join Alvys, an early-stage company ambitiously transforming the $800B US freight industry. As a Senior QA Engineer, you will be the quality infrastructure authority for your domain. You will design test architecture, own the CI/CD quality pipeline, and build the frameworks and tooling that let the whole engineering organization ship with confidence. You will also run AI agents as part of your testing practice, with the specifications, evals and controls that make their output trustworthy.

In this role, you will collaborate closely with engineering, product, and customer success teams to ensure our software remains reliable, performant, and capable of meeting complex customer needs within the transportation logistics sector.

About Alvys

Alvys is on a mission to revolutionize transportation logistics. Combining hands‑on industry expertise with a world‑class technical vision, we're building a multi‑tenant SaaS platform that's becoming indispensable for transportation companies.

  • Engineering Excellence: We embrace a balanced approach of practical and theoretical techniques to deliver superior code quality and architecture.
  • End‑to‑End Ownership: If you build it, you own it—teams are fully responsible for their code and its performance.
  • Blameless Culture: We learn from mistakes collaboratively, focusing on growth rather than finger‑pointing.
  • Core Values: Trust, transparency, and fairness underlie everything we do, shaping the solutions we build for an often fragmented industry.

We leverage a combination of modern testing tools and frameworks, including Playwright for end‑to‑end automation, with contract, performance and synthetic tests running in our CI/CD pipelines. Engineers in this role also use AI coding agents, skills and evals to build, run and verify tests. The ability to scale and optimize our test automation infrastructure is a key part of the role.

Minimum Qualifications
  • 4 to 7 years of industry experience in software or test engineering.
  • Bachelor's degree in Computer Science, Engineering, or a related field.
  • Strong track record designing and building Playwright-based test automation frameworks that other engineers adopt.
  • Experience owning a CI/CD quality pipeline, including parallelization, flake management and post‑deploy monitoring.
  • Experience defining test strategy for complex software systems, with risk‑based prioritization and measurable quality metrics.
  • AI proficiency, at minimum, you write specifications with acceptance checks before delegating to an agent, review results against evidence, and keep task state outside the context window.
  • Strong analytical and problem‑solving skills with a dedication to delivering high‑quality software.
Preferred Qualifications:
  • AI proficiency with running parallel agent loops in a harness, with evals in CI and reusable checks built from past failures.
  • Experience building eval and regression frameworks for AI‑powered features or non‑deterministic system outputs.
  • Experience with contract testing, synthetic monitoring or chaos engineering.
  • Proficiency in performance and load testing tools.
  • Experience mentoring test engineers and driving quality practices across multiple teams.
  • Knowledge of industry‑standard tools for bug tracking and test management, such as Jira, Azure DevOps, or TestRail.
Responsibilities
  • Quality infrastructure: Architect the automation and quality infrastructure strategy for your product area, including Playwright‑based frameworks that every engineer, not only QAs, can use.
  • CI/CD quality pipeline: Own the pipeline end to end: sharding, parallelization, flake SLOs, artifact collection and post‑deploy monitors. Build dashboards for test health, flakiness, coverage trends and mean time to detection.
  • Advanced testing: Apply contract testing, performance testing, synthetic monitoring and chaos engineering where the risk justifies them.
  • Test architecture: Define the test strategy and standards for your domain, including test pyramid balance, coverage targets and risk‑based prioritization. Design test data and environment isolation so tests stay deterministic at scale.
  • AI-driven testing: Run agent‑based test development and triage loops with software‑enforced limits, and build eval and regression frameworks for AI‑powered features. See AI Literacy below.
  • Process: Improve release processes and quality gates. Lead post‑incident quality reviews and make sure systemic fixes are automated and monitored.
  • Influence: Represent quality in architecture and product decisions. Work with Product, Platform and Customer Success, and use escape rate, MTTD and flakiness rate to guide quality investment.

Alvys is an equal opportunity employer and as such, we do not discriminate on the basis of race, color, religion, sex, sexual orientation, gender identity, national origin, age, disability, or any other characteristic protected by applicable laws.

We are dedicated to growing a diverse team of highly talented people. We’re dedicated to building a workplace where we give each other the strategies, support, and space we each need to thrive—believing in and bringing out the best of everyone.

If you require any accommodations during the recruitment process, whether it be alternate forms of material, accessible meeting rooms, etc., please let us know and we will work with you to meet your needs.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior QA Engineer: AI-Driven Testing & CI/CD Architect
Senior QA Engineer: AI-Driven Testing & CI/CD Architect

Alvys • Colombia

On-site
COP 60,000,000 - 90,000,000
QA Automation Engineer
QA Automation Engineer

Applaudo • Colombia

On-site
COP 60,000,000 - 90,000,000
QA Automation Engineer
QA Automation Engineer

Applaudo • Medellín

Remote
COP 180,227,000 - 294,918,000
Senior QA Engineer
Senior QA Engineer

Altura • Bogotá

On-site
COP 90,000,000 - 130,000,000
Qa Manual Engineer
Qa Manual Engineer

Azumo • Bogotá

Remote
COP 196,612,000 - 393,223,000
Paid time off
US holidays
Training
+4
QA Engineer (EST hours) ID35731
QA Engineer (EST hours) ID35731

AgileEngine, LLC. • Perímetro Urbano Medellín

Hybrid
COP 120,462,576 - 200,770,960
Professional growth opportunities
Competitive compensation
Flextime options
QA Engineer (EST hours) ID35731
QA Engineer (EST hours) ID35731

AgileEngine, LLC. • Perímetro Urbano Bucaramanga

Hybrid
COP 120,462,576 - 200,770,960
Professional growth opportunities
Competitive USD-based compensation
Flextime for work-life balance
QA Manual Engineer
QA Manual Engineer

Azumo • Puerto Bogotá

Remote
COP 242,986,000 - 356,379,000
Paid time off
U.S. Holidays
Training
+4
QA Engineer (EST hours) ID35731
QA Engineer (EST hours) ID35731

AgileEngine, LLC. • Perímetro Urbano Santiago de Cali

On-site
COP 120,144,173 - 200,240,288
Professional growth opportunities
Competitive USD-based compensation
Flexible working schedule
+1
AI-Augmented Software Engineer
AI-Augmented Software Engineer

Azumo • Colombia

Remote
COP 287,292,000 - 383,056,000
Paid time off (PTO)
US Holidays
AI Training
+3