Test Architect – Regression & Quality Strategy

Oowlish Technology; United States; Remote; USD 140,000 - 190,000; Full time

Benefits offered by this job

Home office

Competitive compensation

Career growth

International projects

Oowlish English Program

Oowlish Fitness

Games and competitions

Job summary

Oowlish Technology seeks an experienced Test Architect to own regression testing strategy and quality framework for a complex observability and audit platform. You will design automation architecture, establish coverage across functional, performance, security, and infrastructure requirements, and act as the quality gatekeeper through development lifecycles.

You will partner with engineering teams delivering logging, tracing, audit trails, and IaC capabilities, ensuring success metrics are met

Qualifications

• 8+ years of professional experience in Test Architecture, Quality Engineering, QA Automation, or similar technical quality roles.
• Proven experience leading testing strategy for distributed, data-intensive, or infrastructure-heavy systems.
• Deep experience designing regression testing frameworks and automation strategies.
• Experience validating performance, scalability, security, and reliability.
• Strong understanding of modern observability concepts and distributed systems.
• Experience with cloud-based infrastructure and automated deployment environments.
• Experience defining formal acceptance criteria and quality gates.
• Strong written and verbal English communication skills.

Responsibilities

• Own and design the end-to-end regression testing strategy and framework across multiple platform components and enterprise environments.
• Translate formal success metrics and technical evaluation criteria into clear, measurable, and automatable acceptance criteria.
• Define comprehensive test coverage for log/metric ingestion, performance, tracing, audit trail, and IaC deployment validation.
• Design the automation architecture and determine testing approaches and tooling.
• Establish regression suites that validate sprint deliverables.
• Own test environment strategy and test data management across versions/environments.
• Define approaches for performance, functional, security, and scalability validation.
• Validate IaC deployments meet acceptance criteria and are reproducible.
• Collaborate with engineering to align testing with platform architecture.
• Track testing progress, risks, defects, and quality status; provide clear reporting.
• Own quality gates and provide sign-off recommendations ahead of formal acceptance.

Skills

Test architecture

QA automation

Quality engineering

English communication

Leadership

Cloud/AWS

Agile methodologies

Observability concepts

Tools

OpenTelemetry

AWS

Terraform

CI/CD tools

Job description

Join Our Team

Oowlish, one of Latin America’s rapidly expanding software development companies, is seeking experienced technology professionals to enhance our diverse and vibrant team.

As a valued member of Oowlish, you will collaborate with premier clients from the United States and Europe, contributing to pioneering digital solutions. Our commitment to creating a nurturing work environment is recognized by our certification as a Great Place to Work, where you will have opportunities for professional development, growth, and a chance to make a significant international impact.

We offer the convenience of remote work, allowing you to craft a work-life balance that suits your personal and professional needs. We’re looking for candidates who are passionate about technology, proficient in English, and excited to engage in remote collaboration for a worldwide presence.

About the Role:

We are looking for an experienced Test Architect to own the regression testing strategy and quality framework for a complex observability and audit platform operating across multiple enterprise environments.

This is a highly technical quality leadership role focused on defining what successful validation looks like across functional, performance, security, scalability, and infrastructure-related requirements. You will design the automation architecture, establish test coverage and acceptance criteria, and serve as the quality gatekeeper throughout the development lifecycle.

You will work closely with engineering teams delivering logging, tracing, alerting, audit trail, and Infrastructure as Code (IaC) capabilities, ensuring the platform continues to meet defined success metrics as new builds are delivered across sprints.

The ideal candidate brings deep experience designing regression and automation strategies for distributed, data-intensive, infrastructure-heavy systems and is comfortable owning quality sign-off for business-critical technical platforms.

Responsibilities:

• Own and design the end-to-end regression testing strategy and framework across multiple platform components and enterprise environments.
• Translate formal success metrics and technical evaluation criteria into clear, measurable, and automatable acceptance criteria.
• Define comprehensive test coverage for:
  • Log and metric ingestion.
  • Search and query performance.
  • Distributed tracing correctness.
  • Audit trail integrity and immutability.
  • Alert firing, delivery, and routing.
  • Infrastructure as Code (IaC) deployment validation.
  • Load and scalability scenarios.
  • Failure-injection scenarios.
  • Security and compliance-related acceptance criteria.
• Design the automation architecture and determine the appropriate testing approaches and tooling.
• Establish regression suites that continuously validate sprint deliverables.
• Own test environment strategy and test data management across multiple product versions and environments.
• Define approaches for performance, functional, security, and scalability validation.
• Validate that Infrastructure as Code deployments are reproducible and meet defined acceptance criteria.
• Collaborate with engineering teams to ensure testing approaches align with the underlying platform architecture.
• Track testing progress, risks, defects, and overall quality status throughout the development lifecycle.
• Provide clear quality reporting and recommendations during sprint reviews and stakeholder discussions.
• Own quality gates and provide sign-off recommendations ahead of formal acceptance.

Requirements:

• 8+ years of professional experience in Test Architecture, Quality Engineering, QA Automation, or similar technical quality roles.
• Proven experience leading testing strategy for distributed, data-intensive, or infrastructure-heavy systems.
• Deep experience designing comprehensive regression testing frameworks and automation strategies.
• Experience validating more than functional behavior, including performance, scalability, security, and reliability.
• Strong understanding of modern observability concepts and distributed systems.
• Experience working with cloud-based infrastructure and automated deployment environments.
• Strong understanding of software development lifecycles, Agile delivery, and sprint-based development.
• Experience defining formal acceptance criteria and quality gates.
• Strong written and verbal English communication skills.

Must Have:

• 8+ years of experience in Test Architecture, QA Engineering, Quality Engineering, or QA leadership roles.
• Proven ownership of regression testing strategy and automation architecture.
• Deep experience designing regression frameworks covering functional, performance, and security validation.
• Experience testing distributed, data-intensive, infrastructure-heavy, or observability-related systems.
• Working knowledge of OpenTelemetry and modern observability concepts.
• Understanding of log and metrics pipelines.
• Experience validating distributed tracing and/or observability workflows.
• Working knowledge of AWS-based infrastructure sufficient to design meaningful technical test cases.
• Experience validating Infrastructure as Code (IaC) deployments.
• Experience working with Terraform-deployed environments.
• Experience with load, scale, and performance testing.
• Experience defining test strategies across multiple environments and/or product versions.
• Experience defining test environments and test data strategies.
• Experience translating technical success metrics into measurable and automatable acceptance criteria.
• Experience working with formal quality gates and Definition of Done (DoD).
• Comfortable owning quality sign-off and providing acceptance recommendations.

Nice to Have:

• Previous experience testing observability platforms.
• Experience with logging, monitoring, tracing, or telemetry platforms.
• Experience validating audit trail integrity and immutability.
• Experience with failure-injection or resilience testing.
• Experience with compliance-oriented or security-sensitive platforms.
• Experience testing ERP or other complex enterprise platforms.
• Experience working across multiple versions of the same enterprise application.
• Experience defining testing strategies for high-volume data ingestion systems.
• Experience with performance benchmarking and scalability validation.
• Experience working in client-facing technical engagements.

Benefits & Perks:

• Home office;
• Competitive compensation based on experience;
• Career plans to allow for extensive growth in the company;
• International Projects;
• Oowlish English Program (Technical and Conversational);
• Oowlish Fitness with Total Pass;
• Games and Competitions;