Test Automation Engineer

Seargin

Poland

Remote

PLN 180,000 - 240,000

Full time

24 hours ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

MultiSport and Private Medical Care

Job summary

Seargin Ltd is hiring a Senior QA Automation Engineer in Poland to own the test strategy and automation frameworks across frontend, backend, and API layers. You will develop automated API tests, UI tests with Playwright, and tests for AI agent workflows, while integrating everything into CI/CD pipelines.

You will work with engineers and AI specialists to ensure robust test coverage, manage cloud test environments on AWS, and reduce flaky tests through continuous improvements.

Qualifications

  • Minimum 5 years of QA or software testing experience with 3+ years in test automation.
  • Experience defining test strategies and owning automation frameworks.
  • Strong Python or TypeScript programming skills for test automation.
  • Practical REST API test automation experience (functional, negative, integration).
  • Knowledge of OpenAPI and JSON Schema for contract testing.
  • Experience testing asynchronous workflows (polling, queues, WebSockets).
  • Understanding OAuth2, OIDC, JWT and RBAC security concepts.
  • Hands-on Playwright UI automation for React SPAs.
  • Experience reducing flaky tests and integrating tests into CI/CD (GitLab).
  • Familiarity with Docker-based environments and AWS cloud testing.
  • Ability to read logs/metrics and use tracing for issue investigation.
  • Experience testing AI/LLM-powered workflows and tooling.

Responsibilities

  • Establish test strategy and pyramid to ensure platform quality.
  • Own test automation frameworks across frontend, backend, and API layers.
  • Develop automated REST API tests including schema validation.
  • Create tests for asynchronous processes (polling, queues, WebSockets).
  • Build end-to-end UI tests with Playwright for React apps.
  • Test AI agent workflows and MCP tool calls, logs, and memory usage.
  • Integrate automated tests into CI/CD with quality gates and regression runs.
  • Maintain AWS-based test environments and ensure reliable runs.
  • Analyze flaky tests, perform root-cause analysis and improvements.
  • Collaborate with engineers to identify quality risks early.

Skills

QA Experience
Test Strategy
Python/TypeScript
REST API Testing
API Schema Testing
Asynchronous Testing
OAuth2/JWT
Playwright UI Testing
CI/CD Integration
Docker & Cloud (AWS)
Monitoring & Tracing
AI/LLM Testing
AI Tools & Communication

Tools

Playwright
Docker
AWS
GitLab CI

Job description

  • Establish and maintain the overall test strategy and appropriate test pyramid to ensure comprehensive platform quality coverage.
  • Own Test Automation Frameworks
    • Build, maintain and take ownership of the test automation repository and framework across frontend, backend and API layers.
  • Develop Automated API Tests
    • Create and maintain REST API tests covering functional, negative, integration and schema validation scenarios.
  • Develop automated tests for asynchronous processes involving polling, message queues and WebSockets.
  • Develop End-to-End UI Tests
    • Build and maintain end-to-end UI automation tests using Playwright to validate platform functionality.
  • Test AI Agent Workflows
    • Implement smoke and integration tests covering AI agent deployment, authentication, MCP tool calls, logs, traces and memory-related functionality.
  • Integrate Tests into CI/CD Pipelines
    • Implement automated tests in CI/CD pipelines, including merge-request quality gates, scheduled regression runs and post-deployment smoke tests.
  • Maintain Cloud Test Environments
    • Support the provisioning and maintenance of AWS-based test environments to ensure reliable automated testing.
  • Perform root cause analysis of test failures, identify flaky tests and implement improvements to increase automation reliability.
  • Monitor Application Behaviour
    • Use application logs, metrics and distributed tracing to investigate issues and assess platform performance.
  • Collaborate with Engineering Teams
    • Work with developers, platform engineers and AI specialists to identify quality risks early in the development lifecycle.
  • Review Technical Designs
    • Evaluate technical designs and recommend improvements to testability, reliability and overall product quality.
  • Report Quality Results and Risks
    • Communicate test results, report quality risks and continuously improve testing processes and practices.
Requirements
  • QA and Software Testing Experience
    • Minimum 5 years of experience in QA or Software Testing, including at least 3 years of hands‑on experience in Test Automation.
  • Test Strategy and Framework Ownership
    • Experience defining test strategies and independently managing test automation frameworks or repositories.
  • Programming Skills
    • Strong programming skills in Python or TypeScript, with practical experience applying them to test automation.
  • REST API Testing
    • Practical experience with REST API test automation, including functional, negative and integration testing scenarios.
  • API Schemas and Contract Testing
    • Knowledge of OpenAPI, JSON Schema validation and contract testing to verify API specifications and integrations.
  • Asynchronous Workflow Testing
    • Experience testing asynchronous workflows involving polling, message queues and WebSockets.
  • Authentication and Authorization
    • Understanding of OAuth2, OIDC, JWT and RBAC mechanisms used to secure application access and permissions.
  • Frontend Test Automation
    • Hands‑on experience with Playwright, preferably testing React-based single-page applications.
  • Test Reliability and CI/CD Integration
    • Experience identifying and reducing flaky tests and integrating automated testing into CI/CD pipelines, preferably GitLab CI.
  • Containerization and Cloud Infrastructure
    • Knowledge of Docker and containerized environments, with experience testing cloud-based applications and infrastructure, preferably AWS.
  • Monitoring and Observability
    • Familiarity with application logs, metrics and distributed tracing for investigating application behaviour and technical issues.
  • AI and LLM Application Testing
    • Understanding of LLM-based applications, AI agents and the specific challenges involved in testing AI-powered functionality.
  • AI Development Tools and Communication Skills
    • Experience using AI coding assistants, combined with strong analytical, troubleshooting and communication skills.
What we offer
  • B2B Contract
    • Employment based on a B2B contract
  • Stable and Dynamic International Firm
    • Opportunity to work in a stable, dynamically developing international company
  • Engaging Projects and Latest IT
    • Chance to participate in interesting projects and work with the latest information technologies
  • Competitive Rates
    • Attractive remuneration rates offeres
  • Renowned International Projects
    • Involvement in the most prestigious international project
  • MultiSport and Private Medical Care
    • MultiSport and Private Medical Care
Nice to have
  • AWS Services
    • Experience with AWS services such as Lambda, API Gateway, S3 and CloudWatch.
  • AI Agent Frameworks
    • Familiarity with LangGraph, CrewAI or AWS Strands.
  • LLM Evaluation Tools
    • Experience with DeepEval, Promptfoo or Ragas.
  • MCP and A2A Protocols
    • Knowledge of Model Context Protocol (MCP) and Agent-to-Agent (A2A) protocols.
  • RAG and Vector Databases
    • Experience with RAG pipelines, vector databases and retrieval-based applications.
  • Application Security
    • Understanding of OWASP security principles and application security testing.
  • Regulated Environments
    • Experience working in regulated environments or with GxP requirements.

Work with us

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Java Automation Tester
Java Automation Tester

Seargin • Katowice

On-site
PLN 120,000 - 180,000
B2B Contract
Stable and Dynamic International Firm
Engaging Projects and Latest IT
+3
Solution Architect
Solution Architect

Seargin • Poland

Remote
PLN 300,000 - 520,000
B2B Contract
Global opportunities
Engaging projects and latest IT
Senior QA Automation Engineer – Cloud, Web Apps & APIs
Senior QA Automation Engineer – Cloud, Web Apps & APIs

Accuris • Województwo pomorskie

Hybrid
PLN 60,000 - 90,000
Engineering Manager
Engineering Manager

Seargin • Polska

On-site
PLN 420,000 - 600,000
B2B contract
International projects
Latest IT
+3
Business Analyst
Business Analyst

Seargin Ltd • Poland

Remote
PLN 180,000 - 240,000
MultiSport
Private Medical Care
Senior Quality Assurance Engineer (Python/AI) IRC306475
Senior Quality Assurance Engineer (Python/AI) IRC306475

GlobalLogic Inc. • Kraków

On-site
PLN 120,000 - 180,000
Relocation options
Learning & Development support
Inclusive culture
Senior Associate 1, Software QA Engineering
Senior Associate 1, Software QA Engineering

Accuris • Województwo pomorskie

Hybrid
PLN 60,000 - 90,000
Senior QA Engineer
Senior QA Engineer

Diverse Consulting Group • Warszawa

On-site
PLN 180,000 - 280,000
Private medical care
Co-financing for sports card
Dedicated consultant support
Test Automation Engineer
Test Automation Engineer

Seargin • Poland

On-site
PLN 180,000 - 300,000
Security Assurance Specialist
Security Assurance Specialist

Seargin • Polska

On-site
PLN 201,000 - 268,000
B2B Contract
Stable and Dynamic International Firm
Engaging Projects and Latest IT
+8
Top locations