Senior QA Automation Engineer, Python, Selenium, Pytest

Jobtailor; Deutschland; Vor Ort; EUR 60.000 - 90.000; Vollzeit

Zusammenfassung

Jobtailor is seeking an experienced QA engineer to design comprehensive test architectures across unit, integration, E2E, and semantic validation for AI‑driven pipelines. You will own test strategy, mentor engineers, collaborate with the AI/LLM Lead, and champion CI/CD quality gates to ensure reliable releases in a multi‑tenant, agile environment.

The role emphasizes leadership, advanced automation, and cross‑functional communication, with a focus on ensuring test coverage and traceability

Qualifikationen

• 5+ years of hands‑on software QA with a track record of test strategy, planning, execution, and maintenance.
• Comprehensive test documentation and traceability.
• Advanced test automation with custom frameworks; scripting.
• 3+ years with automated testing tools such as Selenium or Pytest; ability to write custom testing frameworks.
• Proficiency in Python (primary) or Java, C#, Go for test automation.
• Deep knowledge of databases and SQL for data validation and multi‑tenant isolation.

Aufgaben

• Design comprehensive test architecture – plan unit, integration, E2E, and semantic validation test suites.
• Build semantic validation harnesses for AI outputs with reference profiles and coverage targets.
• Implement access-control testing to verify cross‑tenant isolation and RLS policies.
• Design and maintain CI/CD quality gates and automated test runners for every commit.
• Lead test automation practices and recommend tools for testing efficiency.
• Collaborate with the team as QA voice in design reviews and define correctness for pipeline stages.
• Mentor junior engineers on test design and AI testing practices.
• Own test documentation, results, and traceability; report blockers and risks.

Kenntnisse

Test Strategy

Test Automation

Python

SQL

CI/CD

Jira

Selenium

Pytest

Semantic Validation

Tools

Selenium

Pytest

Custom Testing Frameworks

Jira

Jobbeschreibung

Responsibilities

• Design comprehensive test architecture – plan unit, integration, E2E, and semantic validation test suites that cover the full pipeline from profile intake through roadmap generation; define coverage targets and acceptance criteria
• Build semantic validation harnesses for AI outputs – design golden-set test cases (5–8 CISO-approved reference profiles) that measure AI stage precision/recall, rigor-tier correctness, floor-control invariants, traceability completeness, and run-to-run stability; a semantic regression blocks merge
• Implement access-control testing – design automated probes at API and database layers that verify cross-tenant isolation; simulate compromised sessions and verify RLS policies enforce tenant boundaries
• Design and maintain CI/CD quality gates – build automated test runners that execute on every commit: unit tests, integration tests, schema validation, migration guards, image scanning, access-control probes; red builds block merge
• Lead test automation practices – expand automation frameworks and practices; identify opportunities for improving test processes; recommend tools and technologies for testing efficiency
• Collaborate across the team – serve as the QA voice in technical design reviews; flag testability issues early; work with the AI/LLM Lead to define what "correct" means for each pipeline stage
• Mentor junior test engineers – guide the team on test design, semantic validation, and CI/CD best practices; share knowledge on testing AI systems where reproducibility is critical
• Own test documentation and reporting – maintain clear test plans, results, and traceability matrices; report test coverage and quality metrics to leadership; communicate blockers and risks transparently

Requirements

• 5+ years of hands‑on software QA with a track record of:
• Test strategy, planning, execution, and maintenance
• Comprehensive test documentation and traceability
• Advanced test automation (custom frameworks, advanced scripting)
• 3+ years with automated testing tools – Selenium, Pytest, or equivalent; ability to write custom testing frameworks
• Advanced proficiency in a programming language relevant to test automation:
• Python (primary for this engagement; Pyset, async testing)
• Or Java, C#, Go
• Deep knowledge of databases and SQL – execute complex data validation, verify multi‑tenant isolation at the DB layer, test RLS policies
• CI/CD pipeline expertise – understand how tests integrate into automated deployment workflows; experience optimizing test execution for speed and reliability
• Understanding of Agile/Scrum methodologies – ability to drive QA strategies in rapid, iterative development cycles
• Proficiency in defect tracking (Jira or equivalent)
• Proven leadership – mentor junior engineers, advocate for quality standards, drive process improvements
• Exceptional communication skills – articulate complex technical issues to engineers, product, and stakeholders
• Self‑motivated and detail‑oriented – work independently under time pressure, manage multiple priorities
• Exceptional English proficiency – work effectively with distributed, global teams.

Core Competencies

Demonstrates expertise in test strategy, automation, and CI/CD processes, with a strong focus on semantic validation and comprehensive test documentation. Proven ability to mentor teams and communicate effectively across technical and non‑technical stakeholders.

Hard Skills

• Test Strategy
• Test Documentation
• Advanced Test Automation
• Python
• Selenium
• Pytest
• SQL
• CI/CD
• Defect Tracking
• Semantic Validation

Soft Skills

• Exceptional Communication
• Mentoring
• Self‑Motivated
• Detail‑Oriented

Industry Keywords

• Quality Assurance
• Test Automation
• Agile
• Multi‑Tenant Isolation
• AI Testing

Tools & Technologies

• Jira
• Automated Testing Tools
• Custom Testing Frameworks