Role summary
We are hiring a senior QA Engineer to own quality across our web products. You will plan testing, build and run automated test suites, and help us release with confidence. You will also test our AI features, including LLM-powered assistance and an MCP server.
Key responsibilities
Test strategy and planning
- Own the test strategy: what gets tested, how, and when, across unit, API, UI, integration and end-to-end levels.
- Write test plans and test cases from product requirements, and review requirements early to catch gaps.
- Decide what to automate and what to keep manual, and track test coverage.
Test automation
- Design, build and maintain a test automation framework from scratch or improve an existing one.
- Automate UI tests for the web app, API tests for the REST services, and regression suites that run on every build.
- Plug automated tests into the CI pipeline so failures block bad releases.
- Keep tests fast, stable and easy to read; fix flaky tests quickly.
Functional and integration testing
- Test role-based access, multi-step workflows, dashboards, scoring logic, file uploads and report exports (CSV, PPTX, ZIP).
- Test single sign-on (OIDC and SAML) and MFA with several identity providers.
- Check data correctness directly in the databases.
- Test data migration between product versions.
Release, installation and non-functional testing
- Test installation, upgrade and uninstall on Windows Server and Linux, including unattended upgrades.
- Run performance and load tests and report on bottlenecks.
- Run basic security tests and verify fixes for reported vulnerabilities.
- Sign off releases and keep clear bug reports and test reports.
Team and process
- Work closely with developers on testable design and shift-left testing.
- Mentor junior testers and set QA standards as the team grows.
Required skills and qualifications
Experience
- 8+ years in software testing, with at least 4 years building and maintaining test automation.
- Has set up an automation framework and a QA process from the ground up at least once.
Automation tools
- UI automation: Selenium WebDriver with Java, or Playwright or Cypress for Vue.js front ends.
- API automation: REST Assured (Java) and Postman/Newman.
- Test frameworks: JUnit 5 or TestNG; Spock for Groovy code; Cucumber (BDD) is a plus.
- Performance: Apache JMeter.
- Security testing: OWASP ZAP, plus working knowledge of the OWASP Top 10.
- CI and reporting: Jenkins or GitHub Actions, Git, and reports such as Allure.
Product technology (must be able to test against)
- Java (OpenJDK) and Groovy/Grails backend; Vue.js frontend.
- MariaDB: write SQL to check data. Neo4j: write Cypher queries to check graph data.
- Apache Tomcat and TLS configuration.
- Keycloak; SSO with OIDC and SAML using Okta, Microsoft Entra ID and Auth0; MFA.
- REST APIs.
- Windows Server and Linux (Ubuntu) for install and upgrade testing.
Other
- Strong Java programming skills for writing test code.
- Clear bug reports and test documentation in written English.
- Degree in Computer Science or similar, or equivalent hands-on experience.
AI, LLM and MCP testing
Our products include AI features, so the candidate must be able to test software whose output is not always the same.
Nice to have
- ISTQB Advanced or similar testing certification.
- Experience testing security, compliance or audit-related software.
- Experience testing on-premises software that customers install themselves.
- Accessibility testing (WCAG) and cross-browser testing.
- Experience with AI evaluation tools such as Promptfoo or DeepEval.
What success looks like
- First 30 days: Learns the products, writes the test strategy, and gets a smoke test suite running in CI.
- By 60 days: Automated regression covers the main user flows and APIs; install and upgrade tests run on Windows and Linux.
- By 90 days: Every release goes through automated checks, including AI test sets and MCP server tests, with a clear release sign-off report.
Interview process and how to apply
- Intro call (30 min): background, testing experience, availability.
- Take-home task (3-4 hours): automate UI and API tests for a small sample web app, run them in a CI pipeline, and write a short bug report on any issues found.
- Technical interview (60 min): walk through the task, then design a test strategy for a new feature, including how to test an AI assistant.
- Founder chat (30 min): working style, ownership, expectations.