QA Engineer

Billennium; Polska; On-site; PLN 110,000 - 150,000; Full time

Benefits offered by this job

Udemy for Business

Private medical care

Multisport card

Veterinary package

Language lessons

Shopping vouchers

Job summary

Roche is seeking a QA professional to translate AI Control Towers requirements into detailed test cases for a PoC. You will plan, execute, and document test cycles across installation, functional, integration, performance, and security testing.

You will validate vendor responses, support endpoint testing across pilot users, and log defects while coordinating with cross-functional teams to ensure traceability and regulatory compliance.

Qualifications

• Bachelor degree in Computer Science, Information Systems, Engineering, or related field (or equivalent practical experience).
• 3+ years of QA/software testing experience, ideally with enterprise platform rollouts or vendor PoCs.
• Hands-on experience testing AI/SaaS platform.
• Experience writing test plans and test cases from functional and technical requirements.
• Experience with defect/issue tracking tools (e.g., Jira) and Kanban workflows.
• Strong analytical skills with high attention to detail and clear written documentation.
• Fluent English, written and spoken; able to work with cross-functional and multi-vendor teams.
• Test planning, execution, and requirements traceability.
• Defect management and root-cause coordination with vendors.
• Stakeholder communication across business, procurement, and technical teams.
• Structured, evidence-based reporting.
• Comfort operating with ambiguity in a fast-moving PoC-stage environment.

Responsibilities

• Translate the AI Control Towers requirements into detailed, traceable test cases and scenarios.
• Plan, execute, and document test cycles across the PoC (installation, functional, integration, performance, and security testing).
• Validate vendor self-assessment responses against the requirements checklist and flag gaps or discrepancies.
• Support and verify endpoint installation testing across the pilot user cohort (up to 50% of end users during PoC).
• Test and confirm core governance capabilities (runtime AI governance, risk/impact evaluation, monitoring and observability, behave as specified).
• Log, prioritize, and track defects and issues through resolution, coordinating directly with vendors' technical teams.
• Coordinate with dependent teams within RO to align on resource needs and testing dependencies after each submission milestone.
• Contribute to defining the Definition of Done (DoD) and Definition of Ready (DoR) for the team's Kanban board.
• Support User Acceptance Testing (UAT) with the pilot end-user cohort and capture structured feedback.
• Verify that audit trails, logs, and compliance reporting outputs meet Roche's evidentiary and regulatory needs.
• Prepare clear, concise QA status reporting for AI Control Tower stakeholders, procurement, and leadership.

Skills

QA/testing experience

AI testing

Test planning

Defect management

Stakeholder communication

Analytical thinking

Education

Bachelor's degree in Computer Science/Info Systems/Engineering

Tools

Jira

Job description

• Translate the AI Control Towers functional and technical requirements into detailed, traceable test cases and scenarios.
• Plan, execute, and document test cycles across the PoC (installation, functional, integration, performance, and security testing).
• Validate vendor self-assessment responses against the requirements checklist and flag gaps or discrepancies.
• Support and verify endpoint installation testing across the pilot user cohort (up to 50% of end users during PoC).
• Test and confirm core governance capabilities (runtime AI governance, risk/impact evaluation, monitoring and observability, behave as specified.
• Log, prioritize, and track defects and issues through resolution, coordinating directly with vendors technical teams.
• Coordinate with dependent teams within RO to align on resource needs and testing dependencies after each submission milestone.
• Contribute to defining the Definition of Done (DoD) and Definition of Ready (DoR) for the team's Kanban board.
• Support User Acceptance Testing (UAT) with the pilot end-user cohort and capture structured feedback.
• Verify that audit trails, logs, and compliance reporting outputs meet Roche's evidentiary and regulatory needs.
• Prepare clear, concise QA status reporting for AI Control Tower stakeholders, procurement, and leadership.

Required technologies and skills:

• Bachelor degree in Computer Science, Information Systems, Engineering, or a related field (or equivalent practical experience).
• 3+ years of QA / software testing experience, ideally involving enterprise platform rollouts or vendor PoCs.
• Hands-on experience in testing AI/SaaS platform.
• Demonstrated experience writing test plans and test cases directly from functional and technical requirements.
• Working experience with defect/issue tracking tools (e.g., Jira) and Kanban-based ways of working.
• Strong analytical skills with high attention to detail and clear written documentation.
• Fluent English, written and spoken; comfortable working with cross-functional and multi-vendors teams.
• Test planning, execution, and requirements traceability.
• Defect management and root-cause coordination with vendors.
• Stakeholder communication across business, procurement, and technical teams.
• Structured, evidence-based reporting.
• Comfort operating with ambiguity in a fast-moving, PoC-stage environment.

Nice to have:

• Prior exposure to AI/ML systems, AI governance, or model-risk testing.
• Familiarity with recognized AI governance frameworks
• Experience in a regulated industry (e.g., pharmaceutical)
• Experience testing endpoint-deployed software across a large, distributed user base.
• Agile/Scrum or Kanban delivery experience within a small, cross-functional team.
• Comprehensive benefits - enjoy Udemy for Business, private medical care, Multisport card, veterinary package, language lessons, and shopping vouchers.
• Career growth - access opportunities for professional development and learning, including perks related to our official partnerships with global IT giants: Microsoft, AWS, Snowflake, Salesforce & more.
• Global collaboration - work with a diverse, international team.
• Innovative environment - be part of a forward-thinking and growth-oriented workplace.
• Engaging community – Work with passionate professionals and participate in team-building events, hackathons, and CSR initiatives to make an impact beyond work.
• Team-building events including our company tradition (annual company event in Mazury). A pleasant surprise to start your journey with us in the form of a welcome pack.