Strong Junior QA Manual Engineer

NineTwoThree AI Studio; España; On-site; PHP 3,762,000 - 6,270,000; Full time

Benefits offered by this job

Annual paid vacation

Paid sick leave

Health Insurance allowance

Maternity/paternity leave

Accounting assistance

Hardware provided

Professional development reimbursement

Strong engineering culture

Job summary

NineTwoThree AI Studio is a remote-first product design, engineering, and marketing studio founded in 2012 and based in Boston. We build AI-powered web and mobile apps for Fortune 500 brands and fast-moving startups.

This QA role focuses on evaluating probabilistic AI outputs, designing test plans, performing manual and exploratory testing across web and mobile, inspecting API traffic with DevTools or Postman, and communicating findings clearly to technical and non-technical stakeholders.

Qualifications

• 1.5+ years in QA or software engineering.
• Strong understanding of QA process, methodology, and terminology (test plan, test cases, SDLC, regression).
• Experience with manual testing of web and mobile applications.
• Comfort working with REST API and browser DevTools to inspect what’s actually happening under the hood.
• Upper-Intermediate English (you’ll communicate with international clients daily).
• You ask 'why is this the right answer?' before accepting what the screen shows you.

Responsibilities

• Design test plans, scenarios, and checklists for AI-powered features where expected results are probabilistic.
• Perform manual functional, regression, and exploratory testing across web and mobile.

Skills

QA processes

REST API

Manual testing

Web & mobile testing

English communication

Tools

DevTools

Postman

Job description

Why Join Us?

If you're looking to work on cutting-edge AI products, solve challenging problems, and be part of a fast-moving, high-talent team, you'll love it here.

Why Join Us?

If you're looking to work on cutting-edge AI products, solve challenging problems, and be part of a fast-moving, high-talent team, you'll love it here.

Join NineTwoThree AI Studio, a remote-first product design, engineering, and marketing studio, founded in 2012 and based in Boston. We build AI-powered web and mobile apps for big brands and fast-moving startups — from Fortune 500 companies to MIT research labs.

You'll work with really smart people — the kind of teammates who challenge you, push you forward, and make you better. We move fast and focus on getting things done.

We've been growing 20% every year for the last 5 years, which means there's plenty of room for career growth and promotions. We run on clear processes and strong leadership — we move quickly, but we don't do chaos. We do high-quality work, and we do it right.

We focus on products with a positive impact: sports, health, logistics, nuclear, and AI. If you're into gambling, adult entertainment, or crypto — we're not your place.

About This Role

This is not a traditional QA role. Most of our products are powered by AI — meaning the system's output is intentionally non-deterministic. There's no single "right answer" to compare against. Your job is to figure out what "correct" looks like for a given business goal, build your own definition of it, and systematically verify whether the system gets there.

You'll be testing things like: does the AI response correctly synthesize data from multiple sources? Does it apply the right organisational rules? Does it stay within its intended boundaries or leak information it shouldn't?

We'll teach you the tools and techniques. What we can't teach is how you think — and that's what we're hiring for.

What This Role Is Not

• It's not pixel-perfect UI checking (though functional correctness is still your baseline)
• It's not pass/fail against a rigid spec
• It's not for someone who is "comfortable with ambiguity" in the sense of being okay with vague conclusions — you'll be expected to resolve ambiguity, not tolerate it

Mindset we're hiring for (this matters more than your CV):

• When requirements are vague, you don't get stuck — you form a hypothesis, define your own acceptance criteria, and test against it
• You understand that AI systems fail in specific, diagnosable ways: hallucination, retrieval gaps, prompt sensitivity, role/permission leakage
• You think in terms of outcomes and business goals, not just functional steps
• You're honest when something is untestable without more information — and you push to get that information

Requirements

• Review requirements and independently define what "correct output" looks like when none is explicitly stated
• Design test plans, scenarios, and checklists for AI-powered features where expected results are probabilistic
• Perform manual functional, regression, and exploratory testing across web and mobile
• Test AI outputs for hallucinations, incomplete retrieval, confidently wrong answers, and failure to apply business rules
• Inspect API requests and responses via DevTools or Postman to verify what data the system actually used — not just what it showed
• Document and report bugs with enough context that developers can reproduce and diagnose them
• Collaborate closely with developers, product managers, and AI engineers
• Present findings clearly to both technical and non-technical stakeholders

Must-have:

• 1.5+ years in QA or software engineering
• Strong understanding of QA process, methodology, and terminology (test plan, test cases, SDLC, regression)
• Experience with manual testing of web and mobile applications
• Comfort working with REST API and browser DevTools to inspect what's actually happening under the hood
• Upper-Intermediate English (you'll communicate with international clients daily)
• You ask "why is this the right answer?" before accepting what the screen shows you

Nice to have:

• Basic SQL or ability to query data directly to verify what the system pulled
• Familiarity with how LLMs, RAG pipelines, or AI chatbots work under the hood
• Experience testing products with role-based access control (RBAC)

Benefits

What We Offer

• Annual paid vacation: 20 days-off per year during the first 3 years, further increasing to 25 days in later years
• Paid sick leave, 10 national holidays and 2 company days-off
• Well-being budget
• Health Insurance allowance
• Maternity/paternity leave
• Accounting assistance
• Reimbursement of expenses for professional development courses/certifications (up to 100% in agreement with the Manager)
• Hardware upon business needs
• Strong positive engineering culture, a tightly-knit team of professionals with a good sense of humor

What's The Process

We value your time and ours and make the process fast and easy.

Our interview process takes the following steps: interview with the HR, technical interview with the QA Team Lead and QA Manual Engineer, Offer.

What Growth Looks Like Here

We're building out an AI QA function from the ground up. If you grow into this role, you'll be one of the people who defines how AI systems get tested at this company — building ground-truth datasets, designing evaluation rubrics, and eventually leading QA on full AI product lines.