QA Engineer

Hatz AI, Inc.; New York (NY); On-site; USD 140,000 - 190,000; Full time

Benefits offered by this job

Health insurance

Dental insurance

Vision insurance

401(k) with match

Equity

Job summary

Hatz AI, Inc. in New York City (Flatiron District) is seeking a QA Engineer to own product quality strategy, end-to-end testing, and AI-assisted frameworks for an AI-native MSP platform.

You’ll collaborate with engineering to review integration tests, optimize coverage, and build scalable testing rules and tools. This role emphasizes independent judgment, strong communication, and a customer-focused mindset in a fast-paced, change-driven environment.

Qualifications

• Experience owning quality strategy and risk-based test prioritization, not just executing a test plan.
• Proven ownership of end-to-end test suites and the judgment to evolve frameworks.
• Deep fluency to identify critical customer workflows and where risk lives.
• Comfort reviewing integration tests and collaborating with engineers.
• Fluency using AI tools to scale testing across the team.
• Experience with test automation frameworks (Playwright/Cypress/Selenium).
• Experience testing RESTful APIs and SQL for data integrity.
• Version control with Git.
• Excellent communication and ability to work independently in a fast-paced environment.

Responsibilities

• Own product quality strategy based on critical customer workflows.
• Be responsible for end-to-end testing and evolve your own frameworks and tooling.
• Build AI-assisted rules and frameworks to scale testing across the team.
• Review and test integration tests written by engineers; own the coverage.
• File clear bug reports and contribute fixes, with AI-assisted coding for core tasks.
• Define and track quality metrics (coverage, defect escape, regression).
• Build and run evals for AI features with datasets and rubrics.
• Communicate quality tradeoffs clearly to teams and customers.

Skills

Quality strategy

End-to-end testing

AI-assisted testing

Playwright

Cypress

Selenium

REST APIs

SQL

Git

Communication

Independent work

Tools

Playwright

Cypress

Selenium

Job description

New York City Metropolitan Area Full-Time

Position Overview

We're looking for a QA Engineer who operates less like a gatekeeper and more like the most demanding customer on the engineering team. Based in New York City's vibrant Flatiron District, Hatz AI is building the AI-native platform for Managed Service Providers (MSPs) and the small businesses they serve. Because you sit closest to the customer and understand our critical workflows better than anyone on the team, you'll own product quality strategy outright - deciding where risk-based coverage matters most, and owning end-to-end testing with full autonomy over the frameworks and tools you use to get there.

This isn't a role for someone who just executes a test plan handed to them. Critical workflow coverage is your version of code coverage - it's the metric you're accountable for, and you decide how to hit it. You'll partner closely with engineering: reviewing and getting hands-on with the integration tests they own, helping testability get considered before code is written, and using AI to build the rules, skills, and frameworks that scale your judgment across the team rather than routing everything through you.

How We Work

We ship. We'd rather see a working feature that isn't perfectly polished than a release that's stalled chasing edge cases nobody will hit. Bias toward end-to-end coverage - test the flows customers actually use before the ones that are easy to test.

AI-native by default. We expect you to use AI as a force multiplier - not just to generate test cases faster, but to build reusable rules, skills, and frameworks that bake your quality judgment into the team's workflow, so testability gets considered without you needing to be in every conversation. That means reviewing what the model produces, catching its blind spots, and owning the result rather than blindly trusting it.

Resilient under change. Features change fast, schemas migrate live, and APIs shift under you. We value QA engineers who write tests that survive change, isolate root cause quickly, and adapt coverage instead of letting the suite rot.

Customer-fluent. You can explain why something broke (or why it matters) without hiding behind jargon, and you keep the real user experience in mind - not just whether a test passed.

Key Responsibilities

This is the non-negotiable core of the role - what we're hiring for first.

• Own product quality strategy: help decide, based on critical customer workflows, where risk-based test coverage matters most.
• Be responsible for end-to-end testing, with discretion to choose and evolve your own test frameworks and tooling. Critical workflow coverage is your version of code coverage.
• Build AI-assisted rules, skills, and frameworks that let testing judgment scale across the team without requiring manual testing input on every ticket.
• Review and get hands-on with the integration tests engineers write. Unit and component-level testing stays owned by engineering; you're encouraged to get involved wherever it strengthens coverage.
• File clear, reproducible bug reports, and grow into contributing fixes directly - AI-assisted coding makes this realistic once you're covering the core of the role.
• Define and track the quality metrics (critical workflow coverage, defect escape rate, regression trends) that tell us whether the strategy is working.
• Build and run evals for our AI features - golden datasets, regression suites, and scoring rubrics that catch hallucinations, accuracy drift, and prompt or model regressions before they reach customers.
• Communicate clearly with teammates and customers, translating quality tradeoffs and technical issues into plain language.

How This Role Grows

• Performance and load testing.
• Exploratory testing.
• A/B test design and analysis.
• Beta and MSP customer programs.
• Contributing bug fixes directly, not just filing them.

Required Skills and Qualifications

• Experience owning quality strategy and risk-based test prioritization, not just executing a test plan someone else scoped for you.
• Proven ownership of end-to-end test suites, including the judgment to choose and evolve your own frameworks and tooling. (We care more about the coverage decisions you've made than years alone.)
• Deep enough product fluency to independently identify critical customer workflows and where risk actually lives.
• Comfort reviewing and getting hands-on with integration-level tests that engineers write.
• Fluency using AI tools in your daily workflow—including building reusable rules, skills, or frameworks that scale your judgment across the team.
• Experience with test automation frameworks (e.g., Playwright, Cypress, or Selenium).
• Experience testing RESTful APIs and asynchronous workflows; comfort writing and reading SQL to verify data integrity.
• Experience with version control systems, particularly Git.
• Excellent communication - this is a highly visible role that represents the customer inside engineering.
• Ability to work independently and as part of a team in a fast-paced, changing environment.

Good to Have Skills

• Experience evaluating LLM or generative AI outputs - building eval datasets, scoring rubrics, or regression harnesses to catch hallucinations and accuracy drift.
• Familiarity with eval tooling (e.g., Braintrust, LangSmith) or experience building an in-house eval harness.
• Experience with performance and load testing.
• Exploratory testing experience.
• A/B testing experience.
• Experience with beta programs or MSP/channel customer programs.
• Understanding of CI/CD pipelines and how automated tests fit into deployment gates.
• Knowledge of PostgreSQL/SQL and Row Level Security.
• Experience validating zero-downtime schema migrations on live systems.

Competitive salary and equity

• Comprehensive health, dental, and vision insurance; life and disability insurance, and 401(k) with match; equity.
• Opportunities for professional development and career growth.
• A collaborative and inclusive work environment.

Hatz AI is building the AI-native platform purpose-built for Managed Service Providers and the small businesses they serve - making sophisticated AI capabilities accessible, reliable, and practical at the business level. We're a focused team with deep conviction that AI isn't a feature to bolt on, but a foundation to build from. We're early, ambitious, and moving fast - and we're looking for the people who want to help define what comes next.

Equal Opportunity Statement

Hatz AI is proud to be an equal opportunity employer. We are committed to building a diverse, inclusive team and welcome applicants of all backgrounds, identities, and experiences. We do not discriminate on the basis of race, color, religion, sex, sexual orientation, gender identity or expression, national origin, age, disability, veteran status, or any other characteristic protected by applicable law. We believe that diverse perspectives make for better products and a stronger company - and we're actively working to build a team that reflects that belief.