Quality Engineer (AI Assistant, On-Device Applications)

career; Pottersville (NY); Remote; USD 90,000 - 120,000; Full time

Job summary

A leading company in AI technology is seeking a Quality Engineer to enhance their product's reliability and user readiness. You will define quality standards, implement automated testing, and collaborate with teams to drive a quality-first mindset. Ideal candidates possess strong analytical skills and experience in software testing, especially in AI applications.

Qualifications

• 3+ years of experience in QA or Quality Engineering.
• Hands-on experience with automated testing tools.
• Strong understanding of overall software testing principles.

Responsibilities

• Own the test strategy and quality process across the IrisGo product stack.
• Design and implement automated tests for LLM workflows.
• Collaborate with product and engineering teams to define acceptance criteria.

Skills

Automated testing

Software testing principles

Analytical skills

Communication skills

CI/CD systems

Scripting skills

Collaboration

Job description

Who we are:

AI workflow is broken. Digital work is buried under copy-paste routines, fragmented tools, and repetitive tasks that drain our time and focus.

We're building IrisGo — your AI butler for the AI PC era. It understands how you work, observes your context, and automates what you shouldn’t have to do. We’re a small team of engineers and builders driven to solve hard problems — from browser automation to computer use, from local LLMs to full workflow orchestration. We believe the future of productivity is ambient, intuitive, and immersive. Our goal: reclaim your time and focus, one automated task at a time.

Based in California and Taipei, we bring deep roots in full-stack engineering, machine learning, and product design. If you want to build the future of human-computer interaction, we’re hiring.

About the Role

We’re looking for a Quality Engineer to ensure our on-device AI assistant is robust, reliable, and user-ready. In this role, you will define and implement quality standards, build testing pipelines, and ensure seamless performance across a wide range of edge devices and AI use cases. You’ll work closely with product and engineering to test new features, catch regressions, and improve overall product stability and user trust.

If you’re passionate about shipping polished software, building automated test systems, and working with bleeding-edge GenAI technologies—this is the role for you.

What You’ll Do:

• Own the test strategy and quality process across the IrisGo product stack (UI, backend, on-device AI pipeline).
• Design and implement automated tests for LLM workflows, agent behaviors, and file system interactions.
• Set up and maintain CI pipelines and test environments for multiple device configurations (e.g., Mac, Windows AI PCs).
• Perform exploratory, regression, and stress testing to validate AI-driven workflows and real-world usage.
• Collaborate with product and engineering teams to define acceptance criteria and catch edge cases early.
• Develop tools or scripts to monitor product performance and reliability in production-like scenarios.
• Reproduce and isolate bugs reported by users or QA channels, and document findings clearly for engineering resolution.
• Help drive a quality-first mindset across the organization with clear QA guidelines and automation practices.

What You Must Bring:

• 3+ years of experience in QA or Quality Engineering, ideally in fast-paced product environments.
• Hands-on experience with automated testing tools and frameworks.
• Strong understanding of software testing principles: functional, regression, integration, load, and UI testing.
• Familiarity with CI/CD systems (e.g. GitHub Actions, Jenkins) and writing test cases into pipelines.
• Solid scripting skills (Python, Bash, or JavaScript) for writing test automation and debugging tools.
• Excellent analytical and communication skills; able to collaborate closely with engineers and product managers.
• Passion for high-quality user experiences and building tools that "just work."

Bonus Points:

• Experience testing AI-powered applications, LLM pipelines, or agent-based systems.
• Understanding of version control, Git workflows, and issue tracking tools (e.g. Linear, Jira).
• Exposure to cross-platform testing (macOS, Windows, Linux) or embedded/on-device environments.
• Prior experience in early-stage startup teams or shipping consumer-facing software.

#LI-DNI

#LI-Remote