Senior QA Engineer - AI-Driven Desktop, Cross-Platform

Amazon Web Services (AWS); Seattle (WA); On-site; USD 133,300 - 180,300; Full time

Job summary

Amazon.com Services LLC in Seattle is seeking a Senior Quality Assurance Engineer to own end‑to‑end quality for Quick Desktop across macOS, Windows, iOS, Android and web. You will design scalable test automation frameworks, define quality metrics, and drive AI-powered evaluation for agent workflows, integrations, and desktop applications.

Collaborate with SDEs, SDETs, SDMs, and product teams to embed quality throughout the development lifecycle.

Qualifications

• 6+ years of quality assurance engineering experience.
• 4+ years delivering test frameworks, leading QA projects and initiatives.
• Knowledge of QA methodology and tools, with demonstrated experience in a QAE role.
• Experience in automation testing.
• Experience in manual testing.

Responsibilities

• Own end-to-end quality strategy — Define and drive the quality assurance approach for Quick Desktop, covering functional, integration, performance, and security testing across macOS and Windows platforms.
• Design and build test automation frameworks — Architect scalable, reusable automation infrastructure for desktop (Electron), API, and connector integration testing that enables rapid, confident releases.
• Drive AI/agent quality evaluation — Develop evaluation frameworks for LLM‑based agent workflows, including correctness, latency, hallucination detection, and reliability testing for scheduled agents, chat interactions, and tool execution pipelines.
• Establish quality metrics and reporting — Define and track comprehensive quality metrics (defect density, test coverage, escape rate, mean time to detect); create dashboards and reports that drive data‑informed decisions.
• Lead cross‑functional quality initiatives — Collaborate with engineering, product, and design teams to ensure testability is built into architecture from day one; influence design reviews with a quality‑first perspective.
• Connector and integration testing — Design test harnesses and contract tests for Slack, Outlook, Teams, and other third‑party connector integrations, including mock services and fault injection.
• Mentor and raise the bar — Establish testing best practices across the team; mentor QAEs and SDETs; conduct test plan reviews; foster a culture of quality ownership among all engineers.
• Anticipate future testing needs — Evaluate emerging tools and methodologies (AI‑driven testing, synthetic test generation, LLM‑as‑judge evaluation) and proactively build solutions to address upcoming challenges.]
• CoT_job_summary_short":"COMPANY NAME: Amazon.com Services LLC\nKEY POINTS: Quality strategy ownership, test automation framework design, cross‑platform testing"
• job_summary_short:
• contract_type
• location_type
• remote_scope
• perks
• stated_min
• stated_max
• stated_absolute
• salary_estimation_cot
• estimated_low
• estimated_medium
• estimated_high
• currency
• frequency
• bonus
• tax
• application_email
• job_end_date
• contact_person
• hiring_department_name
• CoT_job_summary_short
• job_summary_short
• input_language
• output_language
• perks
• RemoteScope
• LocationType
• CompanyName
• job_search_id
• job_title
• department
• visa
• seniority
• company_industry
• industry
• experience
• education
• tools
• location_region
• location_country
• location_city
• remote_policy
• remote_possible
• telework
• sponsorship
• country
• city
• county
• state
• zip
• address
• job_source
• job_board
• posted_date
• closing_date
• recruiter
• recruiter_email
• company_website
• job_url
• job_id
• job_type
• employment_type
• industry_sector
• required_languages
• benefits
• description_full
• short_description
• work_type
• remote_work
• about_company
• sdl
• travel
• visa_sponsorship
• language
• requirements
• responsibilities
• qualification_skills
• qualifications_tools
• qualifications_education
• Qualification_item
• Skill_item
• Company
• JobTitle
• JobID
• SalaryRange
• SalaryCurrency
• SalaryFrequency
• JobLocation
• JobRemote
• JobType
• Domain
• keywords
• ]} } } }]} 0]} 0]} } } 0]}]} 0]}]} 0]} 0]} 0]} 0]} 0]} 0]} 0]} 0]} 0]} 0]} 0]} 0]} 0]} 0]} 0]} 0]} 0]} 0]} 0]} 0]} 0]} 0]} 0]} 0]} 0]} 0]} 0]} 0]} 0]} 0]} 0]} 0]} 0]} 0]} 0]} 0]} 0]} 0]} 0]} 0]} 0]} 0]} 0]} 0]} 0]} 0]} 0]} 0]} 0]} 0]} 0]} 0]} 0]} 0]} 0]} 0]} 0]} 0]} 0]} 0]} 0]} 0]} 0]}
• output_language_date_time_indexed?
• Replace this with valid JSON object.
• salary_estimation_cot
• estimated_low
• estimated_medium
• estimated_high
• currency
• frequency
• bonus
• tax
• application_email
• job_end_date
• contact_person
• hiring_department_name
• CoT_job_summary_short
• job_summary_short
• input_language
• output_language
• perks
• RemoteScope
• LocationType
• CompanyName
• job_search_id
• job_title
• department
• visa
• seniority
• company_industry
• industry
• experience
• education
• tools
• location_region
• location_country
• location_city
• remote_policy
• remote_possible
• telework
• sponsorship
• country
• city
• county
• state
• zip
• address
• job_source
• job_board
• posted_date
• closing_date
• recruiter
• recruiter_email
• company_website
• job_url
• job_id
• job_type
• employment_type
• industry_sector
• required_languages
• benefits
• description_full
• short_description
• work_type
• remote_work
• about_company
• sdl
• travel
• visa_sponsorship
• language
• requirements
• responsibilities
• qualification_skills
• qualifications_tools
• qualifications_education
• Qualification_item
• Skill_item
• Company
• JobTitle
• JobID
• SalaryRange
• SalaryCurrency
• SalaryFrequency
• JobLocation
• JobRemote
• JobType
• Domain
• keywords

Skills

Quality assurance

Automation testing

Manual testing

Test frameworks

QA methodologies

Job description

Amazon.com Services LLC in Seattle is seeking a Senior Quality Assurance Engineer to own end‑to‑end quality for Quick Desktop across macOS, Windows, iOS, Android and web. You will design scalable test automation frameworks, define quality metrics, and drive AI-powered evaluation for agent workflows, integrations, and desktop applications.

Collaborate with SDEs, SDETs, SDMs, and product teams to embed quality throughout the development lifecycle.