Remote AI Quality & Test Engineer — AWS/LLM Testing Lead

Simple Technology Solutions, LLC; United States; Remote; USD 130.000 - 180.000; Vollzeit

Benefits dieser Stelle

Health insurance

401(k) retirement plan

Unlimited PTO

Work from home stipend

Professional development budget

Zusammenfassung

Simple Technology Solutions, LLC is seeking an AI Quality & Test Engineer to own end-to-end testing across AI applications on AWS-native stacks. You will design test strategies, build and execute tests, and define acceptance criteria with business stakeholders.

Remote role with occasional travel to client sites and STS events. Applicants should have 8+ years in software quality engineering or test automation, strong Python/TypeScript skills, and experience in federal or regulated environments.

Qualifikationen

• Bachelor’s degree or equivalent professional experience.
• 8+ years of software quality engineering or test automation.
• Experience with AI/ML testing and end-to-end test suites.
• Experience leading user-acceptance testing in federal or regulated environments.
• Strong Python/TypeScript test automation skills and API testing.

Aufgaben

• Define AI test strategy across projects, including unit and end-to-end tests.
• Design and execute end-to-end and user-acceptance tests.
• Build evaluation harnesses for AI behavior and guardrails.
• Automate tests in CI/CD and manage quality gates between environments.
• Triage and track defects in Jira and drive resolutions with engineers.
• Test on AWS-native AI stacks when required by clients.
• Provide test standards and tooling improvements to the team.

Kenntnisse

Test automation

CI/CD

User acceptance testing

Federal/regulatory know-how

Communication

Ausbildung

Bachelor’s degree in Computer Science/Software Engineering or related field

Tools

Playwright

pytest/Jest

Jira

GitHub

Amazon Bedrock / AWS services

Jobbeschreibung

Simple Technology Solutions, LLC is seeking an AI Quality & Test Engineer to own end-to-end testing across AI applications on AWS-native stacks. You will design test strategies, build and execute tests, and define acceptance criteria with business stakeholders.

Remote role with occasional travel to client sites and STS events. Applicants should have 8+ years in software quality engineering or test automation, strong Python/TypeScript skills, and experience in federal or regulated environments.