QA Engineer – AI/LLM Testing & DevSecOps

Steampunk, Inc.; McLean (VA); On-site; USD 90,000 - 130,000; Full time

Job summary

Steampunk, Inc. is seeking a Manual Test Engineer to join our DevSecOps practice, delivering QA for applications, cloud, and data systems.

You'll work in an Agile environment, validate AI model outputs, and collaborate with engineering and data science teams to ensure quality across the stack. The role emphasizes data validation, performance testing, accessibility, and end-to-end testing of APIs and UI, with a focus on continuous improvement in DevSecOps processes.

Qualifications

• Bachelor’s degree in IT or related IT experience with a non-IT degree.
• 3 years of experience with Git providers such as GitHub, GitLab, Bitbucket.
• 3 years of application DevSecOps experience in an Agile environment.
• Experience with performance and load testing and cloud environments (AWS/Azure/GCP).
• Familiarity with responsible AI and bias-testing practices.

Responsibilities

• Understand stakeholder needs and convey to developers.
• Create test plans, test cases, and QA reports for products.
• Perform data validation, functional, performance, usability, and accessibility testing.
• Test AI model outputs and verify latency, timeouts, and error states.
• Conduct regression testing post model updates and document defects with teams.

Skills

Quality assurance practices

Agile/DevSecOps experience

Stakeholder communication

AI model verification

Ability to obtain U.S. government TS/s

Education

Bachelor’s Degree in IT

Tools

Git

Docker

Kubernetes

Job description

Steampunk, Inc. is seeking a Manual Test Engineer to join our DevSecOps practice, delivering QA for applications, cloud, and data systems.

You'll work in an Agile environment, validate AI model outputs, and collaborate with engineering and data science teams to ensure quality across the stack. The role emphasizes data validation, performance testing, accessibility, and end-to-end testing of APIs and UI, with a focus on continuous improvement in DevSecOps processes.