AI QA & DevSecOps Test Engineer

Steampunk; McLean (VA); On-site; USD 90,000 - 130,000; Full time

Job summary

Steampunk seeks a Manual Test Engineer to join our DevSecOps practice, delivering QA across applications, cloud, and data systems in an Agile setting.

You will develop test plans and cases, validate AI outputs, and perform functional, regression, and performance testing across the stack. Collaboration with engineering and data science teams is essential, with opportunities to mentor teammates and improve processes.

Qualifications

• Ability to obtain a U.S. government Security Clearance.
• Bachelor's Degree in an IT field OR Bachelor's in a non-IT field and 2 years related IT experience.
• 3 years of experience with Git SCM providers such as GitHub, GitLab, Bitbucket.
• 3 years of experience with one or more programming or scripting languages.
• 3 years of application DevSecOps experience in an Agile environment.
• Experience utilizing docker containers and utilizing platforms such as Kubernetes.
• Experience with performance and load testing.
• Experience in one or more cloud computing environments (e.g. AWS, Azure, or GCP).
• Experience with LLM-specific evaluation frameworks.
• Familiarity with responsible AI and bias-testing practices.

Responsibilities

• Understand stakeholder needs and convey to developers.
• Meet with product design team to determine testing parameters.
• Create test plans, test cases, procedures, defects, and QA reports.
• Manage test data architecture definition and requests.
• Perform data validation, functional, performance/load, usability, accessibility, and AI model verification tests.
• Validate AI-generated output for accuracy and bias-free results.
• Test dynamic UI rendering of AI content and edge cases.
• Conduct API testing to isolate model vs UI issues.
• Document defects and collaborate with engineering and data science teams.
• Mentor junior team members and drive DevSecOps process improvements.

Skills

GitHub/GitLab/Bitbucket

Scripting languages

DevSecOps experience

Cloud platforms

LLM eval frameworks

Responsible AI bias testing

Education

Bachelor's in IT

2+ years IT exp with non-IT degree

Tools

Docker

Kubernetes

Cloud tooling

Job description

Steampunk seeks a Manual Test Engineer to join our DevSecOps practice, delivering QA across applications, cloud, and data systems in an Agile setting.

You will develop test plans and cases, validate AI outputs, and perform functional, regression, and performance testing across the stack. Collaboration with engineering and data science teams is essential, with opportunities to mentor teammates and improve processes.