Automated Test Engineer for AI & Cloud DevSecOps

Steampunk; Bloomington (IL); On-site; USD 90,000 - 130,000; Full time

Job summary

Steampunk is seeking an Automated Test Engineer in Bloomington, IL to join our DevSecOps practice, delivering QA across application, cloud, and data systems. You will design test plans, automate tests, and collaborate with product and engineering teams to ensure robust releases, including AI model verification and bias testing.

You will implement test automation frameworks, perform data validation, functional, performance, and accessibility testing, and help optimize CI/CD processes while

Qualifications

• Ability to obtain a U.S. government Security Clearance
• Bachelor's Degree in an IT field OR Bachelor's degree in a non-IT field and 2 years related IT experience
• 3 years of experience with Git SCM providers such as GitHub, GitLab, Bitbucket
• 3 years of programming or scripting languages
• 3 years of application DevSecOps experience in an Agile environment
• Experience utilizing docker containers and utilizing platforms such as Kubernetes
• 3 years of experience implementing test automation, using tools such as Selenium, Appium, Soap UI, RestAssured, Postman
• Experience integrating test automation including performance, security, and functional tests into CI/CD Pipelines
• Experience with performance and load testing
• Experience in one or more cloud computing environments (e.g. AWS, Azure, or GCP)
• Experience with LLM‑specific evaluation frameworks
• Familiarity with responsible AI and bias‑testing practices
• Local to the Washington, DC metro area

Responsibilities

• Understand the needs of stakeholders and convey to developers
• Meet with product design team to determine testing parameters
• Create test plans, create test cases, test procedures, defects, defect reports and final QA reports for products
• Manage test data architecture definition and requests
• Ability to perform the following types of testing and analysis: Data validation, Functional, Performance and load, Usability, Accessibility (508), AI model verification
• Establish automated testing tools and framework for test automation
• Provide validation testing of different system and data sets for cloud migrations
• Help to automate and improve development, testing, deployment, and release processes
• Validate AI-generated output for accuracy, relevance, consistency, and freedom from hallucination or bias
• Test dynamic UI rendering of variable-length, variable-structure AI-generated content, including truncation, overflow, and formatting edge cases
• Perform functional, regression, exploratory, and boundary/edge-case testing across the full application stack
• Test API endpoints directly to isolate whether defects originate from the model or from the UI layer
• Validate latency handling, loading states, timeouts, and error states tied to variable AI response times
• Conduct adversarial/red-team style testing to identify unexpected or malicious input handling gaps
• Perform regression testing following model updates, fine-tuning, or retraining to catch unintended behavior shifts
• Document, track, and prioritize defects in collaboration with engineering and data science teams
• Work with software developers and software engineers to ensure that development follows established processes and works as intended
• Document as-is state of the environment, perform a gap analysis, and produce artifacts that articulate options and recommendations
• Leverage virtualization and containerization to optimize testing software systems
• Work with teams to bring continuous improvement to DevSecOps processes and tools
• Present regular status updates and provide cross training to other DevOps team members
• Act as an individual contributor and mentor more junior team members

Job description

Steampunk is seeking an Automated Test Engineer in Bloomington, IL to join our DevSecOps practice, delivering QA across application, cloud, and data systems. You will design test plans, automate tests, and collaborate with product and engineering teams to ensure robust releases, including AI model verification and bias testing.

You will implement test automation frameworks, perform data validation, functional, performance, and accessibility testing, and help optimize CI/CD processes while