AI-Native QA Engineer: Automated Testing for AI Systems

IDR, Inc.; Rosemont (CO); On-site; USD 120,000 - 160,000; Full time

Benefits offered by this job

Employee Stock Ownership Program

Full benefits

Job summary

IDR, Inc. is seeking an AI-Native Quality Engineer in Rosemont, Colorado, to design and own automated testing for AI-native systems across API, UI, and integration layers.

You will ensure quality in environments where AI agents assist in code and test generation, partnering with cross-functional teams to implement robust testing strategies. The role requires hands-on automation skills and experience with AI/LLM tech, OpenAI/Anthropic LangChain integrations, and cloud-based architectures.

Qualifications

• Experience designing and owning automated test coverage across API, UI, and integration layers in AI-native systems.
• Proven ability to develop, execute, and own automated testing frameworks for complex AI systems.
• Knowledge of data pipelines, ML concepts, and security/regulatory considerations for AI systems.

Responsibilities

• Design and own automated test coverage for API, UI, and integration layers in an AI-native delivery model.
• Ensure quality standards in environments where AI agents contribute to code and test generation at scale.
• Collaborate with cross-functional teams to implement testing strategies for AI and enterprise integrations.
• Operate hands-on automation tools and frameworks to safeguard AI system quality and performance.
• Act as a key quality safeguard in a fast-paced AI engineering environment.

Skills

AI testing

Automation testing

API testing

Tools

OpenAI API

Anthropic Claude

LangChain

Job description

IDR, Inc. is seeking an AI-Native Quality Engineer in Rosemont, Colorado, to design and own automated testing for AI-native systems across API, UI, and integration layers.

You will ensure quality in environments where AI agents assist in code and test generation, partnering with cross-functional teams to implement robust testing strategies. The role requires hands-on automation skills and experience with AI/LLM tech, OpenAI/Anthropic LangChain integrations, and cloud-based architectures.