Agentic QA Lead — TRACE AI Testing

Trane Technologies; La Crosse (WI); On-site; USD 97,407 - 135,835; Full time

Benefits offered by this job

Health insurance

401K match

Paid time off

Tuition assistance

Job summary

Trane Technologies in Wisconsin is seeking an Agentic Software Test Engineer to lead a team of AI testing agents for TRACE, the HVAC energy simulation platform. You will work with .NET, Blazor, PostgreSQL, and EnergyPlus, driving QA across multiple repos and coordinating with software developers on quality and release readiness.

You will guide agent personas, design prompts, and oversight of regression, exploration, and accessibility testing while staying hands-on with production code in C#,

Qualifications

• 5+ years in software quality assurance with shipping experience.
• 1+ year with LLM-based agents or multi-agent systems in production.
• Experience designing test plans, defect lifecycle, and release gating.
• Hands-on with AI coding agents and APIs (Claude/Copilot/OpenAI).
• Knowledge of prompt engineering, JSON schema, and multi-agent orchestration.
• Ability to read/modify production code in C#, Python, or JavaScript.

Responsibilities

• Direct agentic testing team and define agent personas and QA checkpoints.
• Author prompts, context contracts, and knowledge bases for test plans.
• Build evaluation harnesses for agent output quality and regression checks.
• Curate agent outputs and ship into the engineering pipeline with your stamp.
• Hunt bugs through various testing methods and verify findings with devs.
• Own TRACE's quality posture as SME on HVAC sim correctness and ASHRAE reporting.
• Collaborate with Developers and Product Owners on test coverage decisions.
• Run regression, functional, and data tests across .NET backend, Blazor frontend, PostgreSQL, EnergyPlus.

Skills

5+ years QA experience

LLM-based agents

AI tooling

Prompt engineering

C#, Python, JavaScript

GitHub Actions

Jira

Playwright

xUnit/NUnit

Education

Bachelor's Degree in Engineering/CS

Tools

Claude Code

Cursor

Copilot Workspace

Anthropic/OpenAI APIs

Blazor/.NET 10.0

PostgreSQL EF Core

Job description

Trane Technologies in Wisconsin is seeking an Agentic Software Test Engineer to lead a team of AI testing agents for TRACE, the HVAC energy simulation platform. You will work with .NET, Blazor, PostgreSQL, and EnergyPlus, driving QA across multiple repos and coordinating with software developers on quality and release readiness.

You will guide agent personas, design prompts, and oversight of regression, exploration, and accessibility testing while staying hands-on with production code in C#,