Product Validation Engineer II: AI Agent Quality Assurance (QA)

Cadence Design Systems; Belo Horizonte; Presencial; BRL 120 000 - 180 000; Tempo integral

Vantagens oferecidas por esta oferta de emprego

Competitive benefits

Resumo da oferta

Cadence Design Systems in Belo Horizonte, Brazil is seeking a Product Validation Engineer II for AI Agent Quality Assurance (QA). You will validate AI Agent workflows and customer scenarios, writing test plans and running validation cycles across prompts, tool usage, and retrieval quality.

The role requires a bachelor’s degree in CS/CE/EE and hands-on QA experience, with Python scripting and strong English/Portuguese communication. This position is full-time and based on site in Belo Horizonte.

Qualificações

• Hands-on experience writing test plans and test cases.
• Experience with validation cycles, defect reporting, and regression testing.
• Familiarity with AI/LLM concepts, AI agents, prompts, and RAG workflows.
• Proficient in Python or scripting for testing, data prep, logs, or reporting.

Responsabilidades

• Validate AI Agent products and customer workflows through structured test planning and execution.
• Test agent behavior across prompts, tool usage, retrieval quality, and latency.
• Document defects and support root-cause analysis and regression testing.
• Collaborate with product and engineering teams to improve release readiness.

Conhecimentos

Test plan execution

Automation testing

Python scripting

Communication in English & Portuguese

Formação académica

Bachelor's degree in CS/CE/EE

Descrição da oferta de emprego

## Product Validation Engineer II: AI Agent Quality Assurance (QA)Apply: BELO HORIZONTE: Full time: Posted Today: R56588## **At Cadence, we hire and develop leaders and innovators who want to make an impact on the world of technology.**Cadence Design Systems Inc. is looking for a motivated **Product Validation Engineer II: AI Agent Quality Assurance (QA)** to work with us in Belo Horizonte, Brazil.At Cadence, we hire and develop leaders and innovators who want to impact the world of technology. Cadence has been nominated as a Great Place to Work globally is also a Fortune 100 Best Companies to Work For.As a **Product Validation Engineer II: AI Agent Quality Assurance (QA)**, you will be part of the Hardware System Verification Software team in Belo Horizonte, Brazil. To understand more about what we do Click Here. Working at Cadence is very dynamic, fast-paced, and integrated with other teams all around the world.**Job Description:** * Validate AI Agent products and customer workflows through structured test planning and execution.* Test agent behavior across prompts, tool usage, retrieval quality, workflow execution, error handling, and response consistency.* Evaluate agent outputs using quality rubrics, benchmarks, regression checks, and metrics such as accuracy, relevance, safety, latency, and task success.* Create and expand testcase suites and evaluation datasets that reflect real customer scenarios, edge cases, and domain-specific workflows.* Document defects, analyze failures, support root-cause triage, and verify fixes through repeatable regression testing.* Collaborate with product and engineering teams to improve AI Agent quality, release readiness, and customer experience.**Requirements:** * Complete bachelor’s degree in Computer Science, Computer Engineering, Electrical Engineering, or equivalent experience.* 2+ years of experience in product validation, software QA, test engineering, software development, or engineering productivity tools.* Hands-on experience writing test plans and testcases, executing validation cycles, reporting defects, and verifying fixes.* Familiarity with AI/LLM concepts, AI agents, prompt behavior, RAG workflows, and common AI system failure modes.* Ability to evaluate AI Agent outputs using clear quality criteria and communicate findings to technical and product stakeholders.* Experience with Python, scripting, or automation for testing, data preparation, log analysis, or reporting.* Good spoken and written English and Portuguese with strong attention to detail and a collaborative mindset.**Nice to have**: * Experience validating AI agents, copilots, conversational products, or workflow automation tools.* Familiarity with AI evaluation frameworks, benchmarking, red-team testing, or metrics-driven product improvement.* Experience creating evaluation datasets, golden answers, customer workflow test suites, or regression packs.* Knowledge of vector databases, embeddings, retrieval evaluation, or agent orchestration frameworks.* Knowledge of EDA, VLSI design, design verification, emulation, Palladium, or Protium workflows. **Additional Job Details:** * Employment category: CLT* Employment term: 40 hours/week.* Competitive benefits.* Location: Av Contorno 5800, Belo Horizonte, Minas Gerais Brazil.