AI-Driven QA Agent & Reliability Engineer

Insight Global; Westlake (TX); Vor Ort; USD 110.000 - 170.000; Vollzeit

Zusammenfassung

Insight Global seeks a highly capable Full-Stack Agentic QA Engineer to transform ERP verification with AI-driven workflows. You will lead a QA Swarm testing UI, APIs, and financial processes, replacing manual tests with autonomous, self‑healing suites.

Build AI testing agents to explore, evaluate, and ensure 100% reliability in an autonomous environment. You will design, implement, and stress‑test verification pipelines, leveraging LLMs and modern tooling to guard production quality.

Qualifikationen

• Familiarity with LLMs and Agentic frameworks (OpenAI, Anthropic, LangChain/LangGraph).
• Strong hands‑on QA/SDET experience in UI test automation and API test automation.
• Hands on ability to build AI driven testing and verification workflows.
• Experience using Playwright for AI‑driven UI exploration.
• Proficiency with Python and SQL (Postgres or SQL Server).
• Knowledge of DSPy or other prompt‑optimization / evaluation frameworks.
• Background in red teaming, adversarial testing, or stress testing.
• Exposure to vector databases (pgvector, Qdrant) and RAG systems.
• Familiarity with data pipelines and orchestration tools (dbt, Airflow, Apache Hop).
• Experience with Docker, observability, or ML tooling (OpenTelemetry, Weights & Biases).
• Experience building AI Testing Agents i.e. Exploration Agents, Adversarial Agents.

Aufgaben

• Build and evolve an autonomous “QA Swarm” that tests the ERP UI, APIs, and financial workflows.
• Design AI agents that explore the product, find broken flows, and validate reconciliations.
• Replace brittle, manual tests with self‑healing, AI‑maintained test suites.
• Create Judge / Eval Agents to assess agent accuracy, hallucinations, and data safety.
• Reverse‑engineer legacy business logic and wrap it in modern, automated tests.
• Stress‑test systems using synthetic ERP data and adversarial scenarios.
• Act as the final gatekeeper of production reliability for agent‑driven features.

Kenntnisse

LLMs

Agentic frameworks

QA/SDET

Playwright

Python

SQL

Red teaming

Vector databases

Tools

OpenAI

Anthropic

LangChain/LangGraph

PostgreSQL/SQL Server

Docker

Airflow

dbt

OpenTelemetry

Weights & Biases

Jobbeschreibung

Insight Global seeks a highly capable Full-Stack Agentic QA Engineer to transform ERP verification with AI-driven workflows. You will lead a QA Swarm testing UI, APIs, and financial processes, replacing manual tests with autonomous, self‑healing suites.

Build AI testing agents to explore, evaluate, and ensure 100% reliability in an autonomous environment. You will design, implement, and stress‑test verification pipelines, leveraging LLMs and modern tooling to guard production quality.