Lead AI QA Engineer: Validation & Automation

Envestnet; Berwyn (PA); Hybrid; USD 152,000 - 190,000; Full time

Job summary

Envestnet’s Quality Assurance Engineering team is hiring to validate AI-enabled products and platforms. You will combine traditional QA with AI/ML validation to ensure data integrity, model performance, and secure, compliant operations.

Join a cross-functional team that collaborates with engineering, data science, product, cybersecurity, and risk to deliver scalable, trustworthy AI solutions.

Qualifications

• Experience with automated testing frameworks, API testing, model evaluation, prompt testing, hallucination testing, data quality validation, AI governance controls, and regulatory, security, privacy, or responsible AI requirements.

Responsibilities

• Leads testing efforts for moderately complex AI products, features and platform enhancements.
• Designs advanced test plans covering model accuracy, bias detection, explainability and operational resilience.
• Develops automated testing frameworks and monitoring approaches for AI systems.
• Performs detailed analysis of defects, model drift and production quality issues.
• Partners with cross-functional stakeholders to define acceptance criteria and quality standards.
• Mentors junior analysts and reviews testing deliverables for quality and consistency.
• Supports implementation of enterprise AI governance and risk management controls.
• Recommends improvements to testing methodologies, tooling and operational processes.
• Facilitates quality reviews, stakeholder workshops, model validation discussions, and testing strategy sessions.
• Identifies operational, technical, compliance, and model-related risks and recommends mitigation strategies.
• Leads validation activities for AI models, data pipelines, automation workflows, user-facing AI capabilities, vendors, tools, and third-party technologies.
• Evaluates quality, reliability, security, governance, and compliance considerations associated with AI products and services.

Skills

AI testing

Model validation

Automated testing

Cross-functional collaboration

QA governance

Job description

Envestnet’s Quality Assurance Engineering team is hiring to validate AI-enabled products and platforms. You will combine traditional QA with AI/ML validation to ensure data integrity, model performance, and secure, compliant operations.

Join a cross-functional team that collaborates with engineering, data science, product, cybersecurity, and risk to deliver scalable, trustworthy AI solutions.