Senior AI QA Engineer - Model Validation & Governance

Envestnet; Raleigh (NC); Hybrid; USD 152,000 - 190,000; Full time

Benefits offered by this job

Medical insurance

PTO

401k match

Parental leave

Education reimbursement

Disability coverage

Mental health & wellness support

Job summary

Envestnet is seeking a Quality Assurance Engineer for AI-enabled products with a hybrid work model across multiple U.S. locations.

You will lead testing for AI features, validate model performance, and develop automation frameworks to ensure data integrity and governance across platforms. Collaborating with engineering, data science, product management, cybersecurity, legal, and risk teams, you will drive high standards for testing, quality, and risk mitigation while mentoring junior analysts

Qualifications

• Ability to evaluate complex problems, identify root causes, assess alternatives, and implement practical, scalable, data-driven solutions.
• Demonstrated ability to establish and maintain productive relationships across business, technology, product, engineering, data science, and risk organizations.
• Knowledge of process improvement techniques, operational workflows, dependency management, quality optimization, and governance practices.
• Ability to communicate technical and non-technical concepts clearly to diverse audiences, including leadership stakeholders.
• Experience coordinating cross-functional initiatives, managing dependencies, tracking progress, and delivering measurable outcomes.
• Strong understanding of AI concepts, machine learning fundamentals, AI system capabilities, limitations, risks, and practical applications, with experience validating AI/ML models, Generative AI applications, LLM-enabled systems, or data science solutions.
• Experience with automated testing frameworks, API testing, model evaluation, prompt testing, hallucination testing, data quality validation, AI governance controls, and regulatory, security, privacy, or responsible AI requirements.

Responsibilities

• Leads testing efforts for moderately complex AI products, features and platform enhancements.
• Designs advanced test plans covering model accuracy, bias detection, explainability and operational resilience.
• Develops automated testing frameworks and monitoring approaches for AI systems.
• Performs detailed analysis of defects, model drift and production quality issues.
• Partners with cross-functional stakeholders to define acceptance criteria and quality standards.
• Mentors junior analysts and reviews testing deliverables for quality and consistency.
• Supports implementation of enterprise AI governance and risk management controls.
• Recommends improvements to testing methodologies, tooling and operational processes.
• Facilitates quality reviews, stakeholder workshops, model validation discussions, and testing strategy sessions.
• Identifies operational, technical, compliance, and model-related risks and recommends mitigation strategies.
• Leads validation activities for AI models, data pipelines, automation workflows, user-facing AI capabilities, vendors, tools, and third-party technologies.
• Evaluates quality, reliability, security, governance, and compliance considerations associated with AI products and services.

Job description

Envestnet is seeking a Quality Assurance Engineer for AI-enabled products with a hybrid work model across multiple U.S. locations.

You will lead testing for AI features, validate model performance, and develop automation frameworks to ensure data integrity and governance across platforms. Collaborating with engineering, data science, product management, cybersecurity, legal, and risk teams, you will drive high standards for testing, quality, and risk mitigation while mentoring junior analysts