Manager AI Quality, Security & Assurance

Westinghouse Electric Company; Cranberry Township (Butler County); Hybride; USD 130 000 - 163 000; Plein temps

Avantages offerts par ce poste

Comprehensive Medical benefits

Wellness Programs

401(k) with Company Match

Paid vacations and holidays

Flexible work arrangements

Educational Reimbursement

Global Recognition

Employee Referral Program

Résumé du poste

Westinghouse Electric Company is seeking a Manager of AI Quality, Security & Assurance to lead a team ensuring AI applications and GenAI systems are reliable, secure, and compliant with Westinghouse policies.

Role includes mapping testing to policy, defining readiness criteria, and coordinating with Corporate Cybersecurity to ensure secure, auditable evidence before release.

Qualifications

• 8+ years in software quality engineering, test automation, software assurance or application security.
• 2+ years hands-on testing/evaluating ML, GenAI or agent-based systems.
• 3+ years leading quality, testing or assurance teams, including hiring and growing teams.
• Skills include AI evaluation, LLM/RAG metrics, grounding analysis, agent evaluation, datasets, LLM-as-a-judge techniques.
• Testing and automation: CI/CD integration, functional/regression/performance testing.

Responsabilités

• Define AI quality and security assurance practices across the Data & AI portfolio.
• Lead risk-based testing and readiness reviews with Cybersecurity coordination.
• Coordinate test frameworks and practices integrated into CI/CD pipelines.
• Provide independent readiness recommendations before release and manage findings.
• Collaborate with IT Quality Assurance, Cybersecurity and business owners.

Connaissances

AI evaluation

Test automation

AI security

Risk-based assurance

Collaboration & influence

Terraform?

Formation

Bachelor's degree in computer science / Software Engineering / Data Science / Engineering

Outils

Azure DevOps

Python

Description du poste

Are you interested in being part of an innovative team that supports Westinghouse’s mission to provide clean energy solutions? At Westinghouse, we recognize that our employees are our most valuable asset and we seek to identify, attract and recruit the most qualified talent while recognizing and encouraging the value of diversity in the global workplace.

Early engagement and estimation: Engage from early stage planning so that we include assurance effort and acceptance criteria in estimates for new developments and commercial projects.

About The Role

As a Manager, AI Quality, Security & Assurance, you will lead a team. This team ensures AI applications, agent-based workflows, and Technology Bricks developed by Data & AI are reliable, secure, and meet Westinghouse policy and standards. The goal of this team is to ensure their usage is suitable for the nuclear industry. You will map testing to Westinghouse policy. It defines and applies the testing frameworks for AI quality, AI evaluation, and product security assurance practices used across the Data & AI portfolio. Additionally, it provides an independent readiness recommendation before release.

You will report to the Director, AI Security and work a hybrid/mobile role based in Cranberry, PA.

Key Responsibilities

The Assurance framework defines and maintains several components. These include risk-based classification by intended use, assurance plans, minimum evidence requirements, Definition of Done, readiness reviews, Technobrick integration into solutions, and exception management. The framework integrates into the common AI SDLC and applies Westinghouse AI policies and software quality requirements without redefining them.

AI evaluation involves establishing methods and datasets. We will use these to evaluate GenAI responses and agent behavior, including grounding, robustness, tool use, human oversight, and regression. We must establish acceptance thresholds and automation additionally. This is necessary after model, prompt, or data changes.

Test and test automation: Define the test strategy for AI applications and Technology Bricks and provide the test frameworks and practices integrated into CI/CD pipelines, which development teams apply in their work.

Product and AI security assurance: Coordinate application security assessments and lead risk-based red teaming of GenAI systems and agents, with Corporate Cybersecurity. Ensure findings are tracked until they are remediated or formally accepted.

Independent readiness recommendation: Review testing, evaluation and security evidence before release and issue a readiness recommendation. Escalate unresolved findings and residual risks to the applicable owner, who retains formal acceptance. Document reports pre turnover and integration of technology bricks into existing/legacy systems by WEC policy.

Collaboration with IT Quality Assurance: Act as the primary Data & AI counterpart to IT Quality Assurance, agreeing on shared testing services, environments, tools and standards to avoid duplication.

Early engagement and estimation: Engage from early stage planning so that we include assurance effort and acceptance criteria in estimates for new developments and commercial projects.

Quality metrics and continuous improvement: Report quality and readiness metrics across the portfolio and improve methods, automation and standards.

Team capacity and growth: Lead a small primary team in AI evaluation, test automation and security assurance, and scale it as demand grows through hiring, contractors and specialist third parties.

People leadership and development: Oversee goal setting, performance management, recognition and succession, and mentor team members through coaching, mentoring and upskilling in AI evaluation and AI security.

Qualifications

Bachelor's degree in computer science, Software Engineering, Data Science, Engineering or a related discipline required.

8+ years in software quality engineering, test automation, software assurance or application security; including 2+ years of hands‑on experience testing or evaluating ML, GenAI or agent‑based systems. 3+ years leading quality, testing or assurance teams, including hiring and growing teams.

Skills: AI evaluation: LLM and RAG evaluation methods and metrics, hallucination and grounding analysis, agent evaluation, evaluation datasets and LLM-as-a-judge techniques. Testing and automation: test strategy, functional, regression and performance testing, and test automation integrated into CI/CD (e.g., Azure DevOps, Python-based frameworks).

AI security: application security, secure SDLC and AI-specific threats such as prompt injection, data leakage and insecure tool use; experience with security scanning tools (e.g., AppScan) and red teaming.

Risk-based assurance: ability to define proportionate evidence requirements and to make and defend independent readiness recommendations. Traceability and evidence: documentation and audit-ready evidence practices; knowledge of software quality requirements in regulated environments.

AI risk frameworks: familiarity with frameworks such as the NIST AI Risk Management Framework is helpful

Collaboration and influence: ability to challenge development teams constructively and to work across Cybersecurity, AI Governance and business owners.

We are committed to transparency and equity in all of our people practices.

The base salary range for this position, which is dependent upon experience, qualifications and skills, is estimated to be $130,400 to $163,000 per year.

Why Westinghouse?

Benefits

Our benefits package is tailored to meet the diverse needs of our employees, while also promoting wellness and career growth. The following are representative of what we offer:

• Comprehensive Medical benefits which could include medical, dental, vision, prescription coverage and Health Savings Account (HSA) with employer contributions options
• Wellness Programs designed to support employees in maintaining their health and well-being including Employee Assistance Program providing support for our employees and their household members
• 401(k) with Company Match Contributions to support employees' retirement
• Paid Vacations and Company Holidays
• Opportunities for Flexible Work Arrangements to promote work-life balance
• Educational Reimbursement and Comprehensive Career Programs to help employees grow in their careers
• Global Recognition and Service Programs to celebrate employee accomplishments and service
• Employee Referral Program

Westinghouse Electric Company Is The Global Nuclear Energy Industry's First Choice For Safe, Clean, And Efficient Energy Solutions. We Enable Our Delivery Of This Vision By Living Our Value System

• Safety and Quality
• Integrity and Trust
• Customer Focus and Innovation
• Speed and Passion to Win
• Teamwork and Accountability

While our Global Headquarters are located in Cranberry Township, PA, we have over 11,000 employees working at locations in 19 different countries. You can learn more by visiting http://www.westinghousenuclear.com .

Westinghouse is an Equal Opportunity Employer including Veterans and Individuals with Disabilities

Get connected with Westinghouse on social media:

Twitter | Facebook | LinkedIn | YouTube