Manager AI Quality, Security & Assurance

Westinghouse Electric Company; Cranberry Township (Butler County); Hybrid; USD 130,000 - 163,000; Full time

Benefits offered by this job

Medical benefits including Health, Rx,

401(k) with company match

Paid vacations & holidays

Flexible work arrangements

Educational reimbursement

Job summary

Westinghouse Electric Company in Cranberry Township, PA, seeks a Manager of AI Quality, Security & Assurance to lead a team ensuring AI applications and Technology Bricks are reliable, secure and compliant with Westinghouse policy. You will map testing to policy and provide independent readiness recommendations before releases.

You will report to the Director, AI Security, and work a hybrid/mobile role in Cranberry, PA.

Qualifications

• 8+ years in software quality engineering and test automation.
• 2+ years testing or evaluating ML, GenAI or agent-based systems.
• 3+ years leading quality, testing or assurance teams.
• Knowledge of AI evaluation methods and datasets.
• Experience with security threats in AI and secure SDLC.

Responsibilities

• Define AI quality testing strategy and CI/CD integration.
• Lead risk-based red teaming of GenAI systems and agents.
• Coordinate application security assessments with Cybersecurity.
• Review testing, evaluation and security evidence before release and issue readiness recommendations.
• Collaborate with IT Quality Assurance to align testing services and standards.

Skills

AI evaluation

GenAI testing

RAG evaluation

LLM as judge

Test automation

CI/CD

Azure DevOps

Python testing

AI security

Secure SDLC

Red teaming

Software quality

Education

Bachelor's degree in CS/Engineering/Data Science

Tools

AppScan

CI/CD tooling

Job description

Are you interested in being part of an innovative team that supports Westinghouse's mission to provide clean energy solutions? At Westinghouse, we recognize that our employees are our most valuable asset and we seek to identify, attract and recruit the most qualified talent while recognizing and encouraging the value of diversity in the global workplace.

Early engagement and estimation: Engage from early stage planning so that we include assurance effort and acceptance criteria in estimates for new developments and commercial projects.

About the role:

As a Manager, AI Quality, Security & Assurance, you will lead a team. This team ensures AI applications, agent-based workflows, and Technology Bricks developed by Data & AI are reliable, secure, and meet Westinghouse policy and standards. The goal of this team is to ensure their usage is suitable for the nuclear industry. You will map testing to Westinghouse policy. It defines and applies the testing frameworks for AI quality, AI evaluation, and product security assurance practices used across the Data & AI portfolio. Additionally, it provides an independent readiness recommendation before release.

You will report to the Director, AI Security and work a hybrid/mobile role based in Cranberry, PA.

Key Responsibilities:

The Assurance framework defines and maintains several components. These include risk-based classification by intended use, assurance plans, minimum evidence requirements, Definition of Done, readiness reviews, Technobrick integration into solutions, and exception management. The framework integrates into the common AI SDLC and applies Westinghouse AI policies and software quality requirements without redefining them.

AI evaluation involves establishing methods and datasets. We will use these to evaluate GenAI responses and agent behavior, including grounding, robustness, tool use, human oversight, and regression. We must establish acceptance thresholds and automation additionally. This is necessary after model, prompt, or data changes.

Test and test automation: Define the test strategy for AI applications and Technology Bricks and provide the test frameworks and practices integrated into CI/CD pipelines, which development teams apply in their work.

Product and AI security assurance: Coordinate application security assessments and lead risk-based red teaming of GenAI systems and agents, with Corporate Cybersecurity. Ensure findings are tracked until they are remediated or formally accepted.

Independent readiness recommendation: Review testing, evaluation and security evidence before release and issue a readiness recommendation. Escalate unresolved findings and residual risks to the applicable owner, who retains formal acceptance. Document reports pre turnover and integration of technology bricks into existing/legacy systems by WEC policy.

Collaboration with IT Quality Assurance: Act as the primary Data & AI counterpart to IT Quality Assurance, agreeing on shared testing services, environments, tools and standards to avoid duplication.

Early engagement and estimation: Engage from early stage planning so that we include assurance effort and acceptance criteria in estimates for new developments and commercial projects.

Quality metrics and continuous improvement: Report quality and readiness metrics across the portfolio and improve methods, automation and standards.

Team capacity and growth: Lead a small primary team in AI evaluation, test automation and security assurance, and scale it as demand grows through hiring, contractors and specialist third parties.

People leadership and development: Oversee goal setting, performance management, recognition and succession, and mentor team members through coaching, mentoring and upskilling in AI evaluation and AI security.

Qualifications:

Bachelor's degree in computer science, Software Engineering, Data Science, Engineering or a related discipline required.

8+ years in software quality engineering, test automation, software assurance or application security; including 2+ years of hands‑on experience testing or evaluating ML, GenAI or agent-based systems. 3+ years leading quality, testing or assurance teams, including hiring and growing teams.

Skills: AI evaluation:LLM and RAG evaluation methods and metrics, hallucination and grounding analysis, agent evaluation, evaluation datasets and LLM-as-a-judge techniques. Testing and automation: test strategy, functional, regression and performance testing, and test automation integrated into CI/CD (e.g., Azure DevOps, Python-based frameworks).

AI security: application security, secure SDLC and AI-specific threats such as prompt injection, data leakage and insecure tool use; experience with security scanning tools (e.g., AppScan) and red teaming.

Risk-based assurance: ability to define proportionate evidence requirements and to make and defend independent readiness recommendations. Traceability and evidence: documentation and audit-ready evidence practices; knowledge of software quality requirements in regulated environments.

AI risk frameworks: familiarity with frameworks such as the NIST AI Risk Management Framework is helpful.

Collaboration and influence: ability to challenge development teams constructively and to work across Cybersecurity, AI Governance and business owners.

We are committed to transparency and equity in all of our people practices.

We are committed to transparency and equity in all of our people practices. The base salary range for this position, which is dependent upon experience, qualifications and skills, is estimated to be $130,400 to $163,000 per year.

#LI-Hybrid

Why Westinghouse?

• Comprehensive Medical benefits which could include medical, dental, vision, prescription coverage and Health Savings Account (HSA) with employer contributions options

• Wellness Programs designed to support employees in maintaining their health and well-being including Employee Assistance Program providing support for our employees and their household members

• 401(k) with Company Match Contributions to support employees' retirement

• Paid Vacations and Company Holidays

• Opportunities for Flexible Work Arrangements to promote work-life balance

• Educational Reimbursement and Comprehensive Career Programs to help employees grow in their careers

• Global Recognition and Service Programs to celebrate employee accomplishments and service

• Employee Referral Program

• Safety and Quality

• Integrity and Trust

• Customer Focus and Innovation

• Speed and Passion to Win

• Teamwork and Accountability

Westinghouse is an Equal Opportunity Employer including Veterans and Individuals with Disabilities

Get connected with Westinghouse on social media: Twitter | Facebook | LinkedIn| YouTube

While our Global Headquarters are located in Cranberry Township, PA, we have over 11,000 employees working at locations in 19 different countries. You can learn more by visiting http://www.westinghousenuclear.com.