Principal Quality Assurance Engineer – Generative AI & LLM Platforms

Hewlett Packard Enterprise Development LP; San Juan (PR); Hybrid; USD 130,000 - 190,000; Full time

Benefits offered by this job

Health & Wellbeing benefits

Career Development Programs

Inclusive culture and flexibility

Employee connectivity programs

Job summary

Hewlett Packard Enterprise Development LP seeks a Principal Quality Assurance Engineer to own quality strategy for Generative AI, large language models, and distributed systems. You will design automated frameworks, validate UI/API, and drive testability across our enterprise platforms.

The role blends AI evaluation expertise with software testing fundamentals, mentoring teammates, and shaping secure, high-performance software delivery. Hybrid work with office days is required.

Qualifications

• Bachelor's or Master's in Computer Science, ML, or related field.
• 12+ years experience with at least 3 years in a lead role.
• Proven track record in quality engineering and automation.

Responsibilities

• Define risk-based test strategies and quality gates across AI, UI, API, cloud, and network layers.
• Evaluate model quality, safety, grounding, latency, and cost.
• Validate React interfaces, accessibility, security, and APIs.
• Test AWS deployments, distributed systems, traffic behavior, failover, and disaster recovery.
• Build reusable Python/pytest frameworks and perform CI/CD integrated testing.
• Use telemetry and incidents to detect regressions and improve coverage.
• Mentor engineers and promote shared ownership of quality.

Skills

Quality Engineering

Automation: Python

UI Testing

API Testing

Web Testing: React

GenAI Evaluation

Networking

Performance Testing

AI Observability

AWS & Monitoring

Leadership

Education

Bachelor's or Master's in Computer Science / ML

Tools

pytest

JMeter

Postman

LangSmith

Job description

Principal Quality Assurance Engineer – Generative AI & LLM Platforms

This role has been designed as 'Hybrid' with a requirement that you will work on average 2 days per week from an HPE office.

Who We Are:

Hewlett Packard Enterprise is the global edge-to-cloud company advancing the way people live and work. We help companies connect, protect, analyze, and act on their data and applications wherever they live, from edge to cloud, so they can turn insights into outcomes at the speed required to thrive in today’s complex world.

Our culture thrives on finding new and better ways to accelerate what’s next.

We know varied backgrounds are valued and succeed here.

We have the flexibility to manage our work and personal needs.

We make bold moves, together, and are a force for good.

If you are looking to stretch and grow your career our culture will embrace you. Open up opportunities with HPE.

Job Description:

Job Family Definition:

Designs, develops, troubleshoots and debugs software programs for software enhancements and new products. Develops software including operating systems, compilers, routers, networks, utilities, databases and Internet-related tools. Determines hardware compatibility and/or influences hardware design.

Management Level Definition:

Contributions have visible technical impact on a product or major subcomponent. Applies in-depth professional knowledge and innovative ideas to solve complex problems. Visible contributions improve time-to-market, achieve cost reductions, or satisfy current and future unmet customer needs. Recognized internal authority on key technology area applying innovative principles and ideas. Provides technical leadership for significant project/program work. Leads or participates in cross-functional initiatives and contributes to mentorship and knowledge sharing across the organization.

Role Overview:

We are seeking a Senior Quality Engineer to own quality strategy and hands-on validation for enterprise products built with Generative AI, large language models, distributed systems, and modern React-based user interfaces. This role combines strong software testing fundamentals with AI evaluation expertise. The successful candidate will design automated quality frameworks, test deterministic and probabilistic behaviour, uncover complex cross-layer defects, influence architecture for testability, and help engineering teams deliver secure, reliable, accessible, high-performance products at speed.

Responsibilities:

• Define risk-based test strategies, quality gates, release criteria, traceability, and measurable objectives across AI, UI, API, cloud, and network layers.
• Evaluate model quality, groundedness, safety, privacy, robustness, tool use, permissions, failure recovery, latency, and cost.
• Validate React interfaces, web standards, accessibility, security, APIs, asynchronous workflows, and enterprise integrations.
• Test AWS deployments, distributed systems, traffic behavior, scaling, failover, disaster recovery, and adverse network conditions.
• Build reusable Python and pytest frameworks and execute performance, scale, reliability, and end-to-end testing with CI/CD integration.
• Use telemetry, incidents, and user feedback to detect regressions, strengthen coverage, and improve preventive controls.
• Partner across disciplines, use AI-assisted testing responsibly, mentor engineers, and promote shared ownership of quality.

Education and Experience Required:

• Bachelor's or Master's degree in Computer Science, Machine Learning, Artificial Intelligence, or a related discipline.
• 12+ years’ experience with at least 3 years of experience in a lead role.

Knowledge and Skills:

• Quality Engineering: Enterprise test strategy, automation, quality governance
• Automation: Python, pytest, UI/API testing, mocking, diagnostics, CI/CD
• Web Testing: React, responsive design, accessibility, cross-browser, web security
• API testing: JMeter, SoapUI, Postman
• GenAI Evaluation: LLM testing, groundedness, hallucination, safety, regression, metrics, human review, LangSmith, LangGraph, Langfuse, MCP
• Networking & Protocols: IP clos fabric, EVPN, VXLAN, BGP, MPLS, NETCONF, RESTCONF, gRPC, SNMP, LLDP, traffic simulators such as Ixia, Spirent etc…
• Performance Engineering: Performance, scale, functional, integration, E2E, regression, security, accessibility, reliability, compatibility
• Problem-Solving: Architecture analysis, cross-layer debugging, risk assessment, root-cause communication
• AI quality and observability: Experience with agent evaluation, prompt regression, model comparison, tracing, and production monitoring.
• Performance and resilience: Proficiency in API and browser performance testing, cloud-scale resilience, and chaos testing.
• Security and complex platforms: Knowledge of OWASP risks, threat modelling, adversarial validation, and testing multi-tenant or distributed enterprise architectures.
• AWS and monitoring: Familiarity with AI services, container platforms, and observability tools such as Datadog.
• Credentials and leadership: Relevant networking certifications and demonstrated leadership across automation, cloud quality, performance, security, or responsible AI.

What We Can Offer You:

Health & Wellbeing

We strive to provide our team members and their loved ones with a comprehensive suite of benefits that supports their physical, financial and emotional wellbeing.

Personal & Professional Development

We also invest in your career because the better you are, the better we all are. We have specific programs catered to helping you reach any career goals you have — whether you want to become a knowledge expert in your field or apply your skills to another division.

Unconditional Inclusion

We are unconditionally inclusive in the way we work and celebrate individual uniqueness. We know varied backgrounds are valued and succeed here. We have the flexibility to manage our work and personal needs. We make bold moves, together, and are a force for good.

Let’s Stay Connected

Follow @HPECareers on Instagram to see the latest on people, culture and tech at HPE.

Job: Engineering Job Level: TCP_05

HPE is an Equal Employment Opportunity/ Veterans/Disabled/LGBT employer. We do not discriminate on the basis of race, gender, or any other protected category, and all decisions we make are made on the basis of qualifications, merit, and business need.

Equal Employment Opportunity is the Law Equal Employment Opportunity is the Law - Supplement E-Verify (US & PR only) HPE is an E-Verify employer. E-Verify is an Internet-based system that compares information from an employee's Form I‑9, Employment Eligibility Verification, to data from U.S. Department of Homeland Security and Social Security Administration records to confirm the employment eligibility of all newly hired employees. For more information click here.

Accessibility

HPE is committed to creating an inclusive and accessible workplace and encourages applications from all qualified individuals, including those with disabilities. If you believe you require accommodation during any stage of the application or interview process, please submit your request by completing our secure form linked here. Note: This option is reserved for applicants needing assistance/reasonable accommodation related to a disability.

Disclosure of Sensitive Personal Data Please ensure the resume you submit to us does not include any sensitive personal data. Sensitive personal data includes data revealing information about your racial or ethnic origin, political opinions, religious or philosophical beliefs, trade union membership, health, sex life or sexual orientation. To the extent the resume you submit does contain this type of personal data, you consent to the storing and processing of this data by HPE for the purpose of reviewing and managing your application.