Principal Engineer - Generative AI & LLM Platforms

Hewlett Packard Enterprise Company; Friday Harbor (WA); Hybrid; USD 210,000 - 270,000; Full time

Job summary

Hewlett Packard Enterprise Company is seeking a Principal Engineer - Generative AI & LLM Platforms to design and deliver production-grade AI systems. The role emphasizes multi-year roadmaps, architectural leadership, and rapid experimentation across cloud-native platforms.

The candidate will drive transformer-based LLM architectures, enable tool-calling workflows, and ensure privacy, safety, and cost optimization while mentoring engineers across teams.

Qualifications

• Advanced degree in Computer Science, Machine Learning, AI, or related field
• 15+ years of industry experience
• Proven technical leadership at senior levels across multiple teams
• Experience with transformer-based LLMs and AI platforms
• Hands-on with Python and Golang, APIs, and modern software design

Responsibilities

• Technical strategy and multi-year product road mapping
• Emerging technology evaluation and customer-focused innovation
• Production-grade LLM and agentic solution architecture
• Prompt engineering, fine-tuning, and model customization
• LLM evaluation, guardrails, privacy, bias, and safety
• Scalable, low-latency, multi-tenant distributed systems design
• Observability, SLOs, incident response, capacity and cost management
• Technical leadership, mentoring, and cross-team influence
• Agile delivery and rapid prototyping of features

Skills

Python

Go

APIs

LLMs

Distributed Systems

Cloud AWS

MLOps

Mentoring

Agile

Education

Advanced degree in CS/ML

Bachelor's degree

Tools

Kubernetes

Hugging Face Transformers

LangChain

Apache Spark

Amazon Bedrock

EKS

pgvector

CI/CD

Job description

Principal Engineer - Generative AI & LLM Platforms

This role has been designed as 'Hybrid' with a requirement that you will work on average 2 days per week from an HPE office.

Who We Are:

Hewlett Packard Enterprise is the global edge-to-cloud company advancing the way people live and work. We help companies connect, protect, analyze, and act on their data and applications wherever they live, from edge to cloud, so they can turn insights into outcomes at the speed required to thrive in today's complex world. Our culture thrives on finding new and better ways to accelerate what's next. We know varied backgrounds are valued and succeed here. We have the flexibility to manage our work and personal needs. We make bold moves, together, and are a force for good. If you are looking to stretch and grow your career our culture will embrace you. Open up opportunities with HPE.

Job Description:

Job Family Definition:

Designs, develops, troubleshoots and debugs software programs for software enhancements and new products. Develops software including operating systems, compilers, routers, networks, utilities, databases and Internet-related tools. Determines hardware compatibility and/or influences hardware design.

Management Level Definition:

Contributions have visible technical impact on a product or major subcomponent. Applies in-depth professional knowledge and innovative ideas to solve complex problems. Visible contributions improve time-to-market, achieve cost reductions, or satisfy current and future unmet customer needs. Recognized internal authority on key technology area applying innovative principles and ideas. Provides technical leadership for significant project/program work. Leads or participates in cross-functional initiatives and contributes to mentorship and knowledge sharing across the organization.

Responsibilities:

• Technical strategy and multi-year product road mapping
• Emerging-technology evaluation and customer-focused innovation
• Production-grade LLM and agentic solution architecture
• Prompt engineering, fine-tuning, and model customization
• LLM evaluation, guardrails, privacy, bias, and safety
• Scalable, low-latency, multi-tenant distributed systems design
• Observability, SLOs, incident response, capacity, and cost management
• Technical leadership, mentoring, and cross-team influence
• Agile delivery, rapid prototyping, and product ionization

Education and Experience Required:

• Advanced degree in Computer Science, Machine Learning, Artificial Intelligence, or a related discipline
• 15+ years of relevant industry experience

Knowledge and Skills:

• Proven technical leadership at Staff, Principal, Architect, or equivalent level, with influence across multiple teams or product areas and experience in delivering significant ownership of architecture for large-scale production systems.
• Strong hands-on proficiency in Python and Golang; solid understanding of APIs, asynchronous processing, testing, and software design principles.
• Deep understanding of transformer-based LLMs, tokenization, embeddings, context management, prompt engineering, inference behavior, and common model failure modes.
• Experience building and operating production grade Generative AI systems, including RAG, agents or tool-calling workflows, evaluation pipelines, and safety mechanisms.
• Practical experience customizing models through fine-tuning or parameter-efficient techniques and measuring quality against representative datasets.
• Hands on experience with AWS and cloud-native architecture, including compute, storage, identity and access management, monitoring, and deployment automation;
• strong networking domain knowledge covering routing & switching protocols, VPC design, private connectivity, network security, hybrid cloud connectivity, and troubleshooting of distributed application traffic flows.
• Expertise in distributed systems and systems design, including scalability, reliability, security, performance, data architecture, and cost optimization.
• Demonstrated mentoring and coaching skills, with a track record of growing engineers, building technical communities, facilitating constructive design discussions, and leading through influence in ambiguous environments.
• Strong innovation mindset, intellectual curiosity, and ability to translate emerging technologies into practical solutions through rapid experimentation, evidence-based decisions, and thoughtful risk management.
• Demonstrated ability to work in agile delivery models, rapidly build and present functional proofs of concept, and use early technical validation to guide priorities, architecture decisions, and incremental delivery.
• Bachelor's degree in Computer Science, Engineering, Mathematics, or a related field, or equivalent practical experience
• Cloud, Platform, and Network Architecture:
• AWS cloud, Kubernetes, infrastructure as code, and CI/CD
• Amazon Bedrock and AWS AI/ML services
• Amazon EMR, Apache Spark, and Apache Flink
• Amazon Aurora PostgreSQL, pgvector, Amazon EKS, and Amazon S3
• Secure network architecture and hybrid/multi-region connectivity
• AI/ML Frameworks and Orchestration:
• Hugging Face Transformers and PyTorch
• LangChain, LangGraph, and LlamaIndex
• MLOps and LLMOps:
• Experiment tracking, model registries, and version management
• Automated model evaluation and controlled releases
• AI Platform Architecture and Inference:
• Multi-model platforms, AI gateways, and model routing
• Semantic caching and batch/streaming inference
• Security, and Compliance:
• Privacy-preserving AI and adversarial testing
• AI red teaming, content safety, and explainabilityAI regulatory compliance
• Thought Leadership:
• Patents, publications, open-source contributions, and technical thought leadership

What We Can Offer You:

Health & Wellbeing

We strive to provide our team members and their loved ones with a comprehensive suite of benefits that supports their physical, financial and emotional wellbeing.

Personal & Professional Development

We also invest in your career because the better you are, the better we all are. We have specific programs catered to helping you reach any career goals you have - whether you want to become a knowledge expert in your field or apply your skills to another division.

Unconditional Inclusion

We are unconditionally inclusive in the way we work and celebrate individual uniqueness. We know varied backgrounds are valued and succeed here. We have the flexibility to manage our work and personal needs. We make bold moves, together, and are a force for good.

Let's Stay Connected:

Follow @HPECareers on Instagram to see the latest on people, culture and tech at HPE.

#puertorico

#networking

Job:

Engineering

Job Level:

TCP_05

HPE is an Equal Employment Opportunity/ Veterans/Disabled/LGBT employer. We do not discriminate on the basis of race, gender, or any other protected category, and all decisions we make are made on the basis of qualifications, merit, and business need. Our goal is to be one global team that is representative of our customers, in an inclusive environment where we can continue to innovate and grow together. Please click here: Equal Employment Opportunity .

Hewlett Packard Enterprise is EEO Protected Veteran/ Individual with Disabilities.

HPE will comply with all applicable laws related to employer use of arrest and conviction records, including laws requiring employers to consider for employment qualified applicants with criminal histories.

All legitimate job opportunities will come through official company channels, and candidates are responsible for verifying the credentials of any third party claiming to represent the company. Any reliance on fraudulent communication is at the individual's own risk, and HPE disclaims legal liability for any resulting damages. If you suspect recruitment fraud, do not share personal information or make any payments and report the incident to your local authorities immediately.