AI and HPC Systems Performance Engineer

Hewlett Packard Enterprise Development LP; India; On-site; INR 4,500,000 - 6,500,000; Full time

Job summary

Hewlett Packard Enterprise Development LP is seeking an experienced AI and HPC Systems Performance Engineer to optimize GPU server performance for AI workloads on Linux. The role is hybrid, requiring about 2 days per week in an HPE office, with collaboration across customers, partners, and internal teams.

The ideal candidate has extensive experience in AI/ML frameworks, distributed training, and performance characterization, including DX automation and containerized AI environments.

Qualifications

• Senior AI/HPC performance engineering experience with Linux platforms.
• Hands-on with AI/ML frameworks (PyTorch, JAX, Hugging Face) and distributed workloads.
• Strong debugging, profiling, and performance tuning skills across multi-GPU systems.
• Experience with containerized AI stacks (Docker/Kubernetes) and CI/CD workflows.
• Ability to analyze telemetry, traces, and logs to optimize AI workloads.

Responsibilities

• Install, configure, and optimize AI infrastructure components including GPU servers and storage.
• Develop automation scripts and IaC solutions for provisioning AI platforms.
• Characterize performance of AI training and inference workloads on HPE infrastructure.
• Design benchmarks for LLMs and distributed training environments.
• Analyze system telemetry to identify bottlenecks and optimization opportunities.
• Collaborate with customers, partners, and engineering teams to optimize AI solutions.

Skills

8+ years experience

Linux system administration

AI/ML frameworks

Distributed training

Programming (Python/Bash/Go)

GPU performance tuning

Tools

Docker

Kubernetes

CUDA

Job description

AI and HPC Systems Performance Engineer

This role has been designed as 'Hybrid' with a requirement that you will work on average 2 days per week from an HPE office.

Who We Are:

Hewlett Packard Enterprise is the global edge-to-cloud company advancing the way people live and work. We help companies connect, protect, analyze, and act on their data and applications wherever they live, from edge to cloud, so they can turn insights into outcomes at the speed required to thrive in today’s complex world. Our culture thrives on finding new and better ways to accelerate what’s next. We know varied backgrounds are valued and succeed here. We have the flexibility to manage our work and personal needs. We make bold moves, together, and are a force for good. If you are looking to stretch and grow your career our culture will embrace you. Open up opportunities with HPE.

Job Description:

High Performance Computing, AI and Labs is a critical element of HPE. We are focused on delivering innovative solutions that accelerate our customers’ digital transformation, enabling them to tackle their complex, and data-intensive workloads. Combining deep expertise and the development of the world’s most cutting-edge, high-performance supercomputers, is defining the next era of computing delivering valuable insight & innovation. Join us and redefine what’s next for you. We are looking for an experienced AI Performance Engineer with expertise in tuning GPU server performance for a variety of Artificial Intelligence (AI) training and inference workloads running on Linux platforms. The ideal candidate will be a senior or principal-level engineer with demonstrated experience installing, configuring, characterizing, and optimizing industry-standard server infrastructure including compute, storage, networking, and accelerator technologies for AI workloads. The individual in this role will investigate workload behavior by capturing and analyzing system telemetry, profiling data, traces, and performance metrics to characterize workload execution and identify opportunities for optimization through software, firmware, and hardware configuration changes. They will work closely with customers, partners, and internal engineering teams to optimize performance and scalability of AI solutions deployed on HPE platforms. This role requires strong research, analytical, and problem-solving skills, along with experience building, deploying, optimizing, and maintaining containerized AI/ML environments and workloads. The engineer will collaborate with software development teams to capture workload telemetry, improve observability, and optimize AI software stacks running on HPE infrastructure. They should understand the performance and capacity characteristics of modern AI training and inference workloads and be comfortable working independently to evaluate emerging technologies, author technical papers, and develop AI reference architectures. Experience troubleshooting complex, multi-tier software systems and distributed AI environments is highly desirable. Experience with one or more of PyTorch, JAX, Hugging Face Transformers, DeepSpeed, Megatron-LM, Ray, vLLM, SGLang, TensorRT-LLM, Dynamo, ONNX Runtime, Kubernetes, Redis, Vector Databases, Retrieval-Augmented Generation (RAG) architectures, distributed training and inference, and large-scale AI/LLM workloads is highly desired. The ideal candidate will also have experience characterizing and optimizing performance across multi-GPU and distributed AI environments utilizing modern GPU interconnect, networking, and storage technologies. Strong written and verbal communication skills are required.

What you’ll do:

• Install, configure, and optimize complex AI infrastructure components including GPU servers, storage systems, high-speed networking, and AI software stacks.
• Develop automation scripts, deployment frameworks, and Infrastructure-as-Code solutions to streamline AI platform provisioning and workload execution.
• Perform system-level performance characterization and optimization of AI training and inference workloads on HPE platforms utilizing GPU accelerators and distributed computing technologies.
• Design, execute, and analyze performance benchmarks for AI/ML workloads, including large language models (LLMs), multimodal models, Retrieval-Augmented Generation (RAG) pipelines, and distributed training environments.
• Characterize and optimize performance across multi-GPU and distributed AI environments using modern interconnect, storage, and networking technologies such as InfiniBand, Ethernet fabric, GPUDirect, and RDMA.
• Capture, analyze, and interpret system telemetry, performance metrics, logs, traces, and profiling data to identify bottlenecks and optimization opportunities.
• Develop tools, software, and automation frameworks to improve AI workload observability, performance analysis, scalability testing, and benchmark execution.
• Collaborate with customers, partners, and internal engineering organizations to characterize, troubleshoot, and optimize AI solutions deployed on HPE infrastructure.
• Work closely with ISV, IHV, GPU vendor, and open-source ecosystem partners to evaluate, optimize, and validate AI software and hardware solutions.
• Evaluate emerging AI frameworks, models, accelerators, and infrastructure technologies; provide technical recommendations and performance guidance.
• Author technical reports, white papers, reference architectures, benchmark studies, and best-practice guidance for AI performance optimization and solution design.
• Document findings, performance issues, and optimization recommendations, and communicate technical results to engineering teams, customers, and management.
• Provide technical leadership, mentoring, and guidance to junior engineers and contribute to the development of performance engineering best practices.
• Communicate project status, technical risks, and performance findings to management and stakeholders in a timely manner.

What you need to bring:

• Typically 8+ years of experience
• Strong experience with Linux system administration and command-line environments across multiple enterprise Linux distributions.
• Experience with modern AI/ML frameworks and ecosystems including PyTorch, JAX, Hugging Face Transformers, and related technologies.
• Experience with AI model training, inference, benchmarking, performance characterization, and optimization.
• Experience with data analysis, statistical methods, experiment design, and performance modeling techniques.
• Experience conducting technical research and evaluating emerging AI technologies, frameworks, and hardware platforms.
• Experience with high-performance networking technologies including InfiniBand, RDMA, RoCE, and Mellanox/NVIDIA networking solutions.
• Strong analytical, troubleshooting, and root-cause analysis skills.
• Proficiency in one or more programming or scripting languages such as Python, Bash, Go, C++, or similar.
• Experience working with complex, distributed, multi-layer software systems and AI infrastructure stacks.
• Experience using performance profiling, tracing, observability, and benchmarking tools to analyze system and application performance.
• Experience with containerized and orchestrated environments including Docker, Kubernetes, and related cloud-native technologies.
• Experience analyzing and optimizing AI workloads running on GPU-accelerated systems.
• Experience with distributed training and inference frameworks and large-scale AI/LLM workloads.
• Experience with GPU accelerator technologies, memory hierarchies, and AI software stacks including CUDA, NCCL, and related ecosystem tools.
• Experience with distributed GPU environments and multi-node AI clusters.
• Experience with LLM serving frameworks such as vLLM, TensorRT-LLM, SGLang, or similar technologies.
• Aptitude for self-learning; Learns new concepts quickly.
• Excellent written and verbal communication; mastery in English.
• Able to work well in a team environment and perform well under pressure
• Experience with tuning system performance in a benchmarking environment

Desired Skills and Experience:

• MS/ME/MTech or PhD in Computer Science, Computer Engineering, Electrical Engineering, Data Science, Artificial Intelligence, or a related technical discipline.
• 5+ years of experience in AI/ML infrastructure, performance engineering, high-performance computing (HPC), or related technical fields.
• Experience with large-scale AI training and inference environments supporting foundation models and large language models (LLMs).
• Experience with HPE platforms, AI Factory architectures, or enterprise AI infrastructure solutions.
• Experience with parallel and distributed storage technologies, including Weka, Lustre, BeeGFS, GPFS, or similar high-performance file systems.
• Experience with AI benchmarking methodologies and industry benchmarks such as MLPerf.
• Experience developing reference architectures, technical papers, benchmark studies, or performance guidance documentation.
• Experience working directly with customers, partners, and cross-functional engineering teams in highly collaborative environments.
• Experience optimizing performance across multi-GPU and multi-node AI environments using InfiniBand, RDMA, GPUDirect, or equivalent technologies.
• Ability to work independently in globally distributed teams with minimal supervision.

What We Can Offer You:

• Health & Wellbeing We strive to provide our team members and their loved ones with a comprehensive suite of benefits that supports their physical, financial and emotional wellbeing.
• Personal & Professional Development We also invest in your career because the better you are, the better we all are. We have specific programs catered to helping you reach any career goals you have — whether you want to become a knowledge expert in your field or apply your skills to another division.
• Unconditional Inclusion We are unconditionally inclusive in the way we work and celebrate individual uniqueness. We know varied backgrounds are valued and succeed here. We have the flexibility to manage our work and personal needs. We make bold moves, together, and are a force for good.
• Let's Stay Connected: Follow @HPECareers on Instagram to see the latest on people, culture and tech at HPE. #india #highperformancecompute

Recruitment Fraud Alert

We have become aware of an increase in fraudulent recruitment activities in which individuals impersonate our company or authorized recruitment agencies to offer fake employment opportunities. These scams may occur through false websites, emails, social media, or chat-based applications and often aim to obtain personal information or money. Please note that Hewlett Packard Enterprise (HPE), its direct and indirect subsidiaries and affiliated companies, and its authorized recruitment agencies/vendors will never charge a candidate a registration fee, hiring fee, or any other fee in connection with its recruitment and hiring process. We also never request personal information such as bank account details, Social Security numbers, or national IDs via social media or chat applications. All legitimate job opportunities will come through official company channels, and candidates are responsible for verifying the credentials of any third party claiming to represent the company. Any reliance on fraudulent communication is at the individual’s own risk, and HPE disclaims legal liability for any resulting damages. If you suspect recruitment fraud, do not share personal information or make any payments and report the incident to your local authorities immediately.

Equal Employment Opportunity

HPE is an Equal Employment Opportunity / Veterans / Disabled / LGBT employer. We do not discriminate on the basis of race, gender, or any other protected category, and all decisions we make are made on the basis of qualifications, merit, and business need. Our goal is to be one global team that is representative of our customers, in an inclusive environment where we can continue to innovate and grow together.

Hewlett Packard Enterprise provides equal employment opportunity to any employee or applicant without regard to sex, gender, color, race, ethnicity, religion, creed, national origin, ancestry, citizenship, age, marital status, sexual orientation, gender identity and expression, physical or mental disability, medical condition, pregnancy, protected veteran status, uniformed service status, familial status, genetic information, political affiliation, or any other characteristic protected by federal, state, or local law.

Equal Employment Opportunity is the Law.

Supplement E-Verify (US & PR only) HPE is an E-Verify employer. E-Verify is an Internet-based system that compares information from an employee’s Form I-9, Employment Eligibility Verification, to data from U.S. Department of Homeland Security and Social Security Administration records to confirm the employment eligibility of all newly hired employees.

Accessibility

HPE is committed to creating an inclusive and accessible workplace and encourages applications from all qualified individuals, including those with disabilities. If you believe you require accommodation during any stage of the application or interview process, please submit your request by completing our secure form linked here. Note: This option is reserved for applicants needing assistance/reasonable accommodation related to a disability.