Senior HPC AI Cluster Engineer

NVIDIA; Lavamünd; Vor Ort; EUR 90.000 - 130.000; Vollzeit

Zusammenfassung

NVIDIA in Austria is seeking an experienced HPC-AI Engineer to join the Networking Clusters Solutions Infrastructure team. You will design and operate large-scale HPC/AI clusters, implement monitoring, logging and alerting, and collaborate with researchers to optimise workflows for GPU-accelerated computing.

You will manage Linux job scheduling (Slurm, K8s), develop CI/CD pipelines, automate deployment, and establish self-service resource provisioning.

Qualifikationen

• Degree in computer science or related field.
• 8+ years of experience in HPC/AI environments.
• Experience with Slurm and orchestration tools.
• Strong Linux networking and OS security knowledge (Red Hat/CentOS, Ubuntu).
• Familiarity with Lustre/GPFS/Weka.io storage solutions.
• Proficiency in Python and Bash.
• Automation with Jenkins/Ansible/Puppet/Chef.
• Knowledge of InfiniBand and Ethernet networking.

Aufgaben

• Design, implement and maintain large scale HPC/AI clusters with monitoring, logging and alerting.
• Manage Linux job/workload schedules and orchestration tools.
• Develop and maintain CI/CD pipelines for infrastructure.
• Develop tooling to automate deployment and self-service resource provisioning.
• Deploy monitoring for servers, network and storage.
• Troubleshoot from bare metal to application level.
• Document standard methodologies for internal teams.
• Support R&D activities and engage in POCs/POVs for future improvements.

Kenntnisse

HPC systems

Linux admin

Python scripting

CI/CD pipelines

Troubleshooting

Ausbildung

CS degree

Tools

Slurm

Kubernetes

Jenkins

Ansible

Puppet/Chef

VMware

Lustre

GPFS

Jobbeschreibung

NVIDIA is looking for an experienced HPC-AI Engineer to join the Networking Clusters Solutions Infrastructure team. we are focused on building supercomputers and AI clusters based on groundbreaking technologies. We are looking for an outstanding engineer, be a key player to the most exciting computing hardware and software to contribute to the latest breakthroughs in artificial intelligence and GPU computing. Provide insights on at-scale system design and tuning mechanisms for large-scale compute runs. You will work with the latest Accelerated computing and Deep Learning software and hardware platforms, and with many scientific researchers, developers, and customers to craft improved workflows and develop new, leading differentiated solutions. You will interact with HPC, OS, GPU compute, and systems specialist to architect, develop and bring up large scale performance platforms.

What you will be doing:

• Design, implement and maintain large scale HPC/AI clusters with monitoring, logging and alerting
• Manage Linux job/workload schedules and orchestration tools
• Develop and maintain continuous integration and delivery pipelines
• Develop tooling to automate deployment and management of large-scale infrastructure environments, to automate operational monitoring and alerting, and to enable self-service consumption of resources
• Deploy monitoring solutions for the servers, network and storage
• Perform troubleshooting bottom up from bare metal, operating system, software stack and application level
• Being a technical resource, develop, re-define and document standard methodologies to share with internal teams
• Support Research & Development activities and engage in POCs/POVs for future improvements

What we need to see:

• A degree in Computer Science, Engineering, or a related field and 8+ years of experience
• Knowledge of HPC and AI solution technologies from CPU’s and GPU’s to high speed interconnects and supporting software
• Experience with job scheduling workloads and orchestration tools such as Slurm, K8s
• Excellent knowledge of Windows and Linux (Redhat/CentOS and Ubuntu) networking (sockets, firewalld, iptables, wireshark, etc.) and internals, ACLs and OS level security protection and common protocols e.g. TCP, DHCP, DNS, etc.
• Experience with multiple storage solutions such as Lustre, GPFS, Weka.io. Familiarity with newer and emerging storage technologies.
• Python programming and bash scripting experience.
• Comfortable with automation and configuration management tools such as Jenkins, Ansible, Puppet/chef
• Deep knowledge of Networking Protocols like InfiniBand, Ethernet
• Deep understanding and experience with virtual systems (for example VMware, Hyper-V, KVM, or Citrix)
• Familiarity with cloud computing platforms (e.g. AWS, Azure, Google Cloud)

Ways to stand out from the crowd:

• Knowledge of CPU and/or GPU architecture
• Knowledge of Kubernetes, container related microservice technologies
• Experience with GPU-focused hardware/software (DGX, Cuda)
• Experience with RDMA (InfiniBand or RoCE) fabrics

We are an equal opportunity employer and value diversity at our company. We do not discriminate on the basis of race, religion, color, national origin, sex, gender, gender expression, sexual orientation, age, marital status, veteran status, or disability status. We will ensure that individuals with disabilities are provided reasonable accommodation to participate in the job application or interview process, to perform essential job functions, and to receive other benefits and privileges of employment. Please contact us to request accommodation.