HPC Performance Engineer: Kernel & Systems

CoreWeave; New York (NY); On-site; USD 165,000 - 242,000; Full time

Benefits offered by this job

Medical, dental, and vision insurance

401(k) with employer match

Tuition Reimbursement

Flexible PTO

Catered lunch

Job summary

CoreWeave is seeking a highly skilled HPC Performance Engineer to join our HAVOCK Team, reporting to the Manager of Systems Engineering. You will design, develop, and optimize bare-metal systems from POST through joining a Kubernetes cluster, maintaining a custom Linux kernel, Ubuntu-based images, and the container/runtime stack.

You will collaborate with cross-functional teams and stakeholders to ensure low-latency, high-throughput performance, with telemetry and automation driving decisions

Qualifications

• 5+ years of professional experience in Systems/HPC Performance Engineering, Benchmarking, and/or Validation.
• Bachelor’s degree in Computer Engineering, Electrical Engineering, Computer Science, or a related field.
• Strong experience with MPI workloads and distributed system performance analysis.
• Familiarity with RoCE, InfiniBand, and GPUDirect/Data Direct I/O, NUMA, etc in HPC workloads.
• Hands-on use of public HPC benchmarks (HPCC, HPL, OSU, MLPerf-HPC, STREAM, IO500).

Responsibilities

• Develop and maintain tools for establishing systems performance baselines.
• Develop and maintain performance regression analysis testing automation.
• Design and maintain performance regression test pipelines for HPC workloads.
• Debug and tune fabric-level performance to ensure low-latency high-throughput configurations.
• Development of telemetry for performance analysis across distributed clusters of servers.
• Triage and fix performance issues in Linux.
• Define Linux and OS requirements, specifications, and system architecture in relation to systems performance, in collaboration with cross-functional teams.

Skills

Python

Go

bash/sh

C

Prometheus

Victoria Metrics

Grafana

Linux Kernel

Ubuntu

Kubernetes

Docker

KubeVirt

containerd

kubelet

NVIDIA GPUs

Infiniband

Education

Bachelor’s degree in Computer Engineering, Electrical Engineering, Computer Science, or a related field

Tools

MPI workloads

OS benchmarks (HPCC, HPL, OSU, MLPerf-HPC, STREAM, IO500)

Job description

CoreWeave is seeking a highly skilled HPC Performance Engineer to join our HAVOCK Team, reporting to the Manager of Systems Engineering. You will design, develop, and optimize bare-metal systems from POST through joining a Kubernetes cluster, maintaining a custom Linux kernel, Ubuntu-based images, and the container/runtime stack.

You will collaborate with cross-functional teams and stakeholders to ensure low-latency, high-throughput performance, with telemetry and automation driving decisions