Senior Infrastructure Engineer, Compute Platforms (GPU)

Ornn AI, Inc.; New York, Northern (NY, KY); Hybrid; USD 180,000 - 240,000; Full time

Benefits offered by this job

Health coverage

Meaningful equity

Free meals

Job summary

Ornn AI, Inc. is seeking a Senior Engineer, Infrastructure Services to own the systems underpinning Ornn Compute.

You will work across Linux hosts, Kubernetes and Slurm clusters, and bare-metal provisioning to ensure reliable capacity delivery across datacenters. You will design provisioning, scheduling and isolation mechanisms, write software in Rust and Python, and operate multi-tenant environments with secure tenancy.

Qualifications

• Strong Linux systems knowledge including debugging, networking, memory, filesystems and performance.
• Rust production systems experience.

Responsibilities

• Build and operate infrastructure powering Ornn Compute across GPU clusters and datacenters.
• Design provisioning, scheduling, isolation, monitoring and management across bare-metal, containerized and virtualized environments.
• Build infrastructure software in Rust and Python for node management, orchestration, telemetry, networking and cluster operations.
• Operate and extend Kubernetes and Slurm environments including RKE2, Slinky, container runtimes and GPU scheduling.
• Design secure multi-tenant compute environments using containers, VMs, hypervisors and related isolation tech.
• Debug failures across Linux, networking, storage, schedulers, virtualization, GPUs and distributed systems.
• Build systems for collecting infrastructure state, telemetry, inventory, health and utilization data.
• Automate deployment and lifecycle management across clusters; ensure predictable degradation and automatic recovery.

Skills

Linux systems

Rust

SQL

containerized workloads

Kubernetes

Slurm

virtualization

distributed systems

independent work

Education

BS/MS or equivalent in CS/CE/EE

Tools

RKE2

Slinky

Docker/containerd

Kata Containers

Kubernetes

Job description

Ornn AI, Inc. is seeking a Senior Engineer, Infrastructure Services to own the systems underpinning Ornn Compute.

You will work across Linux hosts, Kubernetes and Slurm clusters, and bare-metal provisioning to ensure reliable capacity delivery across datacenters. You will design provisioning, scheduling and isolation mechanisms, write software in Rust and Python, and operate multi-tenant environments with secure tenancy.