Infrastructure, Large-scale Training

Hark

San Jose (CA)

On-site

USD 180,000 - 450,000

Full time

14 hours ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Hark, an AI company, is seeking a Member of Technical Staff, Infrastructure Compute to lead and manage large-scale GPU compute clusters powering its AI training and deployment workloads. You will own the reliability, scalability, and efficiency of the compute platform that researchers and engineers depend on.

You will partner with ML researchers to remove bottlenecks, translate findings into infrastructure improvements, and drive incident response, capacity planning, and hardware lifecycle

Qualifications

  • 5+ years in infrastructure, systems, or platform engineering.
  • 2+ years in ML or HPC environments.
  • Experience managing GPU clusters.
  • Proficient in at least one systems programming language.
  • Strong networking fundamentals for high-throughput workloads.
  • Experience with container orchestration and job scheduling.
  • Proven track record owning production systems with high reliability.
  • Strong debugging and observability across the full stack.

Responsibilities

  • Design, implement, and maintain IaC practices for scalable cluster provisioning.
  • Enhance and harden CI/CD deployment pipelines for robust model service delivery.
  • Own training infrastructure operating at the scale of 10,000+ GPUs, including scheduling and fault tolerance.
  • Collaborate with ML researchers to translate compute bottlenecks into infra improvements.
  • Monitor system health, define SLOs, and lead incident response for training/inference workloads.
  • Drive capacity planning, cost efficiency, and hardware lifecycle management across the GPU fleet.
  • Contribute to internal tooling and platform abstractions for developer experience.

Skills

Infrastructure engineering
GPU compute
CI/CD pipelines
Observability
Networking fundamentals
Distributed systems
Debugging
Multi-tenant resource management

Tools

Kubernetes
Pulumi
PyTorch
Ray
Rust
Go

Job description

Hark is an artificial intelligence company building advanced, personalized intelligence. One that is proactive, multimodal, and capable of interacting with the world through speech, text, vision, and persistent memory.

We're pairing that intelligence with next-generation hardware to create a universal interface between humans and machines. While today's AI largely operates through chat boxes and decade-old devices, Hark is focused on what comes next: agentic systems that interact naturally with people and the real world.

To get there, we're developing multimodal models and next-generation AI hardware together - designed from the ground up as a single, unified interface for a new era of intelligent systems.

About the Role

We are looking for a Member of Technical Staff, Infrastructure Compute to lead and manage large-scale GPU computing clusters powering our AI training and deployment workloads. You'll work at the intersection of systems engineering and machine learning infrastructure, owning the reliability, scalability, and efficiency of the compute platform that our research and engineering teams depend on. This is a high-impact, highly technical role suited for someone who thrives in complex distributed systems environments and cares deeply about infrastructure as a product.

Responsibilities
  • Design, implement, and maintain Infrastructure as Code (IaC) best practices to enable repeatable, auditable, and scalable cluster provisioning.
  • Enhance and harden CI/CD deployment pipelines to ensure robust, secure, and low-latency model service delivery across production environments.
  • Own and evolve stable training infrastructure operating at the scale of 10,000+ GPUs, including job scheduling, fault tolerance, and network fabric optimization.
  • Partner closely with ML researchers and engineers to understand compute bottlenecks and translate them into infrastructure improvements.
  • Monitor system health, define SLOs, and lead incident response for critical training and inference workloads.
  • Drive capacity planning, cost efficiency initiatives, and hardware lifecycle management across the GPU fleet.
  • Contribute to internal tooling and platform abstractions that improve developer experience for teams consuming compute resources.
Requirements
  • 5+ years of experience in infrastructure, systems, or platform engineering, with at least 2 years working in ML or HPC environments.
  • Demonstrated experience managing GPU clusters or large-scale distributed compute infrastructure.
  • Strong proficiency in at least one systems or infrastructure programming language.
  • Deep understanding of networking fundamentals (RDMA, InfiniBand, or RoCE a plus) relevant to high-throughput training workloads.
  • Experience with container orchestration, job scheduling, and multi-tenant resource management.
  • Proven track record owning production systems with high reliability requirements.
  • Strong debugging and observability skills across the full infrastructure stack.
Bonus Qualifications
  • Kubernetes (K8s) — particularly experience operating large, GPU-aware clusters.
  • Pulumi or similar modern IaC tooling.
  • Rust and/or Go for systems-level tooling and performance-critical services.
  • Familiarity with PyTorch and Ray for understanding workload patterns and integration requirements.
Compensation

The US base salary range for this full-time position is between $180,000 - $450,000 annually.

The pay offered for this position may vary based on several individual factors, including job-related knowledge, skills, and experience. The total compensation package may also include additional components and benefits depending on the specific role. This information will be shared if an employment offer is extended.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Member of Technical Staff - GPU Infrastructure
Member of Technical Staff - GPU Infrastructure

Prime Intellect, Inc. • San Francisco (CA)

On-site
USD 150,000 - 300,000
Equity incentives
Member of Technical Staff, Distributed Training Performance
Member of Technical Staff, Distributed Training Performance

Hark • San Jose (CA)

On-site
USD 180,000 - 450,000
Senior ML Infra Engineer — Large-Scale GPU Training
Senior ML Infra Engineer — Large-Scale GPU Training

Hark • San Jose (CA)

On-site
USD 180,000 - 450,000
Member of Technical Staff, Distributed Training Performance San Jose
Member of Technical Staff, Distributed Training Performance San Jose

Hark • San Jose (CA)

On-site
USD 180,000 - 450,000
Senior GPU Infrastructure Architect for Frontier AI
Senior GPU Infrastructure Architect for Frontier AI

Prime Intellect, Inc. • San Francisco (CA)

Hybrid
USD 150,000 - 300,000
Equity incentives
Member of Technical Staff - GPU Infrastructure
Member of Technical Staff - GPU Infrastructure

Prime Intellect • United States

Hybrid
USD 150,000 - 300,000
Remote work option
Equity incentives
Professional development budget
+2
HPC/GPU Infrastructure Software Engineer - Member of Technical Staff
HPC/GPU Infrastructure Software Engineer - Member of Technical Staff

Designworks Talent • Bellevue (WA)

Hybrid
USD 140,000 - 210,000
Software Engineer, Supercomputing
Software Engineer, Supercomputing

Bison • San Francisco (CA)

On-site
USD 350,000 - 475,000
Health/dental/vision
Unlimited PTO
Parental leave
+1
Senior GPU Infrastructure Engineer - AI Infrastructure
Senior GPU Infrastructure Engineer - AI Infrastructure

Hamilton Barnes • Texas

On-site
USD 120,000 - 160,000
Potential equity/bonus
Cluster Design
Cluster Design

Blue Signal Search • San Francisco (CA)

On-site
USD 150,000 - 230,000