Software Engineer, AI Infrastructure

Harell Data

Palo Alto (CA)

Vor Ort

USD 180.000 - 260.000

Vollzeit

14 Tage+

Eine vollständige Bewerbung in einer Minute

Maßgeschneiderter Lebenslauf und Anschreiben – versandbereit.

Schaffe es an den ATS-Filtern vorbei

Zusammenfassung

Harell Data is seeking an experienced engineer to lead the compute platform in Palo Alto, focusing on GPU clusters and scalable ML infrastructure. You will own the end-to-end ML pipeline, from data ingestion to deployment, while guiding architectural choices and collaborating closely with customers to translate needs into reliable systems.

You will pair with the CTO and shape the engineering direction, implementing Kubernetes-based orchestration, autoscaling, and efficient resource management to

Qualifikationen

  • 5+ years building and operating production infrastructure, with a focus on ML workloads
  • Hands-on experience with Kubernetes on AWS or GCP, ideally with GPU workloads
  • Strong CS fundamentals and system design chops
  • Comfortable with ambiguity — you’ve worked somewhere where the playbook didn’t exist yet

Aufgaben

  • Build the GPU compute layer — orchestration for GPU workloads on Kubernetes, including resource allocation and cost management
  • Build the inference layer — model loading, autoscaling, batching, and serving with low latency
  • Own the ML pipeline end-to-end — data ingestion, preprocessing, training, fine-tuning, and recovery
  • Work directly with customers to debug fine-tuning jobs and improve observability of model performance and resource health
  • Own reliability through incident response, on-call duties, and platform uptime as usage grows
  • Shape technical direction by leading build-vs-buy decisions and setting engineering standards

Kenntnisse

Kubernetes
ML infrastructure
System design
Ambiguity tolerance
GPU compute
AWS/GCP

Tools

GPU clusters
Kubernetes on AWS/GCP

Jobbeschreibung

You\'ll be an early engineer reporting directly to the CTO. You\'ll own the compute layer: the GPU clusters and the inference systems that run on them. You\'ll make the architectural decisions that define the platform. You\'ll also work directly with customers to understand what they actually need and turn that into infrastructure that works at scale.

What You Will Do

  • Build the GPU compute layer - Orchestration for GPU workloads on Kubernetes: resource allocation, scheduling, multi-tenancy, and cost management.
  • Build the inference layer - Model loading, autoscaling, batching, and serving. You own the latency and throughput customers feel.
  • Own the ML pipeline end to end - Data ingestion, preprocessing, training and fine-tuning jobs, and recovery when multi-node jobs fail.
  • Work directly with customers - Debug fine-tuning jobs that fail or run slow. Build the observability that tracks model performance and resource health in real time.
  • Own reliability - Incident response, on-call, and keeping the platform up as usage grows.
  • Shape technical direction - Lead build-vs-buy decisions on infrastructure and security. Set engineering standards. Help hire the team you want to work with.

Qualifications

  • 5+ years building and operating production infrastructure, with a focus on ML workloads: training, inference, or data pipelines
  • Hands-on experience with Kubernetes on AWS or GCP, ideally with GPU workloads.
  • Strong CS fundamentals and system design chops
  • Comfortable with ambiguity — you\'ve worked somewhere where the playbook didn\'t exist yet

Location note: this role is based in Palo Alto, CA. No relocation assistance available for this role.

Hol dir deinen kostenlosen, vertraulichen Lebenslauf-Check.

oder ziehe deine Datei hierhin.

Similar jobs

Ähnliche Jobs, die dir auch gefallen könnten

Platform Engineer
Platform Engineer

Harrison Clarke • San Francisco (CA)

Vor Ort
USD 120.000 - 160.000
Member of Technical Staff (Software Engineer, GPU Cluster Infrastructure)
Member of Technical Staff (Software Engineer, GPU Cluster Infrastructure)

Perplexity AI • San Francisco (CA)

Vor Ort
USD 180.000 - 280.000
GPU Compute Infrastructure Engineer
GPU Compute Infrastructure Engineer

Linuxconfig • San Francisco (CA)

Hybrid
USD 210.000 - 270.000
Lead AI Infra Architect – GPU Cloud & ML Pipelines Equity
Lead AI Infra Architect – GPU Cloud & ML Pipelines Equity

Hamilton Barnes • Texas

Vor Ort
USD 283.500 - 346.500
Equity (RSUs)
Senior Platform Engineer
Senior Platform Engineer

talentpluto • San Francisco (CA)

Hybrid
USD 180.000 - 250.000
Equity
Remote work
Member of Technical Staff (Software Engineer, GPU Cluster Infrastructure)
Member of Technical Staff (Software Engineer, GPU Cluster Infrastructure)

Perplexity • USA

Vor Ort
USD 180.000 - 240.000
Founding Engineer — AI Infrastructure Optimization
Founding Engineer — AI Infrastructure Optimization

Paralleliq • USA

Remote
USD 140.000 - 190.000
Equity
Member of Technical Staff (Software Engineer, GPU Cluster Infrastructure)
Member of Technical Staff (Software Engineer, GPU Cluster Infrastructure)

Perplexity • USA

Remote
USD 180.000 - 320.000
Platform Engineer
Platform Engineer

Reactor • San Francisco (CA)

Vor Ort
USD 190.000 - 260.000
Visa sponsorship
Relocation assistance
Health, dental, vision
+1
Software Engineer, Infrastructure
Software Engineer, Infrastructure

Fudo Partners • New York (NY)

Vor Ort
USD 180.000 - 240.000
Medical, dental and vision coverage
Flexible paid time off
Winter break
+3