DevRel Engineer: Run GPUs, Build Open-Source Endpoints

Vast.ai Inc.; San Francisco, Northern (CA, KY); Hybrid; USD 160,000 - 200,000; Full time

Benefits offered by this job

Health insurance

Dental insurance

Vision insurance

Life insurance

401(k) with company match

Meals on site

Travel and conference budget

Equity

Job summary

Vast.ai Inc. in San Francisco or Los Angeles is seeking an engineer who will run real workloads on Vast weekly, deploying, fine-tuning, and serving open source models on rented GPUs.

You will build public repos, Docker templates, and benchmarks that developers clone and use. You will also turn technical work into guides, short videos, and community posts, becoming the most technically credible voice in our Discord, Reddit, and X, while representing Vast at hackathons and conferences roughly once

Qualifications

• You can take an open source model from Hugging Face to a running endpoint on rented GPUs with Linux, Docker, Python, SSH.
• You can debug GPU stack issues including CUDA mismatches, OOM errors, and multi-GPU configurations (NCCL/topology).
• Public proof of work is required: GitHub, technical writing, or live projects with walkthroughs.

Responsibilities

• Run real workloads on Vast weekly: deploy, fine-tune, and serve open source models and keep live endpoints running.
• Build public example repos, Docker templates, and benchmarks that developers can clone and use.
• Turn what you build into teaching: guides, short videos, talks, livestreams.
• Be the most technically credible voice in our Discord, Reddit, and X.
• Represent Vast at hackathons and conferences roughly one trip a month.
• Report friction and missing docs to engineering and product.

Skills

Linux

Docker

Python

SSH

Open source models

Public speaking

Tools

GitHub

CUDA

NCCL

Job description

Vast.ai Inc. in San Francisco or Los Angeles is seeking an engineer who will run real workloads on Vast weekly, deploying, fine-tuning, and serving open source models on rented GPUs.

You will build public repos, Docker templates, and benchmarks that developers clone and use. You will also turn technical work into guides, short videos, and community posts, becoming the most technically credible voice in our Discord, Reddit, and X, while representing Vast at hackathons and conferences roughly once