Developer Relations Engineer

Vast.ai Inc.; San Francisco, Northern (CA, KY); Hybrid; USD 160,000 - 200,000; Full time

Benefits offered by this job

Health insurance

Dental insurance

Vision insurance

Life insurance

401(k) with company match

Meals on site

Travel and conference budget

Equity

Job summary

Vast.ai Inc. in San Francisco or Los Angeles is seeking an engineer who will run real workloads on Vast weekly, deploying, fine-tuning, and serving open source models on rented GPUs.

You will build public repos, Docker templates, and benchmarks that developers clone and use. You will also turn technical work into guides, short videos, and community posts, becoming the most technically credible voice in our Discord, Reddit, and X, while representing Vast at hackathons and conferences roughly once

Qualifications

• You can take an open source model from Hugging Face to a running endpoint on rented GPUs with Linux, Docker, Python, SSH.
• You can debug GPU stack issues including CUDA mismatches, OOM errors, and multi-GPU configurations (NCCL/topology).
• Public proof of work is required: GitHub, technical writing, or live projects with walkthroughs.

Responsibilities

• Run real workloads on Vast weekly: deploy, fine-tune, and serve open source models and keep live endpoints running.
• Build public example repos, Docker templates, and benchmarks that developers can clone and use.
• Turn what you build into teaching: guides, short videos, talks, livestreams.
• Be the most technically credible voice in our Discord, Reddit, and X.
• Represent Vast at hackathons and conferences roughly one trip a month.
• Report friction and missing docs to engineering and product.

Skills

Linux

Docker

Python

SSH

Open source models

Public speaking

Tools

GitHub

CUDA

NCCL

Job description

About Vast.ai

Vast.ai runs one of the largest GPU marketplaces in the world. Over 20,000 GPUs, from RTX 4090s up to B300s, rented by more than 25,000 customers a month who train, fine-tune, and serve AI models on them. We are profitable, the team is flat, and we ship quickly. Your application goes straight to the hiring team.

The role

This is an engineering job that happens in public. You will be our heaviest user.

Most of your week goes to renting GPUs on Vast and building things on them. Serving open source models with vLLM and SGLang. Fine-tuning. Running ComfyUI pipelines. Keeping live inference endpoints up, including token endpoints on markets like OpenRouter. Writing the example repos, Docker templates, and benchmarks that other developers copy.

The rest of your week is spent showing your work. Short videos, technical write-ups, answers in Discord and on Reddit, hackathons. You are not building the Vast product. You are using it harder than any of our customers, in the open, and reporting back everything that breaks.

If you want a content calendar and a campaign plan, this is the wrong job. If you already spin up GPUs on weekends because you want to see whether the new model actually runs, keep reading.

What you'll do

• Run real workloads on Vast every week. Deploy, fine-tune, and serve open source models, and keep live endpoints running.

• Build public example repos, Docker templates, and benchmarks that developers can clone and use.

• Turn what you build into teaching: guides, short videos, talks, livestreams.

• Be the most technically credible voice in our Discord, on Reddit, and on X.

• Represent Vast at hackathons and conferences, roughly one trip a month.

• Report the friction, the breakage, and the missing docs straight to engineering and product.
  

What we need to see

• You can take an open source model from Hugging Face to a running endpoint on rented GPUs with nobody helping you. Linux, Docker, Python, SSH.

• You can debug the GPU stack. Driver and CUDA mismatches, out of memory errors, and multi-GPU configuration including NCCL and topology issues do not scare you.

• Public proof of work you have shipped. A GitHub profile, technical writing, or live projects. We will ask you to walk us through code you wrote and explain the parts that went wrong.

• You work without a roadmap and prefer it that way. Nobody here will hand you a task list.

• You can explain a hard thing clearly, in writing and out loud.
  

Nice to have

• Content or side projects that found a real audience.

• Previous developer relations, community, or customer-facing work. Useful here, but it is a bonus and not the job.

• vLLM or SGLang internals, distributed training with FSDP or DeepSpeed, CUDA.

• Time at a cloud, GPU, AI infrastructure, or developer tools company.
  

First 90 days

• Ship several public example projects on Vast, including at least one live serving endpoint.

• Publish benchmarks or guides that developers actually use and pass around.

• Become the recognizable technical voice in our community channels.

• Represent Vast at a sponsored hackathon.
  

Compensation & benefits

$160,000 to $200,000 base, plus equity and bonus. Health, dental, vision, and life insurance. 401(k) with company match. Meals on site. Travel and conference budget. This role is on site in San Francisco or Los Angeles.