Developer Relations Engineer: Open-Source AI on GPUs

Vast.ai; Los Angeles (CA); On-site; USD 160,000 - 200,000; Full time

Benefits offered by this job

On-site in SF/LA

Health, dental, vision insurance

Travel/conference budget

Job summary

Vast.ai in Los Angeles on-site is seeking an engineering role that happens in public — you’ll be Vast’s resident power user: renting GPUs, deploying and serving open-source models with vLLM, SGLang, PyTorch, and ComfyUI, and keeping live endpoints running and benchmark templates ready. You’ll teach it: create short videos and guides, answer questions on Discord and Reddit, and participate in hackathons.

You won’t build the product yourself, you’ll use it intensely and feed friction and gaps back

Qualifications

• Linux, Docker, Python, SSH required; strong open-source experience preferred.
• Public proof of shipped work (GitHub, technical writing, or live projects) is expected.
• Self-directed; able to explain hard concepts clearly in writing and speech.

Responsibilities

• Run real workloads on Vast weekly: deploy, fine-tune, and serve open-source models; keep live inference endpoints up.
• Build public example repos, Docker templates, and benchmarks; contribute to our open-source CLI/SDK and serverless tooling.
• Turn what you build into teaching: guides, short videos, talks, livestreams.

Skills

Linux

Docker

Python

SSH

GitHub

Tools

CLI/SDK usage

Open-source tooling

Job description

Vast.ai in Los Angeles on-site is seeking an engineering role that happens in public — you’ll be Vast’s resident power user: renting GPUs, deploying and serving open-source models with vLLM, SGLang, PyTorch, and ComfyUI, and keeping live endpoints running and benchmark templates ready. You’ll teach it: create short videos and guides, answer questions on Discord and Reddit, and participate in hackathons.

You won’t build the product yourself, you’ll use it intensely and feed friction and gaps back