Public GPU DevRel Engineer: Open-Source ML Demos & Outreach

Vast.ai; San Francisco (CA); On-site; USD 160,000 - 200,000; Full time

Benefits offered by this job

Health insurance

401(k) with match

Onsite meals

Travel budget

Job summary

Vast.ai is seeking a hands-on engineering-relations role in San Francisco or Los Angeles. You will deploy and serve open-source models on rented GPUs, build public examples with Docker templates, and create benchmarks to show developers how to reproduce results.

You will teach through guides, short videos, talks, and live sessions, becoming the credible voice in our community and feeding feedback to engineering.

Qualifications

• Experience deploying open-source models to running endpoints on rented GPUs with Linux/Docker/Python.
• Strong debugging of GPU stacks, including CUDA and NCCL configurations.
• Publicly verifiable shipped work: GitHub projects, technical writing, or live demos.
• Self-directed and able to explain hard concepts clearly in writing and speaking.

Responsibilities

• Run real workloads on Vast weekly: deploy, fine-tune, and serve open-source models; keep live inference endpoints up.
• Build public example repos, Docker templates, and benchmarks; contribute to open-source CLI/SDK and serverless tooling.
• Turn what you build into teaching: guides, short videos, talks, livestreams.
• Be the technically credible voice in our Discord, Reddit, and X communities, and represent Vast at hackathons and conferences.
• Close the loop: report friction and missing docs to engineering and product.

Skills

Linux

Docker

Python

SSH

GPU deployment

Open-source models

Communication

Tools

GitHub

CLI/SDK

Serverless tooling

Job description

Vast.ai is seeking a hands-on engineering-relations role in San Francisco or Los Angeles. You will deploy and serve open-source models on rented GPUs, build public examples with Docker templates, and create benchmarks to show developers how to reproduce results.

You will teach through guides, short videos, talks, and live sessions, becoming the credible voice in our community and feeding feedback to engineering.