Staff Engineer, GPU AI Inference & RL Infrastructure

B Capital; San Francisco (CA); On-site; USD 120,000 - 160,000; Full time

Benefits offered by this job

Top-tier compensation

Comprehensive medical, dental, and vision insurance

Fully paid parental leave

Paid time off

Regular team celebrations

Job summary

B Capital is seeking a skilled engineer for GPU infrastructure in San Francisco. This role involves designing and operating high-performance systems for model inference, synthetic data generation, and reinforcement learning.

The ideal candidate has strong GPU systems experience, optimization skills, and a passion for working in cutting-edge AI. Benefits include top-tier compensation, comprehensive health insurance, and paid parental leave.

Qualifications

• Experience deploying and operating large-scale GPU systems for inference.
• Several years' hands-on experience building production infrastructure.
• Strong understanding of GPU performance characteristics.

Responsibilities

• Design and build large-scale GPU infrastructure for model inference.
• Develop systems for synthetic data generation and reinforcement learning.
• Optimize GPU utilization for large language model workloads.

Skills

GPU system deployment

Production infrastructure management

Optimization techniques

Inference frameworks

Distributed reinforcement learning

Tools

SGLang

Megatron

Job description

B Capital is seeking a skilled engineer for GPU infrastructure in San Francisco. This role involves designing and operating high-performance systems for model inference, synthetic data generation, and reinforcement learning.

The ideal candidate has strong GPU systems experience, optimization skills, and a passion for working in cutting-edge AI. Benefits include top-tier compensation, comprehensive health insurance, and paid parental leave.