Tech Lead Manager for Scalable LLM Training Platform

United States Digital Space LLC; San Francisco, New York (CA, NY); On-site; USD 290,000 - 363,000; Full time

Job summary

United States Digital Space LLC seeks engineers to build and optimize a large-scale training and inference framework that powers LLM research and data curation. You will collaborate with ML researchers to accelerate model development and deploy state-of-the-art technologies across multi-node systems.

The role emphasizes strong software engineering with CUDA, PyTorch, and transformers, and requires clear cross-functional communication in a fast-paced AI environment.

Qualifications

• Passionate about system optimization.
• Experience with multi-node LLM training and inference.
• Experience with developing large-scale distributed ML systems.
• Experience with post-training methods like RLHF/RLVR and related algorithms.
• Strong software engineering skills with CUDA, PyTorch, transformers, flash attention.

Responsibilities

• Build, profile and optimize our training and inference framework.
• Collaborate with ML and research teams to accelerate research and development for next generation models and data curation.
• Research and integrate state-of-the-art technologies to optimize our ML system.

Skills

System optimization

Multi-node LLM training

LLM inference

Distributed ML systems

CUDA

PyTorch

Transformers

Flash Attention

Cross-functional communication

Tools

CUDA

PyTorch

Transformers

FlashAttention

Job description

United States Digital Space LLC seeks engineers to build and optimize a large-scale training and inference framework that powers LLM research and data curation. You will collaborate with ML researchers to accelerate model development and deploy state-of-the-art technologies across multi-node systems.

The role emphasizes strong software engineering with CUDA, PyTorch, and transformers, and requires clear cross-functional communication in a fast-paced AI environment.