Hybrid Staff AI Training Infrastructure Engineer

Designworks Talent LLC; Bellevue (KY); Hybrid; USD 150,000 - 210,000; Full time

Benefits offered by this job

Medical, dental, vision insurance

401(k) with company match

Paid holidays

Job summary

Designworks Talent LLC in Bellevue, WA is seeking an AI Training Infrastructure Engineer to build and scale distributed training systems for large AI models, operating across multi-node GPU clusters.

You will collaborate with platform, orchestration, and performance teams to improve reliability, efficiency, and training throughput while enabling researchers to push the boundaries of AI workloads.

Qualifications

• Hands-on experience building and operating distributed training systems or large-scale ML infrastructure.
• Experience supporting large AI models, foundation models, post-training workflows, or similar ML systems.
• Strong understanding of reliability, scalability, and efficiency challenges with multi-node GPU training.
• Experience integrating training systems with production ML pipelines.

Responsibilities

• Build and scale distributed training infrastructure for large AI models across GPU clusters.
• Design and improve systems for reliability, efficiency, and resource utilization.
• Develop fault tolerance, checkpointing, recovery for large-scale training operations.
• Integrate AI models into production training pipelines with platform and performance teams.
• Diagnose and resolve issues impacting training throughput, stability, and cost efficiency.
• Build tools and automation to improve developer experience for AI researchers and engineers.
• Establish best practices for training infrastructure and platform reliability.
• Contribute to evolution of AI infrastructure platform as an early engineering team member.

Skills

Distributed training

ML infrastructure

Reliability engineering

Production ML pipelines

Distributed systems

Programming skills

Tools

Kubernetes

Containerization

Job description

Designworks Talent LLC in Bellevue, WA is seeking an AI Training Infrastructure Engineer to build and scale distributed training systems for large AI models, operating across multi-node GPU clusters.

You will collaborate with platform, orchestration, and performance teams to improve reliability, efficiency, and training throughput while enabling researchers to push the boundaries of AI workloads.