ML Infrastructure Engineer

Bright Vision Technologies; Deutschland; Vor Ort; EUR 90.000 - 130.000; Vollzeit

Zusammenfassung

Bright Vision Technologies is seeking an ML Infrastructure Engineer to design, build, and operate the platform layer powering large-scale AI training and inference workloads. Focus areas include GPU clusters, scheduling, and efficient, cost-aware operations.

The role emphasizes reliability, developer experience, and cross‑team collaboration with ML researchers and engineers. Remote work is supported with opportunities across on-demand cloud and on‑prem resources.

Qualifikationen

• Bachelor’s or Master’s degree in Computer Science or a related field.
• Six+ years of infrastructure, platform, or HPC engineering experience.
• Hands-on experience operating GPU clusters or large-scale ML training infrastructure.
• Strong proficiency in Python and at least one systems language (Go or C++).
• Deep understanding of distributed training, accelerator architectures, and collective communication.
• Experience with Kubernetes, Slurm, Ray, or similar ML scheduling systems.
• Strong Linux, networking, and high-performance storage knowledge.
• Experience with major cloud ML infrastructure offerings.
• Strong software engineering practices including testing, CI/CD, and code review.

Aufgaben

• Design and operate GPU and accelerator infrastructure for training and inference across on‑prem, cloud, and hybrid setups.
• Build scheduling, queuing, and resource sharing to maximize accelerator utilization.
• Integrate PyTorch, JAX, DeepSpeed, FSDP, Megatron‑LM, and Ray Train into a unified platform.
• Operate high‑performance storage systems and data pipelines for training data throughput.
• Design networking architectures supporting RDMA, InfiniBand, NCCL, and high‑bandwidth communication.
• Develop observability for AI workloads including utilization, throughput, and failure analytics.
• Implement checkpointing and fault‑tolerance for long-running training jobs.
• Drive cost optimization across compute, storage, and networking via scheduling and right‑sizing.
• Develop tooling and paved‑road workflows for researchers to launch experiments safely.
• Partner with ML teams to plan capacity for upcoming training runs.

Kenntnisse

Python

Go

C++

Distributed training

Linux

Communication

Ausbildung

Bachelor’s or Master’s in Computer Science

Tools

Kubernetes

Slurm

Ray

NCCL

Jobbeschreibung

ML Infrastructure Engineer - Remote

Sponsorship: U.S. Citizens, Green Card Holders, EAD Holders, and H-1B transfer candidates are encouraged to apply. We are unable to sponsor new H-1B visa petitions for this position.

Job Summary

We are seeking an AI Infrastructure Engineer to design, build, and operate the platform layer that powers large-scale AI training and inference workloads. The role focuses on GPU clusters, distributed training frameworks, scheduling, storage performance, and developer experience for ML engineers and researchers, with strong emphasis on reliability, efficiency, and cost control.

Key Responsibilities

• Design and operate GPU and accelerator infrastructure for training and inference, spanning on-prem clusters, cloud‑managed services, and hybrid configurations.
• Build scheduling, queueing, and resource‑sharing systems that maximize accelerator utilization across many teams.
• Integrate frameworks such as PyTorch, JAX, DeepSpeed, FSDP, Megatron‑LM, and Ray Train into a unified platform offering.
• Operate high‑performance storage systems and data pipelines that keep accelerators fed with training data at near‑line‑rate.
• Design networking architectures supporting RDMA, InfiniBand, NCCL, and high‑bandwidth collective communication.
• Build observability for AI workloads including utilization, throughput, training stability, and failure‑mode analytics.
• Implement checkpointing, restart, and fault‑tolerance patterns for long‑running training jobs at scale.
• Drive cost optimization across compute, storage, and networking through scheduling, spot capacity, and right‑sizing.
• Develop developer tooling and paved‑road workflows that let researchers launch experiments safely and efficiently.
• Partner with research and applied ML teams to plan capacity for upcoming training runs.
• Implement security controls, isolation, and access management for multi‑tenant AI infrastructure.
• Drive automation across cluster provisioning, lifecycle management, and configuration enforcement.
• Maintain runbooks, capacity dashboards, and operational documentation for the AI platform.
• Stay current with AI infrastructure research, accelerator hardware, and emerging open‑source AI tooling.

Required Qualifications

• Bachelor’s or Master’s degree in Computer Science or a related field.
• Six or more years of experience in infrastructure, platform, or HPC engineering.
• Hands‑on experience operating GPU clusters or large‑scale ML training infrastructure.
• Strong proficiency in Python and at least one systems language such as Go or C++.
• Deep understanding of distributed training, accelerator architectures, and collective communication.
• Experience with Kubernetes, Slurm, Ray, or similar scheduling systems for ML workloads.
• Strong understanding of Linux internals, networking, and high‑performance storage.
• Experience with at least one major cloud provider’s ML infrastructure offerings.
• Strong software engineering practices including testing, CI/CD, and code review.
• Excellent communication and cross‑functional collaboration skills.

Preferred Qualifications

• Experience operating InfiniBand or RDMA networking at scale.
• Contributions to open‑source ML infrastructure projects.
• Familiarity with custom orchestrators or research‑grade training stacks.
• Exposure to frontier model training operations.
• Experience with FinOps for AI workloads.

Equal Employment Opportunity (EEO) Statement

Bright Vision Technologies is an Equal Opportunity Employer.

Bright Vision Technologies (BV Teck) is committed to equal employment opportunity (EEO) for all employees and applicants without regard to race, color, religion, sex, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, veteran status or any other protected status as defined by applicable federal, state or local laws. This commitment extends to all aspects of employment, including recruitment, hiring, training, compensation, promotion, transfer, leaves of absence, termination, layoffs, and recall.

BV Teck expressly prohibits any form of workplace harassment or discrimination. Any improper interference with employees' ability to perform their job duties may result in disciplinary action up to and including termination of employment.