Research Engineer: Scalable ML Training Systems

Roboticsconnected; Iowa; On-site; USD 120,000 - 170,000; Full time

Job summary

Mind Robotics is seeking a Research Engineer to build the core systems that enable fast, reliable, and scalable model training for real-world industrial AI on factory-scale hardware.

You will design scalable training pipelines, optimize distributed systems across hundreds of GPUs, and collaborate with modeling teams to accelerate iteration while controlling costs. A strong Python background with PyTorch or JAX expertise is essential.

Qualifications

• Experience building infrastructure for large-scale ML training.
• Understanding of how modern LLM/VLM systems are trained and scaled.
• Proven experience setting up and scaling distributed training across hundreds of GPUs.
• Strong understanding of parallelization strategies (data, model, pipeline parallelism).
• Strong proficiency in Python programming.
• Expert-level proficiency in PyTorch and/or JAX.
• Knowledge of attention optimization, kernel fusion, and efficient memory usage.

Responsibilities

• Design scalable systems for training large ML models.
• Enable efficient workflows for data ingestion, training, and iteration.
• Develop and optimize distributed training systems across hundreds of GPUs.
• Implement strategies for parallelization, sharding, and efficient compute utilization.
• Improve training efficiency through techniques such as attention optimizations, kernel fusion, and memory management.
• Partner closely with modeling teams to accelerate iteration speed and reduce training costs.
• Build internal tools for experiment tracking, monitoring, and debugging.
• Implement systems for tracking training performance, failures, and resource utilization.
• Debug and resolve bottlenecks across the training stack.
• Provide lightweight infrastructure support for deploying and running models in production environments.
• Optimize inference performance and reliability where needed.

Skills

Python

PyTorch

JAX

Distributed training

GPU scaling

Job description

Mind Robotics is seeking a Research Engineer to build the core systems that enable fast, reliable, and scalable model training for real-world industrial AI on factory-scale hardware.

You will design scalable training pipelines, optimize distributed systems across hundreds of GPUs, and collaborate with modeling teams to accelerate iteration while controlling costs. A strong Python background with PyTorch or JAX expertise is essential.