Distributed ML Systems Engineer: Scalable Training

Susquehanna International Group, LLP; Lower Merion Township (Montgomery County); On-site; USD 120,000 - 170,000; Full time

Job summary

Susquehanna International Group, LLP is seeking a Machine Learning Systems Engineer to strengthen performance and scalability of distributed training infrastructure. You will work with researchers to streamline development and execution of large-scale training runs, helping them maximize compute resources.

You will build tools to make distributed training efficient and accessible, and continually refine system performance through profiling, benchmarking, and optimization.

Qualifications

• Experience with large-scale ML training pipelines and distributed training frameworks.
• Strong Python software engineering skills.
• Ability to profile and optimize resource usage in distributed environments.

Responsibilities

• Collaborate with researchers to enable systems-efficient models and architectures.
• Apply techniques to training runs to improve hardware efficiency.
• Create tooling to help researchers distribute training jobs more effectively.
• Profile and optimize training runs.

Skills

Python

Distributed training

Performance profiling

Job description

Susquehanna International Group, LLP is seeking a Machine Learning Systems Engineer to strengthen performance and scalability of distributed training infrastructure. You will work with researchers to streamline development and execution of large-scale training runs, helping them maximize compute resources.

You will build tools to make distributed training efficient and accessible, and continually refine system performance through profiling, benchmarking, and optimization.