Member of Technical Staff, AI Pretraining Platform

Microsoft; London; On-site; USD 99,000 - 200,000; Full time

Job summary

An innovative company is seeking a Member of Technical Staff to contribute to the AI Pretraining Platform. This role involves designing and developing cutting-edge infrastructure for large-scale AI model training, utilizing Python and CUDA/HIP C++. Candidates should have a strong background in HPC and data engineering, alongside a passion for exploring new technologies. Join a collaborative team dedicated to pushing the boundaries of AI capabilities and making a significant impact in the field. If you thrive in a fast-paced environment and are eager to tackle complex challenges, this opportunity is for you.

Qualifications

• Experience with HPC and parallel programming.
• Strong background in data science and software development.

Responsibilities

• Design and develop code for distributed training of multimodal LLMs.
• Build infrastructure for processing petabytes of data.

Skills

Python

CUDA/HIP C++

HPC (High Performance Computing)

Parallel Programming

Data Engineering

Education

Bachelor's Degree in Computer Science

Master's Degree in Computer Science

Tools

GPU Clusters

Job description

Member of Technical Staff, AI Pretraining Platform

Join to apply for the Member of Technical Staff, AI Pretraining Platform role at Microsoft

Member of Technical Staff, AI Pretraining Platform

2 weeks ago Be among the first 25 applicants

Join to apply for the Member of Technical Staff, AI Pretraining Platform role at Microsoft

Help build the world’s most advanced training platform at Microsoft AI

We are on a mission to create the leading pretraining platform to develop the world’s most capable AI frontier models. This platform will span one of the world’s most foremost GPU clusters, pushing the boundaries of scale, performance, and reliability.

The AI Pre-training Platform team at Microsoft AI is responsible for all aspects of infrastructure including scalability, benchmarking, kernel development, performance optimizations, communications, and fault tolerance to support our model pre-training operations. We are an interdisciplinary team of engineers and scientists, learning from each other, and collaborating to create the best models, methods and products. We work closely with the teams that transform pre-trained models into the models that power the consumer Copilot experience.

About

We are looking for outstanding individuals excited about contributing to the next generation of systems that will transform the field. We are looking for candidates who:

• Are passionate about the infrastructure enabling large-scale AI model training
• Will thrive in a highly collaborative, fast-paced environment
• Have a high degree of craftsmanship and pay close attention to details
• Demonstrate a proactive attitude and enthusiasm for exploring new methods and technologies
• Effectively manage multiple responsibilities and can adjust to shifting priorities.
  
  

Responsibilities

• Design and develop Python and CUDA/HIP C++ code that enable distributed training of multimodal LLMs ingesting text, audio, images, or video data.
• Build and maintain cutting-edge infrastructure that can store and process the petabytes of data needed to power models.
• Partner with the pretraining and post-training teams to improve our data recipe by rigorous and careful experimentation.
• Collaborate with the product team and other engineers and researchers across Microsoft AI to identify gaps in the current generation of models.
• Embody our culture and values.
  
  

Required/Minimum Qualifications

• Bachelor's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND experience in business analytics, data science, software development, data modeling or data engineering work
• OR Master's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND experience in business analytics, data science, software development, or data engineering work
• Experience with HPC (High performance computing) and/ or parallel programming?
• Experience in the area of pretraining
• Experience working with GPU clusters
  
  

Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, color, family or medical care leave, gender identity or expression, genetic information, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran status, race, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable laws, regulations and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or the recruiting process, please send a request via the Accommodation request form.

Benefits/perks listed below may vary depending on the nature of your employment with Microsoft and the country where you work.

#Copilot #MicrosoftAI

Seniority level

• Seniority level

  Not Applicable

Employment type

• Employment type

  Full-time

Job function

• Job function

  Other

• Industries

  Software Development

Referrals increase your chances of interviewing at Microsoft by 2x

Sign in to set job alerts for “Member of Technical Staff” roles.

Member of Technical Staff, Product Engineer

London, England, United Kingdom 4 days ago

Member of Technical Staff, Product Engineer

London, England, United Kingdom 3 weeks ago

Ealing, England, United Kingdom 2 weeks ago

London, England, United Kingdom 2 months ago

London, England, United Kingdom 1 week ago

London, England, United Kingdom 3 weeks ago

London, England, United Kingdom 1 week ago

London, England, United Kingdom 2 weeks ago

London, England, United Kingdom 3 weeks ago

R&D Tax - Senior Clinical / Veterinary Consultant

London, England, United Kingdom 6 days ago

London, England, United Kingdom 2 weeks ago

Regional Operations Manager - London & East of England

London, England, United Kingdom 2 weeks ago

Principal Geo-Environmental Consultant (hybrid)

London, England, United Kingdom 1 month ago

Transfer Pricing and International Tax Manager

London, England, United Kingdom 1 week ago

London, England, United Kingdom 2 weeks ago

Membership Development Director, 6 Month FTC

London, England, United Kingdom 5 days ago

US Private Client Senior Tax Manager/ Associate Director

London, England, United Kingdom 2 days ago

London, England, United Kingdom 4 days ago

London, England, United Kingdom 4 days ago

London, England, United Kingdom 1 week ago

Member of Technical Staff, AI Post-Training

London, England, United Kingdom 2 weeks ago

Member of Technical Staff, AI Multimodal

London, England, United Kingdom 2 weeks ago

London, England, United Kingdom 2 weeks ago

Member of Technical Staff, AI Pretraining

London, England, United Kingdom 2 weeks ago

London, England, United Kingdom 3 weeks ago

Member of Technical Staff, AI Multimodal

London, England, United Kingdom 3 weeks ago

Member of Technical Staff, AI Pretraining

London, England, United Kingdom 3 weeks ago

Member of Technical Staff, AI Post-Training

London, England, United Kingdom 3 weeks ago

London, England, United Kingdom $99,998.00-$200,000.00 11 months ago

Member of Technical Staff, AI Pretraining Platform

London, England, United Kingdom 3 weeks ago

Member of Technical Staff, AI - Reinforcement Systems

London, England, United Kingdom 3 weeks ago

Member of Technical Staff, Agent Infrastructure Engineer

London, England, United Kingdom 4 days ago

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.