Research Scientist Intern, Systems ML - SW/HW Co-Design - CPUSys (PhD)

Meta; Menlo Park (CA); On-site; USD 34,440,000 - 55,104,000; Full time

Job summary

Meta is seeking Research Scientist Interns for the Systems SW/HW Co-design CPUSys team to help define next-generation compute and storage architectures within Meta's datacenter footprint. The role involves collaborating with internal software and platform teams to understand workloads and infrastructure requirements, and to drive technology path-finding and adoption plans.

The internship lasts 12 to 24 weeks with multiple start dates throughout the year.

Qualifications

• Pursuing PhD in CS or related STEM field.
• Experience with hardware architecture, compute technologies and/or storage systems.
• Must have work authorization in the country of employment at time of hire.
• Architectural understanding of CPU, GPU, accelerators, networking and storage systems.
• Experience with large-scale infrastructure, distributed systems, and server analysis.
• Experience with C/C++, Rust, Python and/or PyTorch.

Responsibilities

• Develop tools and methodologies for large scale workload analysis and extract representative benchmarks in C++/Rust/Python/Hack to drive early evaluation of upcoming platforms.
• Analyze evolving Meta workload trends to derive requirements for future offerings.
• Apply in-depth knowledge of how distributed systems interact with compute and storage systems.
• Utilize understanding of CPUs, Flash/HDD storage, networking, and GPUs to identify bottlenecks and improve efficiency.
• Collaborate with software developers to re-architect services and reduce resource consumption.
• Identify industry trends and disruptive paradigms; conduct prototyping to quantify value proposition for Meta.
• Influence vendor hardware roadmap and align with Meta's roadmap requirements.
• Work with cross-functional teams to deliver hardware roadmap into production and drive adoption.

Skills

Team leadership

Cross-functional collaboration

Quantitative analysis

Public speaking / communication

Education

PhD in Computer Science or related STEM field

Tools

C/C++

Rust

Python

PyTorch

Job description

About

The System SW/HW Co-design team’s mission is to explore, develop and help productize high-performance software and hardware technologies for applications at datacenter scale. We achieve this via concurrent design and optimization of many aspects of the system such as models, algorithms, numerics, performance and hardware including compute, networking and storage. In essence, we drive the HW roadmap at Meta and ensure our existing and future system workloads and software are well optimized and suited for the next-generation hardware infrastructure.Meta is seeking Research Scientist Interns to join our Systems Co-Design CPUSys team to drive the definition of our next-generation compute and storage architectures. In this role, you will work with internal software and platforms engineering teams to understand the workloads and infrastructure requirements. You will drive technology path-finding, roadmap definition and co-design activities to deliver new capabilities and efficient systems for our fleet.Join our team and help shape one of the largest infrastructure footprints which powers Meta’s applications used by billions of people across the globe.Our team at Meta System SW/HW Co-design offers twelve (12) to twenty-four (24) weeks long internships and we have various start dates throughout the year. To learn more about our research, visit https://aisystemcodesign.github.io.

Responsibilities

• Develop tools and methodologies for large scale workload analysis and extract representative benchmarks (in C++/Rust/Python/Hack) to drive early evaluation of upcoming platforms.
• Analyze evolving Meta workload trends and business needs to derive requirements for future offerings.
• Apply in depth knowledge of how the distributed systems interact with the compute and storage systems around.
• Utilize extensive understanding of CPUs (x86/ARM), Flash/HDD storage systems, networking, and GPUs to identify bottlenecks and enhance product/service efficiency.
• Collaborate closely with software developers to re-architect services, improve codebase through algorithm redesign, reduce resource consumption, and identify hardware/software co-design opportunities.
• Identify industry trends, analyze emerging technologies and disruptive paradigms.
• Conduct prototyping exercises to quantify the value proposition for Meta and develop adoption plans.
• Influence vendor hardware roadmap and broader ecosystem to align with Meta's roadmap requirements.
• Work with Software Services, Product Engineering, and Infrastructure Engineering teams to find the optimal way to deliver the hardware roadmap into production and drive adoption.

Minimum Qualifications

• Currently in the process of obtaining, PhD degree in the field of Computer Science or a related STEM field
• Experience with hardware architecture, compute technologies and/or storage systems
• Must obtain work authorization in the country of employment at the time of hire, and maintain ongoing work authorization during employment Proven track record of achieving results as demonstrated by grants, fellowships, patents, as well as first-authored publications at leading workshops or conferences such as MICRO, ISCA, HPCA, ASPLOS, ATC, SOSP, OSDI, MLSys or similar
• Architectural understanding of CPU, GPU, Accelerators, Networking, Flash/HDD Storage systems
• Some experience with large-scale infrastructure, distributed systems, full stack analysis of server applications
• Experience or knowledge in developing and debugging in C/C++, Rust, Python and/or PyTorch
• Experience leading a team in solving analytical problems using quantitative approaches
• Experience in theoretical and empirical research and for answering questions with research
• Experience communicating research for public audiences of peers
• Experience working and communicating cross functionally in a team environment
• Intent to return to a degree-program after the completion of the internship/co-op