Principal Machine Learning Engineer - Large Scale Embedding

Reddit, Inc.; United States; Remote; USD 276,000 - 388,000; Full time

Job summary

An innovative company is seeking a Principal Machine Learning Engineer to lead the design of advanced multi-entity embedding generation using Graph Neural Networks and transformers. This role involves architecting scalable recommendation models and optimizing large-scale machine learning pipelines. With a focus on collaboration across various teams, you will mentor engineers and contribute to shaping the future of recommendation systems. If you are passionate about applying machine learning to enhance relevance and user experience, this is an exciting opportunity to make a significant impact in a dynamic environment.

Benefits

Medical, dental, and vision insurance

401(k) program with employer match

Generous vacation time

Parental leave

Equity in the form of restricted stock units

Qualifications

• 15+ years of technical leadership experience in machine learning.
• Expertise in GNNs and deep learning for recommendations.

Responsibilities

• Lead the design of GNN and transformers for embedding generation.
• Develop large-scale graph-based ML pipelines for recommendations.

Skills

Graph Neural Networks

Deep Learning

Python

Collaborative Filtering

Knowledge Graphs

Education

Bachelor's Degree in Computer Science or related field

Master's Degree or PhD preferred

Tools

PyTorch Geometric

Deep Graph Library

TensorFlow

scikit-learn

Job description

Principal Machine Learning Engineer - Large Scale Embedding

Remote - United States

Reddit is a community of communities. It’s built on shared interests, passion, and trust and is home to the most open and authentic conversations on the internet. Every day, Reddit users submit, vote, and comment on the topics they care most about. With 100,000+ active communities and approximately 101M+ daily active unique visitors, Reddit is one of the internet’s largest sources of information. For more information, visit redditinc.com.

The LS Embedding team will focus on building highly expressive multi-entity large scale embeddings exploring architectures beyond standard two-tower approaches to enhance our recommendation systems at Reddit. This entails modelling various compound interactions and relationships between users and entities they interact with using Graphs and exploring Graph neural networks and transformers to encode them.

We are looking for a Principal Machine Learning Engineer to lead the design and architecture of GNN and transformers based multi-entity embedding generation actively participating in end-to-end implementation process including enabling efficient distributed training and serving for such architectures shaping the future of recommendation systems at Reddit.

If applying ML / AI in production to improve Reddit Relevance excites you, then you’ve found the right place.

RESPONSIBILITIES:

• Lead the team that architects and designs GNN and transformers based multi-entity embedding generation.
• Define the technical roadmap and plan of execution in collaboration with Xfn partners.
• Develop and optimize large-scale graph-based machine learning pipelines for recommendation systems.
• Architect scalable and efficient GNN and transformers-based recommendation models that can process complex, interconnected data structures.
• Collaborate with cross functional business units such as Ads teams leveraging the models for upstream functions and improve relevance metrics.
• Collaborate with ML Infrastructure teams to enable distributed GPU based training and online serving architecture.
• Lead feature engineering efforts to identify and curate expressive raw data to be used for creating embeddings.
• Be a mentor and cross-functional advocate for the team.
• Contribute towards team and product strategy, operations and execution at Reddit.

QUALIFICATIONS:

• 15+ years of Technical Leadership Experience.
• Proven ability to lead ML initiatives, mentor engineers, and communicate complex concepts to cross-functional teams.
• Expertise in Graph Neural Networks, collaborative filtering, knowledge graphs, and deep learning for recommendations.
• Understanding of graph theory, network science, and representation learning technique.
• Strong coding skills in Python and experience with ML frameworks like PyTorch Geometric (PyG), Deep Graph Library (DGL), TensorFlow, and scikit-learn.
• Solid understanding of ML infrastructure components and libraries (data parallel, model parallel, pipeline parallel, torch.inductor, model pruning, etc.) enabling efficient distributed training and inference.

Pay Transparency:

This job posting may span more than one career level.

In addition to base salary, this job is eligible to receive equity in the form of restricted stock units, and depending on the position offered, it may also be eligible to receive a commission. Additionally, Reddit offers a wide range of benefits to U.S.-based employees, including medical, dental, and vision insurance, 401(k) program with employer match, generous time off for vacation, and parental leave. To learn more, please visit redditinc.com/careers.

The base pay range for this position is:

$276,700 - $387,400 USD

Reddit is proud to be an equal opportunity employer, and is committed to building a workforce representative of the diverse communities we serve.

Apply for this job

* indicates a required field

First Name *

Last Name *

Email *

Phone *

Location (City) *

Resume/CV *

LinkedIn Profile

How did you hear about this job? *

Are you currently authorized to work in the U.S.? * Select...

Do you now, or will you in the future, require immigration sponsorship to work at Reddit? * Select...

By selecting "I agree," I understand that the information I have provided as part of this job application will be processed in accordance with Reddit's Candidate Privacy Policy. * Select...

Provide a brief description of your experience working on large scale recommendation systems. *

Provide a brief description of your experience creating multi-entity embeddings with GNNs and transformers. *