Principal Machine Learning Engineer - Large Scale Embedding Remote - United States

Reddit, Inc.; United States; Remote; USD 276,000 - 388,000; Full time

Job summary

An innovative company is seeking a Principal Machine Learning Engineer to lead the design of advanced embedding architectures. This role involves developing scalable GNN and transformers for enhancing recommendation systems, optimizing ML pipelines, and collaborating with cross-functional teams to drive impactful ML initiatives. If you are passionate about applying machine learning to improve user relevance and thrive in a dynamic environment, this position offers a unique opportunity to shape the future of recommendation technologies. Join a forward-thinking team dedicated to pushing the boundaries of what's possible in the ML space.

Benefits

Medical Insurance

Dental Insurance

Vision Insurance

401(k) with Employer Match

Generous Vacation Time

Parental Leave

Equity in the form of RSUs

Qualifications

• Proven ability to lead ML initiatives and mentor engineers.
• Strong coding skills in Python with expertise in ML frameworks.

Responsibilities

• Lead the team in designing GNN and transformers for embedding generation.
• Develop large-scale graph-based ML pipelines for recommendation systems.

Skills

Graph Neural Networks

Deep Learning

Python

Collaborative Filtering

Knowledge Graphs

Education

15+ years of Technical Leadership Experience

Tools

PyTorch Geometric

Deep Graph Library

TensorFlow

scikit-learn

Job description

Principal Machine Learning Engineer - Large Scale Embedding

Remote - United States

Reddit is a community of communities. It’s built on shared interests, passion, and trust and is home to the most open and authentic conversations on the internet. Every day, Reddit users submit, vote, and comment on the topics they care most about. With 100,000+ active communities and approximately 101M+ daily active unique visitors, Reddit is one of the internet’s largest sources of information. For more information, visit redditinc.com.

The LS Embedding team will focus on building highly expressive multi-entity large scale embeddings exploring architectures beyond standard two-tower approaches to enhance our recommendation systems at Reddit. This entails modelling various compound interactions and relationships between users and entities they interact with using Graphs and exploring Graph neural networks and transformers to encode them.

We are looking for a Principal Machine Learning Engineer to lead the design and architecture of GNN and transformers based multi-entity embedding generation, actively participating in the end-to-end implementation process including enabling efficient distributed training and serving for such architectures, shaping the future of recommendation systems at Reddit.

If applying ML / AI in production to improve Reddit Relevance excites you, then you’ve found the right place.

RESPONSIBILITIES:

• Lead the team that architects and designs GNN and transformers based multi-entity embedding generation.
• Define the technical roadmap and plan of execution in collaboration with Xfn partners.
• Develop and optimize large-scale graph-based machine learning pipelines for recommendation systems.
• Architect scalable and efficient GNN and transformers-based recommendation models that can process complex, interconnected data structures.
• Collaborate with cross functional business units such as Ads teams leveraging the models for upstream functions and improve relevance metrics.
• Collaborate with ML Infrastructure teams to enable distributed GPU based training and online serving architecture.
• Lead feature engineering efforts to identify and curate expressive raw data to be used for creating embeddings.
• Be a mentor and cross-functional advocate for the team.
• Contribute towards team and product strategy, operations, and execution at Reddit.

QUALIFICATIONS:

• 15+ years of Technical Leadership Experience.
• Proven ability to lead ML initiatives, mentor engineers, and communicate complex concepts to cross-functional teams.
• Expertise in Graph Neural Networks, collaborative filtering, knowledge graphs, and deep learning for recommendations.
• Understanding of graph theory, network science, and representation learning techniques.
• Strong coding skills in Python and experience with ML frameworks like PyTorch Geometric (PyG), Deep Graph Library (DGL), TensorFlow, and scikit-learn.
• Solid understanding of ML infrastructure components and libraries (data parallel, model parallel, pipeline parallel, torch.inductor, model pruning, etc.) enabling efficient distributed training and inference.

Pay Transparency:

This job posting may span more than one career level.

In addition to base salary, this job is eligible to receive equity in the form of restricted stock units, and depending on the position offered, it may also be eligible to receive a commission. Additionally, Reddit offers a wide range of benefits to U.S.-based employees, including medical, dental, and vision insurance, 401(k) program with employer match, generous time off for vacation, and parental leave. To learn more, please visit redditinc.com/careers.

The base pay range for this position is:

$276,700 - $387,400 USD

Reddit is proud to be an equal opportunity employer, and is committed to building a workforce representative of the diverse communities we serve. Reddit is committed to providing reasonable accommodations for qualified individuals with disabilities and disabled veterans in our job application procedures. If you need assistance or an accommodation due to a disability, please contact us at [e-mail].