Machine Learning Researcher / Engineer (Foundational Models)

Pathway Genomics Corporation; Menlo Park, California, Paris (CA, MO, TX); Hybrid; USD 100,000 - 1,000,000; Full time

Job summary

An early-stage AI startup is seeking R&D Engineers to push the boundaries of Live AI and machine learning. This role offers the chance to work on groundbreaking projects with a flexible GPU budget, collaborating with top-tier professionals in a stimulating environment. You will engage in hands-on experiments, contribute to innovative model architectures, and play a crucial role in the success of the project. If you have a passion for deep learning and are eager to make an impact in the AI landscape, this opportunity is perfect for you. Join a vibrant community and be part of a transformative journey in AI research!

Benefits

Employee Stock Option Plan

Flexible GPU Budget

Intellectually Stimulating Work Environment

Qualifications

• Strong track record in machine learning models research with publications.
• Experience with distributed model training and improving architectures.

Responsibilities

• Perform distributed model training and adapt architectures based on results.
• Design new tasks and oversee data preparation activities.

Skills

Deep Learning Research

Machine Learning Models Research

Hands-on Experiments

Graph Algorithms

Fluent in English

Education

Lead Author on Research Paper

Experience in Leading ML Research Center

ICPC World Finalist or Medalist

Tools

PyTorch

Jax

TensorFlow

Git

CI/CD

Build Systems

Job description

About Pathway

Pathway is an enabler for Live AI, allowing organizations to run contextualized ML models connected to ever-changing enterprise data. In addition to being an infrastructure provider delivering an AI framework, we are working to advance the state-of-the-art.

This is an R&D position in attention-based models.

Pathway is VC-funded, with some amazing BAs (such as Lukasz Kaiser, co-inventor of Transformers). Pathway's CTO has co-authored papers with Geoff Hinton and Yoshua Bengio. We have just raised a $10M+ seed, with exciting developments ahead. The management team includes growth leaders who have scaled companies with multiple exits, and who have built online communities reaching millions of users.

Our client portfolio is focused around mobility, IoT data, logs and transactions, and also includes larger actors such as NATO and national postal services. We have a vibrant community centered around our developer frameworks, with almost 10,000 stars on GitHub.

Our offices are in Menlo Park, CA, as well as Paris, France and Wroclaw, Poland.

The Opportunity

We are currently searching for 1 or 2 R&D Engineers with a strong track record in machine learning models research.

This is an extremely ambitious foundational project. There is a flexible GPU budget associated with this specific project, guaranteed to be in the 7-digit range minimum.

You Will

• Perform (distributed) model training.
• Help improve/adapt model architectures based on experiment results.
• Design new tasks and experiments.
• Optionally: Oversee activities of team members involved in data preparation.
  

The results of your work will play a crucial role in the success of the project.

You Are Expected to Meet at Least One of the Following Criteria:

1. You have published at least one paper at NeurIPS, ICLR, or ICML - where you were the lead author or made significant conceptual & code contributions.
2. You have significantly contributed to an LLM training effort which became newsworthy (topped a Huggingface benchmark, best in class model, etc.), preferably using multiple GPUs.
3. You have spent at least 6 months working in a leading Machine Learning research center (e.g. at: Google Brain / Deepmind, Apple, Meta, Anthropic, Nvidia, MILA).
4. You were an ICPC World Finalist, or an IOI, IMO, or IPhO medalist in High School.
   

You Are

• A deep learning researcher, with a track record in Language Models and/or RL (candidates with a Vision or Robotics ML background are also welcome to apply).
• Interested in improving foundational architectures and creating new benchmarks.
• Experienced at hands-on experiments and model training (PyTorch, Jax, or Tensorflow).
• Have a good understanding of GPU architecture, memory design, and communication.
• Have a good understanding of graph algorithms.
• Have some familiarity with model monitoring, git, build systems, and CI/CD.
• Respectful of others.
• Fluent in English
  

Bonus Points

• Knowledge of approaches used in distributed training.
• Familiarity with Triton.
• Successful track record in algorithms & data science contests.
• Showing a code portfolio.

Why You Should Apply

• Join an intellectually stimulating work environment.
• Be a pioneer: you get to work with a new type of "Live AI" challenges around long sequences and changing data.
• Be part of an early-stage AI startup that believes in impactful research and foundational changes.

• Type of contract: Full-time, permanent.
• Preferable joining date: January 2025. The positions are open until filled – please apply immediately.
• Compensation: six-digit annual salary based on profile and location + Employee Stock Option Plan.
• Location: Remote work. Possibility to work or meet with other team members in one of our offices: Menlo Park, CA, Paris, France, or Wroclaw, Poland. As a general rule, permanent residence will be required in the EU, UK, US, or Canada.

If you meet our broad requirements but are missing some experience, don’t hesitate to reach out to us.