Machine Learning Researcher / Engineer (Foundational Models)

Talantir; Paris; Remote; EUR 100,000 - 150,000; Full time

Benefits offered by this job

Remote work

Office options: Paris, Palo Alto, Wró

Job summary

Pathway is seeking 1–2 R&D Engineers for an ambitious foundational project on attention-based models. You will train distributed models, adapt architectures, and design new experiments with a flexible GPU budget, aiming for a six-digit salary depending on profile and location.

Remote-friendly position with potential office meetings in Paris, Palo Alto, or Wroclaw. Join a pioneering AI startup focused on long-sequence and dynamic data challenges.

Qualifications

• Publications in NeurIPS/ICLR/ICML or significant conceptual/code contributions.
• Contributed to an LLM training effort with multi-GPU setups.
• Minimum 6 months in a leading ML research center (e.g., Google Brain, DeepMind, Nvidia).
• Deep learning researcher with focus on Language Models and/or RL.
• Experienced with PyTorch, Jax, or TensorFlow.
• Understanding of GPU architectures, memory design, and communication.
• Familiarity with model monitoring, git, build systems, and CI/CD.

Responsibilities

• Perform distributed model training and experiment design.
• Improve/adapt model architectures based on results.
• Design tasks and experiments to advance the project.
• Optionally oversee data preparation activities.

Skills

Fluent English

PyTorch

Jax

TensorFlow

GPU architecture

Graph algorithms

Hands-on experiments

Distributed training

Code portfolio

General research

Tools

Git

CI/CD

Build systems

Job description

About Pathway

Pathway at Pathway we are shaking the foundations of artificial intelligence by introducing the world's first post-transformer model that adapts and thinks just like humans.Our breakthrough architecture outperforms Transformer and provides the enterprise with full visibility into how the model works. Combining the foundational model with the fastest data processing engine on the market, Pathway enables enterprises to move beyond incremental optimization and toward truly contextualized, experience-driven intelligence. We are trusted by organizations such as NATO, La Poste, and Formula 1 racing teams.Pathway is led by co-founder & CEO Zuzanna Stamirowska, a complexity scientist who created a team consisting of AI pioneers, including CTO Jan Chorowski who was the first person to apply Attention to speech and worked with Nobel laureate Geoff Hinton at Google Brain, as well as CSO Adrian Kosowski, a leading computer scientist and quantum physicist who obtained his PhD at the age of 20.The company is backed by leading investors and advisors, including Lukasz Kaiser, co-author of the Transformer ("the T" in ChatGPT) and a key researcher behind OpenAI's reasoning models. Pathway is headquartered in Palo Alto, California.

The Opportunity

This is an R&D position in attention-based models. We are currently searching for 1 or 2 R&D Engineers with a strong track record in machine learning models research.This is an extremely ambitious foundational project. There is a flexible GPU budget associated with this specific project, guaranteed to be in the 7-digit range minimum.

You Willperform (distributed) model traininghelp improve/adapt model architectures based on experiment resultsdesign new tasks and experimentsoptionally: oversee activities of team members involved in data preparation. The results of your work will play a crucial role in the success of the project.

Requirements

• You are expected to meet at least one of the following criteria:
• You have published at least one paper at NeurIPS, ICLR, or ICML - where you were the lead author or made significant conceptual & code contributions.
• You have significantly contributed to an LLM training effort which became newsworthy (topped a Huggingface benchmark, best in class model, etc.), preferably using multiple GPU's
• You have spent at least 6 months working in a leading Machine Learning research center (e.g. at: Google Brain / Deepmind, Apple, Meta, Anthropic, Nvidia, MILA)
• You were an ICPC World Finalist, or an IOI, IMO, or IPhO medalist in High School.
• You Are A deep learning researcher, with a track record in Language Models and/or RL (candidates with a Vision or Robotics ML background are also welcome to apply)
• Interested in improving foundational architectures and creating new benchmarks
• Experienced at hands-on experiments and model training (PyTorch, Jax, or Tensorflow)
• Have a good understanding of GPU architecture, memory design, and communication
• Have a good understanding of graph algorithms
• Have some familiarity with model monitoring, git, build systems, and CI/CD
• Respectful of others
• Fluent in English

Bonus Points

• Knowledge of approaches used in distributed training
• Familiarity with Triton
• Successful track-record in algorithms & data science contests
• Showing a code portfolio

Why You Should Apply

Join an intellectually stimulating work environment

Be a pioneer: you get to work with a new type of "Live AI" challenges around long sequences and changing data

Be part of one of an early-stage AI startup that believes in impactful research and foundational changes

Benefits

• Type of contract: Full-time, permanent
• Preferable joining date: Immediate.
• The positions are open until filled
• Compensation: six-digit annual salary based on profile and location + Employee Stock Option Plan
• Location: Remote work.
• Possibility to work or meet with other team members in one of our offices: Palo Alto, CA; Paris, France or Wroclaw, Poland.
• Candidates based anywhere in the EU, UK, United States, and Canada will be considered

If you meet our broad requirements but are missing some experience