Remote Foundational Models Research Engineer

Pathway; Palo Alto (CA); On-site; USD 120,000 - 210,000; Full time

Benefits offered by this job

Remote work

Employee Stock Option Plan

Global offices

Job summary

Pathway is seeking 1 or 2 R&D Engineers to work on an extremely ambitious foundational project focused on attention-based models. The role involves distributed model training, experimentation, and driving new benchmarks to advance how AI learns from long sequences.

The team values hands-on experimentation with PyTorch/Jax/TF, strong knowledge of GPU architectures, and a passion for foundational AI research.

Qualifications

• Publications in top ML venues (NeurIPS/ICLR/ICML) or equivalent demonstrable impact on LLM training.
• Significant hands-on experience with large-scale model training and distributed systems.
• Experience in research centers or top institutes is highly desirable.
• Proven track record of contributing to foundational AI research and benchmarks.

Responsibilities

• Conduct distributed model training and evaluation.
• Iterate on architectural improvements based on experimental results.
• Design and run new tasks/benchmarks to test model capabilities.
• Oversee data preparation activities when needed.

Skills

Language Models / RL

Deep Learning Research

English Fluency

Hands-on Experiments

Tools

PyTorch

Jax

TensorFlow

Triton

Job description

Pathway is seeking 1 or 2 R&D Engineers to work on an extremely ambitious foundational project focused on attention-based models. The role involves distributed model training, experimentation, and driving new benchmarks to advance how AI learns from long sequences.

The team values hands-on experimentation with PyTorch/Jax/TF, strong knowledge of GPU architectures, and a passion for foundational AI research.