Research Scientist - Machine Learning

Extropic; Boston (MA); On-site; PHP 9,253,546 - 15,422,577; Full time

Job summary

Extropic’s hardware massively accelerates certain kinds of probabilistic inference, and our ML team researches training models in the thermodynamic paradigm. Senior hires lead their own research direction across hardware, software, physics, and math.

Extropic is seeking senior researchers and engineers to derive probabilistic ML theory, empirically demonstrate scaling properties, deploy performant models, publish papers, contribute to open source, and create production models for domain experts

Qualifications

• Experience with scientific Python and deep learning frameworks.
• Strong foundations in probability and linear algebra.
• Familiarity with DL theory and scaling laws.
• Publications in top ML conferences.
• Experience training high-performance models and related infra.
• Experience deploying models with modern tools.

Responsibilities

• Collaborate with researchers, residents, engineers, and physicists to develop theory of probabilistic models and learning rules.
• Scale experimentation infrastructure and optimize model design space.
• Implement, visualize, and evaluate new architectures, training algorithms, and benchmarks.
• Publish papers, contribute to open source, and communicate design insights to hardware team.
• Create production models for domain experts using customer data.

Skills

Scientific Python

Deep learning frameworks

Probability & linear algebra

Publications in ML conferences

Scale training infra

Model deployment

Tools

Slurm

Ray

Weights & Biases

AWS

ONNX

Job description

Overview

Extropic’s hardware massively accelerates certain kinds of probabilistic inference. Our ML team works on the science of training models in the thermodynamic paradigm, and we are looking for senior research and engineering talent to derive probabilistic ML theory, empirically demonstrate its scaling properties, and deploy performant models. Senior hires will be leading their own research direction and are therefore expected to quickly become experts across our abstraction stack, including the hardware, software, physics, and math.

Responsibilities

• Collaborate with senior researchers, residents, engineers, and physicists to derive the theory of new probabilistic models and their learning rules, including energy-based models and diffusion models.
• Scale up experimentation infrastructure and optimize over the design space of models.
• Implement, visualize, and evaluate new architectures, training algorithms, and benchmarks.
• Publish papers, contribute to open source, and communicate design insights to our hardware team.
• Create production models for domain experts using customer data.

Required Qualifications

• Experience in scientific Python and at least one deep learning framework (PyTorch, JAX, TensorFlow, Keras)
• Extremely strong foundations in probability and linear algebra
• Familiarity with deep learning theory and literature, including theory of over-parameterization and scaling laws
• Publications in top ML conferences (NeurIPS, ICML, ICLR, CVPR)
• Experience training high-performance models, including familiarity with infrastructure (Slurm, Ray, Weights & Biases)
• Experience deploying models, including familiarity with infrastructure (Ray, AWS, ONNX)

Preferred Qualifications

• Experience designing probabilistic graphical models (PGM)
• Experience training energy-based models (EBMs) or diffusion models
• Experience with numerical methods in diffeq solvers
• Experience with message passing or training graph neural networks (GNNs)
• Strong theoretical background in information geometry
• Strong theoretical background in random matrix theory
• Strong grasp of computational Bayesian methods, including MCMC sampling methods and variational inference

Salary: $150,000 - $250,000 a year. Salary and equity compensation will vary with experience.

Extropic is an equal opportunity employer