Machine Learning Architect

Ayo Semiconductor; Boston (MA); On-site; USD 180,000 - 240,000; Full time

Benefits offered by this job

Equity

Health benefits

On-site in Boston

Ownership

Job summary

Ayo Semiconductor in Boston is seeking a founding ML practitioner to join as a core member, deploying and training models on prototype chips and digital twins, and collaborating with hardware engineers to shape processor architecture.

You will work across distributed training, model deployment, and performance optimization, with equity ownership and onsite collaboration; no prior hardware experience required, just a drive to learn and lead in a frontier hardware startup.

Qualifications

• PhD in machine learning, representation learning, theory of computation, or equivalent industry experience.
• Experience training models at scale across many GPUs and large datasets.
• Built and trained neural networks from scratch.
• Understanding internal operation of neural networks and interpretability is a plus.

Responsibilities

• Deploy and run trained models on prototype hardware and digital twins, producing demonstrations.
• Develop and adapt algorithms to train models on novel processing environments.
• Collaborate with hardware engineers to refine processor architecture based on model insights.
• Maintain curiosity about how ML systems run on new hardware and apply it accordingly.
• Support go-to-market strategy development.

Skills

Deep learning

Distributed training

Python

ML research

Interdisciplinary collaboration

Education

PhD in machine learning

Tools

PyTorch

TensorFlow

JAX

Job description

About Ayo

We are a venture-backed early-stage startup developing processors specialized for machine learning. The processor will provide orders or magnitude improvement in speed and power efficiency with a goal of unseating the GPU as the dominant computing platform for AI.

The Role

We are seeking a deep ML practitioner to join as a founding team member - someone with hands-on experience working on or alongside a foundation model at scale, who understands what happens under the hood when splitting jobs across thousands of GPUs, and who is excited to bring that depth to novel hardware. They have a full-stack understanding of machine learning architectures, love to optimize algorithms across disciplinary boundaries, and will deploy and train models directly on our prototype chips to help us prove out what our processor can do - no prior hardware experience required.

What You’ll Do:

• Deploy and run trained models on prototype hardware and digital twins, producing working demonstrations on our chips.

• Develop and adapt algorithms to train models on novel processing environments, including our prototype hardware.

• Work with hardware engineers to define and refine processor architecture based on insights learned through model training and experimentation.

• Maintain a deep curiosity about what makes machine learning systems work - and bring that curiosity to bear on how they run on new hardware.

• Support go-to-market strategy development

What We’re Looking For:

• PhD in machine learning, representation learning, theory of computation, or a related field - or equivalent industry experience working on foundation models at scale.

• Experience training models at scale - distributed training across many GPUs, working with large datasets and compute.

• Has built and trained neural networks from scratch

• Deep knowledge of the structure and internal operation of neural networks - including how and why they behave the way they do (e.g. interpretability or explainability work is a plus).

• Excitement about applying deep AI expertise to new and novel hardware environments - you don’t need prior experience with photonics or silicon, but you want to learn.

• Fluent knowledge of Python

• Fluency in PyTorch (preferred), TensorFlow, JAX, or other industry-standard ML software libraries

Why Ayo

• You'll be a founding AI team member - shaping how we think about and deploy AI as a company.

• We are working on a genuinely hard and interesting problem: unseating the GPU as the dominant AI compute platform.

• Early-stage means real ownership, real impact, and meaningful equity.

• Competitive salary. Equity commensurate with stage and seniority. Benefits package including health, dental, and vision.

• Fully onsite in Boston - we are a collaborative, in-person team.