Staff ML Engineer - LLMs/MoE Lead, On-Device AI (Remote)

webAI; United States; Hybrid; USD 180,000 - 240,000; Full time

Benefits offered by this job

Health, dental & vision

401(k) match

Equity options

Wellness stipend

Continuing Education

Parental leave

Free parking

Flexible Time Off

Job summary

webAI is seeking a Staff Machine Learning Engineer with deep expertise in Large Language Models and Mixture of Experts. You will lead core product initiatives around on-device inference optimization, quantization, RAG, agentic framework, and tool calling while delivering end-to-end ML solutions with cross-functional teams.

The role is based in Austin, TX, with remote work possible for the right skillset. You will mentor engineers and drive research that advances enterprise AI capabilities at

Qualifications

• PhD preferred in Computer Science or related field.
• Proven track record of building and innovations through publications or industry experience.
• Minimum of 6 years of ML experience with LLMs/MoEs.
• Strong Python and ML framework skills (TensorFlow and/or PyTorch).
• Ability to lead complex projects and collaborate in a team.

Responsibilities

• Lead development and optimization of LLMs and MoEs.
• Collaborate with cross-functional teams to integrate ML models into the platform.
• Conduct cutting-edge ML research to improve performance and efficiency of LLMs.
• Stay updated on AI/ML advancements and apply them to improve models.
• Mentor junior engineers and contribute to knowledge sharing.

Skills

LLMs

MoEs

Python

TensorFlow

PyTorch

Leadership

Education

Ph.D. preferred

Tools

AWS

Azure

GCP

Docker

Kubernetes

Job description

webAI is seeking a Staff Machine Learning Engineer with deep expertise in Large Language Models and Mixture of Experts. You will lead core product initiatives around on-device inference optimization, quantization, RAG, agentic framework, and tool calling while delivering end-to-end ML solutions with cross-functional teams.

The role is based in Austin, TX, with remote work possible for the right skillset. You will mentor engineers and drive research that advances enterprise AI capabilities at