Senior Principal ML Engineer: LLMs on Custom AI Hardware

SambaNova; San Jose (CA); On-site; USD 220,000 - 300,000; Full time

Benefits offered by this job

Health insurance

HSA

Equity

Wellness programs

Job summary

SambaNova Systems is seeking a Senior Principal ML Engineer to design, develop, and optimize ML models for their RDU accelerator and SambaStack/SambaCloud platform. You’ll lead model architectures, improve training and inference efficiency, and drive co-design efforts with compiler, systems and hardware teams.

You will mentor senior engineers, guide product roadmaps, and help translate complex ML capabilities into scalable, customer-facing solutions across the SambaNova ecosystem.

Qualifications

• Bachelor's degree in CS, EE, or related field.
• 8+ years of industry ML engineering experience with leadership on large-scale ML systems.
• Deep expertise in LLM training, fine-tuning, inference optimization and evaluation.
• Ability to lead cross-functional technical efforts and mentor engineers.
• Experience with hardware-software co-design in accelerator environments.
• Publications or open-source contributions in ML are a plus.

Responsibilities

• Define and drive technical strategy for ML model development, training pipelines and inference systems on SambaNova's RDU and hardware ecosystem.
• Lead hardware-software co-design with compiler, systems and hardware teams to unlock scalable performance.
• Guide integration of LLM solutions into production systems and customer-facing products like SambaStack and SambaCloud.
• Mentor senior ML engineers and influence product and engineering roadmaps.
• Collaborate with product and leadership to translate ML capabilities into scalable customer solutions.

Job description

SambaNova Systems is seeking a Senior Principal ML Engineer to design, develop, and optimize ML models for their RDU accelerator and SambaStack/SambaCloud platform. You’ll lead model architectures, improve training and inference efficiency, and drive co-design efforts with compiler, systems and hardware teams.

You will mentor senior engineers, guide product roadmaps, and help translate complex ML capabilities into scalable, customer-facing solutions across the SambaNova ecosystem.