Engineering Manager, Scalable ML Training Infra

Woven by Toyota; Palo Alto (CA); On-site; USD 140,000 - 260,000; Full time

Benefits offered by this job

Health, dental and vision coverage

401(k) program

Flexible vacation policy

Family planning and care benefits

Job summary

Woven by Toyota, based in California, seeks an Engineering Manager to lead the ML Training Infrastructure team. You will shape technical direction, foster an engineering culture, and drive the long-term evolution of our ML training platform for scalable, reliable model development.

You will mentor a team of 7–8 engineers, collaborate with cross‑functional partners, and own the architecture of distributed GPU clusters, Kubernetes, and ML pipelines to accelerate innovation.

Qualifications

• 8+ years of software engineering experience
• At least 2 years in a leadership role
• Mentoring high‑performing software or platform teams
• Architecting, deploying, and maintaining large‑scale infrastructure
• Deep Kubernetes expertise
• Hands‑on exposure to cloud platform architectures and distributed systems
• Background in ML model development platforms or data pipelines
• Practical understanding of GPU cluster management and scheduling
• Operational background with high availability, incident reviews, and monitoring enhancements
• Excellent interpersonal abilities to align roadmaps across partners and leadership

Responsibilities

• Lead engineers and foster a collaborative and innovative environment.
• Manage and nurture a group of around 7–8 engineers, providing technical vision and growth.
• Establish the technical vision and roadmap for ML training infrastructure.
• Direct the architecture, construction, and operation of resilient systems for large ML workloads.
• Construct and maintain Kubernetes-driven compute clusters and GPU fleets.
• Oversee and optimize GPU resource scheduling, utilization, and cost performance.
• Advance distributed model training capabilities using Ray and related tools.
• Enhance workflow orchestration with Airflow, Temporal, and similar pipelines.
• Elevate system resilience, monitoring, and operational productivity of the ML stack.
• Collaborate with AD/ADAS, Woven City, and platform partners to ship infrastructure solutions.
• Translate product needs into executable engineering milestones with stakeholders.
• Institute rigorous software practices: reviews, testing, CD, and live site management.
• Engage in production support, post-incident reviews, and continuous refinements.
• Balance short-term feature requests with long-term architectural stability.
• Foster an inclusive, excellence-driven engineering culture.

Skills

Leadership

Software engineering

Kubernetes

Cloud platforms

Distributed systems

GPU infrastructure

Mentoring

Golang

English/Japanese bilingual

Tools

Kubernetes

Ray

Airflow

Temporal

Job description

Woven by Toyota, based in California, seeks an Engineering Manager to lead the ML Training Infrastructure team. You will shape technical direction, foster an engineering culture, and drive the long-term evolution of our ML training platform for scalable, reliable model development.

You will mentor a team of 7–8 engineers, collaborate with cross‑functional partners, and own the architecture of distributed GPU clusters, Kubernetes, and ML pipelines to accelerate innovation.