Technical Program Manager, AI Infra & GPU Scale (Equity)

RadixArk

Palo Alto (CA)

On-site

USD 160,000 - 300,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

RadixArk in Palo Alto is seeking a Technical Program Manager to drive end-to-end programs across inference and training infrastructure, partnering with Product, Research, and Engineering to turn roadmaps into shipped reality.

You will own the how and when of critical initiatives, coordinate with kernel teams and external partners like Nvidia, Google, and AWS, and help scale operations for billions of tokens daily and 10,000+ GPU runs.

Qualifications

  • Bachelor's or Master's degree in Computer Science, Engineering, or a related technical field.
  • 4+ years of direct experience in Technical Program Management or senior engineering roles.
  • Strong fluency in systems software, distributed systems, or AI/ML infrastructure.
  • Proven track record shipping complex, multi‑team programs on time.
  • Excellent written and verbal communication; align across engineers, executives, and partners.

Responsibilities

  • Drive end-to-end execution of large-scale, cross-functional programs spanning inference engines, training frameworks, and hardware.
  • Define program structure with milestones, dependencies, risks, and success criteria; maintain a status truth across stakeholders.
  • Run design reviews, sprint planning, release readiness, and post-mortems; ensure follow-ups are closed.
  • Coordinate dependencies across kernel, runtime, scheduler, networking, and model teams.
  • Drive release management for major versions, changelog ownership, and partner rollout planning.
  • Build engineering cadence with standups, planning rituals, dashboards, and leadership reporting.
  • Lead incident response for production issues; conduct root-cause analysis and corrective actions.

Job description

RadixArk in Palo Alto is seeking a Technical Program Manager to drive end-to-end programs across inference and training infrastructure, partnering with Product, Research, and Engineering to turn roadmaps into shipped reality.

You will own the how and when of critical initiatives, coordinate with kernel teams and external partners like Nvidia, Google, and AWS, and help scale operations for billions of tokens daily and 10,000+ GPU runs.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Technical Program Manager
Technical Program Manager

RadixArk • Palo Alto (CA)

On-site
USD 160,000 - 300,000
Senior Member of Technical Staff, AI Compute Clusters
Senior Member of Technical Staff, AI Compute Clusters

RadixArk • Palo Alto (CA)

On-site
USD 360,000 - 440,000
Product Manager: AI Inference & Open-Source Infra
Product Manager: AI Inference & Open-Source Infra

RadixArk • Palo Alto (CA)

On-site
USD 160,000 - 300,000
Equity
Competitive salary
Impact on AI infra products
Staff Engineer, AI Infrastructure & Developer Tools
Staff Engineer, AI Infrastructure & Developer Tools

RadixArk • Palo Alto (CA)

On-site
USD 200,000 - 400,000
Product Manager
Product Manager

RadixArk • Palo Alto (CA)

On-site
USD 160,000 - 300,000
Equity
Competitive salary
Impact on AI infra products
Member of Technical Staff — Cluster Infrastructure & Supercomputing
Member of Technical Staff — Cluster Infrastructure & Supercomputing

RadixArk • Palo Alto (CA)

On-site
USD 360,000 - 440,000
AI Infrastructure Performance Engineer (GPU/LLM)
AI Infrastructure Performance Engineer (GPU/LLM)

RadixArk • Palo Alto (CA)

On-site
USD 200,000 - 400,000
Member of Technical Staff — Inference-Kernel, Compiler & Communication
Member of Technical Staff — Inference-Kernel, Compiler & Communication

RadixArk • Palo Alto (CA)

On-site
USD 200,000 - 400,000
Member of Technical Staff — Inference-Multi-Hardware
Member of Technical Staff — Inference-Multi-Hardware

RadixArk • Palo Alto (CA)

On-site
USD 200,000 - 400,000
Technical Program Manager, AI Inference & Fleet Scale
Technical Program Manager, AI Inference & Fleet Scale

Candidate • San Francisco (CA)

Hybrid
USD 290,000 - 435,000
Competitive compensation
Equity donation matching (optional)
Generous vacation and parental leave
+2