Head of Software

Oho Group; San Francisco (CA); On-site; USD 350,000 - 520,000; Full time

Job summary

OHO Group (Lithuania) is seeking a visionary Head of Software to build and lead our software engineering organization for next-generation AI compute systems. You will own the full software platform that connects hardware innovations to the broader AI ecosystem.

You will recruit and scale teams across low-level software, kernel, compiler, and systems engineering; shape the tech stack; collaborate with hardware and architecture teams to deliver developer-ready APIs and platform integrations for

Qualifications

• 10+ years of software development experience with a track record of leading engineering teams (Director/VP/Head level).
• Deep systems and silicon domain expertise across AI infrastructure, including AI accelerators and drivers.
• Experience with custom AI ASIC/GPU software stacks, distributed runtimes, and memory management for large models.

Responsibilities

• Lead and build a world-class team of low-level software, kernel, compiler, and systems engineers.
• Define the tech stack spanning MLIR, TVM, Triton, custom acceleration frameworks, hosts drivers and runtimes.
• Bridge hardware and software by collaborating with hardware, chip design and systems teams to optimize primitives.
• Productize compute capabilities into developer-friendly APIs, SDKs and platform integrations.

Job description

Head of Software - Next-Gen AI Compute Systems

I am working with an extremely well-funded AI compute company building the underlying infrastructure for the next generation of artificial intelligence.

We are seeking a visionary Head of Software to build and lead our software engineering organization from the ground up. You will own the full software platform that connects our hardware innovations to the broader AI ecosystem.

What You Will Do

• Lead & Build: Architect, hire, and scale a world-class team of low-level software, kernel, compiler, and systems engineers.
• Define the Tech Stack: Drive the technical architecture spanning deep-learning compilers (MLIR, TVM, Triton), custom acceleration frameworks, host drivers, and hardware management runtimes.
• Bridge Hardware & Software: Work closely with hardware, chip design, and systems architecture teams to co-design hardware/software primitives optimized for massive-scale AI workload execution.
• Productize at Scale: Turn raw compute capabilities into seamless, developer-ready APIs, SDKs, and platform integrations for top AI researchers and enterprise teams.

Who You Are

• Proven Engineering Executive: 10+ years of software development experience with a track record of leading high-performing engineering teams (Director/VP/Head level).
• Deep Systems & Silicon Domain Expertise: Proven experience across modern AI infrastructure, including one or more of the following:
• Custom AI ASIC/GPU software stacks & drivers
• Distributed compute runtimes & memory management for LLM training/inference
• Technical Depth + Strategic Vision: You can dive into kernel-level optimizations or hardware schematics while maintaining a sharp product vision and business roadmap.
• First-Principles Thinker: You thrive on solving complex, unmapped problems at the intersection of software performance and physical compute constraints.

Why Join?

• Frontier Impact: Work on fundamental, high-density AI compute technologies that redefine performance density and energy efficiency.
• Executive Ownership: Direct seat at the leadership table shaping company strategy, culture, and architecture.
• Top-Tier Compensation: Market-leading executive salary, generous equity package, and full executive benefits.