Senior Product Manager - Software

Efficient Computer

San Jose (CA)

On-site

USD 160,000 - 210,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Efficient Computer is seeking a Senior Product Manager - Software to own the strategy for the developer platform, including the compiler, SDK, runtime, and model enablement stack. You will pair with engineering, silicon, and applications teams to translate hardware capabilities into an ecosystem customers can adopt.

The role emphasizes platform thinking, cross-functional leadership, and measurable success through developer adoption and business impact, not sprint management.

Qualifications

  • 7+ years of product management experience for developer-facing software platforms - SDKs, compilers, runtimes, APIs, ML tooling, or embedded developer ecosystems

Responsibilities

  • Define the product roadmap for the compiler, SDK, runtime, model conversion and enablement tooling, and developer platform. Set priorities based on customer requirements, competitive positioning, and strategic platform needs.
  • Lead framework and model enablement strategy across PyTorch, ONNX, ExecuTorch, LiteRT, and future runtimes, including compatibility, validation coverage, performance expectations, and support commitments.
  • Drive reduction in time-to-first-working-application (TTFWA) across customer segments. Define the metric, baseline it, track it, and own the roadmap items that move it.
  • Establish SDK governance: surface area, versioning, API stability commitments, and deprecation policy. Define release quality criteria, validation expectations, and backward compatibility standards.

Skills

PM Experience
Customer-zero shipping
Developer adoption metrics
ML inference pipelines
Customer requirements to Engineering
Performance tradeoffs
Cross-team influence
Credibility with developers

Tools

LLVM
MLIR
TOSA
XLA
FreeRTOS
CMSIS-NN
MCU SDK patterns

Job description

Efficient is developing the world’s most energy-efficient general-purpose computer processor. Efficient’s patented technology uses 100x less energy than state of the art commercially available ultra-low-power processors and is programmable using standard high-level programming languages and AI/ML frameworks. This level of efficiency makes perpetual, pervasive intelligence possible: run AI/ML continuously on a AA battery for 5-10 years. Our platform’s unprecedented level of efficiency enables IoT devices to intelligently capture and curate first-party data to drive the next major computing revolution

Senior Product Manager - Software

owns the strategy and direction for Efficient Computer’s developer platform - including the compiler, SDK, runtime integrations, model enablement stack, and overall developer experience. This role is critical to customer adoption and long-term ecosystem growth, translating Efficient’s hardware capabilities into a scalable, developer-ready platform that enables customers to build, optimize, and deploy applications efficiently.

Success in this role requires thinking beyond individual features and approaching the platform as a complete developer ecosystem. The Software PM is responsible for defining product direction, prioritization, customer requirements, and developer experience outcomes, while partnering closely with software engineering, silicon architecture, applications engineering, marketing, and customer-facing teams.

This is a highly cross-functional product leadership role focused on strategy, platform evolution, and business impact — not project management or sprint administration. The Software PM defines what should be built, why it matters, how success is measured, and how priorities align with customer and company goals, while engineering teams own implementation and execution.

Success Looks Like
  • Developers achieve production-ready applications quickly, without white-glove engineering support
  • The compiler and SDK become a competitive advantage, not an adoption bottleneck
  • Framework support and tooling reduce evaluation friction and accelerate customer design-ins
  • Software capabilities directly influence customer wins and silicon roadmap decisions
Key Responsibilities
  • Define the product roadmap for the compiler, SDK, runtime, model conversion and enablement tooling, and developer platform. Set priorities based on customer requirements, competitive positioning, and strategic platform needs.
  • Lead framework and model enablement strategy across PyTorch, ONNX, ExecuTorch, LiteRT, and future runtimes, including compatibility, validation coverage, performance expectations, and support commitments.
  • Drive reduction in time-to-first-working-application (TTFWA) across customer segments. Define the metric, baseline it, track it, and own the roadmap items that move it.
  • Establish SDK governance: surface area, versioning, API stability commitments, and deprecation policy. Define release quality criteria, validation expectations, and backward compatibility standards.
  • Drive developer confidence through reproducible benchmarking, deterministic tooling behavior, clear diagnostics, and strong documentation.
  • Participate in customer engagements to understand workflow friction, deployment blockers, and framework requirements. Represent software platform strategy in technical customer discussions and ecosystem partnerships.
  • Gather and prioritize developer feedback across evaluation, onboarding, optimization, and deployment phases. Maintain structured mechanisms to feed this directly into roadmap decisions.
  • Partner with Applications Engineering to define the software platform capabilities necessary for production-quality reference applications and customer evaluation flows, including AI inference, vision, audio, and sensor-processing pipelines.
  • Define requirements for profiling, debugging, and performance analysis workflows that allow developers to understand and optimize application behavior on Efficient hardware.
  • Balance long-term platform investments against near-term customer enablement and revenue-driving requirements. Understand when the right call is shipping a polished narrow capability vs. a rough broad one.
  • Influence silicon decisions based on software needs and constraints. Partner with the Hardware PM and architecture team when compiler or runtime requirements have silicon implications.
  • Establish and own developer success metrics and developer workflow metrics and diagnostics: build success rates, TTFWA, workflow completion rate, and friction points.
  • Define and own the SDK release cadence, packaging, distribution, and support lifecycle.
Required Qualifications
  • 7+ years of product management experience for developer-facing software platforms - SDKs, compilers, runtimes, APIs, ML tooling, or embedded developer ecosystems
  • Experience shipping tools and platforms used directly by external developers, including operating through the customer-zero phase
  • Demonstrated ownership of developer adoption, onboarding success, workflow completion, or related developer productivity metrics
  • Strong understanding of modern ML inference and deployment pipelines (PyTorch, ONNX, ExecuTorch, LiteRT (formerly TensorFlow Lite), TensorRT, or equivalent)
  • Experience translating customer workflows and technical constraints into actionable product requirements that engineering can build from without ambiguity
  • Familiarity with software performance tradeoffs involving memory, latency, throughput, power, and hardware utilization
  • Ability to work effectively with compiler, runtime, systems software, and silicon architecture teams and to influence without authority across all of them
  • Ability to establish credibility with highly technical developers, compiler engineers, and ML practitioners through clear thinking, technical depth, and strong customer empathy.
Preferred Qualifications
  • Experience with compiler toolchains, IRs, and deployment flows (LLVM, MLIR, TOSA, XLA, or equivalent)
  • Experience with embedded AI deployment pipelines and edge inference workflows
  • Experience at a semiconductor or AI hardware company building developer tools for a novel architecture
  • Familiarity with embedded software ecosystems (FreeRTOS, CMSIS-NN, MCU SDK patterns) and Linux-based embedded development environments and cross-compilation workflows
  • Experience with performance profiling tools, compiler traces, and benchmark-driven optimization workflows
  • Experience with benchmarking methodologies (MLPerf or equivalent) - including designing, running, and publishing credible results
  • Experience operating in early-stage environments with incomplete requirements and rapidly evolving architectures
  • Experience in startup environments with hybrid PM + DevRel responsibilities.

We offer a competitive salary for this role, generally ranging from $160,000 to $210,000, along with meaningful equity and comprehensive benefits. The final compensation package will be based on your experience and location, with some flexibility to ensure we align with the right candidate.

Why Join Efficient?

Efficient offers a competitive compensation and benefits package, including 401K match, company-paid benefits, equity program, paid parental leave, and flexibility. We are committed to personal and professional development and strive to grow together as people and as a company.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Product Manager - Software San Jose, CA OR Pittsburgh, PA OR San Fransisco, Bay Area OR Austin, TX
Senior Product Manager - Software San Jose, CA OR Pittsburgh, PA OR San Fransisco, Bay Area OR Austin, TX

Efficient Computer Company • San Francisco (CA)

Hybrid
USD 160,000 - 240,000
401K match
Equity program
Paid parental leave
+2
Senior Product Manager - Compiler and Optimizations
Senior Product Manager - Compiler and Optimizations

Efficient Computer • San Jose (CA)

On-site
USD 150,000 - 210,000
Competitive compensation
401K match
Company-paid benefits
+3
Software Technical Program Manager
Software Technical Program Manager

Efficient Computer • Austin (TX), Pittsburgh, San Francisco (CA)

On-site
USD 200,000 - 260,000
Competitive base salary
Equity
401(k) match
+3
Senior Software Optimization Engineer
Senior Software Optimization Engineer

Efficient Computer • San Jose (CA)

On-site
USD 160,000 - 210,000
401K match
Company-paid benefits
Equity program
+2
Senior Staff Software Engineer, Linux Runtime & Drivers
Senior Staff Software Engineer, Linux Runtime & Drivers

Efficient Computer • Pittsburgh

On-site
USD 220,000 - 270,000
Meaningful equity
401(k) match
Company-paid benefits
+2
Senior Staff Software Engineer, Linux Runtime & Drivers
Senior Staff Software Engineer, Linux Runtime & Drivers

Efficient Computer • San Jose (CA)

On-site
USD 220,000 - 270,000
Competitive base salary
Equity
401(k) match
+3
Senior Compiler Engineer
Senior Compiler Engineer

Efficient Computer • San Jose (CA)

On-site
USD 160,000 - 230,000
401(k) match
Equity
Paid parental leave
+1
Senior Embedded Engineer New San Jose, CA OR Pittsburgh, PA
Senior Embedded Engineer New San Jose, CA OR Pittsburgh, PA

Efficient Computer Company • Pennsylvania

On-site
USD 160,000 - 210,000
Equity program
401K match
Company-paid benefits
+2
Engineering Manager - Architecture San Jose, CA OR Pittsburgh, PA
Engineering Manager - Architecture San Jose, CA OR Pittsburgh, PA

Efficient Computer Company • Pennsylvania

Hybrid
USD 200,000 - 260,000
Competitive compensation
401K match
Company-paid benefits
+3
Field Application Engineer
Field Application Engineer

Efficient Computer • San Francisco (CA), Pittsburgh

On-site
USD 160,000 - 230,000