Product Manager On-Device & Edge AI

Sarvam; Bengaluru; On-site; INR 1,500,000 - 2,500,000; Full time

Benefits offered by this job

High ownership and impact from day one

Work with a high-talent team

AI-first focused work approach

Job summary

Sarvam in Bengaluru is seeking a Product Manager to lead the development of its on-device AI solutions. The role focuses on ensuring data sovereignty and reliability in enterprise environments, working closely with internal teams and partners.

The ideal candidate will have 4-8 years of experience in product management, particularly with B2B AI products, driving product decisions and integrating security compliance. If you are excited about pushing the boundaries of AI for India, apply now!

Qualifications

• 4–8 years of product management experience focused on enterprise AI.
• Experience with IT fleet management and enterprise device management.
• Ability to work directly with IT admin and enterprise buyers.

Responsibilities

• Own the product roadmap from on-device inference to fleet management.
• Define features for IT admin personas, including integration and provisioning.
• Collaborate with engineering on API design.

Skills

Product management experience in enterprise SaaS or B2B AI

Experience with on-device or edge AI products

Understanding of enterprise authentication

Data-driven decision making

Technical depth (APIs, compliance)

Education

Background in Computer Science or Electrical Engineering

Tools

Microsoft ecosystem (Entra ID, Intune)

MDM/UEM platforms (Jamf, Intune)

Job description

About Sarvam

Sarvam is building the bedrock of Sovereign AI for India. The company is developing India's full-stack sovereign AI platform, building across research, models, infrastructure and applications with a singular focus on making AI genuinely work for India. Sarvam works with leading enterprises and public institutions and is backed by Lightspeed, Peak XV, and Khosla Ventures. Sarvam partners with India's leading brands, including Tata Capital, SBI Life, CRED, IDFC, and LIC.

About the Role

Sarvam is our on-device AI product line — purpose-built for enterprise deployments where data sovereignty, low latency, and offline reliability are non-negotiable. We're looking for a Product Manager who understands enterprise AI deeply: the IT admin personas, the procurement cycles, the compliance requirements, and the day-to-day friction that determines whether an AI tool gets embedded into workflows or quietly abandoned.

You'll own the product roadmap for drive B2B GTM alignment, and run iterative experiments to build stickiness in enterprise workflows. You'll work closely with engineering, sales, and customer success to define what enterprise-grade AI looks like when it runs on-device, at the edge, and inside a customer's own security perimeter.

You will co‑own as a Full Stack product builder the most ambitious on-device AI problem in India building sovereign models that run at the silicon level across devices. You will be embedded with silicon partners like Qualcomm, Intel, HP, Apple, NVIDIA etc turning research breakthroughs into production‑grade optimisations that serve 1.5b indians at min latency. You will architect the Product motion from tuning to agentic orchestration and client deployment, this is not a feature team, it is a platform‑defining role. If you want to build the infrastructure layer that makes AI truly accessible across every laptop, phone, glasses and car in India, please apply!

What You'll Do

• Own the product roadmap for Sarvam, from on-device inference to enterprise deployment and fleet management
• Define and prioritise features for IT admin personas — MDM integration, device provisioning, policy enforcement, and enterprise authentication (including Microsoft ecosystem)
• Drive B2B GTM alignment by working with sales and customer success to translate customer pain points into product requirements
• Run iterative experiments in enterprise deployments to identify and improve workflow stickiness and adoption
• Design and ship features for multi-tenant SaaS architecture, including tenant isolation, access controls, and admin tooling
• Define requirements for HITL (human‑in‑the‑loop) and agentic workflows, ensuring enterprise‑grade reliability and auditability
• Work across security and compliance requirements — data residency, enterprise auth (SSO, SAML, SCIM), and regulatory standards relevant to enterprise AI
• Collaborate with engineering on API design and integration patterns for enterprise tooling and partner ecosystems
• Define and track product metrics that measure enterprise engagement, retention, and workflow depth

What We're Looking For

• 4–8 years of product management experience, with significant time in enterprise SaaS or B2B AI products
• Demonstrable experience with on‑device or edge AI products, or IT fleet management and enterprise device management
• Strong understanding of enterprise authentication and identity — Microsoft ecosystem (Entra ID, Intune, Azure AD), SSO, SAML, or SCIM
• Experience running structured product experiments and using data to drive roadmap decisions in enterprise contexts
• Ability to work directly with IT admin and enterprise buyer personas — understanding their workflows, constraints, and decision criteria
• Comfort with technical depth: APIs, security and compliance requirements, and multi‑tenant SaaS architecture
• Background in Computer Science or Electrical Engineering preferred

Bonus Points

• Experience with HITL workflows or agentic AI product design
• Prior exposure to data residency, sovereign cloud, or on‑premise enterprise AI deployments
• Familiarity with MDM/UEM platforms (Jamf, Intune, or equivalent)
• Experience working on AI products in regulated industries (BFSI, healthcare, or government)
• Background that combines technical depth with business or GTM exposure

Why Sarvam?

Sarvam is a fast‑moving, high talent‑density team building full‑stack AI for India, working on problems that push the frontiers of AI with real population‑scale impact.

• Work alongside researchers, engineers, builders, and business leaders who move fast and hold each other to a very high bar
• High ownership and high impact, from day one
• Everything we do is AI‑first, from the way we build and ship to the way we think about problems
• You can work on problems that could change how an entire country learns, works, and communicates

If you want to work on problems at the frontier of AI in India, Sarvam is the place to be.