Principal AI Architect

Gloroots AI

Mumbai

On-site

INR 2,000,000 - 3,000,000

Full time

14 days+
Application generator

An application made for this job — a tailored resume and cover letter that speak straight to the posting.

Get past ATS filters

Benefits offered by this job

Competitive compensation
Equity in a high‑growth AI company
Opportunity to work with global tech partners

Job summary

A leading AI company in Mumbai is looking for an experienced technical leader to define the architecture for an AI platform serving over 100 million users across India. The role involves driving the technical direction and leading multiple teams in building distributed AI/ML services. Ideal candidates should have significant experience in AI/ML platforms, hands-on experience with GenAI solutions, and strong leadership qualities. The position offers competitive compensation and the opportunity to work with major tech partners.

Qualifications

  • 10+ years of experience in AI/ML distributed systems and AI/ML platform engineering.
  • Hands‑on experience building and owning GenAI solutions in production.
  • Deep expertise with LangChain/LlamaIndex, VectorDBs, and RAG.

Responsibilities

  • Define and drive the technical architecture for AI orchestration platform serving 100M+ users.
  • Lead multiple engineering teams across AI infrastructure, model orchestration, and vector systems.
  • Establish technical standards and best practices for GenAI platform development.

Skills

AI/ML distributed systems
GenAI solutions
AI Agents and LLM orchestration
AI/ML orchestration frameworks
Azure DevOps
GCP cloud-native stacks
Kubernetes
Kafka
Terraform

Job description

A venture-backed AI company building the intelligence layer for India at massive scale. Backed by partnerships with global tech leaders like Meta and Google.

The company creates AI that serves the entire Indian user base across languages, contexts, and daily needs. Engineered from day one for 100M+ users early and 1B-ready constraints on latency, cost, reliability, and safety.

Position Overview

You will define the architecture and technical direction for an AI platform serving 100M+ users across India. You'll lead multiple technical teams spanning AI infrastructure, model orchestration, and vector knowledge systems while driving hands‑on technical excellence. This role offers direct ownership of distributed AI/ML services that power real‑world consumer experiences at unprecedented scale.

Role & Responsibilities
  • Define and drive the technical architecture for AI orchestration platform serving 100M+ users
  • Lead multiple engineering teams across AI infrastructure, model orchestration, and vector systems
  • Design and implement distributed AI/ML services with focus on latency, cost, and reliability
  • Build hands‑on solutions for LLM orchestration, model routing, and multi‑agent coordination systems
  • Establish technical standards and best practices for GenAI platform development
  • Drive architecture decisions for cloud‑native AI infrastructure and observability systems
  • Own end‑to‑end GenAI solutions from prototype to production‑scale deployment
Must Have Criteria
  • 10+ years of experience in AI/ML distributed systems and AI/ML platform engineering
  • Hands‑on experience building and owning GenAI solutions in production
  • Deep expertise with AI Agents, LLM orchestration, model routing, LangChain/LlamaIndex, VectorDBs, and RAG
  • Strong experience with AI/ML orchestration frameworks and embeddings systems
  • Proven leadership experience driving architecture decisions at scale
  • Experience with Azure DevOps and GCP cloud‑native stacks including Kubernetes, Kafka, and Terraform
  • Demonstrated ability to build distributed AI/ML services with high reliability
Nice to Have
  • Experience building AI platforms for consumer‑scale applications (100M+ users)
  • Background in multi‑modal and multi‑lingual AI systems
  • Previous experience in startup or high‑growth technology environments
  • Open source contributions to AI/ML orchestration or infrastructure projects
What We Offer
  • Opportunity to build AI infrastructure for 100M+ users across India
  • Leadership role in a fast‑moving, high‑ambition AI team
  • Direct impact on category‑defining consumer AI experience
  • Collaboration with global tech partners like Meta and Google
  • Competitive compensation and equity in a high‑growth AI company
Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

Staff Engineer - GenAI
Staff Engineer - GenAI

AjnaLens • Thane

On-site
INR 4,000,000 - 7,000,000
Ai Engineering Architect - PAN INDIA
Ai Engineering Architect - PAN INDIA

Infosys • Pune District, Chennai District, Bengaluru

Hybrid
INR 1,500,000 - 2,000,000
AI Architect – Enterprise Strategy
AI Architect – Enterprise Strategy

Jobgether • India

Hybrid
INR 1,500,000 - 2,500,000
Competitive compensation
Work on cutting-edge AI systems
Flexible remote work environment
+1
Gen AI Architect
Gen AI Architect

Ericsson GmbH • Kolkata District

On-site
INR 4,000,000 - 7,000,000
Assistant Manager - Gen AI
Assistant Manager - Gen AI

BSR & Co • Gurugram District

On-site
INR 800,000 - 1,400,000
Access to AI research labs
Collaborative culture
Opportunity to lead high-impact POCs
AI Engineering Architect
AI Engineering Architect

Deloitte US-India Offices • Chennai District, Bengaluru, Hyderabad

Hybrid
INR 1,500,000 - 2,000,000
AI Architect
AI Architect

Expleo Group • Pune District

On-site
INR 2,800,000 - 4,800,000
Learning & Leadership development
Global exposure
Collaborative environment
Senior AI Engineer
Senior AI Engineer

Zycus Inc. • India

On-site
INR 1,800,000 - 3,200,000
AI Engineer
AI Engineer

Tredence • Bengaluru

On-site
INR 4,000,000 - 7,000,000
Lead Artificial Intelligence Engineer
Lead Artificial Intelligence Engineer

SourcingXPress • Bengaluru

On-site
INR 5,000,000 - 5,500,000
Hybrid work environment