Senior Architect

Keka Technologies Private Limited; Bengaluru; On-site; INR 4,000,000 - 7,000,000; Full time

Job summary

Keka Technologies Private Limited in Bengaluru seeks a visionary Senior Architect (AI) to design and lead scalable, enterprise AI systems. You will define the technical blueprint of our AI platform, guiding engineering teams and aligning business goals with technology strategy.

You will drive architecture strategy, evaluate AI frameworks, ensure governance, and mentor engineers across squads while delivering PoCs and optimized non-functional performance.

Qualifications

• Requires deep expertise in AI/ML architecture patterns (RAG, agentic AI, multi-model orchestration).
• Strong knowledge of LLM ecosystems (OpenAI, Anthropic Claude, Google Gemini, open-source LLMs).
• Experience with vector databases and MLOps tools.
• Proficiency in Python; backend integration in Node.js/Java often needed.

Responsibilities

• Define and drive the organization-wide AI/ML architecture strategy.
• Design scalable, secure AI pipelines and platforms.
• Lead evaluation of AI frameworks, LLM APIs, and vector databases.
• Collaborate with Product/Engineering to translate requirements into roadmaps.
• Establish best practices for model lifecycle management and governance.
• Conduct architecture reviews and mentor engineers; drive PoCs for new AI tech.
• Ensure compliance with data privacy regulations in AI systems.
• Own non-functional requirements: scalability, latency, availability, cost.

Skills

AI/ML architecture

RAG

Agentic AI

LLM ecosystems

Vector databases

MLOps

Python

Backend integration

Data engineering

Microservices

API design

Event-driven architecture

AI governance

Prompt engineering

Containerization

Tools

Python

Node.js

Java

Spark

Kafka

dbt

Airflow

MLflow

Kubeflow

Weights & Biases

Pinecone

Weaviate

pgvector

ChromaDB

Docker

Kubernetes

Helm

Job description

We are looking for a visionary Senior Architect (AI) to design and lead the development of scalable, enterprise-grade AI systems. You will be responsible for defining the technical blueprint of our AI platform, guiding engineering teams, and ensuring alignment between business goals and technology strategy.

KEY RESPONSIBILITIES

• Define and drive the overall AI/ML architecture strategy across the organization
• Design scalable, resilient, and secure AI pipelines and platforms
• Lead the evaluation and adoption of AI frameworks, LLM APIs, and vector databases
• Collaborate with Product, Engineering, and Business leaders to translate requirements into technical roadmaps
• Establish best practices for model lifecycle management, MLOps, and responsible AI
• Conduct architecture reviews, code reviews, and technical design sessions
• Mentor senior engineers and provide technical leadership across squads
• Drive proof-of-concepts (PoCs) for emerging AI technologies and recommend adoption
• Ensure compliance with data privacy regulations (GDPR, DPDPA) in AI systems
• Own non-functional requirements: scalability, latency, availability, and cost optimization

KEY SKILLS & REQUIREMENTS

• Deep expertise in AI/ML architecture patterns: RAG, agentic AI, multi-model orchestration
• Proficiency with LLM ecosystems: OpenAI, Anthropic Claude, Google Gemini, open-source LLMs (Llama, Mistral)
• Strong knowledge of vector databases: Pinecone, Weaviate, pgvector, ChromaDB
• Experience with MLOps tools: MLflow, Kubeflow, Weights & Biases
• Proficiency in Python for AI/ML; working knowledge of Node.js or Java for backend integration
• Knowledge of data engineering: Spark, Kafka, dbt, Airflow
• Strong understanding of microservices, API design, and event-driven architecture
• Familiarity with AI governance, model evaluation frameworks, and prompt engineering
• Experience with containerization: Docker, Kubernetes, Helm

Nice to have

• Experience with agentic frameworks: LangChain, LlamaIndex, AutoGen, CrewAI
• Published research or open-source contributions in AI/ML
• Exposure to multi-modal AI (vision, voice, video) systems
• Prior startup or product-led company experience