Artificial Intelligence Architect

Blue Rock Management; Bengaluru; On-site; INR 4,000,000 - 7,000,000; Full time

Job summary

Blue Rock Management in Bengaluru (Hybrid) seeks a Senior AI Platform Architect to lead enterprise AI platforms across Azure, AWS, and on-prem environments. You will define scalable AI infrastructure, governance, and IaC practices, enabling RAG pipelines, LLM workloads, and vector databases.

Collaborate with AI and infrastructure teams, align with governance boards, and drive observability and security standards for enterprise deployments.

Qualifications

• 10+ years of IT experience with at least 2+ years in AI platform or cloud architecture.
• Strong expertise in Azure and AWS cloud platforms.
• Hands-on Terraform for enterprise IaC.
• Experience with RAG, LLM orchestration, and vector databases.

Responsibilities

• Design and architect scalable AI platforms across Azure, AWS, and on-premises.
• Develop reference architectures, patterns, and governance standards for AI workloads.
• Collaborate with AI teams for RAG pipelines, LLM fine-tuning, vector search, and model deployment.
• Create secure, reusable Terraform-based IaC frameworks.
• Define monitoring, logging, and observability for AI platforms and vector search.
• Present proposals to Enterprise Architecture Review Boards and obtain approvals.
• Set security, networking, and compliance standards for AI deployments.
• Partner with DevOps, Cloud Engineering, and AI teams for implementation.
• Drive Kubernetes-based AI deployments across AKS and EKS.
• Support enterprise AI transformation with technical leadership.

Skills

Azure

AWS

Kubernetes

Azure OpenAI

Azure AI Search

AWS Bedrock

SageMaker

OpenSearch

RAG

LangChain

LlamaIndex

Vector DBs

IaC governance

Tools

Terraform

Job description

Senior AI Platform Architect

Location: Bangalore (Hybrid)

Experience: 10+ years of overall IT experience with at least 2+ years in Cloud/AI Platform Architecture

Job Summary: We are looking for a highly experienced Senior AI Platform Architect to lead the architecture, governance, and standardization of enterprise AI platforms across Azure, AWS, and On-Premises environments. The ideal candidate will design scalable, secure, and high-performance AI infrastructure, enabling AI application teams to build and deploy advanced solutions such as Retrieval-Augmented Generation (RAG) applications, LLM-based workloads, and vector database implementations. This role requires close collaboration with AI engineering teams, infrastructure teams, and enterprise architecture governance boards to define architecture standards, establish Infrastructure as Code (IaC) best practices, and ensure enterprise-grade AI platform capabilities.

Responsibilities

• Design and architect scalable AI platforms across Azure, AWS, and On-Premises infrastructure.
• Develop reference architectures, design patterns, and governance standards for enterprise AI workloads.
• Collaborate with AI application teams to understand infrastructure requirements for RAG pipelines, LLM fine-tuning, vector search, and AI model deployment.
• Design secure, reusable, and compliant Terraform-based Infrastructure as Code (IaC) frameworks.
• Define AI platform monitoring, logging, and observability strategies, including model performance, token usage, latency, and vector search monitoring.
• Present architecture proposals to Enterprise Architecture Review Boards and obtain necessary approvals.
• Define security, scalability, networking, and compliance standards for AI platform deployments.
• Partner with DevOps, Cloud Engineering, and AI teams to ensure successful implementation of architectural standards.
• Drive best practices for Kubernetes-based AI platform deployments across AKS and EKS.
• Support enterprise AI transformation initiatives through technical leadership and architecture guidance.

Required Skills & Qualifications

• 10+ years of overall IT experience with at least 2+ years in AI Platform or Cloud Architecture.
• Strong expertise in Microsoft Azure and Amazon Web Services (AWS) cloud platforms.
• Experience designing hybrid cloud and on-premises AI infrastructure.
• Hands-on experience with Terraform for enterprise Infrastructure as Code (IaC).
• Strong knowledge of Azure OpenAI, Azure AI Search, Azure Kubernetes Service (AKS).
• Experience with AWS Bedrock, SageMaker, OpenSearch, and Amazon EKS.
• Experience designing infrastructure for Retrieval-Augmented Generation (RAG) applications.
• Experience with Large Language Model (LLM) orchestration frameworks such as LangChain or LlamaIndex.
• Experience with enterprise vector databases such as Pinecone, Milvus, Qdrant, or Azure AI Search.
• Strong Kubernetes and container orchestration experience.
• Knowledge of AI infrastructure observability, monitoring, logging, and alerting.
• Excellent stakeholder management, communication, and presentation skills.

Preferred Skills

• Experience with enterprise AI governance and architecture review processes.
• Knowledge of AI platform security, compliance, and networking.
• Experience building reusable Terraform modules for large-scale cloud environments.
• Familiarity with MLOps, DevOps, and CI/CD practices for AI workloads.
• Experience working with enterprise-scale AI and GenAI platform implementations.

Mandatory Skills

• Azure
• AWS
• Terraform
• Kubernetes (AKS/EKS)
• Azure OpenAI
• Azure AI Search
• AWS Bedrock
• SageMaker
• OpenSearch
• Retrieval-Augmented Generation (RAG)
• LangChain or LlamaIndex
• Vector Databases (Pinecone, Milvus, Qdrant, Azure AI Search)
• AI Platform Architecture
• Infrastructure as Code (IaC)
• Hybrid Cloud Architecture
• AI Infrastructure Governance