AI Architect

cai; India; Remote; INR 3,500,000 - 5,500,000; Full time

Job summary

CAI is seeking an AI Architect to lead the design, strategy, and implementation of cutting-edge AI/ML platforms. This full-time, remote role calls for hands-on leadership across India and Singapore.

You will define technical vision, establish governance, and drive GenAI initiatives, while mentoring engineers and guiding architectural decisions for high-impact projects. Collaborate with product and leadership to ensure scalable, secure AI solutions.

Qualifications

• 15+ years in enterprise software architecture with 5+ years designing AI/ML platforms or GenAI solutions
• Cloud-native architectures (AWS/Azure), microservices, API design
• Strong knowledge of GenAI technologies (LLMs, RAG systems, vector databases, prompt engineering)
• Proven experience leading enterprise-scale platforms with high availability and security

Responsibilities

• Define technical vision and architecture for conversational AI platforms and governance systems
• Design cloud-native, microservices-based architectures for GenAI applications using AWS/Azure, Kubernetes
• Establish architectural standards for LLM integration and AI governance
• Drive technology selection for frontend, backend, databases, and AI frameworks
• Design API security patterns, data encryption, and audit logging for AI platforms
• Define multi-tenancy architecture for SaaS AI solutions with RBAC/ABAC
• Provide technical leadership to engineering teams across regions
• Conduct architecture reviews and guide implementation decisions for GenAI projects
• Collaborate with product managers and executives to align architecture with business goals
• Mentor architects on cloud-native design and enterprise integration patterns
• Design MLOps pipelines for model deployment, monitoring, and experimentation
• Architect enterprise integrations with APIs and message brokers
• Define observability strategies using Prometheus, Grafana, Datadog, CloudWatch

Skills

Enterprise architecture

AI/ML platforms

GenAI tech

Cloud-native

Microservices

API design

Distributed systems

Security/compliance

MLOps

Observability

Vendor management

Tools

AWS

Azure

Kubernetes

LangChain

LlamaIndex

TensorFlow Serving

Kafka

RabbitMQ

Prometheus

Grafana

Datadog

CloudWatch

Job description

AI Architect

Req number: R8730

Employment type: Full time

Worksite flexibility: Remote

Who we are

CAI is a global services firm with over 9,000 associates worldwide and a yearly revenue of $1.3 billion+. We have over 40 years of excellence in uniting talent and technology to power the possible for our clients, colleagues, and communities. As a privately held company, we have the freedom and focus to do what is right-whatever it takes. Our tailor-made solutions create lasting results across the public and commercial sectors, and we are trailblazers in bringing neurodiversity to the enterprise.

Job Summary

We are looking for a motivated AI Architect ready to take us to the next level! If you have lead the design, strategy, and implementation of cutting-edge AI/ML platforms and solutions and are looking for your next career move.

Job Description

We are looking for an AI Architect to lead the design, strategy, and implementation of cutting-edge AI/ML platforms and solutions. This position will be full-time and remote .

What You'll Do

• Define technical vision and architecture for conversational AI platforms, AI governance systems, and domain-specific agentic solutions
• Design cloud-native, microservices-based architectures for GenAI applications using AWS/Azure, Kubernetes, and API management platforms
• Establish architectural standards for LLM integration (Claude, OpenAI), RAG systems, vector databases, and AI orchestration
• Drive technology selection for frontend (React/Angular), backend (FastAPI, Node.js), databases (PostgreSQL, MongoDB, OpenSearch), and AI frameworks (LangChain, LlamaIndex)
• Design AI governance frameworks including usage tracking, cost optimization, access control (RBAC/ABAC), and compliance enforcement (SOC 2, GDPR)
• Architect API security patterns (OAuth 2.0, JWT, mTLS), data encryption, and audit logging for AI platforms
• Define multi-tenancy architecture for SaaS-based AI solutions with role-based access and data isolation
• Provide technical leadership to engineering teams (backend, frontend, AI/ML, DevOps) across India CoE and Singapore
• Conduct architecture reviews, design reviews, and guide implementation decisions for high-impact GenAI projects
• Collaborate with product managers, business stakeholders, and executive leadership to align technical architecture with business objectives
• Mentor architects and senior engineers on cloud-native design, AI/ML best practices, and enterprise integration patterns
• Design MLOps pipelines for AI model deployment, versioning, monitoring, and A/B testing
• Architect enterprise integrations with APIs, message brokers (Kafka, RabbitMQ), and legacy systems using event-driven patterns
• Define observability and monitoring strategies using Prometheus, Grafana, Datadog, and CloudWatch

What You'll Need

• Required: 15+ years in enterprise software architecture with 5+ years designing AI/ML platforms or GenAI solutions
• Deep expertise in cloud-native architectures (AWS/Azure), microservices, API design, and distributed systems
• Strong knowledge of GenAI technologies (LLMs, RAG systems, vector databases, prompt engineering, agentic frameworks)
• Proven experience architecting enterprise-scale platforms serving 10,000+ users with high availability and security requirements
• Expert-level knowledge of backend frameworks (FastAPI, Node.js, Django), frontend frameworks (React, Angular), and database systems (SQL, NoSQL, vector databases)
• Strong understanding of AI/ML frameworks (LangChain, LlamaIndex, Hugging Face), model serving (TensorFlow Serving, Triton), and MLOps practices
• Proficiency in API management (MuleSoft, Apigee, Kong), event-driven architectures, and message brokers (Kafka, RabbitMQ)
• Deep knowledge of security (OAuth 2.0, JWT, encryption, OWASP), compliance (SOC 2, GDPR), and data privacy
• Proven ability to lead cross-functional teams, influence technical decisions, and drive architectural alignment
• Excellent communication skills with ability to present complex architectures to executive leadership and non-technical stakeholders
• Experience managing vendor relationships, technology partnerships, and third-party integrations
• Strong decision-making abilities based on data-driven insights, trade-off analysis, and business impact
• Preferred: Certifications: AWS Solutions Architect Professional, Azure Solutions Architect Expert, TOGAF, or equivalent
• Experience with AI governance platforms, prompt management systems, and LLM observability tools (LangSmith, Weights & Biases)
• Knowledge of service mesh (Istio, Linkerd), API federation, and zero-trust security architectures
• Prior experience in manufacturing, engineering, or industrial domains is a plus

Physical Demands

Ability to safely and successfully perform the essential job functions

Sedentary work that involves sitting or remaining stationary most of the time with occasional need to move around the office to attend meetings, etc.

Ability to conduct repetitive tasks on a computer, utilizing a mouse, keyboard, and mo