AI Architect

CAI; United States; Remote; USD 180,000 - 240,000; Full time

Job summary

CAI is seeking an AI Architect to lead the design, strategy, and implementation of cutting-edge AI/ML platforms. This remote, full-time role involves defining technical vision and driving GenAI initiatives across global teams.

Ideal candidates have 15+ years of enterprise software architecture experience, strong cloud-native expertise (AWS/Azure), and deep knowledge of AI governance, security, and scalability. Join CAI to shape the future of enterprise AI.

Qualifications

• 15+ years in enterprise software architecture.
• 5+ years designing AI/ML platforms or GenAI solutions.
• Experience architecting enterprise-scale platforms serving 10,000+ users.

Responsibilities

• Define technical vision and architecture for conversational AI platforms and governance systems.

Skills

Enterprise software architecture

Cloud-native architectures

GenAI technologies

LLMs and RAG systems

Security and compliance

Leadership

Cross-functional collaboration

Executive storytelling

MLOps familiarity

API design & management

Tools

AWS

Azure

Kubernetes

LangChain

LlamaIndex

Hugging Face

Prometheus

Grafana

Datadog

CloudWatch

MuleSoft

Apigee

Kafka

RabbitMQ

Job description

AI Architect

Req number:

R8730

Employment type:

Full time

Worksite flexibility:

Remote

Who we are

CAI is a global services firm with over 9,000 associates worldwide and a yearly revenue of $1.3 billion+. We have over 40 years of excellence in uniting talent and technology to power the possible for our clients, colleagues, and communities. As a privately held company, we have the freedom and focus to do what is right—whatever it takes. Our tailor-made solutions create lasting results across the public and commercial sectors, and we are trailblazers in bringing neurodiversity to the enterprise.

Job Summary

We are looking for a motivated AI Architect ready to take us to the next level! If you have lead the design, strategy, and implementation of cutting-edge AI/ML platforms and solutions and are looking for your next career move.

Job Description

We are looking for an AI Architect to lead the design, strategy, and implementation of cutting-edge AI/ML platforms and solutions. This position will be full-time and remote .

What You’ll Do

• Define technical vision and architecture for conversational AI platforms, AI governance systems, and domain-specific agentic solutions

• Design cloud-native, microservices-based architectures for GenAI applications using AWS/Azure, Kubernetes, and API management platforms

• Establish architectural standards for LLM integration (Claude, OpenAI), RAG systems, vector databases, and AI orchestration

• Drive technology selection for frontend (React/Angular), backend (FastAPI, Node.js), databases (PostgreSQL, MongoDB, OpenSearch), and AI frameworks (LangChain, LlamaIndex)

• Design AI governance frameworks including usage tracking, cost optimization, access control (RBAC/ABAC), and compliance enforcement (SOC 2, GDPR)

• Architect API security patterns (OAuth 2.0, JWT, mTLS), data encryption, and audit logging for AI platforms

• Define multi-tenancy architecture for SaaS-based AI solutions with role-based access and data isolation

• Provide technical leadership to engineering teams (backend, frontend, AI/ML, DevOps) across India CoE and Singapore

• Conduct architecture reviews, design reviews, and guide implementation decisions for high-impact GenAI projects

• Collaborate with product managers, business stakeholders, and executive leadership to align technical architecture with business objectives

• Mentor architects and senior engineers on cloud-native design, AI/ML best practices, and enterprise integration patterns

• Design MLOps pipelines for AI model deployment, versioning, monitoring, and A/B testing

• Architect enterprise integrations with APIs, message brokers (Kafka, RabbitMQ), and legacy systems using event-driven patterns

• Define observability and monitoring strategies using Prometheus, Grafana, Datadog, and CloudWatch

What You'll Need

Required:

• 15+ years in enterprise software architecture with 5+ years designing AI/ML platforms or GenAI solutions

• Deep expertise in cloud-native architectures (AWS/Azure), microservices, API design, and distributed systems

• Strong knowledge of GenAI technologies (LLMs, RAG systems, vector databases, prompt engineering, agentic frameworks)

• Proven experience architecting enterprise-scale platforms serving 10,000+ users with high availability and security requirements

• Expert-level knowledge of backend frameworks (FastAPI, Node.js, Django), frontend frameworks (React, Angular), and database systems (SQL, NoSQL, vector databases)

• Strong understanding of AI/ML frameworks (LangChain, LlamaIndex, Hugging Face), model serving (TensorFlow Serving, Triton), and MLOps practices

• Proficiency in API management (MuleSoft, Apigee, Kong), event-driven architectures, and message brokers (Kafka, RabbitMQ)

• Deep knowledge of security (OAuth 2.0, JWT, encryption, OWASP), compliance (SOC 2, GDPR), and data privacy

• Proven ability to lead cross-functional teams, influence technical decisions, and drive architectural alignment

• Excellent communication skills with ability to present complex architectures to executive leadership and non-technical stakeholders

• Experience managing vendor relationships, technology partnerships, and third-party integrations

• Strong decision-making abilities based on data-driven insights, trade-off analysis, and business impact

Preferred:

• Certifications: AWS Solutions Architect Professional, Azure Solutions Architect Expert, TOGAF, or equivalent

• Experience with AI governance platforms, prompt management systems, and LLM observability tools (LangSmith, Weights & Biases)

• Knowledge of service mesh (Istio, Linkerd), API federation, and zero-trust security architectures

• Prior experience in manufacturing, engineering, or industrial domains is a plus

Physical Demands

• Ability to safely and successfully perform the essential job functions

• Sedentary work that involves sitting or remaining stationary most of the time with occasional need to move around the office to attend meetings, etc.

• Ability to conduct repetitive tasks on a computer, utilizing a mouse, keyboard, and monitor

Reasonable accommodation statement

If you require a reasonable accommodation in completing this application, interviewing, completing any pre-employment testing, or otherwise participating in the employment selection process, please direct your inquiries to [e-mail] or (888) 824 – 8111.