AI Principal Architect

Kyndryl Inc.; Bengaluru; On-site; INR 4,500,000 - 6,500,000; Full time

Job summary

Kyndryl is seeking an AI Principal Architect to design the end-to-end Agentic AI platform, spanning runtime, orchestration, LLMs, and secure cloud deployment. You will ensure seamless integrations with ITSM tools, CMDB, repositories, and monitoring platforms while enforcing security, privacy, and governance across the lifecycle.

Lead architecture reviews, define ARB-aligned references, and drive production readiness with scalable, observable, and compliant solutions in a hybrid, multi-location

Qualifications

• 10+ years in enterprise/cloud architecture designing AI agent runtimes and multi-agent orchestration.
• 3+ years in GenAI/LLM platforms architecting RAG pipelines and model routing.
• Expertise in multi-cloud landing zones, Kubernetes, API gateways, RBAC/ABAC and data encryption/residency.

Responsibilities

• Design end-to-end agentic AI frameworks including runtime, orchestration, LLMs, and secure cloud topology.
• Define reusable reference architectures and non-functional requirements for scalability, availability, performance, and DR.
• Build security patterns covering data residency, encryption, identity access, and audit logging.
• Implement human-in-the-loop controls, approval gates, and prompt governance for ARB approvals.
• Define API and event-driven patterns connecting agents with ITSM tools, CMDB, GitHub, SharePoint, and monitoring platforms.
• Architect RAG pipelines, vector search strategies, and metadata models for enterprise data access.
• Review designs for target architecture standards and ensure go-live readiness.

Skills

Agentic AI & Orchestration Architect

LLM & RAG Solutions

Cloud & Enterprise Security

AMS & ITSM Integration

Governance & Lifecycle Management

Architecture Governance & NFRs

Production-Grade Delivery

Core Artifact Creation

Education

Master's degree

Certifications (relevant)

Tools

LangChain

LangGraph

AutoGen

CrewAI

MCP

Azure OpenAI

Gemini

Claude

Llama

Mistral

Job description

## AI Principal ArchitectApplyremote type: Partially Remotelocations: Bangalore, Karnataka, India: Hyderabad, Telangana, India: Gurgaon, Haryana, India: Chennai, Tamil Nadu, India: Pune, Maharashtra, Indiatime type: Full timeposted on: Posted Todayjob requisition id: R-66449**Who We Are**At Kyndryl, we run and reimagine the mission-critical technology systems that drive advantage for the world’s leading businesses. We are at the heart of progress; with proven expertise and a continuous flow of AI-powered insight, enabling smarter decisions, faster innovation, and a lasting competitive edge. For our people—Kyndryls—that means doing purposeful work that powers human progress. Join us and experience a flexible, supportive environment where your well-being is prioritized and your potential can thrive.**The Role****Your role:** The ideal candidate will be responsible for designing the end-to-end Agentic AI platform and solution architecture. In this role, you will define robust deployment patterns across the entire software lifecycle—from initial sandbox and POC environments to customer landing zones, staging, production, and ongoing BAU support. You will architect seamless integrations connecting AI agents with enterprise IT systems, including ITSM tools, CMDB, knowledge repositories, monitoring platforms, cloud services, source code management, and identity providers. Additionally, you will ensure all AI agents are deployed with enterprise-grade security, data privacy, full observability, risk management controls, human-in-the-loop approval workflows, and strict alignment with overarching enterprise architecture standards. **What you will do:*** **Target-State & Topology Design:** Architect end-to-end agentic AI frameworks—including runtime, orchestration, LLMs, and secure cloud deployment topologies.* **Standards & NFR Definition:** Establish reusable reference architectures and non-functional requirements (NFRs) for scalability, availability, performance, and disaster recovery.* **Security & Access Governance:** Design robust security patterns covering data residency, encryption, secrets management, identity access (RBAC/ABAC), and audit logging.* **Guardrails & Compliance:** Build human-in-the-loop controls, approval gates, prompt versioning, and compliance documentation for Architecture Review Board (ARB) approvals.* **Enterprise Integration:** Define API and event-driven integration patterns connecting agents with tools like ServiceNow, GitHub, SharePoint, and monitoring platforms.* **RAG & Knowledge Strategy:** Architect Retrieval-Augmented Generation (RAG) pipelines, vector search strategies, metadata models, and enterprise data access.* **Design Oversight:** Review and align engineering designs from platform, agent, and data engineers against target architecture standards.* **Delivery & Governance:** Produce architectural blueprints and lead technical governance across performance testing, security validation, and go-live readiness.Your Future at Kyndryl The career path ahead is full of exciting opportunities to grow and advance within the job family. With dedication and hard work, you can climb the ladder to higher bands, achieving coveted positions such as Principal Engineer or Vice President of Software. These roles not only offer the chance to inspire and innovate, but also bring with them a sense of pride and accomplishment for having reached the pinnacle of your career in the software industry.**Who You Are**You’re good at what you do and possess the required experience to prove it. However, equally as important – you have a growth mindset; keen to drive your own personal and professional development. You are customer-focused – someone who prioritizes customer success in their work. And finally, you’re open and borderless – naturally inclusive in how you work with others.## ## Required Technical and Professional Experience* **Agentic AI & Orchestration Architecture:** 10+ years in enterprise/cloud architecture with hands-on experience designing AI agent runtimes, multi-agent orchestration, durable execution, and tool registries (LangChain, LangGraph, AutoGen, CrewAI, MCP).* **LLM & RAG Solutions:** 3+ years in GenAI/LLM platforms—architecting RAG pipelines, vector search strategies, model routing, prompt governance, guardrails, and integrations across Azure OpenAI, Gemini, Claude, Llama, and Mistral.* **Cloud & Enterprise Security:** Expertise in multi-cloud (Azure, GCP, AWS) landing zones, Kubernetes, API gateways, Zero Trust models, RBAC/ABAC, data encryption/residency, and SIEM/SOC integrations.* **AMS & ITSM Integration:** Proven track record architecting enterprise integration patterns for ITSM platforms (ServiceNow, CMDB), developer tools (GitHub, Jira), knowledge repositories (SharePoint, Confluence), and monitoring systems.* **Governance & Lifecycle Management:** Deep experience managing the full AI agent lifecycle, setting low-code/no-code platform guardrails, and enforcing security, privacy, and safety controls to mitigate hallucinations.* **Architecture Governance & NFRs:** Skilled in creating Architecture Decision Records (ADRs), NFR matrices, solution design documents, and guiding teams through ARB, security reviews, and production readiness gates.* **Production-Grade Delivery:** Demonstrated capability in designing compliant, secure, scalable, and high-availability cloud-native architectures under enterprise constraints.* **Core Artifact Creation:** Responsible for producing target-state blueprints, deployment topologies, security packs, data retrieval strategies, and risk logs for enterprise deployment.**Preferred Technical and Professional Experience*** Master Degree & any relevant certification**Being You**The “Kyn” in Kyndryl means kinship, which represents the strong bonds we have with each other, our customers and our communities. We focus on ensuring all Kyndryls feel included and we welcome people of all cultures, backgrounds, and experiences. Even if you don’t meet every requirement, we encourage you to apply. We believe in growth, and we’re excited to see what you can bring. At Kyndryl, employee feedback has told us that our number one driver of employee engagement is belonging. That sense of belonging — being a valued, respected, trusted member of the team — is fundamental to our culture and fueling great experiences for our customers. This dedication to welcoming everyone into our company means that Kyndryl gives you the ability to thrive and contribute to our culture of empathy and shared success. That’s The Kyndryl Way.**What You Can Expect**Your career with us isn’t just a job—it’s an adventure with purpose. We offer a dynamic, hybrid-friendly culture that supports your well-being and empowers you to grow. Our Be Well programs are thoughtfully designed to support your financial, mental, physical, and social health—because we know that when you feel your best, you do your best. From your very first day, you’ll dive into impactful work that powers the systems our customers rely on every day. You won’t just contribute—you’ll make a difference, tackling meaningful projects that sharpen your skills and fuel your growth. We’re here to champion your journey. With powerful tools to chart your career path, personalized development goals aligned with your ambitions, and continuous feedback to keep you inspired and on track, you’ll have everything you need to thrive and evolve. You’ll develop in-demand skills to grow your career and achieve your ambitions with access to cutting-edge learning opportunities—from certifications with Microsoft, Google, and Amazon to coaching and hands-on experiences. And through it all, you’ll be part of a culture that values empathy, restless learning, and a devotion to shared success. We want you to thrive here—and we’re committed to helping you do just that. Ready to make an impact? Join us and help shape what’s next.