Agentic AI Engineer II -cloud

Cyod; Gurugram District; On-site; INR 2,500,000 - 6,000,000; Full time

Benefits offered by this job

Medical Insurance

Health Benefits

Professional Development: Learning &-C

Job summary

Insight India is seeking a Cloud AI Engineer II to lead architecture, design, and delivery of enterprise-scale AI/ML and Generative AI cloud platforms across AWS, Azure, and GCP from its Gurugram location.

You will drive technical strategy, establish engineering standards, mentor teams, and deliver secure, scalable AI infrastructure with a strong emphasis on MLOps and LLMOps across multi-cloud environments.

Qualifications

• Strong hands-on experience with AWS, Azure and Google Cloud Platform (GCP).
• Experience with GenAI frameworks and orchestration tools (LangChain, CrewAI, LlamaIndex, Semantic Kernel).
• Experience designing RAG pipelines, embedding workflows, document ingestion pipelines, prompt orchestration, vector search, and enterprise knowledge retrieval solutions.
• Strong understanding of LLM deployment, model serving, inference optimization, prompt engineering, evaluation, guardrails, and responsible AI controls.
• Strong Python and scripting skills (Python, Bash, PowerShell or similar).

Responsibilities

• Architect enterprise-scale AI/ML infrastructure across AWS, Azure, and Google Cloud Platform, ensuring high availability, scalability, performance, and cost efficiency.
• Lead the design and implementation of cloud infrastructure standards, governance frameworks, security controls, and best practices for AI/ML platforms.
• Design scalable Kubernetes-based platforms and self-service environments for ML, data science, and applications teams to build and deploy AI workloads.
• Architect Generative AI, Retrieval-Augmented Generation, vector database, and LLM deployment solutions using LangChain, CrewAI, LlamaIndex, OpenAI-compatible APIs, and enterprise AI services.
• Strong understanding of Microsoft Foundry.
• Build and manage production-grade MLOps and LLMOps pipelines for training, deployment, monitoring, versioning, evaluation, and continuous improvement.
• Design cloud-native solutions for AI workloads using containers, orchestration, serverless, GPU-accelerator compute, managed ML services, and distributed processing frameworks.

Skills

AWS

Azure

Google Cloud

LangChain

CrewAI

LlamaIndex

Semantic Kernel

Python

Automation/Scripting

Tools

Kubernetes

OpenAI APIs

LangChain

LlamaIndex

Semantic Kernel

Job description

Requisition Number: 105658

Insight at a Glance

• 14,000+ engaged teammates globally with operations in 25 countries across the globe.
• Received 35+ industry and partner awards in the past year
• $9.2 billion in revenue
• #20 on Fortune’s World's Best Workplaces™ list
• #14 on Forbes World's Best Employers in IT – 2023
• #23 on Forbes Best Employers for Women in IT- 2023
• $1.4M+ total charitable contributions in 2023 by Insight globally

Location: This is a hybrid opportunity in Delhi NCR, Hyderabad, Bangalore, Pune.

Role Overview

As a Cloud AI Engineer II, you will be responsible for leading the architecture, design, and delivery of enterprise-scale AI/ML and Generative AI cloud platforms. You will drive technical strategy, establish engineering standards, mentor teams, and deliver secure, scalable, reliable, and cost-optimized AI infrastructure across multi-cloud environments including AWS, Azure, and GCP.

This role requires a strong combination of cloud architecture, AI/ML platform engineering, Kubernetes, MLOps, GenAI solution design, infrastructure automation, security governance, and hands‑on experience deploying production‑grade AI workloads.

Key Roles and Responsibilities

• Architect enterprise-scale AI/ML infrastructure across AWS, Azure, and Google Cloud Platform, ensuring high availability, scalability, performance, and cost efficiency.
• Lead the design and implementation of cloud infrastructure standards, governance frameworks, security controls, and technical best practices for AI/ML platforms.
• Design scalable Kubernetes-based platforms and self‑service environments that enable ML, data science, and application teams to build, deploy, and manage AI workloads independently.
• Architect Generative AI, Retrieval‑Augmented Generation, vector database, and LLM deployment solutions using frameworks and tools such as LangChain, CrewAI, LlamaIndex, OpenAI‑compatible APIs, and enterprise AI services.
• Very good understanding of Microsoft Foundry
• Build and manage production‑grade MLOps and LLMOps pipelines for model training, deployment, monitoring, versioning, evaluation, and continuous improvement.
• Design cloud‑native solutions for AI workloads using containerization, orchestration, serverless computing, GPU/accelerator‑based compute, managed ML services, and distributed processing frameworks.

Required Skills and Technical Expertise

• Strong hands‑on experience with cloud platforms such as AWS, Microsoft Azure, and Google Cloud Platform.
• Hands‑on experience with GenAI frameworks and orchestration tools such as LangChain, CrewAI, LlamaIndex, Semantic Kernel, or similar frameworks.
• Experience designing RAG pipelines, embedding workflows, document ingestion pipelines, prompt orchestration, vector search, and enterprise knowledge retrieval solutions.
• Strong understanding of LLM deployment patterns, model serving, inference optimization, prompt engineering, evaluation frameworks, guardrails, and responsible AI controls.
• Strong scripting and programming skills in Python, Bash, PowerShell, or similar languages, with the ability to build automation and integration solutions.
• Ability to work with APIs, data models, and external toolchains across complex systems.

What you can expect

We’re legendary for taking care of you, your family and to help you engage with your local community. We want you to enjoy a full, meaningful life and own your career at Insight. Some of our benefits include:

• Freedom to work from another location—even an international destination—for up to 30 consecutive calendar days per year.
• Medical Insurance
• Health Benefits
• Professional Development: Learning Platform and Certificate Reimbursement
• Shift Allowance

But what really sets us apart are our core values of Hunger, Heart, and Harmony, which guide everything we do, from building relationships with teammates, partners, and clients to making a positive impact in our communities.

At Insight, we celebrate diversity of skills and experience so even if you don’t feel like your skills are a perfect match - we still want to hear from you!

Learn more about Insight: https://www.linkedin.com/company/insight/

Insight is an equal opportunity employer, and all qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, disability status, protected veteran status, sexual orientation or any other characteristic protected by law.

Insight India Location: Level 16, Tower B, Building No 14, Dlf Cyber City In It/Ites Sez, Sector 24 &25 A Gurugram Gurgaon Hr 122002 India