GenAI Architect | Generative AI | LLM | RAG | Agentic AI

Connectio It; Dadri, Pune District, Bengaluru; On-site; INR 4,000,000 - 8,000,000; Full time

Job summary

Connectio It is seeking an experienced GenAI Architect to design enterprise-grade Generative AI and LLM solutions. The role emphasizes RAG, Agentic AI, and orchestration across Azure OpenAI, OpenAI, Claude and other platforms.

You will architect scalable GenAI systems with embeddings, vector databases, and LLMOps, while ensuring secure APIs and governance. Lead projects from POC to production with senior engineering teams.

Qualifications

• 10+ years overall IT experience
• GenAI / Generative AI / LLM
• RAG
• Agentic AI / AI Agents
• Azure OpenAI
• LLM orchestration (LangChain / LangGraph / LlamaIndex)
• Vector databases (Pinecone / FAISS / Weaviate / Azure AI Search)
• LLMOps / AI evaluation / monitoring
• REST APIs / Microservices
• AI Security / Governance

Responsibilities

• Design scalable GenAI/LLM architectures for production
• Architect RAG, Agentic AI, multi-agent workflows and context orchestration
• Work with Azure OpenAI, AWS Bedrock, OpenAI, Claude, Gemini, LLaMA, Mistral and other LLM platforms
• Design solutions using Azure AI Search, Pinecone, FAISS, Weaviate and embeddings
• Define LLMOps including model deployment, evaluation, monitoring and prompt management
• Design secure APIs, microservices and event-driven architectures
• Implement AI security, Responsible AI, governance and compliance
• Lead GenAI solutions from POC to production and provide technical leadership

Skills

GenAI / Generative AI

LLM

RAG

Agentic AI / AI Agents

LLMOps

REST APIs / Microservices

AI Security / Governance

AI orchestration

Tools

Azure OpenAI

Azure AI Search

Pinecone

FAISS

Weaviate

LangChain / LangGraph / LlamaIndex

OpenAI / Claude / Gemini / LLaMA / Mistral

MLOps tools / monitoring

Job description

Job Summary:

We are looking for an experienced GenAI Architect to design and lead enterprise-grade Generative AI and LLM solutions. The ideal candidate should have strong experience in RAG, Agentic AI, LLM orchestration, cloud AI platforms, vector databases, LLMOps, and AI security/governance.

Key Responsibilities:

• Design scalable and production-ready GenAI/LLM architectures.
• Architect RAG, Agentic AI, multi-agent workflows and context orchestration solutions.
• Work with Azure OpenAI, AWS Bedrock, OpenAI, Claude, Gemini, LLaMA, Mistral and other LLM platforms.
• Design solutions using Azure AI Search, Pinecone, FAISS, Weaviate and embeddings.
• Define LLMOps, including model deployment, evaluation, monitoring and prompt management.
• Design secure APIs, microservices and event-driven architectures.
• Implement AI security, Responsible AI, governance and compliance practices.
• Lead GenAI solutions from POC to production and provide technical leadership to engineering teams.

Required Skills:

Must Have:

• 10+ years overall IT experience
• GenAI / Generative AI / LLM
• RAG
• Agentic AI / AI Agents
• Azure OpenAI
• LLM orchestration LangChain / LangGraph / LlamaIndex
• Vector databases – Pinecone / FAISS / Weaviate / Azure AI Search
• LLMOps / AI evaluation / monitoring
• REST APIs / Microservices
• AI Security / Governance

Good to Have:

• AWS Bedrock / Google Vertex AI
• MCP
• Claude / Gemini / LLaMA / Mistral
• Kubernetes / Docker
• MLflow / LangSmith / RAGAS / DeepEval