AI Architect - Generative AI

Jero Technologies; Hyderabad; On-site; INR 3,500,000 - 6,000,000; Full time

Job summary

Jero Technologies in Hyderabad is seeking a seasoned AI architecture lead to design scalable AI systems, including LLMs, RAG, and agent orchestration. You will guide backend, data engineering, and ML teams, define evaluation, observability, and cost optimization standards, and ensure enterprise security and governance alignment.

The role requires deep hands-on expertise with GenAI, vector databases, and modern AI tooling, plus strong coding skills in Python/Java and experience with cloud AI

Qualifications

• Design AI architecture, including LLMs, RAG, multi-agent orchestration, embeddings, and model routing.
• Architect AI asset discovery connectors for models, datasets, agents, prompts, and endpoints.
• Implement AI guardrails for PII detection, prompt injection, jailbreaks, and content moderation.
• Lead architecture reviews and guide AI/ML, backend, and data engineering teams.
• Define LLM evaluation, observability, performance, latency, and cost optimization standards.
• Ensure enterprise security, scalability, and alignment with AI governance frameworks.

Responsibilities

• Design AI architecture, including LLMs, RAG, multi-agent orchestration, embeddings, and model routing.
• Architect AI asset discovery connectors for models, datasets, agents, prompts, and endpoints.
• Implement AI guardrails for PII detection, prompt injection, jailbreaks, and content moderation.
• Lead architecture reviews and guide AI/ML, backend, and data engineering teams.
• Define LLM evaluation, observability, performance, latency, and cost optimization standards.
• Ensure enterprise security, scalability, and alignment with AI governance frameworks.

Skills

Python

Java

GenAI

LLMs

RAG

Prompt engineering

Vector databases

APIs

Microservices

RBAC

SSO

Audit logging

Tools

LangChain

LangGraph

Semantic Kernel

MCP

Bedrock

SageMaker

Azure OpenAI

Azure AI Foundry

LangSmith

Langfuse

Ragas

Arize

Job description

Key Responsibilities

• Design AI architecture, including LLMs, RAG, multi-agent orchestration, embeddings, and model routing.
• Architect AI asset discovery connectors for models, datasets, agents, prompts, and endpoints.
• Implement AI guardrails for PII detection, prompt injection, jailbreaks, and content moderation.
• Lead architecture reviews and guide AI/ML, backend, and data engineering teams.
• Define LLM evaluation, observability, performance, latency, and cost optimization standards.
• Ensure enterprise security, scalability, and alignment with AI governance frameworks.

Required Skills

• Strong programming experience in Python and/or Java.
• Hands-on expertise in GenAI, LLMs, RAG, vector databases, and prompt engineering.
• Experience with LangChain, LangGraph, Semantic Kernel, and familiarity with MCP.
• Experience with AWS Bedrock, SageMaker, Azure OpenAI, or Azure AI Foundry.
• Strong knowledge of APIs, microservices, event-driven architecture, RBAC, SSO, and audit logging.
• Familiarity with LangSmith, Langfuse, Ragas, or Arize.