AI Architect - Generative AI

Jero Technologies; Ahmedabad District; On-site; INR 1,500,000 - 3,000,000; Full time

Job summary

Jero Technologies is seeking an experienced AI architect to design scalable AI systems, including LLMs, RAG, and multi-agent orchestration. You will build governance-aligned architectures, ensure security and observability, and lead AI/ML, backend, and data engineering teams through architecture reviews.

You will implement guardrails for data privacy, prompt injection prevention and content moderation while evaluating performance and cost. Strong collaboration across disciplines is essential.

Qualifications

• Demonstrated experience shaping AI/ML architectures.
• Proven proficiency in Python and/or Java for production systems.
• Hands-on work with GenAI, LLMs, and RAG pipelines.
• Experience with vector stores and prompt engineering best practices.
• Familiarity with LangChain, LangGraph, Semantic Kernel and related tooling.

Responsibilities

• Design AI architecture including LLMs, RAG, multi-agent orchestration and embeddings.
• Architect AI asset discovery connectors for models, datasets, agents, prompts and endpoints.
• Implement guardrails for PII detection, prompt injection, jailbreaks and content moderation.
• Lead architecture reviews with AI/ML, backend and data teams.
• Define LLM evaluation, observability, performance, latency and cost standards.
• Ensure security, scalability and governance alignment.

Skills

Python

Java

GenAI

LLMs

RAG

Vector databases

Prompt engineering

LangChain

LangGraph

Semantic Kernel

MCP

AWS Bedrock

SageMaker

Azure OpenAI

Azure AI Foundry

APIs

Microservices

RBAC

SSO

Audit logging

LangSmith

Langfuse

Ragas

Arize

Tools

LangChain

LangGraph

Semantic Kernel

MCP

Job description

Key Responsibilities

• Design AI architecture, including LLMs, RAG, multi-agent orchestration, embeddings, and model routing.
• Architect AI asset discovery connectors for models, datasets, agents, prompts, and endpoints.
• Implement AI guardrails for PII detection, prompt injection, jailbreaks, and content moderation.
• Lead architecture reviews and guide AI/ML, backend, and data engineering teams.
• Define LLM evaluation, observability, performance, latency, and cost optimization standards.
• Ensure enterprise security, scalability, and alignment with AI governance frameworks.

Required Skills

• Strong programming experience in Python and/or Java.
• Hands-on expertise in GenAI, LLMs, RAG, vector databases, and prompt engineering.
• Experience with LangChain, LangGraph, Semantic Kernel, and familiarity with MCP.
• Experience with AWS Bedrock, SageMaker, Azure OpenAI, or Azure AI Foundry.
• Strong knowledge of APIs, microservices, event-driven architecture, RBAC, SSO, and audit logging.
• Familiarity with LangSmith, Langfuse, Ragas, or Arize.