Software Architect

Kore.ai; Hyderabad; On-site; INR 350,000 - 650,000; Full time

Job summary

Kore.ai in Hyderabad is seeking a senior AI/ML/backend engineer with 10+ years of backend/AI experience to ship enterprise-grade LLM-powered features and ensure robust, deterministic performance.

The role focuses on latency, observability, data residency, audit trails, and guardrails while leveraging LangChain/LlamaIndex and LLM APIs for scalable, reliable AI solutions.

Qualifications

• 10+ years of AI/ML or backend engineering experience.
• Hands-on production experience with LLM APIs (Anthropic, OpenAI, Cohere).
• Experience designing evaluation frameworks: automated evals, regression tests, or LLM-as-judge pipelines.

Responsibilities

• Production builder: shipped LLM-powered features with real users and debugged issues.
• LLM practitioner: understand hallucinations, retrieval failures, context limits, and enterprise determinism.

Skills

Backend engineering

AI/ML exposure

Python programming

LangChain experience

LLM API familiarity

Tools

LangChain

LLamaIndex

Retrieval augmented generation

Job description

Responsibilities

• Production builder: You've shipped LLM-powered features real users depend on and debugged them when they broke.
• LLM practitioner: You understand hallucinations, retrieval failures, context limits, and what it takes to make agents deterministic enough for enterprise use.
• Systems thinker: You design for latency, failure modes, retry logic, and observability before features.
• Enterprise-aware: Data residency, compliance, audit trails, and deterministic guardrails are first-class design constraints for you.

Requirements

• 10+ years in AI/ML or backend engineering with strong AI exposure.
• Hands-on production experience with LLM APIs (Anthropic, OpenAI, Cohere).
• Experience designing evaluation frameworks: automated evals, regression tests, or LLM-as-judge pipelines.
• Strong Python; experience with LangChain, LlamaIndex, or similar agentic frameworks.
• Familiarity with RAG architectures: chunking, embedding models, vector DBs, retrieval quality.