Senior AI / LLM Engineer

Thinkscoop Technologies; Bengaluru; Hybrid; INR 3,000,000 - 5,000,000; Full time

Benefits offered by this job

Remote-friendly culture

Learning budget

Performance bonuses

Equity participation

Job summary

Thinkscoop Technologies in Bengaluru and remote-friendly setting is seeking a Senior AI/LLM Engineer to design and operate intelligent systems in production across the full lifecycle.

You will build production RAG pipelines and multi‑agent workflows, set up LLMOps, collaborate with clients to translate business needs into scalable AI architectures, and own end‑to‑end delivery from design to deployment.

Qualifications

• 4+ years of software engineering experience with 2+ years in production ML or LLM systems.
• Strong Python skills and experience with LangChain, LlamaIndex, or similar frameworks.
• Hands-on experience with vector databases (Pinecone, Weaviate, Qdrant, pgvector).

Responsibilities

• Design and implement production RAG systems, LLM pipelines, and multi-agent workflows
• Build evaluation frameworks to measure accuracy, hallucination rate, and latency before every deployment
• Set up LLMOps infrastructure - logging, monitoring, cost tracking, and model versioning
• Work directly with clients to translate business requirements into AI architectures
• Conduct code reviews, define engineering standards, and mentor junior engineers
• Own end-to-end delivery from architecture to production handover

Skills

Python

LangChain

LlamaIndex

RAG pipelines

Vector databases

Pinecone

Weaviate

Qdrant

pgvector

OpenAI APIs

Prompt engineering

Cloud platforms

Docker

Kubernetes

Tools

Docker

Kubernetes

OpenAI API

Anthropic API

Cohere API

Langfuse

Helicone

Job description

• Home
• Careers
• Senior AI / LLM Engineer

All open roles

Engineering

Senior AI / LLM Engineer

Full-time

Bengaluru / Remote

4-8 years experience

Build production LLM systems, RAG pipelines, and agentic workflows that actually ship.

About The Role

We're looking for a Senior AI/LLM Engineer to design and operate intelligent systems in production. You'll work across the full lifecycle - from architecture and evaluation harnesses to deployment and monitoring. This isn't a research role. You'll be building AI systems that run real workflows for real clients, and you'll own the outcome.

What you'll do

• Design and implement production RAG systems, LLM pipelines, and multi-agent workflows
• Build evaluation frameworks to measure accuracy, hallucination rate, and latency before every deployment
• Set up LLMOps infrastructure - logging, monitoring, cost tracking, and model versioning
• Work directly with clients to translate business requirements into AI architectures
• Conduct code reviews, define engineering standards, and mentor junior engineers
• Own end-to-end delivery from architecture to production handover

What we're looking for

• 4+ years of software engineering experience with 2+ years in production ML or LLM systems
• Strong Python skills and experience with LangChain, LlamaIndex, or similar frameworks
• Hands‑on experience with vector databases (Pinecone, Weaviate, Qdrant, pgvector)
• Experience building and evaluating RAG pipelines at production scale
• Familiarity with OpenAI, Anthropic, Cohere, or open‑source LLM APIs
• Strong understanding of prompt engineering, context management, and retrieval strategies
• Experience with cloud infrastructure (AWS, GCP, or Azure) and containerisation (Docker, Kubernetes)

Nice to have

• Experience with multi‑agent frameworks (AutoGen, CrewAI, LangGraph)
• Familiarity with LLMOps tools (Langfuse, Helicone, Phoenix, W&B Weave)
• Prior consulting or client‑facing project delivery experience
• Contributions to open‑source AI tooling

What we offer

• Work on real production AI systems used by enterprise clients - not internal demos
• Senior, small team with direct impact on architecture decisions
• Competitive salary with performance‑linked bonuses
• Remote-friendly with async‑first culture
• Learning budget (courses, conferences, research papers)
• Access to the latest LLM platforms, APIs, and tooling budgets
• Equity participation for exceptional contributors

Role at a glance

• Department: Engineering
• Type: Full‑time
• Location: Bengaluru / Remote
• Experience: 4-8 years