AI Solution Architect (LLM & Generative AI)

Veltris

India

Hybrid

INR 4,000,000 - 6,000,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Health Insurance
Meal Card
Internet/Mobile Allowance
Elite Bonuses

Job summary

Veltris is seeking an experienced AI Solution Architect (LLM & Generative AI) to define and lead the architecture of enterprise-grade AI platforms powered by large language models and agentic systems. You will collaborate with clients, product teams, and engineering leaders to translate complex business problems into scalable and secure AI solutions.

The role covers end-to-end architecture for RAG, multi-model orchestration, and responsible AI practices across cloud environments (AWS/Azure/GCP).

Qualifications

  • PhD in Computer Science, AI, ML, Data Science or related technical discipline.
  • 10+ years in software engg, data, or AI/ML with architecture/leadership.
  • 3+ years building deploying LLM-based solutions.

Responsibilities

  • Define end-to-end architectures for LLM-powered applications including RAG, agentic workflows and multi-model orchestration.
  • Engage with clients and stakeholders to understand objectives and design fit-for-purpose AI solutions.
  • Select foundation models and decide between prompt engineering, fine-tuning, and retrieval strategies based on cost, latency, accuracy, and risk.
  • Design evaluation frameworks, guardrails and monitoring for production AI systems.

Skills

LLM
Generative AI
RAG
Agentic AI
Prompt Engineering
Fine-tuning
Embeddings
Vector Databases
LangChain
LangGraph
LlamaIndex
GPT
Claude
Llama
Mistral
Gemini
Python
Solution Architecture
AI Architecture
MLOps
LLMOps
AWS
Azure
GCP
Cloud Native
Microservices
CI/CD
Responsible AI

Education

PhD in CS/AI/ML

Job description

Greetings from Veltris!

  • Role: AI Solution Architect (LLM & Generative AI)
  • Experience: 13+
  • Location: Hyderabad / Remote
  • Shift Timings: UK Timings (12/1 PM to 9/10 PM IST) or General Timings
  • Notice Period: 0-15 Days/30 Max (Due to project dependency)
  • No. of open positions: 1
Job Summary:

We are looking for an accomplished AI Solution Architect to define and lead the architecture of enterprise-grade AI solutions powered by large language models and agentic systems. In this role, you will partner with clients, product teams, and engineering leaders to translate complex business problems into scalable, secure, and production-ready AI platforms.

Key Responsibilities:
  • Define end-to-end architectures for LLM-powered applications, including retrieval-augmented generation (RAG), agentic workflows, and multi-model orchestration.
  • Engage with clients and stakeholders to understand business objectives, assess AI feasibility, and design fit-for-purpose solutions.
  • Select and evaluate foundation models, open-source and proprietary, and decide between prompt engineering, fine-tuning, and retrieval strategies based on cost, latency, accuracy, and risk.
  • Design robust evaluation frameworks, guardrails, and monitoring to ensure quality, safety, and reliability of AI systems in production.
  • Architect scalable, secure, and observable AI platforms on cloud environments such as AWS, Azure, or Google Cloud.
  • Establish best practices for responsible AI, including data privacy, security, governance, bias mitigation, and compliance.
  • Provide technical leadership and mentorship to engineers, data scientists, and ML engineers across projects.
  • Create reference architectures, proofs of concept, and technical documentation, and present solutions to both technical and executive audiences.
  • Track emerging research and technologies, and assess their applicability to client and internal use cases.
Preferred candidate profile:
  • Published research or patents in machine learning, natural language processing, or generative AI.
  • Experience with LLMOps and MLOps practices, including model serving, evaluation pipelines, observability, and versioning.
  • Experience building multi-agent systems with planning, memory, and tool-use capabilities.
  • Familiarity with model optimization techniques such as quantization, distillation, and efficient inference.
  • Experience with distributed data and streaming technologies such as Kafka, Spark, or Flink.
  • Domain experience in healthcare, communications, manufacturing, or technology.
  • Cloud or AI certifications from AWS, Azure, or Google Cloud.
Basic Qualifications:
  • PhD in Computer Science, Artificial Intelligence, Machine Learning, Data Science, or a related technical discipline.
  • 10+ years of experience in software engineering, data, or AI/ML, with at least 5 years in an architecture or technical leadership role.
  • 3+ years of hands‑on experience building and deploying solutions with large language models (for example GPT, Claude, Llama, Mistral, or Gemini families).
  • Strong experience with modern generative AI techniques: RAG, prompt engineering, fine‑tuning, embeddings, vector databases, tool use, and agent orchestration (for example LangChain, LangGraph, or LlamaIndex).
  • Proficiency in Python and experience with at least one additional general‑purpose language such as Java, Go, or TypeScript.
  • Proven experience designing cloud‑native, distributed systems on AWS, Azure, or Google Cloud, including containers and CI/CD.
  • Demonstrated ability to take AI solutions from concept to production, with attention to scalability, latency, cost, and reliability.
Key Skills
  • LLM, Generative AI, RAG, Agentic AI, Prompt Engineering, Fine-tuning, Embeddings, Vector Databases, LangChain, LangGraph, LlamaIndex, GPT, Claude, Llama, Mistral, Gemini, Python, Solution Architecture, AI Architecture, MLOps, LLMOps, AWS, Azure, GCP, Cloud Native, Microservices, CI/CD, Responsible AI
Perks and benefits:
  • Health Insurance
  • Meal Card
  • Internet/Mobile Allowance
  • Elite Bonuses

Regards

Chiranjeevi

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

AI Solution Architect
AI Solution Architect

Wfnen • Bengaluru

On-site
INR 1,500,000 - 2,500,000
Data Science – Gen AI / LLM
Data Science – Gen AI / LLM

Greytip Software Private Limited • Hyderabad

On-site
INR 2,500,000 - 3,800,000
Generative AI Technical Architect
Generative AI Technical Architect

ETT CareerMove • Bengaluru Urban

Hybrid
INR 2,500,000 - 3,500,000
Solutions Architect - Applied AI
Solutions Architect - Applied AI

Lyzr AI • Bengaluru

Hybrid
INR 1,500,000 - 3,000,000
AI Software Architect (LLM & Agentic Systems)
AI Software Architect (LLM & Agentic Systems)

Aziro • Hyderabad

Hybrid
INR 3,000,000 - 6,000,000
AIML Engineer
AIML Engineer

Latent Bridge Pvt Ltd • Pune District, Bengaluru, Bhopal

On-site
INR 4,000,000 - 7,000,000
AI Lead Engineer New
AI Lead Engineer New

NetVerks Inc. • Pune District

On-site
INR 4,000,000 - 7,000,000
Senior AI Engineer
Senior AI Engineer

Confidential Hires • Gurugram District

On-site
INR 4,000,000 - 7,000,000
Gen AI Architect | Immediate Joiner | Trivandrum or Kochi Location
Gen AI Architect | Immediate Joiner | Trivandrum or Kochi Location

UST • Thiruvananthapuram

On-site
INR 2,500,000 - 3,500,000
AI Architect
AI Architect

Datakosa Limited • Hyderabad

Hybrid
INR 4,000,000 - 7,000,000