AI Architect

Persistent Systems; Bengaluru; Hybrid; INR 3,500,000 - 9,000,000; Full time

Benefits offered by this job

Hybrid work

Company-sponsored education

Long service awards

Insurance coverage (life, accident, &c

Job summary

Persistent Systems in Bengaluru seeks an experienced AI Architect to lead the design and architecture of Agentic AI and LLM-powered solutions. The role focuses on building scalable, human-in-the-loop multi-agent systems on AWS, driving AI innovation, and providing technical leadership to engineering teams.

You will own end-to-end technical design across work streams, including multi-agent orchestration, LLM workflows, backend services, AWS deployment, and governance with 13+ years of experience

Qualifications

• 10+ years in software / AI engineering, with recent hands-on experience architecting Agentic AI and LLM-powered solutions.
• Expert Python experience, with strong command of FastAPI and backend service architecture.
• Proven experience designing and building LLM-powered applications and multi-agent systems (LangGraph or equivalent orchestration frameworks).
• Deep experience with ORMs, data modeling and business-logic design.
• Strong experience architecting, deploying and operating services on AWS.
• Hands-on with RAG pipelines, vector databases and embeddings.
• Expertise in prompt engineering, and in AI evaluation, observability and guardrails.
• Demonstrated technical leadership — mentoring engineers, driving design reviews, and engaging senior stakeholders.
• Experience delivering in regulated environments (e.g., 21 CFR Part 11 / Annex 11).
• Familiarity with Salesforce and AWS integration patterns, and Datadog observability.

Responsibilities

• Lead the end-to-end technical design and architecture of the agent ecosystem across work streams, from multi-agent orchestration and LLM workflows to backend services and AWS deployment.
• Provide technical leadership and mentorship to the AI engineering team.
• Ensure governance, compliance, and operational excellence in AI solutions.

Skills

Python

FastAPI

Backend architecture

LLM integration

Agentic AI

AWS deployment

RAG pipelines

Vector databases

Embeddings

Prompt engineering

Observability

Guardrails

Team leadership

Salesforce integration

Tools

LangGraph

ORMs

Datadog

AWS

Job description

We are looking for an experienced AI Architect to lead the design and architecture of Agentic AI and LLM-powered solutions. The role involves building scalable, human-in-the-loop multi-agent systems on AWS, driving AI innovation, and providing technical leadership to engineering teams while ensuring governance, compliance, and operational excellence.

• Role: AI Architect
• Experience:13+ yrs
• Job Type: Full Time Employment

What You'll Do:

• This role is part of the Agentic AI Cases squad delivering different work streams.
• The solution is built as a human-in-the-loop, multi-agent system on AWS, with confidence scoring, token optimization, and a shared governance and audit backbone.
• As Agentic AI Architect, you own the end-to-end technical design and architecture of the agent ecosystem across work streams from multi-agent orchestration and LLM workflows to backend services, AWS deployment, and regulatory compliance by design while providing technical leadership and mentorship to the AI engineering team.

Expertise You'll Bring:

• 10+ years in software / AI engineering, with recent hands-on experience architecting Agentic AI and LLM-powered solutions.
• Expert Python experience, with strong command of FastAPI and backend service architecture.
• Proven experience designing and building LLM-powered applications and multi-agent systems (LangGraph or equivalent orchestration frameworks).
• Deep experience with ORMs, data modeling and business-logic design.
• Strong experience architecting, deploying and operating services on AWS.
• Hands-on with RAG pipelines, vector databases and embeddings.
• Expertise in prompt engineering, and in AI evaluation, observability and guardrails.
• Demonstrated technical leadership — mentoring engineers, driving design reviews, and engaging senior stakeholders.
• Nice to Have
• Experience delivering in regulated GxP environments 21 CFR Part 11 / Annex 11.
• Familiarity with Salesforce and AWS integration patterns, and Datadog observability.
• All AI outputs remain advisory and human-reviewed, no autonomous case decisions; design accordingly.
• Work within an Agile, story-point-based delivery model with fortnightly sprints and phased delivery gates.
• Any Graduates
• Competitive salary and benefits package
• Culture focused on talent development with quarterly growth opportunities and company-sponsored higher education and certifications
• Opportunity to work with cutting-edge technologies
• Employee engagement initiatives such as project parties, flexible work hours, and Long Service awards
• Insurance coverage: group term life, personal accident, and Mediclaim hospitalization for self, spouse, two children, and parents

Values-Driven, People-Centric & Inclusive Work Environment:

Persistent is dedicated to fostering diversity and inclusion in the workplace. We invite applications from all qualified individuals, including those with disabilities, and regardless of gender or gender preference. We welcome diverse candidates from all backgrounds.

• We support hybrid work and flexible hours to fit diverse lifestyles.
• Our office is accessibility-friendly, with ergonomic setups and assistive technologies to support employees with physical disabilities.
• If you are a person with disabilities and have specific requirements, please inform us during the application process or at any time during your employment

“Persistent is an Equal Opportunity Employer and prohibits discrimination and harassment of any kind.”