Assistant Vice President- Generative AI-System Architect

Genpact; Bengaluru; On-site; INR 15,00,000 - 25,00,000; Full time

Job summary

A leading global provider of professional services is seeking an experienced Systems Architect in Bengaluru. This role involves architecting and designing end-to-end systems for Generative AI applications, overseeing architectural integrity, and collaborating with teams. Ideal candidates have deep expertise in system architecture, cloud platforms, and AI infrastructure. Join this opportunity to drive innovation and shape the future of AI.

Benefits

Hands-on experience

Mentorship and continuous learning opportunities

Dynamic work environment

Qualifications

• Proven experience in designing and implementing distributed systems.
• Deep understanding of Generative AI architectures.
• Strong experience with at least one cloud platform.

Responsibilities

• Architect and design end-to-end systems for Generative AI applications.
• Define and oversee system architecture covering various processes.
• Lead system design reviews and define non-functional requirements.

Skills

Designing and implementing distributed systems

Cloud-native architectures

Knowledge of Generative AI architectures

Strong experience with cloud platforms

Agentic AI systems

Experience with multimodal systems

Knowledge of semantic search

Experience with advanced security practices

DevOps and MLOps principles

Hands-on experience with AI tools

Education

Bachelor's or Master's degree in Computer Science

Tools

AWS

GCP

Azure

LangChain

Hugging Face

Ray

Kubeflow

MLflow

Docker

Kubernetes

Job description

Overview

Role Overview: We are looking for an experienced Systems Architect with extensive experience in designing and scaling Generative AI systems to production. This role requires an individual with deep expertise in system architecture, software engineering, data platforms, and AI infrastructure, who can bridge the gap between data science, engineering and business.

You will be responsible for end-to-end architecture of Gen.AI systems including model lifecycle management, inference, orchestration, pipelines.

Responsibilities

• Architect and design end-to-end systems for production-grade Generative AI applications (e.g., LLM-based chatbots, copilots, content generation tools).
• Define and oversee system architecture covering data ingestion, model training/fine-tuning, inferencing, and deployment pipelines.
• Establish architectural tenets like modularity, scalability, reliability, observability, and maintainability.
• Collaborate with data scientists, ML engineers, platform engineers, and product managers to align architecture with business and AI goals.
• Choose and integrate foundation models (open source or proprietary) using APIs, model hubs, or fine-tuned versions.
• Evaluate and design solutions based on architecture patterns such as Retrieval-Augmented Generation (RAG), Agentic AI, Multi-modal AI, and Federated Learning.
• Design secure and compliant architecture for enterprise settings, including data governance, auditability, and access control.
• Lead system design reviews and define non-functional requirements (NFRs), including latency, availability, throughput, and cost.
• Work closely with MLOps teams to define the CI/CD processes for model and system updates.
• Contribute to the creation of reference architectures, design templates, and reusable components.
• Stay abreast of the latest advancements in GenAI, system design patterns, and AI platform tooling.

Qualifications

• Minimum Qualifications
• Proven experience designing and implementing distributed systems, cloud-native architectures, and microservices.
• Deep understanding of Generative AI architectures, including LLMs, diffusion models, prompt engineering, and model fine-tuning.
• Strong experience with at least one cloud platform (AWS, GCP, or Azure) and services like SageMaker, Vertex AI, or Azure ML.
• Experience with Agentic AI systems or orchestrating multiple LLM agents.
• Experience with multimodal systems (e.g., combining image, text, video, and speech models).
• Knowledge of semantic search, vector databases, and retrieval techniques in RAG.
• Familiarity with Zero Trust architecture and advanced enterprise security practices.
• Experience in building developer platforms/toolkits for AI consumption.
• Contributions to open-source AI system frameworks or thought leadership in GenAI architecture.
• Hands-on experience with tools and frameworks like LangChain, Hugging Face, Ray, Kubeflow, MLflow, or Weaviate/FAISS.
• Knowledge of data pipelines, ETL/ELT, and data lakes/warehouses (e.g., Snowflake, BigQuery, Delta Lake).
• Solid grasp of DevOps and MLOps principles, including containerization (Docker), orchestration (Kubernetes), CI/CD pipelines, and model monitoring.
• Familiarity with system design tradeoffs in latency vs cost vs scale for GenAI workloads.

• Preferred Qualifications
• Bachelor’s or Master’s degree in computer science, Engineering, or related field.
• Experience in software/system architecture, with experience in GenAI /AI/ML.
• Proven experience designing and implementing distributed systems, cloud-native architectures, and microservices.
• Strong interpersonal and communication skills; ability to collaborate and present to technical and executive stakeholders.
• Certifications in cloud platforms (e.g., AWS Certified Solutions Architect, Microsoft Certified: Azure Solutions Architect Expert, Google Cloud Professional Data Engineer).
• Familiarity with data governance and security best practices.

Be a transformation leader – Work at the cutting edge of AI, automation, and digital innovation

Make an impact – Drive change for global enterprises and solve business challenges that matter

Accelerate your career – Get hands-on experience, mentorship, and continuous learning opportunities

Work with the best – Join 140,000+ bold thinkers and problem-solvers who push boundaries every day

Thrive in a values-driven culture – Our courage, curiosity, and incisiveness - built on a foundation of integrity and inclusion - allow your ideas to fuel progress

Come join the tech shapers and growth makers at Genpact and take your career in the only direction that matters: Up.

Let’s build tomorrow together.

Genpact is an Equal Opportunity Employer and considers applicants for all positions without regard to race, color, religion or belief, sex, age, national origin, citizenship status, marital status, military/veteran status, genetic information, sexual orientation, gender identity, physical or mental disability or any other characteristic protected by applicable laws. Genpact is committed to creating a dynamic work environment that values respect and integrity, customer focus, and innovation.