Senior Architect

Red Hat, Inc.; Mumbai; On-site; INR 2,500,000 - 3,500,000; Full time

Job summary

Red Hat, Inc. is seeking a Senior Architect in Mumbai, India. The ideal candidate will lead the design and implementation of OpenShift-based platforms, ensuring scalability and resilience. With over 15 years in professional services, you will guide clients through AI orchestration and manage complex solutions using tools like KServe and Caikit. A deep understanding of AI/ML principles and a strong security mindset are essential. Red Hat offers a diverse and inclusive work environment.

Qualifications

• Proven track record of deploying OpenShift in production-grade environments.
• Solid understanding of the AI development lifecycle.
• Expertise in RBAC and Network Policies within OpenShift.

Responsibilities

• Lead the strategic design and implementation of OpenShift-based platforms.
• Design and automate deployment of OpenShift clusters across hybrid environments.
• Advise regulated industry clients on maintaining data sovereignty while using AI.

Skills

Consulting DNA

Red Hat Mastery

AI/ML Fluency

Security Mindset

Education

15+ years in professional services

Tools

OpenShift

AWS

Azure

KServe

Caikit

Job description

About The Job

A Senior Architect is able to act as a solution lead for small to medium sized teams delivering standard to complex solutions as well as influence Client Architects, technical individual contributors, and up to Director level (or equivalent) managers. They are accountable for having established expertise of process, concept, and technical knowledge in pre-sales and delivery. A Senior Architect is able to impact their region and has strong connections within teams outside of their career path.

As a Senior Architect, you will lead the strategic design and implementation of OpenShift-based platforms that bridge the gap between traditional DevOps and modern MLOps. Your mission is to architect resilient, scalable environments that allow data scientists to move from "laptop to production" without the friction of infrastructure silos. You will be the primary advisor for clients navigating the complexities of GPU orchestration, Model Serving, and Hybrid Cloud AI.

Note: This role may come into contact with confidential or sensitive customer information requiring special treatment in accordance with Red Hat policies and applicable privacy laws.

What Will You Do

OpenShift Platform Engineering

• Infrastructure as Code (IaC): Design and automate the deployment of OpenShift clusters across hybrid environments (AWS, Azure, On‑prem).
• Cluster Management: Implement Multi‑Cluster Management using Red Hat Advanced Cluster Management (ACM) and ensure security compliance via Advanced Cluster Security (ACS).
• Scaling & Optimization: Tune OpenShift for high‑performance AI workloads, including specialized GPU node labeling, partitioning, and autoscaling.

OpenShift AI & MLOps Orchestration

• AI Lifecycle Design: Architect the full AI lifecycle on OpenShift AI, integrating JupyterHub, Elyra pipelines, and internal model registries.
• Inference & Serving: Design high‑concurrency model serving architectures using KServe, Caikit, and TGIS (Text Generation Inference Server) for LLMs.
• InstructLab Integration: Lead clients in using InstructLab on OpenShift to fine‑tune Large Language Models (LLMs) with proprietary enterprise data.

Strategic Consulting

• Sovereign AI Strategy: Advise regulated industry clients (Banking, Healthcare, Gov) on how to maintain data sovereignty while leveraging Generative AI.
• TCO Analysis: Help clients understand the Total Cost of Ownership of running AI on OpenShift vs. proprietary SaaS AI platforms.
• Developer Experience (DevEx): Create a seamless workflow for developers and data scientists, reducing "time‑to‑first‑token."

What Will You Bring

• Consulting DNA: 15+ years in professional services with a knack for whiteboarding complex YAML‑wrangling into a business‑friendly vision.
• Red Hat Mastery: Proven track record of deploying OpenShift in production‑grade, air‑gapped, or highly regulated environments.
• AI/ML Fluency: Solid understanding of the AI development lifecycle—you don't need to be a Data Scientist, but you must speak "Data Science" fluently (embeddings, vector DBs, fine‑tuning).
• Security Mindset: Expertise in RBAC, Network Policies, and "Shift Left" security within the OpenShift ecosystem.

Certifications (The “Gold Standard”) but not mandatory

• Red Hat Certified Architect (RHCA) – The ultimate validator.
• Red Hat Certified Specialist in OpenShift Automation and Management.
• Cloud‑specific Architect certifications (AWS SAP, Azure Solutions Architect)

Equal Opportunity Policy (EEO)

Red Hat is proud to be an equal opportunity workplace and an affirmative action employer. We review applications for employment without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, ancestry, citizenship, age, veteran status, genetic information, physical or mental disability, medical condition, marital status, or any other basis prohibited by law.