AI Architect - Top Secret Clearance (TS/SCI CI Poly) required

Red Hat; United States; On-site; USD 180,000 - 240,000; Full time

Job summary

Red Hat Services seeks an AI Architect to design and deliver strategic, enterprise AI solutions, blending technical leadership with hands-on implementation on Red Hat AI platforms and OpenShift. You will travel regularly to client locations across North America, work on-site, and collaborate with large teams to deploy scalable, compliant AI architectures and governance.

This role requires strong open-source awareness and the ability to translate business needs into repeatable, secure AI

Qualifications

• 10+ years in enterprise technology, with at least 5 as a hands-on architect or senior consultant delivering in customer environments.
• Deep, current OpenShift expertise: cluster architecture, GitOps, multi-cluster management, security and observability, GPU-enabled nodes.

Responsibilities

• Lead model selection, optimization and serving decisions on Red Hat AI platforms.
• Design portable inference across cloud, on-prem and sovereign environments.
• Ground and evaluate on the customer’s terms in the customer’s environment.
• Architect retrieval and context patterns (RAG, knowledge ingestion, permission-aware context).
• Lead sovereign and disconnected deployments of Red Hat AI on OpenShift.
• Run operations with AI services: Models-as-a-Service and GPU-as-a-Service.
• Build runbooks, reference architectures, harnesses and recipes for repeatable delivery.
• Represent Red Hat’s enterprise AI POV to CTOs and platform leaders.

Skills

OpenShift

GitOps

Multi-cluster

Security

Observability

GPU nodes

Tools

Ansible

Job description

The Red Hat Services team is looking for an AI Architect to design and deliver strategic solutions that solve our clients' business challenges, through technical leadership, hands-on implementation, and enablement of recommended practices. In this role, you will play a key role as a promoter of the adoption of Red Hat's AI platforms and solutions by using your technical expertise and interpersonal skills. You'll need to have a balance of solid technical experience, team leadership, awareness of open source, thorough understanding of business processes, and the ability to identify and solve issues at an enterprise level.

Red Hat Consulting offers more than just technical expertise. We're strategic advisers who take a big picture view of our customers' organizations, understand their challenges, and help to overcome them with comprehensive, cost-effective solutions. As part of our team, you'll help customers quickly and strategically achieve value while building enterprise-wide capabilities. Being open is core to our technologies and our consulting approach.

We are looking for people excited about working with us and growing their careers at Red Hat. We want to be transparent about what would make you most successful in the role,

This position requires candidates to work on-site with clients, so a willingness to travel regularly to customer locations throughout North America is required. Successful applicants must reside in a state where Red Hat is registered to do business and hold an Active Top Secret Clearance (TS/SCI CI Poly).

What you will do:

Our customers want to make AI their own: their model, their data, their AI.

Help customers make frontier and open models their own.

Lead model selection, optimization and serving decisions on Red Hat AI: vLLM, llm-d, LLM Compressor, the validated model catalog, and hardware profiles across NVIDIA, AMD and other accelerators.

Baseline and reduce inference cost per use case (cost per million tokens, GPU utilization) using GuideLLM benchmarks and recipe-based optimization, and decide with evidence whether to prompt, ground or tune a model for a task.

Design portable inference: workloads that move between cloud APIs, on-premises clusters and sovereign environments without re-architecture.

Travel weekly, Monday-Thursday, to client locations.

Ground and evaluate on the customer's terms, in the customer's environment

Design evaluation-driven release gates in Eval Hub so a model or agent ships only when the customer's own tests say so.

Architect retrieval and context patterns (RAG, knowledge ingestion, permission-aware context) that keep data where it belongs, and know when that work is repeatable and when it is bespoke.

Lead sovereign and disconnected deployments of Red Hat AI on OpenShift, including model provenance, signing, AI bills of materials and compliance evidence.

Run it as a service, and run operations with it

Design and stand up Models-as-a-Service and GPU-as-a-Service on OpenShift AI and Red Hat AI Enterprise: multi-tenancy, the AI gateway, metering, showback and chargeback, self-service accelerator access.

Build agentic systems that operate infrastructure through Ansible Automation Platform: patching, CVE remediation, upgrades, supply-chain attestation and incident remediation, with every action passing through RBAC, approval and audit.

Apply agent frameworks and protocols as customers use them today (MCP, A2A, OpenAI-compatible APIs, Llama Stack, LangGraph and similar), with identity, policy and observability designed in from the start.

Lead the engagement and leave it better

Own the architecture and the delivery plan on engagements from two-week baselines to multi-month service builds and lighthouse programs; set the success metric with the customer's sponsor and hold the team to it.

Pair with and certify customer engineers so the result keeps running after we leave.

Turn each delivery into a reusable asset for the practice: runbooks, reference architectures, harnesses and recipes, and feed product gaps back to Red Hat engineering with evidence.

Represent Red Hat's point of view on enterprise AI with CTOs, platform leaders and FinOps teams, and support sellers in scoping results that can be dated with confidence.

Provide customer feedback to internal teams to enhance product offerings and services.

Lead internal initiatives that foster innovation, efficiency, and growth within the Services business.

Continuously learn, grow, and adapt to new skills and technologies

Regular travel to client locations, up to weekly according to project needs

What you bring

10+ years in enterprise technology, with at least 5 as a hands-on architect or senior consultant delivering in customer environments.

Deep, current OpenShift expertise: cluster architecture, GitOps, multi-cluster management, security and observability, GPU-enabled nodes; Red Hat Certifie