OpenShift AI Platform Architect — MLOps & LLM Pipelines

Red Hat; New York (NY); Hybrid; USD 142,000 - 235,000; Full time

Benefits offered by this job

Medical, dental, vision coverage

401(k) with employer match

Paid time off and holidays

Parental leave plans for new parents

Disability and life insurance

Job summary

Red Hat seeks an architect to design and scale an enterprise AI platform, bridging infrastructure with AI workloads. You will lead container-native ML pipelines on OpenShift, focusing on LLMs, model serving, and automated benchmarking across scalable runtimes.

You will guide customers through technology choices, drive MLOps adoption, and deliver architectural blueprints, deployment guides, and proof‑of‑concepts while mentoring junior teams and shaping internal knowledge.

Qualifications

• 8-10 years in related technology positions.
• 5+ years of Public Cloud and Linux technologies.
• 3+ years with OpenShift Container Platform or Kubernetes.
• 3+ years in production ready AI solutions and ML use cases.

Responsibilities

• Design and advocate AI/ML solutions aligned with customer goals.
• Lead architectural design of container-native ML pipelines on OpenShift.
• Collaborate with stakeholders to manage scope and milestones and meet delivery timelines.
• Create high-level proposals, PoCs, and compelling technical demonstrations.
• Mentor consultants and document architectures for long-term reuse.

Skills

MLOps architecture

OpenShift expertise

Cloud computing

Linux systems

Stakeholder engagement

AI/ML strategy

Tools

OpenShift Container Platform

KServe

vLLM

TGI

Triton

Kubernetes

Job description

Red Hat seeks an architect to design and scale an enterprise AI platform, bridging infrastructure with AI workloads. You will lead container-native ML pipelines on OpenShift, focusing on LLMs, model serving, and automated benchmarking across scalable runtimes.

You will guide customers through technology choices, drive MLOps adoption, and deliver architectural blueprints, deployment guides, and proof‑of‑concepts while mentoring junior teams and shaping internal knowledge.