Architect, AI Platform

Red Hat, LLC; New York (NY); Hybrid; USD 142,000 - 235,000; Full time

Benefits offered by this job

Medical, dental, vision coverage

401(k) with employer match

Paid time off and holidays

Parental leave plans

Disability and family leave benefits

Equity and incentive programs

Job summary

Red Hat, LLC is seeking a visionary Architect focused on MLOps and AI to design, build, and scale an enterprise AI platform. You will lead container‑native ML pipelines on OpenShift, with emphasis on LLMs, model serving, and scalable runtimes.

You will collaborate with stakeholders to align AI capabilities with business goals, drive time‑to‑market improvements, and deliver technical demonstrations and PoCs. Remote‑US travel may be involved.

Qualifications

• 8–10 years in related technology positions (sales, consulting, operations, development).
• 5+ years of experience with Public Cloud and Linux technologies.
• 3+ years of production‑ready AI solutions and ML use cases.
• 3+ years experience with Red Hat OpenShift Container Platform or Kubernetes.

Responsibilities

• Design and advocate AI/ML solutions aligned with customer goals.
• Lead architectural design of container‑native ML pipelines on OpenShift.
• Guide customers through model selection and deployment architectures.
• Develop automated benchmarking and documentation for long‑term success.
• Mentor consultants on deploying AI workloads on Kubernetes.

Skills

Public Cloud

Kubernetes

Tools

OpenShift Container Platform

KServe

vLLM

Triton

TGI

Job description

We are seeking a visionary Red Hat Architect specializing in Machine Learning Operations (MLOps) and Artificial Intelligence (AI) to design, build, and scale our enterprise AI platform. In this role, you will bridge the gap between enterprise-grade infrastructure and cutting‑edge artificial intelligence. You will lead the architectural design of our container‑native machine learning pipelines on Red Hat OpenShift, with a heavy focus on Large Language Models (LLMs), containerized model serving, scalable runtime environments, and automated benchmarking.

What you will do:

Design and advocate solutions that leverage the full Red Hat ecosystem to solve complex business problems, explicitly aligning AI/ML capabilities with customer strategic goals. Work hand‑in‑hand with customer associates and executive stakeholders to guide the adoption of Artificial Intelligence and MLOps processes, drastically improving model time‑to‑market and operational efficiency. Collaborate with project and customer team members to manage scope, mitigate architectural risks, and consistently meet delivery timelines and project goals. Participate in consulting sales motions to discover customer pain points, scope complex engineering engagements, architect high‑level proposals, and deliver compelling technical demonstrations/proof‑of‑concepts (PoCs). Contribute heavily to project documentation and diagrams, capturing architectural blueprints, deployment guides, and best practices to ensure long‑term customer success and internal knowledge reuse. Commit to continuous training and professional development to stay at the absolute frontier of the rapidly evolving LLM, MLOps, and Cloud‑Native ecosystem. Architect and build production‑grade MLOps pipelines using Red Hat OpenShift Container Platform and Red Hat OpenShift AI (RHOAI). Guide customers through Model Selection (e.g., Llama,Mistral,Granite) by analyzing specific business use cases against hardware/GPU memory constraints, cost profiles, and licensing models. Design containerized Model Deployment architectures using KServe, optimizing low‑latency Inference Servers (e.g., vLLM,TGI,Triton) within OpenShift environments. Establish automated Benchmarking and Test pipelines to measure tokens‑per‑second throughput, hardware efficiency, and cost‑per‑inference metrics. Mentor and share knowledge with customers through structured workshops, paired programming sessions, and architectural reviews, empowering their internal teams to confidently manage the platform post‑delivery. Act as an internal champion, coaching junior consultants and engineering associates on the nuances of deploying AI workloads on Kubernetes.

What you will bring:

8-10 years in a related technology position, e.g., sales, consulting, operations, development, etc. 5+ years of experience with Public Cloud and Linux technologies. 3+ years of experience with Red Hat OpenShift Container Platform or Kubernetes. 3+ years experience in production ready AI solutions. 3+ years experience in production ready Machine Learning use cases.

Nice to have:

Experience in designing and delivering implementations using various public and private cloud infrastructure technologies and providers. RedHat Certified Architect (RHCA) or Specialist certifications in OpenShift. Demonstrated experience publishing technical whitepapers, architectural blueprints, or speaking at industry conferences (e.g., RedHat Summit,KubeCon). Experience in Financial Services.

The salary range for this position is $142,370.00 - $234,770.00. Actual offer will be based on your qualifications. Pay Transparency RedHat determines compensation based on several factors including but not limited to job location, experience, applicable skills and training, external market value, and internal pay equity. Annual salary is one component of RedHat’s compensation package. This position may also be eligible for bonus, commission, and/or equity. For positions with Remote-US locations, the actual salary range for the position may differ based on location but will be commensurate with job duties and relevant work experience.

Benefits

• Comprehensive medical, dental, and vision coverage
• Flexible Spending Account - healthcare and dependent care
• Health Savings Account - high deductible medical plan
• Retirement 401(k) with employer match
• Paid time off and holidays
• Paid parental leave plans for all new parents
• Leave benefits including disability, paid family medical leave, and paid military leave
• Additional benefits including employee stock purchase plan, family planning reimbursement, tuition reimbursement, transportation expense account, employee assistance program, and more!

Note: These benefits are only applicable to full time, permanent associates at RedHat located in the United States.

About RedHat

RedHat is the world’s leading provider of enterprise open source software solutions, using a community‑powered approach to deliver high‑performing Linux, cloud, container, and Kubernetes technologies. Spread across 40+ countries, our associates work flexibly across work environments, from in‑office, to office‑flex, to fully remote, depending on the requirements of their role. RedHatters are encouraged to bring their best ideas, no matter their title or tenure. We're a leader in open source because of our open and inclusive environment. We hire creative, passionate people ready to contribute their ideas, help solve complex problems, and make an impact.

Inclusion at RedHat

RedHat’s culture is built on the open source principles of transparency, collaboration, and inclusion, where the best ideas can come from anywhere and anyone. When this is realized, it empowers people from different backgrounds, perspectives, and experiences to come together to share ideas, challenge the status quo, and drive innovation. Our aspiration is that everyone experiences this culture with equal opportunity and access, and that all voices are not only heard but also celebrated. We hope you will join our celebration, and we welcome and encourage applicants from all the beautiful dimensions that compose our global village.

Equal Opportunity Policy (EEO)

RedHat is proud to be an equal opportunity workplace and an affirmative action employer. We review applications for employment without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, ancestry, citizenship, age, veteran status, genetic information, physical or mental disability, medical condition, marital status, or any other basis prohibited by law. RedHat does not seek or accept unsolicited resumes or CVs from recruitment agencies. We are not responsible for, and will not pay, any fees, commissions, or any other payment related to unsolicited resumes or CVs except as required in a written contract between RedHat and the recruitment agency or party requesting payment of a fee. RedHat supports individuals with disabilities and provides reasonable accommodations to job applicants. If you need assistance completing our online job application, email [e-mail]. General inquiries, such as those regarding the status of a job application, will not receive a reply.

We’re the world’s leading provider of enterprise open source solutions—Linux, cloud, container, and Kubernetes. We deliver hardened solutions that make it easier for enterprises to work across platforms and environments, from the core datacenter to the network edge. At RedHat, our commitment to open source extends beyond technology into virtually everything we do. We collaborate and share ideas, create inclusive communities, and welcome diverse perspectives from all RedHatters, no matter their role. It’s what makes us who we are. Some of the most knowledgeable and passionate people in the technology industry work here. Whether we’re building software, championing our products, or training new associates, we’re collaborating openly to make a difference in the world of open source and beyond.