AI Infrastructure Consulting Engineer – Orchestration & Platform

CO1003 CDW Technologies, LLC; United States; On-site; USD 78,000 - 108,000; Full time

Job summary

CDW is seeking an AI Infrastructure Consulting Engineer – Orchestration & Platform Engineering to implement, integrate, and support enterprise AI platforms. You will work across Kubernetes-based environments to enable secure, multi-user access to accelerated resources and collaborate with security, compute, and data teams to deliver high-quality outcomes.

The role requires 3+ years of platform experience or 7 years with similar scope, strong Kubernetes skills, and familiarity with Run:ai,

Qualifications

• Bachelor’s degree and 3 years’ experience delivering complex platform, infrastructure, or cloud-native solutions.
• Hands-on experience administering Kubernetes in production or customer environments.
• Experience with containers, registries, Helm, operators, storage classes, ingress, identity integration, secrets, and RBAC.
• Experience with GPU scheduling, quotas, tenancy, resource allocation, job lifecycle, and utilization concepts in AI environments.

Responsibilities

• Manage time and expense to meet or exceed SOW expectations; escalate risks early.
• Implement and configure AI workload orchestration, scheduling, and platform services.
• Deploy and integrate Kubernetes and related tools across customer environments.
• Perform platform discovery, installation, configuration, validation, upgrades, and troubleshooting.
• Collaborate with security, networking, compute, storage, app, and data teams to resolve cross-platform dependencies.
• Create and maintain project documentation, as-built configurations, test plans, and client handoff materials.

Skills

Kubernetes

Containers

Git workflows

Linux

Scripting

CI/CD

Networking

Observability

Education

Bachelor’s degree

Tools

Run:ai

ClearML

Slurm

NVIDIA Base Command

Kubeflow

MLflow

Prometheus

Grafana

Job description

Job Summary The AI Infrastructure Consulting Engineer – Orchestration & Platform Engineering is responsible for implementing, integrating, and supporting platforms that schedule, govern, and operate enterprise AI workloads. This client-facing, billable role delivers high-quality technical outcomes and ensures solutions are implemented as designed to the client’s satisfaction and approval. The engineer works across Kubernetes-based and workload-scheduling environments to enable reliable, secure, multi-user access to accelerated computing resources.

What You Will Do

• Manage time and expense to meet or exceed expectations defined in the Statement of Work, proactively escalating potential scope, schedule, or budget issues as soon as they are known.
• Implement and configure AI workload orchestration, scheduling, resource governance, and platform services across customer environments.
• Deploy and integrate Kubernetes, Run:ai, ClearML, Slurm, NVIDIA software components, container registries, observability, and supporting platform services as applicable to the engagement.
• Perform platform discovery, installation, configuration, validation, upgrades, troubleshooting, and client knowledge transfer.
• Collaborate with security, networking, compute, storage, application, and data teams to resolve cross-platform dependencies.
• Provide technical input for SOWs, ROMs, LOEs, implementation plans, and solution validation when requested.
• Create and maintain accurate project documentation, as-built configurations, test plans, work logs, and client handoff materials.

What We Expect of You

• Bachelor’s degree and 3 years’ experience delivering complex platform, infrastructure, or cloud-native solutions, including planning, implementation, integration, and support OR 7 years’ experience delivering complex platform, infrastructure, or cloud-native solutions, including planning, implementation, integration, and support.
• Hands‑on experience administering Kubernetes or enterprise Kubernetes distributions in production or customer environments.
• Experience with containers, registries, Helm, operators, storage classes, ingress, identity integration, secrets, and role‑based access control.
• Working knowledge of GPU scheduling, quotas, tenancy, resource allocation, job lifecycle, and utilization concepts in AI environments.
• Experience with one or more workload platforms such as Run:ai, ClearML, Slurm, NVIDIA Base Command, or comparable orchestration and scheduling technologies.
• Working knowledge of Linux, scripting, APIs, Git‑based workflows, and infrastructure automation.
• Ability to build and execute implementation and test plans aligned to assigned project deliverables and the Statement of Work.
• Strong written and verbal communication skills with the ability to effectively interact with leadership stakeholders and clients.
• Proven ability to create technical documentation and transfer knowledge to administrators and platform users.
• Demonstrated attention to detail, analytical problem solving, and the ability to balance competing priorities while meeting deadlines.
• Ability and willingness to work beyond regularly scheduled shifts, select weekends, or overtime as necessary to meet client needs.
• Ability and willingness to travel as needed to CDW locations or client sites.
• Valid U.S. driver’s license.
• Experience integrating Kubernetes with NVIDIA GPU Operator, Network Operator, device plugins, or NVIDIA AI Enterprise components, is a plus.
• Experience with platform observability, policy, security, identity, MLOps, CI/CD, and infrastructure‑as‑code tooling, is a plus.
• Familiarity with Kubeflow, MLflow, Argo, GitOps, Prometheus, Grafana, or comparable ecosystem tools, is a plus.
• Relevant Kubernetes, NVIDIA, Linux, or automation certifications, is a plus.

Pay range: $77,725 - $108,265 depending on experience and skill set Annual bonus target of % subject to terms and conditions of plan Benefits overview: https://cdw.benefit-info.com/ Salary ranges may be subject to geographic differentials

CDW is committed to being an AI‑fluent organization We’re looking for people who bring curiosity, a learner’s mindset, and a willingness to engage with ever‑evolving technology and tools. We value adopting AI as a partner, openness to experimentation, and a shared interest in learning together on AI. Our goal is to create a culture where AI enhances—not replaces—human creativity and decision‑making. You don’t need to be an expert today; what matters is your readiness to explore, adapt, and grow with us as we integrate AI responsibly and effectively into our work. Additionally, CDW is committed to fostering an equitable, transparent, and respectful hiring process for all applicants. During our application process, our goal is to understand your experience, strengths, skills, and qualifications. As an AI forward company, we see AI not just as a tool, but as a catalyst for new ways of thinking, creating, and communicating.

CDW is an equal opportunity employer. All qualified applicants will receive consideration for employment without regards to race, color, religion, sex, sexual orientation, gender identity, national origin, disability status, protected veteran status or any other basis prohibited by state and local law.

At CDW, we make technology work so people can do great things. We are a leading multi‑brand technology solutions provider to business, government, education and healthcare customers in the United States, the United Kingdom and Canada. Our coworkers across the globe are working together to bring technology to life for our customers by solving complicated IT business challenges, providing outstanding service, and orchestrating the technology landscape to optimize our customers’ performance.