On-Prem AI Infrastructure Engineer

Amax 1; Colorado; On-site; USD 120,000 - 180,000; Full time

Benefits offered by this job

Medical Insurance

Dental Insurance

Vision Insurance

401(k)

Flexible spending account

Commuter benefits

Disability insurance

Job summary

AMAX is expanding its on-prem infrastructure team in Colorado. The role focuses on designing, building, and operating an on-prem cloud-like environment for internal AI/ML workloads.

You will own datacenter operations, implement IaC with Terraform/Terragrunt and Ansible, and secure the HashiCorp stack with Keycloak integration. You will maintain observability with Prometheus/Grafana, manage containerized workloads in Docker/Kubernetes, and participate in a Scrum process using Jira/Confluence.

Qualifications

• Solid experience with Infrastructure-as-Code and Configuration-as-Code.
• Real-world on-prem/datacenter operations experience is required.
• Working knowledge of VLANs, routing, firewalls, and load balancers.
• Hands-on containerization/orchestration with Docker and Kubernetes.
• Proficiency with Git and standard version control workflows.
• Scripting skills to build internal tooling and automation.

Responsibilities

• Design, build, and operate on-prem infrastructure that behaves like a cloud environment for internal teams, including AI/ML workloads.
• Own datacenter and infrastructure operations: compute, storage, networking, and automation layers.
• Build and maintain Infrastructure-as-Code using Terraform (Terragrunt), Ansible, etc.
• Deploy, secure, and operate HashiCorp stack (Vault, Boundary) with identity via Keycloak.
• Build observability with Prometheus, Grafana, and Alertmanager.
• Deploy and manage containerized workloads via Docker and Kubernetes.
• Design and maintain networking infrastructure: VLANs, routing, firewalls, and load balancers.
• Write scripts/tools to automate operational toil and contribute code.
• Provide datacenter support for customers in the HostMax datacenter: cabling, hardware swaps, rack/stack, troubleshooting.
• Participate in business-hours on-call rotation for customer and infrastructure support.
• Engage in SDLC/Scrum workflow with Jira/Confluence for planning and documentation.
• Help define standards, runbooks, and best practices as the team grows.
• Develop and deploy AI infrastructure workloads on-prem (GPU scheduling, model serving infra, self-hosted AI tooling).

Skills

IaC & Configuration

On-prem/datacenter ops

Networking fundamentals

Containerization & orchestration

Scripting & automation

Git & version control

Tools

Terraform

Terragrunt

Ansible

HashiCorp Vault

HashiCorp Boundary

Keycloak

Prometheus

Grafana

Alertmanager

Docker

Kubernetes

Jira

Confluence

Job description

AMAX is expanding its on-prem infrastructure team in Colorado. The role focuses on designing, building, and operating an on-prem cloud-like environment for internal AI/ML workloads.

You will own datacenter operations, implement IaC with Terraform/Terragrunt and Ansible, and secure the HashiCorp stack with Keycloak integration. You will maintain observability with Prometheus/Grafana, manage containerized workloads in Docker/Kubernetes, and participate in a Scrum process using Jira/Confluence.