AI Infra Engineer: On-Prem, GPU AI & Kubernetes

AMAX Engineering Corporation; Fremont (CA); Hybrid; USD 170,000 - 230,000; Full time

Benefits offered by this job

Medical Insurance

Dental Insurance

Vision Insurance

401(k)

Flexible spending account

Commuter benefits

Disability insurance

Job summary

AMAX is seeking an experienced on-prem infrastructure engineer to design, build, and operate our datacenter environments for internal AI/ML workloads. You will own compute, storage, networking, and the automation layer, using IaC tools like Terraform/Terragrunt and Ansible.

Role requires hands-on datacenter operations, containerization with Docker/Kubernetes, and HashiCorp stack deployment with Keycloak identity.

Qualifications

• Real-world on-prem/datacenter operations experience required.
• IaC/Configuration-as-Code expertise needed.
• Networking fundamentals: VLANs, routing, firewalls, and load balancers.
• Hands-on experience with containerization/orchestration (Docker, Kubernetes).
• Proficiency with Git and standard version control workflows.
• Scripting to build internal tooling and automation.
• Comfort with hands-on datacenter hardware work (cabling, rack/stack, hardware troubleshooting).

Responsibilities

• Own datacenter operations: compute, storage, networking, and automation layers.
• Design, build, and operate on-prem infrastructure with cloud-like behavior for AI/ML workloads.
• Build and maintain Infrastructure-as-Code using Terraform/Terragrunt and Ansible.
• Deploy, secure, and operate HashiCorp stack with Keycloak integration.
• Maintain observability with Prometheus, Grafana, and Alertmanager; manage Docker/Kubernetes workloads.
• Perform datacenter support for colocated customers (cabling, rack/stack, troubleshooting).
• Participate in on-call rotation during business hours; contribute to SDLC/Scrum processes with Jira/Confluence.
• Develop and deploy AI onboarding/inference infrastructure on-prem (GPU scheduling, model serving).

Skills

IaC

Networking

Docker

Kubernetes

Git

Automation

Datacenter hardware

Tools

Terraform

Terragrunt

Ansible

Vault

Boundary

Keycloak

Prometheus

Grafana

Alertmanager

Docker

Kubernetes

Git

Jira

Confluence

Job description

AMAX is seeking an experienced on-prem infrastructure engineer to design, build, and operate our datacenter environments for internal AI/ML workloads. You will own compute, storage, networking, and the automation layer, using IaC tools like Terraform/Terragrunt and Ansible.

Role requires hands-on datacenter operations, containerization with Docker/Kubernetes, and HashiCorp stack deployment with Keycloak identity.