Senior Infrastructure Engineer: Kubernetes & AI Platform

American Express; Phoenix (AZ); On-site; USD 130,000 - 170,000; Full time

Job summary

American Express is seeking a Senior Infrastructure Engineer to design, deploy, and maintain scalable, secure enterprise infrastructure. You will manage Kubernetes environments, container platforms, and CI/CD workflows across Linux/Unix stacks, with strong emphasis on observability, automation, and incident response.

The role requires deep experience with cloud-native tooling (Kubernetes/OpenShift), Istio, Vault, and GPU-enabled deployments, plus leadership in change control and production

Qualifications

• 15+ years of IT experience across installation, configuration, administration, design, development, deployment, testing, and production support throughout the SDLC.
• Experience supporting business application systems in finance and health care environments.
• Deep knowledge of high-availability infrastructure, enterprise operations, release management, incident management, performance optimization, and production support.

Responsibilities

• Build, administer, upgrade, scale, and troubleshoot bare-metal Kubernetes environments using Kubespray and Kubeadm, including highly available control planes, resource limits, persistent storage, secrets, YAML automation, kubectl scripting, and Horizontal Pod Autoscaling.
• Engineer containerized and microservices platforms with Kubernetes, Docker, Containerd, OpenShift, Rancher, Helm, and reusable Helm charts.
• Use Istio for observability, security, traffic management, routing, load balancing, fault tolerance, resilience, and context-based ingress routing.
• Operate GitLab, configure ADS authentication, maintain security and patching, automate upgrades, enable runners, and deliver CI/CD pipelines with Jenkins and Quay.
• Administer Linux, Unix, and RHEL systems through builds, upgrades, patching, migrations, scripting, troubleshooting, and root-cause analysis.
• Deploy and operate HashiCorp Vault HA on Kubernetes with Vault Agent Injector, Kubernetes secrets, and Raft storage.
• Create end-to-end visibility with Elasticsearch, Fluentd, Metricbeat, Filebeat, Kibana, Prometheus, Grafana, APM agents, and Weave Scope.
• Design and deploy a standalone NGINX reverse proxy to distribute AI/LLM inference traffic across GPU-enabled worker nodes.
• Deploy and Monitor NVIDIA A10 GPU environments with Prometheus, Grafana, Node Exporter, and DCGM Exporter.
• Install, upgrade, configure, and support MapR, Hadoop, IBM DataStage, and Infosphere Information Server platforms.
• Lead change, release, incident response, production support, RCA, documentation, and knowledge transfer.

Skills

Kubernetes

OpenShift

Docker

CI/CD

GitLab

Jenkins

Helm

Istio

Prometheus

Grafana

Linux/Unix

Security

Education

Master's degree in Computer Science

Tools

Kubespray

Kubeadm

Quay

Jenkins

GitLab Runner

Prometheus

Grafana

Job description

American Express is seeking a Senior Infrastructure Engineer to design, deploy, and maintain scalable, secure enterprise infrastructure. You will manage Kubernetes environments, container platforms, and CI/CD workflows across Linux/Unix stacks, with strong emphasis on observability, automation, and incident response.

The role requires deep experience with cloud-native tooling (Kubernetes/OpenShift), Istio, Vault, and GPU-enabled deployments, plus leadership in change control and production