AI Infra DevOps & Backend Engineer

GMI Cloud; Mountain View (CA); On-site; USD 160,000 - 210,000; Full time

Job summary

GMI Cloud is seeking an Infrastructure Backend Engineer to design, build, and maintain scalable AI infrastructure in Mountain View, CA. The role emphasizes cloud computing, distributed systems, and DevOps practices to enable efficient AI infrastructure operations.

You will contribute to large-scale training and inference, automate resource provisioning, and implement telemetry with Prometheus, Grafana, and Mimir while staying current with GPU technology.

Qualifications

• Bachelor’s degree in Computer Science or related field.
• Proficiency in at least one programming language (Golang, Python, Bash) with strong coding practices.
• Experience with infrastructure orchestration platforms, especially OpenStack and Kubernetes.
• Experience with automation and CI/CD using Ansible, Jenkins, or GitLab CI.
• Experience with telemetry/observability tools such as Prometheus, Grafana, and Mimir.
• Knowledge of networking, GPU clusters, security, and performance tuning.

Responsibilities

• Design, implement, and maintain AI/ML infrastructure optimized for large-scale training and inference.
• Develop automation pipelines for GPU/CPU resource provisioning and workload scheduling using DevOps best practices.
• Develop observability and telemetry solutions to pro-actively monitor hardware performance, utilization, and health to ensure cluster reliability and efficiency.
• Optimize infrastructure for high-throughput data transfer and low-latency communication.
• Manage infrastructure security, access controls, and compliance standards for on-prem GPU cluster environments.
• Collaborate with relevant engineering teams to configure and troubleshoot GPU clusters and hardware resources.
• Document infrastructure architecture, deployment procedures, automation workflow, and operational best practices.
• Stay current with the latest GPU technology developments, infrastructure engineering and integrate new hardware/software solutions as appropriate.

Skills

Golang

Python

Bash

Education

Bachelor’s degree in Computer Science or related field

Tools

OpenStack

Kubernetes

Ansible

Jenkins

GitLab CI

Prometheus

Grafana

Mimir

HashiCorp Vault

Vastdata

Weka

DDN

Ceph

Job description

GMI Cloud is seeking an Infrastructure Backend Engineer to design, build, and maintain scalable AI infrastructure in Mountain View, CA. The role emphasizes cloud computing, distributed systems, and DevOps practices to enable efficient AI infrastructure operations.

You will contribute to large-scale training and inference, automate resource provisioning, and implement telemetry with Prometheus, Grafana, and Mimir while staying current with GPU technology.