AI Factory Platform Operations Engineer

Accrescent Group; San Francisco (CA); On-site; USD 180,000 - 280,000; Full time

Job summary

Accrescent Group in San Francisco seeks an experienced AI Factory Platform Operations Engineer to deploy, operate, and troubleshoot enterprise AI infrastructure. You will own Linux-based environments, Kubernetes and container platforms, networking, automation, monitoring, and GPU AI workloads.

Collaborate across infrastructure, DevOps, security, and software teams to maintain platform reliability, perform root-cause analyses, drive improvements, and implement CI/CD and IaC automation for

Qualifications

• Strong Linux administration across RHEL, Rocky Linux and Ubuntu.
• Kubernetes admin and troubleshooting.
• Docker / container runtime knowledge.
• TCP/IP, DNS, routing, load balancing fundamentals.
• Shell/Bash scripting for automation.
• Incident management and root cause analysis.
• Monitoring, log analysis and performance tuning.

Responsibilities

• AI/GPU infrastructure day-to-day operations and platform health.
• Triaging issues across compute, OS, network, and storage.
• Support cluster deployment, upgrades, scaling, and maintenance.
• Investigate container runtimes and orchestration problems.
• Collaborate with security, DevOps and engineering teams to improve reliability.
• Develop automation to reduce manual toil and improve observability.

Skills

Linux administration

Networking fundamentals

Shell scripting

Incident management

Git version control

Monitoring & troubleshooting

Root cause analysis

Performance analysis

Tools

Kubernetes

Docker

CI/CD tooling

Job description

We are seeking an experienced AI Factory Platform Operations Engineer one of a client to support deployment, operations, troubleshooting, and reliability of enterprise AI infrastructure. The role will focus on Linux-based infrastructure, Kubernetes and container platforms, networking, automation, monitoring, and operational support of AI/GPU environments. The engineer will work closely with infrastructure, network, DevOps, cloud, security, and engineering teams to maintain platform availability, resolve complex infrastructure issues, perform root cause analysis, and improve operational reliability.

Job Description:

Key Responsibilities

AI / GPU Infrastructure Operations Support day-to-day operations of AI infrastructure and GPU-based platforms. Perform infrastructure health checks, validation, troubleshooting, and operational readiness activities. Troubleshoot infrastructure issues across compute, operating system, network, container, and platform layers. Support workload onboarding and platform configuration. Participate in incident resolution and infrastructure remediation. The existing AI Factory JD specifically identifies exposure to AI Infrastructure or GPU-based platforms as a preferred capability. Linux Administration Administer enterprise Linux environments including RHEL, Rocky Linux and Ubuntu. Troubleshoot OS, kernel, storage, networking, services, and application-related issues. Perform patching, upgrades, security hardening, and vulnerability remediation. Monitor system performance, capacity, and availability. Perform log analysis and troubleshoot recurring infrastructure issues. Manage system services, access, file systems, LVM, and packages. Kubernetes & Container Platform Administer and support Kubernetes environments. Support cluster deployment, upgrade, scaling, and maintenance activities. Troubleshoot Pods, Deployments, StatefulSets, Services, Ingress, Storage Classes, Persistent Volumes, and Namespaces. Investigate container runtime and orchestration issues. Maintain platform availability through proactive monitoring and health validation. Networking Troubleshoot infrastructure and Kubernetes network issues. Analyze TCP/IP connectivity, routing, DNS, load balancing, firewall, and ingress issues. Perform network validation and performance testing. Work with network teams on complex connectivity incidents. Perform packet-level troubleshooting when required. Internal AI Factory discussions also call out TCP/IP, VLANs, routing, link health, MTU, DNS/NTP, packet troubleshooting, fabric/GPU/host correlation, latency, throughput, packet loss, congestion, and configuration drift. Automation & Scripting Develop Shell/Bash scripts for infrastructure and operational automation. Automate health checks, monitoring, reporting, log collection, and remediation activities. Support CI/CD and Infrastructure-as-Code initiatives. Identify opportunities to eliminate repetitive manual activities. Python scripting knowledge is desirable. Incident / Problem / Change Management Provide advanced technical support for infrastructure incidents. Resolve service disruptions within defined SLAs. Perform detailed Root Cause Analysis and implement preventive measures. Support production changes, validation, maintenance, and rollback activities. Act as an escalation point for operational issues. Monitoring & Reliability Support monitoring dashboards, alerts, and operational reporting. Analyze platform trends and identify reliability improvements. Reduce recurring incidents through automation and platform optimization. Support observability and proactive monitoring initiatives.

Skill Requirements

Strong Linux administration: RHEL / Rocky Linux / Ubuntu Kubernetes administration and troubleshooting Docker / container runtime knowledge TCP/IP, DNS, routing, switching and load-balancing fundamentals Shell/Bash scripting Linux performance and log analysis Incident management and RCA Git/version control Infrastructure monitoring and troubleshooting The existing JD specifically calls for production Kubernetes experience including architecture, networking, storage, RBAC, pod lifecycle and cluster upgrades.