Staff Platform Engineer - Edge AI On-Prem Infra

webAI; Austin (TX); On-site; USD 140,000 - 210,000; Full time

Benefits offered by this job

Competitive salary

Health/dental/vision benefits

401k match

Flexible PTO

Parental leave

Education support

Life insurance

Disability insurance

Free parking

Job summary

webAI is hiring a Staff Platform/Infrastructure Engineer to own the substrate that runs the private AI stack on customer hardware, including on-prem Apple-silicon fleets and Linux servers. You will guide deployment, orchestration, security, and observability while moving toward a leaner next-gen architecture and a reusable deployment kit.

You’ll lead incident response, define SLOs, and mentor the team. This hands-on role requires coding, architecture decisions, and pager duty in a global

Qualifications

• 8+ years building and operating production infrastructure.
• Deep experience with at least one workload orchestrator (Nomad or Kubernetes).
• Strong Terraform and configuration management (Ansible or similar).
• Production experience with AWS, Azure, or both (identity/IAM, KMS, registries).
• Solid networking fundamentals: VPN overlays, firewalls, NAT, proxies, DNS, TLS.
• Secrets/identity: Vault or equivalent, PKI/mTLS, OIDC.
• CI/CD and release engineering in GitLab: container builds, signing, reproducible builds.
• Observability: Prometheus/Grafana/Loki, alert design, on-call.

Responsibilities

• Own deployment for the webAI kernel and B2B SDK across on-prem and cloud.
• Evolve orchestration approach (Nomad, Kubernetes, or config-managed native services).
• Run Apple-silicon fleets in production: launchd, firewalling, VMs, and local LLM sizing.
• Build the inference serving layer with scalable routing and load testing.
• Own the software supply chain: CI, artifact signing, pinned builds, air-gapped registries.
• Secure the platform: secrets, PKI/mTLS, identity integration, network policy.
• Build observability and alerting, export telemetry to customer systems.
• Define HA levels and SLOs, then implement them.
• Write runbooks and RCAs for operators and customers, and lead incident response.
• Collaborate with kernel engineers on networking and deployment simplicity.
• Mentor engineers on infrastructure-as-code, testing, and operations.

Skills

Kubernetes

Nomad

Terraform

Ansible

GitLab CI

Networking (VPNs/TLS)

Rust

Go

Python/Bash

Observability (Prometheus/Grafana)

Security/Identity (OIDC/Vault)

Tools

Lima

Docker

Envoy

Vault

KMS

cosign/minisign

Loki

Grafana

Job description

webAI is hiring a Staff Platform/Infrastructure Engineer to own the substrate that runs the private AI stack on customer hardware, including on-prem Apple-silicon fleets and Linux servers. You will guide deployment, orchestration, security, and observability while moving toward a leaner next-gen architecture and a reusable deployment kit.

You’ll lead incident response, define SLOs, and mentor the team. This hands-on role requires coding, architecture decisions, and pager duty in a global