Staff Engineer, Frontier AI Infrastructure

Prime Intellect AI; San Francisco (CA); Hybrid; USD 150,000 - 300,000; Full time

Benefits offered by this job

Cash compensation range: $150-300k

Flexible work arrangement (SF office +

Full visa sponsorship and relocation

Professional development budget for-c}

Job summary

Prime Intellect AI is building an open frontier AI platform designed for scalable, secure and interoperable AI workloads. This hybrid role covers both the underlying sandbox infrastructure and the developer-facing platform for AI workload management.

You will design, implement and optimize distributed systems in Go and Rust, work on cloud resources, container orchestration, and tools to monitor and control AI jobs at scale, with a strong emphasis on performance and reliability.

Qualifications

• Proficient in Rust systems programming and low-level software design.
• Strong Linux systems knowledge including networking, namespaces, and performance tuning.
• Experience with virtualization (VMs, hypervisors) and resource management.
• Infrastructure automation using Ansible and Terraform.
• Container orchestration with Kubernetes.
• Cloud platform expertise, preferably GCP.
• Observability tooling with Prometheus and Grafana.
• Backend Python development with FastAPI (async).
• Frontend tooling with TypeScript, React/Next.js, Tailwind.
• Experience building developer tools and dashboards.
• RESTful API design and implementation.

Responsibilities

• Design and implement distributed orchestration infrastructure in Go and Rust.
• Build high-performance networking and coordination components.
• Create infrastructure automation pipelines with Ansible.
• Manage cloud resources and container orchestration.
• Implement scheduling systems for heterogeneous hardware (CPU, GPU, TPU).
• Build intuitive web interfaces for AI workload management and monitoring.
• Develop REST APIs and backend services in Python.
• Create real-time monitoring and debugging tools.
• Implement user-facing features for resource management and job control.

Skills

Rust

Linux

Virtualization

Go

Ansible

Terraform

Kubernetes

GCP

Prometheus

Grafana

Python

FastAPI

TypeScript

React/Next.js

Tailwind

REST APIs

Tools

Ansible

Terraform

Kubernetes

Go

Job description

Prime Intellect AI is building an open frontier AI platform designed for scalable, secure and interoperable AI workloads. This hybrid role covers both the underlying sandbox infrastructure and the developer-facing platform for AI workload management.

You will design, implement and optimize distributed systems in Go and Rust, work on cloud resources, container orchestration, and tools to monitor and control AI jobs at scale, with a strong emphasis on performance and reliability.