AI Platform SRE / DevOps Engineer (CJIS & FedRAMP)

Archer; United States; Hybrid; USD 180,000 - 240,000; Full time

Job summary

Archer is partnering with Leo Technologies to recruit a DevOps / SRE focused on deploying and hardening AI systems used in public safety analytics. You will own production-grade pipelines, GPU-backed inference, and secure, auditable operations across cloud, on‑prem, and air-gapped environments.

You will implement scalable CI/CD, enforce strict data segregation and access controls, and work with data scientists and security teams to ensure reliability and regulatory compliance in high-stakes

Qualifications

• Minimum 5+ years in DevOps/SRE or platform engineering, with ML/AI workloads in production.
• Fluency with Kubernetes and infrastructure-as-code (Terraform, Pulumi).
• Hands-on experience deploying LLM inference at scale and selecting between tooling options.
• Strong Python and Bash scripting; systems programming experience is a plus.
• Experience with GPU drivers, CUDA, and cloud/on‑prem environments.
• Solid security posture: IAM, secrets management, vulnerability scanning, SBOMs.

Responsibilities

• Design and operate the deployment platform for LLM applications across cloud, on‑prem, and air‑gapped environments.
• Build CI/CD pipelines for model and application delivery, including versioning and rollback strategies.
• Stand up and maintain inference infrastructure: GPU clusters, model serving, and vector/graph databases.
• Operate Kubernetes across providers with proper GPU scheduling and isolation.
• Implement observable metrics including token throughput, model drift, and cost per request.
• Harden environments to CJIS, FedRAMP, StateRAMP or DoD controls and manage encryption and key management.
• Enforce data segregation, need‑to‑know access and secrets management; build air‑gap deployment patterns.
• Manage incident response, on‑call rotations, and blameless postmortems for AI systems.
• Coordinate with data scientists, security and compliance to ship safely.

Skills

Kubernetes

CI/CD pipelines

Python scripting

Terraform / IaC

GPU infrastructure

Security/compliance

Education

BS in CS/Engineering

Tools

vLLM

Triton

Weaviate / vector DBs

Kubernetes operators

Job description

Archer is partnering with Leo Technologies to recruit a DevOps / SRE focused on deploying and hardening AI systems used in public safety analytics. You will own production-grade pipelines, GPU-backed inference, and secure, auditable operations across cloud, on‑prem, and air-gapped environments.

You will implement scalable CI/CD, enforce strict data segregation and access controls, and work with data scientists and security teams to ensure reliability and regulatory compliance in high-stakes