DevOps Engineer (Vision)

Archer; Boca Raton (FL); On-site; USD 120,000 - 180,000; Full time

Job summary

Archer, in collaboration with Leo Technologies, seeks a DevOps / SRE to deploy, operate, and harden AI systems used for corrections operations and intelligence analysis. You will own the path from model prototype to production, ensuring uptime, data segregation, and auditability in CJIS/FedRAMP-aligned environments.

The role requires designing LLM deployment platforms, building robust CI/CD for ML, and managing GPU-based inference infrastructure with strong security and observability practices.

Qualifications

• 5+ years in DevOps, SRE, or platform engineering.
• 2+ years operating ML/AI workloads in production.

Responsibilities

• Design and operate deployment platform for LLM apps, agentic systems, and RAG pipelines across clouds, on-premises and air-gapped environments.
• Build CI/CD pipelines for model and application delivery, including registries, versioning, evaluation gates, and rollback paths.
• Stand up and maintain inference infra: GPU clusters, model serving, vector/graph DBs, and data services.
• Operate Kubernetes as the backbone for AI workloads with GPU scheduling and isolation.
• Implement observability for AI systems: token throughput, model drift, logs, and cost per request.
• Harden environments to CJIS, FedRAMP, StateRAMP, or DoD controls with encryption and audit logging.
• Enforce data segregation and need-to-know access via IAM and secrets management.
• Build deployment patterns for air-gapped or classified enclaves with signed artifacts.
• Manage incident response: runbooks, on-call rotations, blameless postmortems, and LLM failure modes.
• Collaborate with data scientists, security, and compliance to ship safely.

Skills

Kubernetes

CI/CD

Python

Bash

Terraform/Pulumi

Security posture

Observability

GPU infrastructure

Tools

Terraform

Pulumi

vLLM/TGI/Triton

Ollama

TensorRT-LLM

Kubernetes (EKS/AKS/GKE)

GitHub Actions

GitLab CI

Jenkins

ArgoCD

Prometheus

Grafana

OpenTelemetry

Loki

Elastic/Datadog

Job description

Archer is collaborating with Leo Technologies to connect them with exceptional professionals for this role.

Description

The Role

We're hiring a DevOps / SRE to deploy, operate, and harden the AI systems that support corrections operations and intelligence analysis. Our data scientists build LLM-powered agents, RAG pipelines, and ontology-driven analytics — your job is to make sure those systems run reliably, securely, and auditably in environments where uptime, data segregation, and chain-of-custody actually matter. You'll own the path from a trained model or agent prototype to a production system that analysts depend on, in infrastructure that meets CJIS, FedRAMP, or equivalent standards.

Requirements

What You’ll Do

• Design and operate the deployment platform for LLM applications, agentic systems, RAG pipelines, and supporting data services across cloud, on-prem, and air-gapped environments.
• Build CI/CD pipelines for model and application delivery — including model registries, prompt and config versioning, evaluation gates, and rollback paths.
• Stand up and maintain inference infrastructure: GPU clusters, model serving (vLLM, TGI, Triton, Ollama, TensorRT-LLM), vector databases (pgvector, Weaviate, Qdrant, Milvus), and graph databases (Neo4j, Neptune).
• Operate Kubernetes (EKS, AKS, GKE, or on-prem) as the backbone for AI workloads, with GPU scheduling, autoscaling, and workload isolation.
• Implement observability for AI systems specifically — not just CPU and latency, but token throughput, model drift, agent trace logs, tool-call success rates, retrieval quality, and cost per request.
• Harden environments to meet CJIS, FedRAMP Moderate/High, StateRAMP, or DoD IL4/5 controls as applicable — encryption at rest and in transit, key management, audit logging, FIPS-validated crypto, and boundary controls.
• Enforce data segregation, classification boundaries, and need-to-know access through network policy, IAM, and secrets management (Vault, AWS Secrets Manager, KMS/HSM).
• Build deployment patterns for air-gapped or classified enclaves — including offline model distribution, signed artifacts, and dependency mirroring.
• Manage incident response for AI systems: runbooks, on-call rotations, blameless postmortems, and the special failure modes that come with LLMs (hallucination spikes, prompt injection, retrieval poisoning, runaway tool loops).
• Partner with data scientists, security, and compliance teams to ship safely — and push back when a deploy would compromise security or reliability.

What We Value

• 5+ years in DevOps, SRE, or platform engineering, with at least 2 years operating ML or AI workloads in production.
• Strong fluency with Kubernetes, container orchestration, and infrastructure-as-code (Terraform, Pulumi, or equivalent).
• Hands-on experience deploying LLM inference at scale — you know the tradeoffs between vLLM, TGI, Triton, and managed APIs, and when to use which.
• Solid Python skills for tooling, automation, and glue code; comfort with Bash and at least one systems language is a plus.
• Experience operating GPU infrastructure (NVIDIA drivers, CUDA, MIG, GPU operator, scheduling) in either cloud (A10/A100/H100 instances) or on-prem environments.
• Production experience with CI/CD (GitHub Actions, GitLab CI, Jenkins, ArgoCD) and GitOps patterns.
• Strong security posture: IAM, secrets management, network segmentation, vulnerability scanning, supply-chain security (SBOMs, signed artifacts, SLSA).
• Experience with observability stacks (Prometheus, Grafana, OpenTelemetry, Loki, Elastic, Datadog) and applying them to ML systems.
• Demonstrated ability to work with sensitive data and operate within compliance frameworks.

Nice to Have

• Direct experience deploying systems in CJIS, FedRAMP, IL4/5, or equivalent regulated environments.
• Experience with air-gapped or cross-domain deployments.
• Familiarity with LLM-specific tooling: LangSmith, Langfuse, Helicone, Phoenix, Weights & Biases, MLflow.
• Vector and graph database operations at scale — sharding, replication, backup, query tuning.
• Experience with FedRAMP-authorized cloud regions (AWS GovCloud, Azure Government, GCC High) or on-prem cloud (OpenStack, VMware Tanzu).
• Familiarity with model and prompt evaluation in CI — automated guardrails, regression tests against curated eval sets.
• Experience with policy-as-code (OPA, Kyverno, Sentinel) and admission controllers.
• Background supporting law enforcement, corrections, intelligence, or defense missions.
• Active or recent security clearance.
• Familiarity with 28 CFR Part 23, CJIS Security Policy, NIST 800-53 / 800-171, or FISMA controls.

How We Think About This Work

In corrections and intelligence environments, an outage isn't just a missed SLA — it can mean analysts lose access to tools during a developing situation, or an audit trail gets broken at exactly the wrong time. We expect rigor: changes are reviewed, deploys are reversible, access is least-privilege, and every action affecting sensitive data is logged in a way that survives scrutiny. We also expect honesty about AI system risk. If a model regression slipped through, or a retrieval index is serving stale or wrong data, we want it caught and surfaced — not papered over. People who treat reliability and security as core features rather than overhead will thrive here.

What Success Looks Like

In your first 90 days, you'll have inventoried the current deployment surface, stood up or hardened CI/CD for at least one production AI service, and established baseline observability covering both infrastructure and model-level signals. Within six months, you'll own the AI platform's reliability posture — including SLOs, incident response, and the security controls that let us deploy into the most sensitive environments our customers operate.

LeoTech recruits, employs, trains, compensates, and promotes regardless of race, religion, color, national origin, sex, disability, age, veteran status, and other protected status as required by applicable law.