Remote LLM DevOps & Inference Engineer

United States Digital Space LLC; United States; Remote; USD 124,000 - 152,000; Full time

Job summary

United States Digital Space LLC is seeking an LLM DevOps/Inference Engineer for a remote, long-term engagement focused on healthcare AI benchmarks. You will design and operate the GPU-backed evaluation platform, ensure scalable model serving, and drive cost-efficient, observable infrastructure.

This role emphasizes hands-on GPU provisioning, orchestration, and secure execution environments. The ideal candidate brings deep experience with AWS at scale, IaC with Terraform, and practical knowledge

Qualifications

• Experience building production-grade AWS infrastructure for ML workloads.
• Proficient with Terraform as IaC and no point-and-click resources.
• Hands-on with LLMs and model serving pipelines.
• Know-how on GPU scheduling, batching, and multi-GPU sharding.
• Ability to implement cost-aware, reliable, observable platforms.

Responsibilities

• Build and maintain AWS infrastructure for evaluation platform as code.
• Stand up self-hosted inference track for healthcare models on GPU compute.
• Create provider abstraction layer for API-based and self-hosted models.
• Make benchmark runs reproducible and cost-optimized with pinned versions.
• Develop observability dashboards for throughput, latency, and GPU-hour costs.
• Support burst workloads and contribute to TEEs architecture.

Skills

AWS infra at prod scale

Terraform

LLM/model serving

GPU scheduling

CI/CD

Observability

Cost optimization

Tools

AWS EKS/ECS

EC2 GPU instances

CUDA

SageMaker/Bedrock

Job description

United States Digital Space LLC is seeking an LLM DevOps/Inference Engineer for a remote, long-term engagement focused on healthcare AI benchmarks. You will design and operate the GPU-backed evaluation platform, ensure scalable model serving, and drive cost-efficient, observable infrastructure.

This role emphasizes hands-on GPU provisioning, orchestration, and secure execution environments. The ideal candidate brings deep experience with AWS at scale, IaC with Terraform, and practical knowledge