Senior Platform Engineer, AI/ML Infra - TS/SCI Clearance

Bitwise; Maryland; On-site; USD 282,000 - 332,000; Full time

Benefits offered by this job

Top salaries

PTO 3–5 weeks

11 federal holidays

2 snow days

401(k) match 24%

Employer-paid health benefits

Education assistance $5,250

Job summary

Bitwise seeks a Software Engineer to own the platform layer delivering AI/ML capabilities for national security missions. You’ll focus on DevOps, platform engineering, and automation to build reliable on-prem infrastructure and deployment pipelines.

Responsibilities include deploying containerized services, implementing observability, and enabling high availability and performance in collaboration with data scientists and sysadmins.

Qualifications

• 12 years of software engineering experience or a B.S. plus 8 years in technical roles
• Experience deploying and managing services in on-premises infrastructure
• Production experience with Docker and Kubernetes
• Hands-on with Prometheus, Grafana, or equivalent
• Knowledge of CI/CD pipelines and GitOps
• Proficiency with Git, Jira, Confluence
• Experience with model serving technologies (vLLM, TorchServe, TF Serving, Triton)
• Knowledge of AI infra tools (LiteLLM, Bifrost, Ray, Ollama)
• Experience with Istio or Linkerd or advanced Kubernetes patterns
• Awareness of AI/ML landscape and SIGINT topics
• Experience with production CNO capabilities

Responsibilities

• Own the platform layer providing AI/ML capabilities for mission systems
• Focus on DevOps, platform engineering, and automation
• Build reliable, scalable infrastructure and CI/CD pipelines
• Deploy and manage containerized services in on-prem environments
• Design infrastructure to ensure high availability and performance
• Translate operational requirements into platform engineering solutions

Skills

Years of experience

On-prem deployment

Docker & Kubernetes

Observability tools

CI/CD pipelines

Git version control

Jira & Confluence

Model serving tech

AI infrastructure tools

Service mesh (Istio/Linkerd)

Kubernetes patterns

SIGINT knowledge

CNO operations

Education

Bachelor’s degree in a technical discipline

Tools

Docker

Kubernetes

Prometheus

Grafana

Git

Jira

Confluence

vLLM

TorchServe

TensorFlow Serving

Triton

LiteLLM

Bifrost

Ray

Ollama

Istio

Linkerd

Job description

Bitwise seeks a Software Engineer to own the platform layer delivering AI/ML capabilities for national security missions. You’ll focus on DevOps, platform engineering, and automation to build reliable on-prem infrastructure and deployment pipelines.

Responsibilities include deploying containerized services, implementing observability, and enabling high availability and performance in collaboration with data scientists and sysadmins.