Principal ML Ops Architect - Remote/Hybrid

Pragmatike; Chicago (IL); On-site; USD 180,000 - 260,000; Full time

Benefits offered by this job

Competitive salary & equity options

Sign-on bonus

Health, Dental, and Vision

401k

Job summary

Pragmatike is seeking a Staff/Principal ML Ops Engineer to lead the design, implementation, and scaling of the company\'s ML infrastructure and production AI systems. This high-impact role spans the model lifecycle from training to deployment and observability, partnering with researchers, GPU engineers, and product teams.

You\'ll shape architecture, drive strategy, and deliver robust, automated pipelines across cloud and on-prem environments while mentoring engineers and advancing the ML

Qualifications

• Deep hands-on experience designing and operating production ML systems at scale (Staff/Principal-level expected).
• Strong background in ML Ops, distributed systems, and cloud infrastructure (AWS, GCP, or Azure).
• Proficiency with Python and familiarity with TypeScript or Go for platform integration.

Responsibilities

• Architect, build, and scale the end-to-end ML Ops pipeline, including training, fine-tuning, evaluation, rollout, and monitoring.
• Design reliable infrastructure for model deployment, versioning, reproducibility, and orchestration across cloud and on-prem GPU clusters.
• Optimize compute usage across distributed systems (Kubernetes, autoscaling, caching, GPU allocation, checkpointing workflows).
• Lead the implementation of observability for ML systems (monitor drift, performance, throughput, reliability, cost).
• Build automated workflows for dataset curation, labeling, feature pipelines, evaluation, and CI/CD for ML models.
• Collaborate with researchers to productionize models and accelerate training/inference pipelines.
• Establish ML Ops best practices, internal standards, and cross-team tooling.
• Mentor engineers and influence architectural direction across the entire AI platform.

Skills

ML Ops at scale

Kubernetes

Python

PyTorch

Model deployment

CI/CD

Tools

Docker

Kubernetes

Helm

CUDA

Transformers

Job description

Pragmatike is seeking a Staff/Principal ML Ops Engineer to lead the design, implementation, and scaling of the company\'s ML infrastructure and production AI systems. This high-impact role spans the model lifecycle from training to deployment and observability, partnering with researchers, GPU engineers, and product teams.

You\'ll shape architecture, drive strategy, and deliver robust, automated pipelines across cloud and on-prem environments while mentoring engineers and advancing the ML