Remote ML Ops Engineer: GPU Cloud Infrastructure

Pragmatike; Town of Italy (NY); On-site; USD 120,000 - 160,000; Full time

Job summary

Pragmatike is seeking a seasoned professional in machine learning operations to build AI-native cloud services. Your role includes creating production-grade infrastructure and managing complex ML systems. Candidates must have hands-on experience with model serving frameworks and strong Python skills, along with a proven track record in distributed systems. Join a fast-scaling startup committed to sustainability and innovation in cloud computing—fully remote role available.

Qualifications

• 4+ years of experience in ML Ops, Platform Engineering, SRE, or similar roles.
• Hands-on experience with model serving frameworks.
• Strong background in container orchestration and GPU-based workloads.

Responsibilities

• Build and operate production-grade model serving infrastructure.
• Design and implement robust deployment pipelines.
• Manage model registries and CI/CD pipelines.

Skills

ML Ops

Python

Container orchestration

Distributed systems

Infrastructure-as-code

Tools

vLLM

TGI

Triton

Terraform

Helm

Job description

Pragmatike is seeking a seasoned professional in machine learning operations to build AI-native cloud services. Your role includes creating production-grade infrastructure and managing complex ML systems. Candidates must have hands-on experience with model serving frameworks and strong Python skills, along with a proven track record in distributed systems. Join a fast-scaling startup committed to sustainability and innovation in cloud computing—fully remote role available.