Senior ML Infra Engineer — Real-Time Vision & Cloud GPUs

Claryo

San Francisco, Northern (CA, KY)

Hybrid

USD 180,000 - 240,000

Full time

14 days+
Application generator

Stand out for this role — generate a tailored resume and cover letter in about a minute.

Get past ATS filters

Benefits offered by this job

Medical/Dental/Vision
401k with employer matching
Parental leave
Unlimited vacation

Job summary

Claryo seeks a Senior Software Engineer - ML Infrastructure to build and scale infrastructure powering our AI-driven warehouse intelligence platform. You will own the end-to-end lifecycle of computer vision models—from training pipelines through optimized cloud deployment—ensuring high reliability and low-latency production systems.

This deeply technical role sits at the intersection of machine learning, distributed systems, and cloud infrastructure.

Qualifications

  • BS/MS in CS, robotics, or related field.
  • 7+ years software engineering with ML infra experience.

Responsibilities

  • Develop and maintain distributed cloud GPU infrastructure for large-scale world model training and low-latency inference.
  • Build end-to-end computer vision pipelines—from data ingestion to deployment—into core product workflows.
  • Deploy and optimize ML models in the cloud using model serving platforms and inference optimization techniques.
  • Design and operate orchestration systems for ML pipelines for engineers and non-engineers.
  • Establish monitoring, benchmarking and evaluation frameworks for production models.

Skills

Python
C++/CUDA
Distributed systems
PyTorch/TensorFlow
GPU infrastructure
Cloud platforms
Model serving

Education

B.S./M.S. in Computer Science or related field

Tools

Kafka
gRPC
ROS2
Flyte
Temporal
Airflow
TorchServe
TensorRT

Job description

Claryo seeks a Senior Software Engineer - ML Infrastructure to build and scale infrastructure powering our AI-driven warehouse intelligence platform. You will own the end-to-end lifecycle of computer vision models—from training pipelines through optimized cloud deployment—ensuring high reliability and low-latency production systems.

This deeply technical role sits at the intersection of machine learning, distributed systems, and cloud infrastructure.

Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

Senior Software Engineer - ML Infrastructure
Senior Software Engineer - ML Infrastructure

Claryo • San Francisco (CA), Northern (KY)

Hybrid
USD 180,000 - 240,000
Medical/Dental/Vision
401k with employer matching
Parental leave
+1
Senior Software Engineer - ML/CV Infrastructure
Senior Software Engineer - ML/CV Infrastructure

Claryo • San Francisco (CA)

On-site
USD 150,000 - 200,000
Top-tier medical, dental, and vision coverage
401k with employer matching
Parental leave
+1
Senior Software Engineer - Computer Vision Deployment
Senior Software Engineer - Computer Vision Deployment

Claryo, Inc. • San Francisco (CA)

On-site
USD 120,000 - 160,000
Top-tier medical coverage
401k with employer matching
Parental leave
+1
Staff Computer Vision Deployment Engineer (Production ML Infra)
Staff Computer Vision Deployment Engineer (Production ML Infra)

Claryo • San Francisco (CA)

On-site
USD 150,000 - 200,000
Top-tier medical, dental, and vision coverage
401k with employer matching
Parental leave
+1
Senior ML Infra Engineer - Scale GPU Clusters, Remote
Senior ML Infra Engineer - Scale GPU Clusters, Remote

AI Breaking Wire • San Francisco (CA), Northern (KY)

Hybrid
USD 320,000 - 500,000
Equity
Medical/Dental/Vision coverage
Unlimited PTO
+1
Senior AI Platform Engineer - Remote Cloud-Native ML Infra
Senior AI Platform Engineer - Remote Cloud-Native ML Infra

Bright Vision Technologies • Columbus (OH), Dublin (OH)

On-site
USD 130,000 - 180,000
Senior ML Platform Engineer - Kubernetes & Cloud Infra
Senior ML Platform Engineer - Kubernetes & Cloud Infra

CEI • Orlando (FL), Northern (KY)

Hybrid
USD 145,000 - 166,000
Remote ML Infrastructure Engineer: Scale AI Inference
Remote ML Infrastructure Engineer: Scale AI Inference

JobCubby • Redwood City (CA)

Hybrid
USD 105,000 - 143,000
Remote ML Infra Engineer - High-Performance Inference
Remote ML Infra Engineer - High-Performance Inference

Bright Vision Technologies • Mountain View (CA)

On-site
USD 105,000 - 143,000
Senior ML Engineer: Scale Real-Time ML Infra & Data
Senior ML Engineer: Scale Real-Time ML Infra & Data

Ultra • New York (NY)

Hybrid
USD 180,000 - 240,000