Remote Principal ML Systems Architect

Protingent; Washington; Hybrid; USD 180,000 - 240,000; Full time

Job summary

Protingent Staffing is seeking a Principal Machine Learning Engineer to lead the design and evolution of critical ML systems across training, inference, evaluation, and infrastructure in a fully remote role.

You will architect large-scale pipelines, optimize GPU usage, and own production deployment while collaborating with backend/mobile/desktop teams to deliver measurable quality improvements and reliable performance.

Qualifications

• Strong background in deep learning and transformer architectures.
• Hands-on experience training, fine-tuning, or deploying large-scale ML models in production.
• Proficiency with PyTorch or JAX and ability to learn others quickly.
• Experience with distributed training and inference frameworks (DeepSpeed, FSDP, Megatron, Ray).
• Strong software engineering fundamentals – robust, production-grade systems.
• Experience with GPU optimization, memory efficiency, quantization, and mixed precision.
• Comfort owning end-to-end ML systems in production.
• Bias toward shipping and iterative improvement.
• Experience with LLM inference frameworks such as vLLM/TensorRT-LLM or FasterTransformer.
• Contributions to open-source ML or systems libraries.

Responsibilities

• Architect and build large-scale ML systems spanning data, training, evaluation, inference, and deployment.
• Design reproducible, high-performance training pipelines across GPU infrastructure.
• Architect inference systems balancing latency, throughput, cost, and reliability at scale.
• Design and maintain data systems for synthetic and real training data.
• Implement evaluation pipelines for performance, robustness, safety, and bias.
• Own production deployment including GPU optimization and latency reduction.
• Collaborate with application engineering to integrate ML into backend, mobile and desktop products.
• Make pragmatic trade-offs and ship improvements quickly from real usage.
• Work under production constraints: latency, cost, reliability, safety.
• Ensure ML systems are reliable, scalable and meet performance targets.
• Deploy models achieving measurable quality improvements and user impact.
• Monitor, debug, and resolve production issues with root-cause analysis.
• Provide guidance and scalable ML solutions for teammates.
• Enable efficient research-to-production cycles improving product experience.

Skills

Deep learning

Transformer models

PyTorch

JAX

Distributed training

GPU optimization

Memory efficiency

Quantization

Mixed precision

RLHF pipelines

Diffusion models

Multimodal models

vLLM

TensorRT-LLM

FasterTransformer

Open-source

Tools

DeepSpeed

FSDP

Megatron

Ray

Spark

Apache Arrow

Job description

Protingent Staffing is seeking a Principal Machine Learning Engineer to lead the design and evolution of critical ML systems across training, inference, evaluation, and infrastructure in a fully remote role.

You will architect large-scale pipelines, optimize GPU usage, and own production deployment while collaborating with backend/mobile/desktop teams to deliver measurable quality improvements and reliable performance.