Principal ML Engineer — Remote, Scalable AI Systems

Aimlroles; San Francisco (CA); Remote; USD 210,000 - 320,000; Full time

Benefits offered by this job

Medical coverage

Dental & Vision

Savings plan

Paid time off

Job summary

Aimlroles is seeking a Principal Machine Learning Engineer to own and evolve critical AI systems across training, inference, and deployment. You will set technical standards, drive latency, cost, and reliability targets, and collaborate with cross-functional teams to ship production-grade ML solutions.

This remote role demands hands-on leadership, deep learning expertise, and the ability to balance architectural depth with pragmatic delivery and scalable ML infrastructure.

Qualifications

• Proficient in deep learning and transformer architectures.
• Experience deploying ML models in production at scale.
• Strong software engineering fundamentals for production-grade systems.
• Hands-on experience with GPU optimization and inference.
• Experience with RLHF pipelines or multimodal model deployment.

Responsibilities

• Architect and build large-scale ML systems (training, inference, evaluation, deployment).
• Design reproducible, high-performance training pipelines across GPU infrastructure.
• Architect inference systems balancing latency, throughput, cost, and reliability at scale.
• Design and maintain data systems for high-quality synthetic and real-world training data.
• Implement evaluation pipelines covering performance, robustness, safety, and bias; partner with research leadership.
• Own production deployment with GPU optimization, memory efficiency, and latency reduction.
• Collaborate with application engineering to integrate ML systems into backend/mobile/desktop products.
• Ship improvements quickly while learning from real usage.
• Operate under production constraints: latency, cost, reliability, and safety.

Skills

Deep learning

Transformer architectures

AI systems

Distributed training

GPU optimization

LLM inference

PyTorch

JAX

Open-source

Tools

DeepSpeed

Megatron

Ray

TensorRT-LLM

vLLM

FasterTransformer

Apache Arrow

Spark

Kubernetes

PyTorch

Job description

Aimlroles is seeking a Principal Machine Learning Engineer to own and evolve critical AI systems across training, inference, and deployment. You will set technical standards, drive latency, cost, and reliability targets, and collaborate with cross-functional teams to ship production-grade ML solutions.

This remote role demands hands-on leadership, deep learning expertise, and the ability to balance architectural depth with pragmatic delivery and scalable ML infrastructure.