Remote ML Senior Software Engineer: Inference & Safety

Akamai Technologies GmbH; Cambridge (MA); Remote; USD 121,000 - 219,000; Full time

Job summary

Akamai Technologies is seeking a Machine Learning Senior Software Engineer to join the Akamai Inference Cloud Team. This remote US-friendly role focuses on building and operating systems for model validation, quantization, safety, and deployment at global scale.

You will work with PyTorch, TensorFlow, or JAX, develop pipelines for model scanning, optimize latency, and implement guardrails for safety and compliance.

Qualifications

• 5 years of relevant experience with a Bachelor's or Master's degree in Computer Science, Machine Learning, or a related field.
• Proficient with modern ML frameworks (PyTorch, TensorFlow, or JAX) and production ML pipelines.
• Experience with model quantization, inference optimization, and safety/compliance considerations.

Responsibilities

• Develop and operate model validation and security scanning pipelines prior to deployment.
• Implement quantization, pruning, and optimization to reduce model footprint and latency.
• Build guardrails to enforce safety policies and mitigate risks (jail breaking, prompt injection).
• Design model routing and prompt management infrastructure for multiple model variants.
• Contribute to evaluation frameworks measuring accuracy, performance, and safety.

Skills

Python

PyTorch

TensorFlow

JAX

LLMs

Transformers

Cloud infra

CI/CD

Production ML pipelines

Education

Bachelor's in CS/ML

Master's in CS/ML

Tools

PyTorch

TensorFlow

JAX

Job description

Akamai Technologies is seeking a Machine Learning Senior Software Engineer to join the Akamai Inference Cloud Team. This remote US-friendly role focuses on building and operating systems for model validation, quantization, safety, and deployment at global scale.

You will work with PyTorch, TensorFlow, or JAX, develop pipelines for model scanning, optimize latency, and implement guardrails for safety and compliance.