Senior ML Engineer — AI Model Validation & Inference

Akamai Technologies; Cambridge (MA); On-site; USD 121,000 - 219,000; Full time

Job summary

Akamai Technologies in Cambridge, MA, seeks an ML Senior Software Engineer to build and operate ML model validation, quantization, and safety pipelines, ensuring reliable production deployments. You will work with PyTorch, TensorFlow, and JAX, implement model routing and guardrails, and optimize inference across diverse hardware, joining a team delivering high-assurance AI at scale.

The role demands hands-on ML experience, strong Python skills, and collaboration across cross-functional teams to

Qualifications

• 5 years of relevant experience in ML software engineering.
• Hands-on experience with PyTorch, TensorFlow, or JAX and model deployment.
• Strong Python skills and experience with production ML pipelines.

Responsibilities

• Develop and maintain model validation and security scanning pipelines prior to deployment.
• Apply quantization, pruning, and other optimizations to reduce footprint and latency.
• Build guardrails enforcing safety and compliance policies.
• Design routing and prompt management infrastructure for multiple model variants.
• Contribute to evaluation frameworks measuring accuracy, performance, and safety.

Skills

PyTorch

TensorFlow

JAX

Python

Containerized deployments

CI/CD

Cloud infrastructure

Education

Bachelor's or Master's in Computer Science, Machine Learning, or related field

Tools

Docker

Kubernetes

MLflow

Job description

Akamai Technologies in Cambridge, MA, seeks an ML Senior Software Engineer to build and operate ML model validation, quantization, and safety pipelines, ensuring reliable production deployments. You will work with PyTorch, TensorFlow, and JAX, implement model routing and guardrails, and optimize inference across diverse hardware, joining a team delivering high-assurance AI at scale.

The role demands hands-on ML experience, strong Python skills, and collaboration across cross-functional teams to