AI Platform Engineer — Scale, Guardrails & Self-Service

MACHINE LEARNING TECHNOLOGIES LLC; Boston (MA); On-site; USD 96,000 - 165,000; Full time

Job summary

MACHINE LEARNING TECHNOLOGIES LLC is seeking an AI Platform Engineer in Boston, MA for a 6-month engagement to design and operate scalable AI infrastructure. You will work across platform engineering, cloud infrastructure, and DevOps to deploy reliable AI workloads and pipelines.

The role emphasizes production-grade AI systems, cost-aware scaling, and self-serve tooling. You will implement guarded access, monitoring, and governance for model usage, data sources, and performance metrics across

Qualifications

• 4+ years in platform engineering, cloud infra, or DevOps.
• Production AI/LLM platforms experience with grounded data retrieval.
• Knowledge of testing, evaluating, and monitoring AI systems.
• Strong Python programming and API automation skills.
• Experience with AWS or Azure and containerized infrastructure.
• Awareness of cost/performance tradeoffs in AI models.
• Experience exposing metrics via APIs or dashboards.
• Security-first mindset: least-privilege access & data handling.
• Ability to enable self-service while applying guardrails.
• Comfort across infra, automation, integration and app code.

Responsibilities

• Stand up and maintain AI compute environments with containerized and GPU-backed resources.
• Automate safe rollouts with automated pipelines and rollback.
• Connect AI models to data sources for grounded responses.
• Manage vector stores and data retrieval sources.
• Route model access and enforce governance for model use.
• Build guardrails to catch harmful or biased outputs.
• Enable self-service tooling while maintaining control.
• Monitor system health, latency, and error rates.
• Track usage and spend at model and feature levels.

Skills

Platform engineering

AI in production

AI systems judgment

Python

Cloud and containers

Cost and model judgment

Reporting and transparency

Security mindset

Self-service thinking

Full-stack comfort

Tools

Terraform

Kubernetes

Docker

Job description

MACHINE LEARNING TECHNOLOGIES LLC is seeking an AI Platform Engineer in Boston, MA for a 6-month engagement to design and operate scalable AI infrastructure. You will work across platform engineering, cloud infrastructure, and DevOps to deploy reliable AI workloads and pipelines.

The role emphasizes production-grade AI systems, cost-aware scaling, and self-serve tooling. You will implement guarded access, monitoring, and governance for model usage, data sources, and performance metrics across