AI Platform Engineer - Scalable, Secure AI Infra

Apollo Solutions; Boston (MA); On-site; USD 140,000 - 200,000; Full time

Job summary

Apollo Solutions in Boston is hiring an AI Platform Engineer to design and build the underlying platform and infrastructure that enables AI across the business.

This role prioritizes platform engineering over building individual AI apps, focusing on shared services, APIs, and controls for scalable, secure AI deployments.

You will work across software engineering, cloud infrastructure, AI tech, and platform architecture, contributing to hands-on development and long-term technical direction.

Qualifications

• 5+ years of experience in software/platform engineering or related field.
• Experience building production software/platform solutions at scale.
• Strong understanding of distributed systems and service-based architectures.

Responsibilities

• Design and develop shared AI platform services used by engineering teams.
• Build scalable infrastructure enabling secure access to LLMs and foundation models.
• Develop backend services and APIs supporting AI workloads.
• Build platform capabilities around model integration, orchestration and runtime management.
• Design and maintain AI gateway services including routing, controls and governance.
• Develop MCP-related infrastructure: context management and tool integration.
• Create reusable platform components to simplify AI integration for apps.
• Collaborate with cloud and security teams to deploy and operate AI services.

Skills

Distributed systems

Cloud native

Kubernetes

IaC/CI-CD

Backend development

AWS/Azure

Security governance

Observability

Communication

Tools

Kubernetes

AWS

Azure

Terraform

CI/CD tooling

Linux

Job description

Apollo Solutions in Boston is hiring an AI Platform Engineer to design and build the underlying platform and infrastructure that enables AI across the business.

This role prioritizes platform engineering over building individual AI apps, focusing on shared services, APIs, and controls for scalable, secure AI deployments.

You will work across software engineering, cloud infrastructure, AI tech, and platform architecture, contributing to hands-on development and long-term technical direction.