AI Platform Engineer

MACHINE LEARNING TECHNOLOGIES LLC; Boston (MA); Vor Ort; USD 96.000 - 165.000; Vollzeit

Zusammenfassung

MACHINE LEARNING TECHNOLOGIES LLC is seeking an AI Platform Engineer in Boston, MA for a 6-month engagement to design and operate scalable AI infrastructure. You will work across platform engineering, cloud infrastructure, and DevOps to deploy reliable AI workloads and pipelines.

The role emphasizes production-grade AI systems, cost-aware scaling, and self-serve tooling. You will implement guarded access, monitoring, and governance for model usage, data sources, and performance metrics across

Qualifikationen

• 4+ years in platform engineering, cloud infra, or DevOps.
• Production AI/LLM platforms experience with grounded data retrieval.
• Knowledge of testing, evaluating, and monitoring AI systems.
• Strong Python programming and API automation skills.
• Experience with AWS or Azure and containerized infrastructure.
• Awareness of cost/performance tradeoffs in AI models.
• Experience exposing metrics via APIs or dashboards.
• Security-first mindset: least-privilege access & data handling.
• Ability to enable self-service while applying guardrails.
• Comfort across infra, automation, integration and app code.

Aufgaben

• Stand up and maintain AI compute environments with containerized and GPU-backed resources.
• Automate safe rollouts with automated pipelines and rollback.
• Connect AI models to data sources for grounded responses.
• Manage vector stores and data retrieval sources.
• Route model access and enforce governance for model use.
• Build guardrails to catch harmful or biased outputs.
• Enable self-service tooling while maintaining control.
• Monitor system health, latency, and error rates.
• Track usage and spend at model and feature levels.

Kenntnisse

Platform engineering

AI in production

AI systems judgment

Python

Cloud and containers

Cost and model judgment

Reporting and transparency

Security mindset

Self-service thinking

Full-stack comfort

Tools

Terraform

Kubernetes

Docker

Jobbeschreibung

Job Overview

Job ID: J53463

Job Title: AI Platform Engineer

Location: Boston, MA

Duration: 6 Months + Extension

Domain Exposure: Education

Work Authorization: US Citizen,Green Card,OPT-EAD,CPT,H-1B,H4-EAD,L2-EAD,GC-EAD

Client: To Be Discussed Later

Employment Type: W-2, 1099, C2C

Key Responsibilities

• Infrastructure and Scaling: stand up and maintain the compute environment AI workloads run on, including containerized and GPU-backed resources, so workloads run efficiently and cost-effectively
• Automate safe rollouts: build automated pipelines for rolling out AI platform updates, with rollback built in
• Build retrieval systems: connect AI models to the organization's own data so responses are grounded in real, current information
• Maintain vector stores: connect and maintain the vector stores and data sources retrieval depends on
• Route and gate model access: give people one governed way to reach approved AI models and providers, routing each request to the model that actually fits the job
• Redact sensitive data: strip sensitive or private data out of prompts before they reach a model
• Build guardrails: put guardrails in place to catch harmful, biased, or simply wrong AI output before a user sees it
• Enable self-service without losing control: set up access and permissions so people across the organization can use approved AI capabilities on their own, while the platform still enforces where the line is
• Monitor system health: watch system health, response times, and error rates, and catch problems before people have to report them
• Track usage and spend: track usage and spend at the model and feature level so cost surprises do not happen
• Apply cost discipline: apply the same cost-management discipline to AI spend that the platform team applies everywhere else
• Build self-service tools: build self-service tools and APIs so other teams can ship AI features without needing to understand the plumbing underneath
• Report on AI performance: expose usage, spend, and performance metrics through APIs or dashboards so AI costs and performance are visible across the organization

Qualifications

Required

• Platform engineering experience: 4+ years of hands-on experience in platform engineering, cloud infrastructure, or DevOps
• AI in production: experience running AI or LLM platforms in production, including retrieval systems that ground model answers in real company data
• AI systems judgment: understands that AI systems behave differently from regular software, and knows how to test, evaluate, and monitor them so problems get caught early
• Programming and automation: strong Python skills, including building integrations against APIs
• Cloud and containers: solid experience with at least one major cloud provider (AWS or Azure) and building on containerized infrastructure
• Cost and model judgment: some sense of cost and performance tradeoffs between AI models, and when a smaller, cheaper model is the right call
• Reporting and transparency: experience building or exposing metrics through APIs or dashboards for reporting and visibility beyond the immediate team
• Security mindset: builds with security as a first-class concern: least-privilege access, careful handling of sensitive data, sensible defaults
• Self-service thinking: understands how to make AI capability self-service, and where the guardrails actually need to hold
• Full-stack comfort: equally comfortable in infrastructure, automation, integration, and application code

Preferred (Optional)

• Terraform or similar infrastructure-as-code experience
• Exposure to cloud cost management or FinOps practices
• Deeper experience with retrieval pipelines: chunking, embeddings, indexing, and ranking, not just calling a vector database
• Experience routing requests across multiple AI model providers based on cost, speed, or capability
• Judgment about when a simple, predictable workflow beats an open-ended AI agent, with experience building both
• Familiarity with container orchestration for AI or compute-heavy workloads
• Familiarity with governing tool access for AI agents, such as scoped permissions or a central tool registry, as agentic workflows become more common
• Certifications are a plus, not required. What you have actually built matters more.

Equal Opportunity Employer

We are an equal opportunity employer. All aspects of employment including the decision to hire, promote, discipline, or discharge, will be based on merit, competence, performance, and business needs. We do not discriminate on the basis of race, color, religion, marital status, age, national origin, ancestry, physical or mental disability, medical condition, pregnancy, genetic information, gender, sexual orientation, gender identity or expression, national origin, citizenship/ immigration status, veteran status, or any other status protected under federal, state, or local law.