AI Platform Engineer: Production, Retrieval & Guardrails

Ethereum Technologies; Boston (MA); On-site; USD 140,000 - 210,000; Full time

Job summary

Ethereum Technologies is hiring for a senior platform engineer to design and operate scalable AI infrastructure. You will manage compute environments for AI workloads, integrate retrieval systems, and ensure secure, cost-aware operations across cloud and containerized platforms.

You will automate safe rollouts, build vector stores, and implement guardrails. Candidates should show strong Python skills, API integrations, and experience with cloud providers.

Qualifications

• 4+ years in platform engineering, cloud infra, or DevOps.
• Experience running AI in production with retrieval systems grounded in company data.
• Understanding AI systems differ from traditional software; know how to test, evaluate, and monitor them.
• Strong Python skills, including building integrations against APIs.
• Experience with AWS or Azure and containerized infrastructure.
• Sense of cost vs performance tradeoffs for AI models.
• Ability to expose metrics via APIs or dashboards for visibility.
• Security mindset: least-privilege access and safe handling of data.
• Self-service design principles and guardrails for AI usage.
• Comfort across infra, automation, integration, and app code.

Responsibilities

• Infrastructure and Scaling: stand up and maintain compute env for AI workloads, incl. containerized and GPU-backed resources.
• Automate safe rollouts: build pipelines for updates with rollback.
• Build retrieval systems: ground model outputs in real company data.
• Maintain vector stores and data sources for retrieval.
• Route and gate model access with governed, model-fitting routing.
• Redact sensitive data from prompts before models see them.
• Build guardrails to catch harmful or wrong AI output.
• Enable self-service while enforcing access controls.
• Monitor system health, response times, and error rates.
• Track usage and spend at model and feature levels.
• Apply cost discipline across AI spend.
• Build self-service tools and APIs for teams to ship AI features.
• Report on AI performance via dashboards and APIs.

Skills

Platform engineering

AI in production

AI systems judgment

Python programming

Cloud & containers

Cost/performance tradeoffs

APIs & integrations

Security mindset

Self-service thinking

Full-stack infra & code

Job description

Ethereum Technologies is hiring for a senior platform engineer to design and operate scalable AI infrastructure. You will manage compute environments for AI workloads, integrate retrieval systems, and ensure secure, cost-aware operations across cloud and containerized platforms.

You will automate safe rollouts, build vector stores, and implement guardrails. Candidates should show strong Python skills, API integrations, and experience with cloud providers.