Senior AI Platform Architect

Technosylva

United States

Remote

USD 160,000 - 230,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Competitive salary
Private health insurance
Annual bonus
Flexible working hours
Remote work options

Job summary

Technosylva seeks a Staff AI Platform Engineer to own the architecture and technical direction of the AI platform, including the AI gateway, MCP registry, skills, plugins, evaluation and observability, and governance.

This is a hands-on role requiring design, code, production service operation, and on-call participation. You will define security controls, drive RFCs, and mentor engineers across the AI community in a fast-moving environment.

Qualifications

  • 8+ years in software, platform, infrastructure or SRE with architecture ownership across teams.
  • Strong understanding of LLM and API fundamentals, including context windows and prompt caching.
  • Hands-on experience with LLM gateway or similar layers and build-vs-buy decisions.
  • Experience with agent orchestration patterns and multi-agent workflows.
  • Security collaboration for threat modelling and production risk.
  • Familiar with Model Context Protocol (MCP) and security scope.
  • Production containerization expertise (Docker/Kubernetes).
  • IaC experience (Terraform or similar) on major cloud (Azure preferred).
  • Observability and reliability engineering for non-deterministic AI systems.
  • Ability to influence through RFCs/Architecture Decisions to non-technical stakeholders.

Responsibilities

  • Own the AI Platform architecture and set technical vision and standards.
  • Lead gateway evolution, provider routing, and policy decisions including failover and caching.
  • Decide orchestration stack and sandboxing for agents and multi-agent patterns.
  • Design identity, access control, and governance for human and non-human identities.
  • Shape MCP ecosystem: skills/plugins repository, versioning, and security model.
  • Standardize tooling for tracing, evals, and drift detection across AI apps.
  • Design cost attribution framework for token and compute spend with defined owners.
  • Be the technical escalation point and unblock designs with engineering teams.
  • Collaborate with Security on AI threat modelling and policy alignment.
  • Mentor engineers, review RFCs/ADRs, and participate in on-call rotations.

Skills

LLM fundamentals
API design
Architecture leadership
Agent orchestration
Security governance
MCP familiarity
Containerization
Observability
Coding proficiency
RFCs & ADRs

Tools

Azure
Terraform
Docker
Kubernetes
OpenRouter

Job description

Technosylva seeks a Staff AI Platform Engineer to own the architecture and technical direction of the AI platform, including the AI gateway, MCP registry, skills, plugins, evaluation and observability, and governance.

This is a hands-on role requiring design, code, production service operation, and on-call participation. You will define security controls, drive RFCs, and mentor engineers across the AI community in a fast-moving environment.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior AI Platform Engineer - Remote & Flexible Hours
Senior AI Platform Engineer - Remote & Flexible Hours

Technosylva • United States

Remote
USD 160,000 - 260,000
Health insurance
Flexible benefits
Annual bonus
+2
Staff AI Platform Architect - Hands-On Leader
Staff AI Platform Architect - Hands-On Leader

Fanatics Inc. • Redwood City (CA)

On-site
USD 190,000 - 238,000
Senior AI Platform Architect - Remote
Senior AI Platform Architect - Remote

Royper Royco LLC • United States

Remote
USD 183,000 - 229,000
Retirement Plan Matching
Flexible PTO
Wellness Resources
+4
Staff AI Platform Architect
Staff AI Platform Architect

Modernizing Medicine, Inc. • United States

Hybrid
USD 180,000 - 240,000
Medical benefits
401(k) match
PTO & parental leave
+5
AI Platform Lead
AI Platform Lead

SeekUp • New York (NY)

On-site
USD 130,000 - 170,000
Senior AI Platform Architect
Senior AI Platform Architect

Teradata • Phoenix (AZ)

On-site
USD 169,000 - 254,000
Staff AI Platform Engineer — Remote/Hybrid
Staff AI Platform Engineer — Remote/Hybrid

Code Metal, Inc. • United States

Hybrid
USD 205,000 - 250,000
Health care plan with 100% premium
401k with 5% matching
Paid Time Off (uncapped vacation)
+2
Senior AI Platform Engineer
Senior AI Platform Engineer

Covalent Resource Group • Southfield (MI)

On-site
USD 150,000 - 210,000
Senior AI Platform Engineer – Azure, CI/CD, Responsible AI
Senior AI Platform Engineer – Azure, CI/CD, Responsible AI

UNAVAILABLE • New York (NY)

On-site
USD 150,000 - 175,000
Senior AI Platform Engineer - Cloud, Security & Governance
Senior AI Platform Engineer - Cloud, Security & Governance

Adaptive Solutions Group • Maryland Heights (MO)

On-site
USD 110,000 - 150,000
Medical
Dental
STD/LTD
+3