Senior AI Platform Engineer - Remote & Flexible Hours

Technosylva

United States

Remote

USD 160,000 - 260,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Health insurance
Flexible benefits
Annual bonus
Flexible hours
Remote work

Job summary

Technosylva seeks an Senior AI Platform Engineer to own and operate the core services of our AI platform, including gateway integrations, the skills/plugins review pipeline, and the MCP registry. You will manage cost tagging, observability tooling, and security-focused controls while contributing to on-call incident response and continuous improvement.

You will write code, run production services, and collaborate across teams to ensure scalable, secure AI deployments with strong monitoring and

Qualifications

  • 5+ years in software/platform DevOps or SRE building and running production services.
  • Hands-on experience with LLM APIs: tool use, structured outputs, streaming, prompt caching, and provider differences.
  • Experience integrating or configuring an API/LLM gateway (Azure API Management / AI Gateway, LiteLLM, Portkey, OpenRouter, Kong): routing, auth, rate limiting, tagging.
  • Practical experience building with AI coding agents and their extension models (skills, plugins, MCP servers, hooks).
  • Strong coding skills and experience with Docker, Kubernetes and infrastructure as code (Terraform or similar) on a major cloud, ideally Azure.
  • CI/CD experience (GitLab CI or similar) including automated validation and review pipelines.
  • Experience collaborating with Security teams to implement security controls and support security reviews.
  • Experience with observability tooling (OpenTelemetry, Prometheus, Grafana) and on-call for production systems.

Responsibilities

  • Gateway operations & integration. Configure, extend and run our AI gateway: routing, authentication, rate limits, quotas, metadata tagging, and onboarding new teams and models (cloud, third-party and on-prem).
  • Skills & plugins pipeline. Build and run the review pipeline for our skills/plugins repository: automated validation, review gates, versioning and release workflows. Write and review skills, agents and plugins yourself.
  • Curated MCP registry. Run MCP server intake process, including security reviews of third-party servers, tool scoping, and allowlisting, within a published approval SLA.
  • FinOps tagging & reporting. Implement cost tagging and attribution in the gateway and tools so token and compute spend can be traced to teams, products and use cases. Build dashboards and alerts on top.
  • Observability & evaluation. Instrument AI services and agents with tracing, metrics and evals, and build dashboards and alerts for latency, errors, quality and cost per request.
  • Agent identity & secrets. Set up scoped, non-shared identities and secrets for agents and automations, following platform standards.
  • Security collaboration. Work with Security teams on MCP server and plugin reviews, incident response for AI services, and implementing controls such as access scoping, audit logging and secrets rotation.
  • Model routing operations. Configure and maintain routing rules, fallbacks and load balancing across model providers, and monitor routing impact on cost, latency and output quality.
  • Self-service & enablement. Build golden-path templates, CLIs and documentation so engineers can adopt AI without constant support. Help run office hours and workshops for engineers across the company.
  • Operations. Join the on-call rotation, handle incidents for production AI services, and turn learnings into fixes and runbooks.

Skills

LLM APIs
Coding skills
DevOps / SRE
Observability
Security collaboration

Tools

Docker
Kubernetes
Terraform
Azure
GitLab CI

Job description

Technosylva seeks an Senior AI Platform Engineer to own and operate the core services of our AI platform, including gateway integrations, the skills/plugins review pipeline, and the MCP registry. You will manage cost tagging, observability tooling, and security-focused controls while contributing to on-call incident response and continuous improvement.

You will write code, run production services, and collaborate across teams to ensure scalable, secure AI deployments with strong monitoring and

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior AI Platform Architect
Senior AI Platform Architect

Technosylva • United States

Remote
USD 160,000 - 230,000
Competitive salary
Private health insurance
Annual bonus
+2
Remote AI Platform DevOps Engineer
Remote AI Platform DevOps Engineer

Smart Working • United States

Remote
USD 130,000 - 180,000
Senior AI Platform Enablement Engineer (Remote/Hybrid)
Senior AI Platform Enablement Engineer (Remote/Hybrid)

Saragossa • Menlo Park (CA)

Hybrid
USD 210,000 - 270,000
Remote Senior AI Platform Backend Engineer
Remote Senior AI Platform Backend Engineer

Affirm, Inc. • New York (NY)

Remote
USD 160,000 - 230,000
Remote-first compensation structure
Remote work with flexible setup
Health benefits
+1
Senior AI Platform Engineer
Senior AI Platform Engineer

Technosylva • United States

Remote
USD 160,000 - 260,000
Health insurance
Flexible benefits
Annual bonus
+2
Senior AI Platform Engineer - Remote/Hybrid
Senior AI Platform Engineer - Remote/Hybrid

OEC • Alpharetta (GA)

Hybrid
USD 170,000 - 210,000
Senior Cloud Security & AI Risk Engineer
Senior Cloud Security & AI Risk Engineer

Technosylva • United States

Remote
USD 140,000 - 180,000
Health insurance
Annual bonus
Flexible hours
+1
Senior AI Platform Engineer - Fullstack (Flexible Hours)
Senior AI Platform Engineer - Fullstack (Flexible Hours)

SoSafe • United States

Hybrid
USD 90,000 - 140,000
Flexible hours
33 vacation days
Open Up wellbeing program
+2
Remote Senior AI Platform & Data Engineer
Remote Senior AI Platform & Data Engineer

Ad Hoc LLC • United States

Remote
USD 150,000 - 190,000
Company-subsidized health, dental, and
Flexible PTO
401K with employer match
+2
Staff AI Platform Engineer — Remote/Hybrid
Staff AI Platform Engineer — Remote/Hybrid

Code Metal, Inc. • United States

Hybrid
USD 205,000 - 250,000
Health care plan with 100% premium
401k with 5% matching
Paid Time Off (uncapped vacation)
+2