Senior Software Engineer II (AI Enablement)

Hidden Jobs; United States; Remote; USD 140,000 - 175,000; Full time

Job summary

aledade seeks a senior platform engineer to own the substrate powering enterprise AI adoption. You will lead model routing decisions, build a gateway that brokers calls between agents and production systems, and shape workflows that balance performance with cost.

This role blends infrastructure depth with real-world usage and measurable adoption. You will extend MCP gateway, manage integrations with analytics tools, publish plugin pipelines, and mentor teams on developer platform patterns.

Qualifications

• Bachelor’s degree in Computer Science, Engineering, or related field.
• 5+ years of professional software engineering with backend platform ownership.
• Strong production experience in Python, TypeScript/Node, Go, or similar.
• Hands-on experience with machine-to-machine auth (OAuth2, OIDC, M2M).
• Experience instrumenting systems with metrics, logs, tracing or usage analytics.
• Direct hands-on experience with agentic-coding tools in production.
• Excellent written communication; able to author docs and runbooks.

Responsibilities

• Own and extend MCP gateway and connector platform; manage auth, scopes, tenancy, rate limiting, and policy enforcement.
• Run plugin marketplace publishing: versioning, CI/CD, reviews, and release hygiene; build shared plugins and guides.
• Own platform observability and cost attribution; benchmark and evaluations to guide model selection.
• Extend the agent output interface with a browsable, searchable surface with tagging, notifications, and expiry.
• Mentor engineers, run office hours, triage requests, and support marketplace artifacts and gateway availability.

Skills

Backend ownership

Python

TypeScript/Node

Go

CI/CD

OAuth2 / OIDC

Auth modeling

Observability

Documentation

Communication

Agentic coding tools

Education

Bachelor’s degree in Computing

Tools

API Gateway

Docker

Kubernetes

SDK/CLI

CI/CD tooling

Job description

Role overview

Join an internal AI enablement platform team as the engineer accountable for the substrate that powers enterprise-wide AI adoption. This is a senior platform role with direct business impact: model routing decisions affect inference spend and performance, while the gateway you build brokers every tool call between agents and production systems. The work spans infrastructure depth with real users, measurable adoption, and a tight loop between design decisions and outcomes.

Responsibilities

• Own and extend the Model Context Protocol (MCP) gateway and connector platform, building and hardening integrations with chat, ticketing, data warehouse, BI, CRM, and project management tools while managing authentication, scopes, tenancy, rate limiting, and read/write policy enforcement.
• Run the plugin marketplace publishing pipeline including versioning, CI/CD, plugin review, and release hygiene; build shared plugins, skills, hooks, and authoring guides that other teams can adopt independently.
• Own platform observability, model-gateway configuration, and cost attribution so adoption, tool-call health, and inference spend roll up by team, workload, and model; build benchmarks and harness evaluations that drive model selection on evidence.
• Extend the agent output and collaboration surface into a browsable, searchable, commentable interface with discovery, tagging, engagement instrumentation, expiry, and share notifications.
• Serve as a practitioner during office hours and brownbags, mentor engineers on agentic-coding and plugin-authoring patterns, triage inbound requests, and carry on-call for marketplace-published artifacts and gateway availability.

Requirements

• Bachelor's or higher degree in Computer Science, Engineering, or a related field.
• 5+ years of professional software engineering experience with production ownership of a backend service or developer platform (API gateway, service proxy, SDK/CLI, or internal developer platform), including its auth model, release process, and operational health.
• Strong production experience in at least one modern stack (Python, TypeScript/Node, Go, or similar) and modern CI/CD.
• Hands-on experience with authentication and authorization for machine-to-machine traffic such as OAuth2, OIDC, M2M credentials, token scoping, and secret management.
• Demonstrated experience instrumenting an owned system with metrics, structured logging, tracing, or usage analytics, and using that data to drive decisions.
• Direct hands-on experience with one or more agentic coding tools in a production or near-production setting.
• Strong written communication, comfortable producing documentation, runbooks, and educational artifacts for engineers who weren't in the room.

Nice to have

• Experience authoring or maintaining MCP servers, Claude Code plugins, skills, hooks, or comparable LLM-tooling integrations.
• Experience running an LLM gateway or inference proxy in production (LiteLLM, Bedrock, vLLM, or similar), including routing, fallback, caching, quota, and cost attribution.
• Experience building evaluation harnesses or benchmarks for LLM systems, including A/B comparison of prompts, tools, or model versions.
• Experience operating a package registry, plugin ecosystem, or extension marketplace with publishing pipelines, semantic versioning, compatibility, and deprecation.
• Background in healthcare technology or HIPAA-regulated environments, or familiarity with PHI handling, BAA, and data-residency constraints on third-party tooling.