Senior AI Infrastructure Engineer – Gateways & Observability

Workato; United States; Remote; USD 180,000 - 260,000; Full time

Job summary

Workato is seeking a Senior AI infrastructure engineer to build the services that connect enterprise applications with large language model providers. You will own gateways, routing, authentication, and observability, from design through deployment and monitoring.

This role emphasizes high-performance, low-latency systems, PostgreSQL ownership, and deep experience with Go or Ruby, Kubernetes, and distributed systems.

Qualifications

• Minimum 5 years shipping and operating production services in Go or Ruby.
• Deep PostgreSQL knowledge: indexing, transactions, pooling, migrations.
• Experience with concurrency, Kubernetes, deployment pipelines and security.
• Experience with LLM protocol level integration, including messaging, tool calling, streaming, provider APIs and latency.

Responsibilities

• Design and develop MCP and AI gateways that mediate between applications, agents, and model providers.
• Implement protocol-level capabilities including MCP clients and servers, request routing, streaming, tool-call proxying, authentication, authorization, and tenant isolation.
• Build high-throughput, low-latency services involving TCP, TLS, HTTP/1.1, HTTP/2, JSON streaming, connection pooling, and backpressure.
• Own application-level PostgreSQL concerns such as schema design, indexing, query planning, transactions, connection management, and large-scale migrations.
• Design concurrent systems using worker pools, queues, graceful shutdown, and race-free shared state; profile services to identify and resolve bottlenecks.
• Establish useful observability for AI workloads, including metrics, tracing, logs, token usage, provider latency, cache performance, failure modes, and request cost.

Skills

Go

Ruby

PostgreSQL

Distributed systems

Kubernetes

Profiling

Tools

Kubernetes

Docker

CI/CD

Networking

Job description

Workato is seeking a Senior AI infrastructure engineer to build the services that connect enterprise applications with large language model providers. You will own gateways, routing, authentication, and observability, from design through deployment and monitoring.

This role emphasizes high-performance, low-latency systems, PostgreSQL ownership, and deep experience with Go or Ruby, Kubernetes, and distributed systems.