Senior AI Platform Infrastructure Engineer

Manifest OS; New York, Northern (NY, KY); Hybrid; USD 250,000 - 350,000; Full time

Benefits offered by this job

Job summary

Manifest OS in New York, NY is looking for a Senior Infrastructure Engineer for the AI Platform to build scalable infrastructure powering AI features across our product. You will design a model gateway, implement robust observability, and deliver developer tools that help engineers ship faster with confidence at scale.

The role requires 6–9 years of infrastructure experience, strong systems thinking, and the ability to simplify non-deterministic AI workloads while balancing cost, latency, and

Qualifications

• 6–9 years of infrastructure engineering experience.
• Experience with high-throughput, low-latency systems.
• Background with service meshes, API gateways, observability platforms, or developer tooling.
• Comfortable tackling unfamiliar AI/ML domains.

Responsibilities

• Build the AI platform that abstracts away the complexity of AI/ML systems for product engineers.
• Design the model gateway for cost and latency optimization.
• Create robust observability for non-deterministic systems.
• Deliver developer tools to improve engineer productivity and reliability.

Skills

Distributed systems

Platform engineering

API design

LLM operations

Tools

Service meshes

API gateways

Observability platforms

Developer tooling

Job description

Manifest OS in New York, NY is looking for a Senior Infrastructure Engineer for the AI Platform to build scalable infrastructure powering AI features across our product. You will design a model gateway, implement robust observability, and deliver developer tools that help engineers ship faster with confidence at scale.

The role requires 6–9 years of infrastructure experience, strong systems thinking, and the ability to simplify non-deterministic AI workloads while balancing cost, latency, and