Founding Infrastructure Engineer - AI Inference Platform

Observable Intuition; New York (NY); On-site; USD 180,000 - 280,000; Full time

Job summary

Observable Intuition is seeking a Founding Infrastructure Engineer to define and own the production inference platform behind a new AI layer. You’ll build core systems from the ground up, make foundational architectural decisions, and guide the engineering culture while ensuring scalability, security, and reliability across cloud and air-gapped deployments.

You’ll work closely with the founding team, shaping the technical strategy and infrastructure roadmap, and you’ll own end-to-end platform

Qualifications

• Experience operating machine-learning or compute-intensive distributed systems in production.
• Experience with cloud infrastructure, containers, orchestration, and observability.
• Designing multi-tenant platforms with strong isolation and security boundaries.
• Proven track record owning production systems from architecture through operation.
• Familiarity with Infrastructure as Code (IaC) and tools such as Terraform.
• Comfort working hands-on with substantial autonomy and without a predefined blueprint.

Responsibilities

• Own the production inference platform across model serving, orchestration, deployment, observability, and operations.
• Optimize workloads for latency, throughput, quality, and cost.
• Build reliable infrastructure for continuous high-volume data processing, including backfills and reprocessing.
• Design a portable platform across managed cloud, customer-owned infrastructure, and air-gapped environments.
• Ensure strong per-customer isolation across data, compute, identity, and operations for multi-tenancy.
• Own the model lifecycle: versioning, evaluation, rollout, monitoring, rollback.
• Define data retention, governance, and secure deletion across deployments.
• Collaborate with founders to shape technical strategy and the roadmap.

Skills

Production systems

Cloud infrastructure

Containers

Orchestration

Observability

Multi-tenant design

Architecture ownership

Autonomy

Tools

Terraform

Kubernetes

TensorRT

Ray

vLLM

Triton

Job description

Observable Intuition is seeking a Founding Infrastructure Engineer to define and own the production inference platform behind a new AI layer. You’ll build core systems from the ground up, make foundational architectural decisions, and guide the engineering culture while ensuring scalability, security, and reliability across cloud and air-gapped deployments.

You’ll work closely with the founding team, shaping the technical strategy and infrastructure roadmap, and you’ll own end-to-end platform