Founding Infrastructure Engineer – AI Inference Platform

Observable Intuition, Inc.; New York, Northern (NY, KY); Hybrid; USD 120,000 - 200,000; Full time

Job summary

Observable Intuition, Inc. seeks a founding Infrastructure Engineer to define and own the production inference platform behind our data-driven AI layer.

You will collaborate with the founding team to build core systems from the ground up, make foundational architectural decisions, and shape the engineering culture across deployments. Your work will span managed cloud, customer-owned infrastructure, and fully air-gapped environments, ensuring performance, reliability, and security at scale.

Qualifications

• Experience operating machine-learning or similarly compute-intensive distributed systems in production.
• Strong experience with cloud infrastructure, containers, orchestration, and observability.
• Experience designing multi-tenant platforms with rigorous isolation and security boundaries.
• A record of owning production systems from architecture through operation.
• Familiarity with Infrastructure as Code (IaC) and tools such as Terraform.
• Comfort working hands-on with substantial autonomy and without an established blueprint.

Responsibilities

• Own our production inference platform across model serving, orchestration, deployment, observability, and operations.
• Optimize workloads for batching, caching, scheduling, and routing while balancing latency, throughput, quality, and cost.
• Build reliable infrastructure for high-volume data processing, including backfills and safe reprocessing.
• Design a portable platform that runs across managed cloud, customer-owned infrastructure, and air-gapped environments.
• Ensure multi-tenancy with strong per-customer isolation across data, compute, identity, and operations.
• Own the model lifecycle, including versioning, evaluation, rollout, monitoring, and rollback.
• Define data retention, recovery, governance, and secure deletion across deployments.
• Collaborate with founders to shape technical strategy and infrastructure roadmap.

Skills

Distributed systems

Cloud infrastructure

Containers & orchestration

Observability

Multi-tenant design

Production ownership

IaC (Terraform)

Autonomy

Tools

Kubernetes

Terraform

Triton

vLLM

TensorRT

Ray

Job description

Observable Intuition, Inc. seeks a founding Infrastructure Engineer to define and own the production inference platform behind our data-driven AI layer.

You will collaborate with the founding team to build core systems from the ground up, make foundational architectural decisions, and shape the engineering culture across deployments. Your work will span managed cloud, customer-owned infrastructure, and fully air-gapped environments, ensuring performance, reliability, and security at scale.