Founding Infrastructure Engineer, AI Inference Platform

Collective Intuition, Inc.; New York, Northern (NY, KY); Hybrid; USD 120,000 - 200,000; Full time

Job summary

Collective Intuition, Inc. seeks a Founding Infrastructure Engineer to define and own the production inference platform behind a new layer of AI intelligence. You will build core systems, set foundational architecture decisions, and influence engineering culture from day one.

You will ensure the platform operates across managed cloud, customer-owned infrastructure, and air-gapped environments, delivering performance, reliability, and strong security while avoiding fragmentation.

Qualifications

• Experience operating ML or compute-intensive distributed systems in production.
• Strong experience with cloud infrastructure, containers, orchestration, and observability.
• Experience designing multi-tenant platforms with isolation and security boundaries.
• A proven track record owning production systems from architecture through operation.
• Familiarity with Infrastructure as Code (IaC) and Terraform.
• Comfort working hands-on with autonomy and without an established blueprint.

Responsibilities

• Own our production inference platform across model serving, orchestration, deployment, observability, and operations.
• Optimize workloads by batching, caching, scheduling, and routing while balancing latency, throughput, quality, and cost.
• Build reliable infrastructure for high-volume data processing, including backfills and safe reprocessing.
• Design a portable platform that runs across managed cloud, customer-owned infra, and air-gapped environments.
• Make multi-tenancy a foundational property with strong per-customer isolation across data, compute, identity and operations.
• Own the model lifecycle: versioning, evaluation, rollout, monitoring, and rollback.
• Define data retention, recovery, governance, and secure deletion across deployments.
• Collaborate with founders to shape technical strategy and infra roadmap.

Skills

Distributed systems

Cloud infrastructure

Containers

Orchestration

Observability

Multi-tenant design

Architecture ownership

Autonomy

Tools

Terraform

Job description

Collective Intuition, Inc. seeks a Founding Infrastructure Engineer to define and own the production inference platform behind a new layer of AI intelligence. You will build core systems, set foundational architecture decisions, and influence engineering culture from day one.

You will ensure the platform operates across managed cloud, customer-owned infrastructure, and air-gapped environments, delivering performance, reliability, and strong security while avoiding fragmentation.