Software Engineer, Data Platform Lead (Horizon AI)

STN, Inc.

United States

Remote

USD 140,000 - 210,000

Full time

8 days ago

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Horizon AI is seeking a Data Platform Lead to build the data foundation the platform will reason over. You will design a unified model for assets, topology, configuration, and state, enabling an agent to query in one call.

You will also own the data access layer and scale path to support a growing schema and vector indices. This role reports to the Chief AI Officer and requires deep PostgreSQL expertise, time-series data mastery, and experience with DCIM tooling.

Qualifications

  • Strong data modelling judgment for infrastructure domains.
  • Experience with time-series and event data at scale.
  • Deep PostgreSQL expertise including vector search and evolving schemas.
  • Ability to ship usable models early over pursuing perfection.

Responsibilities

  • Design and build the fleet knowledge model: assets, topology, configuration, and state.
  • Build the decision-capture pipeline and instrument operator workflow for labelled decisions.
  • Own the data access layer that abstracts telemetry sources and supports future collection.
  • Negotiate telemetry requirements: signals, granularity, retention, raw event access.
  • Own scaling path, including vector index behaviour and analytics separation.

Skills

Data modeling
Time-series data
PostgreSQL
Vector search
Fleet/infrastructure awareness
Schema evolution

Job description

Data Platform Lead

Horizon AI is building the operating system for how organizations run themselves. The first step is autonomous data centers. A fleet of AI agents senses the state of STN's GPU infrastructure, reasons about what it finds, and increasingly acts on it. This is running in production against real fleet data, not a prototype. Agents already take action where the risk is bounded and the outcome is verifiable. Everything riskier arrives as a recommendation for a human, and the work is moving decisions from the second category into the first, one class at a time, on evidence rather than optimism.

Data centers are the proving ground, not the destination. We start here because infrastructure is measurable and unforgiving: an agent is either right, or the fleet tells you it was wrong. What we build here generalizes, and we know where it goes next.

Level: Principal (MTS 5) · Reports to: Chief AI Officer

The role. Build the data foundation the platform reasons over. Today our agents assemble a picture of the fleet by querying several separate systems, and we cannot prove wider autonomy because we do not systematically capture how humans decide. You fix both.

The problems you inherit

  • Fleet state is scattered across a relational store, a DCIM system, and multiple time-series and monitoring systems. Each has its own query path. There is no unified model. - No decision-capture pipeline exists. We record what agents did, but not what operators saw, concluded, and chose. That record is the evidence base for granting agents wider autonomy.

  • Our retrieval pipeline is document-oriented rather than fleet-state-oriented.

  • We consume telemetry from systems other teams operate, where retention and granularity are tuned for dashboards rather than for learning from history.

You will

  • Design and build the fleet knowledge model: assets, topology, configuration, and current state, queryable by an agent in one call rather than five

  • Build the decision-capture pipeline, and instrument the operator workflow so we accumulate labelled human decisions from day one

  • Own the data access layer that abstracts telemetry sources, so we can keep consuming today and build our own collection if that stops scaling

  • Negotiate our requirements with the teams who own the telemetry: signals, granularity, retention, raw event access

  • Own the scale path, including vector index behaviour and the analytics separation a growing schema will eventually need

You have

  • Strong data modelling judgment, particularly modelling physical or infrastructure domains as something queryable

  • Experience with time-series and event data at scale, including cardinality and retention trade-offs

  • Depth in PostgreSQL, including vector search, and comfort with a large evolving schema - Enough infrastructure literacy to know what a fleet actually is: nodes, GPUs, fabric, schedulers, power. Familiarity with DCIM tooling is a strong plus

  • A bias toward shipping a usable model early over designing a complete one

Nice to have: GPU fleet or HPC exposure, DCGM, Slurm, entity resolution across inconsistent sources

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Autonomous Platform (Horizon AI)
Autonomous Platform (Horizon AI)

STN, Inc. • San Francisco (CA)

On-site
USD 210,000 - 320,000
Autonomous Platform (Horizon AI)
Autonomous Platform (Horizon AI)

STN, Inc. • United States

Remote
USD 180,000 - 240,000
Agent Felet & Multi Agent Systems (Horizon AI)
Agent Felet & Multi Agent Systems (Horizon AI)

STN, Inc. • San Francisco (CA)

On-site
USD 180,000 - 260,000
Inference & Workload Optimization Lead (Horizon AI)
Inference & Workload Optimization Lead (Horizon AI)

STN, Inc. • United States

Remote
USD 180,000 - 280,000
Inference & Workload Optimization Lead (Horizon AI)
Inference & Workload Optimization Lead (Horizon AI)

STN, Inc. • San Francisco (CA)

On-site
USD 200,000 - 320,000
Principal Data Platform Engineer – Fleet & Telemetry
Principal Data Platform Engineer – Fleet & Telemetry

STN, Inc. • United States

Remote
USD 140,000 - 210,000
Data Platform Lead Engineer — Fleet Intelligence
Data Platform Lead Engineer — Fleet Intelligence

STN, Inc. • United States

Remote
USD 180,000 - 240,000
Senior Infrastructure Engineer
Senior Infrastructure Engineer

Rational Dynamics • United States

On-site
USD 180,000 - 260,000
Sr. Software Engineer - Internal Apps
Sr. Software Engineer - Internal Apps

DDN • New York (NY)

On-site
USD 180,000 - 230,000
Senior Data Engineer (AI-Native) — Data Layer
Senior Data Engineer (AI-Native) — Data Layer

Proton • United States

Remote
USD 140,000 - 200,000