Platform Engineer - Inference

Subconscious Systems Technologies, Inc.

Boston (MA)

On-site

USD 180,000 - 230,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Equity ownership
Health coverage
Unlimited PTO
Shy Bird Wednesdays

Job summary

Subconscious Systems Technologies, Inc. is seeking an experienced Platform/Infrastructure engineer to scale our inference platform to hundreds of thousands of users.

You will own reliability, performance, and security of workloads and influence architectural direction in a ground-floor role with leadership growth potential. You will collaborate with research, drive major deployment optimizations, and help build a product factory with CI/CD and guardrails.

Qualifications

  • 5+ years in Platform, Infrastructure, or Inference roles.
  • Experience running Kubernetes at scale.
  • Experience running AWS at scale.
  • Deep observability experience – Datadog required.
  • Expert deployment strategies – zero downtime, rollbacks, blue/green, canary.
  • Proficient in Terraform, CI/CD pipelines, and GitOps.
  • Experience with SDLC security and compliance processes.
  • Staff-level judgment – define ambiguous problems and influence without authority.
  • Product sense – solve problems from end-user and business requirements.
  • Strong communication and collaboration with teams.

Responsibilities

  • Own reliability, performance, observability, uptime, load balancing, and security of inference workloads.
  • Collaborate with research to enable inference optimizations and open-source model support.
  • Contribute to architectural direction and build vs. buy decisions for the inference platform.
  • Help build a scalable product factory with CI/CD and guardrails.
  • Establish engineering culture through docs, reviews, mentorship, and hands-on implementation.

Skills

Platform engineering
Observability
Leadership
Data storytelling
Product sense
Problem solving
Stakeholder influence
End-user focus

Tools

Kubernetes
AWS
Datadog
Grafana
Terraform
CI/CD
GitOps
Blue/Green deployments
Canary

Job description

Build and own the infrastructure that will power billions of agents.

Agents are eating the economy, but it's still the early days. Token useage is increasing 2,500% year over year, agents token consumption is growing 7x faster than humans, and adoption of agentic systems is on the rise across professions. All signs point to these trends continuing, as agentic workloads become irreplacable across software, cybersecurity, legal, finance, HR, sales, and science tasks. We are building the foundation.

Subconscious is an inference platform specifically designed to power long-running agents. For tasks that consume 200k+ tokens, our inference system delivers unparalleled speed, accuracy, and cost efficiency. As agents proliferate, Subconscious will be a provider in every agent stack.

About the role

You will provide the battle-tested infrastructure experience needed to scale our platform to hundreds of thousands of users. Today, we serve billions of tokens per day. With your contributions, we'll serve trillions.

This is a ground-floor role. You will shape the product, technology, and engineering culture. We expect the person who fills this role to grow into a leadership position.

Responsibilities
  • Own the reliability, performance, observability, uptime, load balancing, and security of inference workloads.
  • Work closely with our research team to make new inference optimizations and open source model support broadly available to customers.
  • Contribute to the technical direction of our inference platform including major architecture and build vs. buy decisions.
  • Help build the product factory that makes our team ship code like a team 10x our size - including human-driven process, CI/CD, and agent guardrails.
  • Establish durable engineering culture through design docs, architecture reviews, mentorship, and hands-on implementation.

You will work across our inference stack, from the user-facing platform to GPU cache optimization.

Role requirements
  • 5+ years in Platform, Infrastructure, or Inference engineering roles
  • Experience running Kubernetes at scale
  • Experience running AWS at scale
  • Deep observability experience - including Datadog (Prometheus and Grafana are a plus)
  • Expert in deployment jujitsu - zero downtime, rollbacks, blue/green, canary, etc. - we want someone with battle scars
  • Proficient in Terraform, CI/CD pipelines, and GitOps workflows
  • Experience with SDLC security and compliance processes
  • Staff-level judgment - you can define ambiguous problems, make pragmatic tradeoffs, influence without authority, and leave both systems and teams better than you found them. You can tell a good story with data.
  • Product sense - you solve problems by working backwards from the end-user and business requirements.
  • You have character, a sense of humor, and compassion. You are someone we are excited to introduce to our partner.
Nice to have
  • You have worked in startups before
  • You have worked on AI systems that serve trillions of tokens per day
  • Experience with vLLM, SGLang, or NVIDIA Dynamo
  • Experience with BYOC (bring your own cloud) implementations
  • Experience with SOC 2 - ideally having contributed to achieving compliance
  • Experience with GCP or Azure
  • Experience with agent-driven software delivery at scale
Location

We are based in Boston, MA, and are in the office 5 days a week. For an exceptional candidate, we are willing to consider remote work.

Compensation

We can't build this company without you, and we want you to be a meaningful owner alongside us. Your equity will reflect that.

Salary will be between $180k-$230k with significant equity ownership.

We offer full medical, dental, and vision coverage, plus unlimited PTO. We order Shy Bird on Wednesdays in the office.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Inference Infrastructure Engineer, Serving
Inference Infrastructure Engineer, Serving

Elorian AI • San Francisco (CA)

On-site
USD 200,000 - 400,000
Health, dental, and vision benefits
Unlimited PTO
Parental leave
Software Engineer, Agent Platform Palo Alto
Software Engineer, Agent Platform Palo Alto

Sycamore Labs, Inc. • Palo Alto (CA)

Hybrid
USD 180,000 - 260,000
Competitive cash compensation
Meaningful equity
Platform Engineer
Platform Engineer

Harper • San Francisco (CA)

On-site
USD 140,000 - 280,000
Uber commuter benefits
Meals provided (breakfast, lunch, and/
Snacks, drinks and coffee daily
+2
Software Engineer
Software Engineer

Raydar • San Francisco (CA)

On-site
USD 180,000 - 250,000
Competitive equity
Relocation package
Unlimited PTO
+2
Software Engineer, Inference
Software Engineer, Inference

Speedrun Talent Network • San Francisco (CA)

On-site
USD 300,000 - 400,000
Health, dental, and vision benefits
Unlimited PTO
Paid parental leave
+1
Senior Backend Engineer (Inference Platform)
Senior Backend Engineer (Inference Platform)

you.com • New York (NY)

Remote
USD 150,000 - 210,000
Remote-friendly culture
Competitive compensation
INFERENCE ENGINEER
INFERENCE ENGINEER

MakerMaker.AI • San Francisco (CA)

On-site
USD 120,000 - 160,000
Software Engineer - Inference Platform
Software Engineer - Inference Platform

Baseten • New York (NY)

On-site
USD 180,000 - 360,000
Competitive compensation with equity
Medical, dental, and vision coverage
Flexible PTO with Winter Break
+4
Agent Infrastructure Engineer
Agent Infrastructure Engineer

Nebula • El Segundo (CA)

On-site
USD 100,000 - 250,000
Equity participation in a high-growth 
Comprehensive health, dental, and VIs
401(k) with company matching
+3
Senior Software Engineer
Senior Software Engineer

MetAntz • Palo Alto (CA)

On-site
USD 200,000 - 300,000