Member of Technical Staff, Developer Infrastructure & Agent Automation

Inco AI

Palo Alto (CA)

On-site

USD 180,000 - 320,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Salary & equity
Health coverage
401(k) match
Meals & budget

Job summary

Inco AI seeks a founding member to define how the company builds software and to own the internal developer platform, including CI/CD, build systems, test infrastructure, and source control. You will prototype agent harnesses and shipping tooling while guiding teams toward agent-driven workflows.

You will work with research, engineering, and production to expand automation, scale productivity, and maintain reliability, with a flat organization where ideas travel quickly from inception to

Qualifications

  • Experience building internal developer platforms or dev-productivity infrastructure at scale.
  • Experience integrating LLMs or coding agents into real engineering workflows, not just prototypes.
  • Strong generalist engineering across full stack including Linux, CI/CD, and tooling at scale.
  • Fluency with monorepos, build systems, caching, test infrastructure, and CI/CD platforms such as GitHub Actions, Buildkite, Jenkins, or GitLab CI.
  • Experience with coding agents, agent harnesses, and orchestration systems with sandboxed execution, observability, and cost controls.
  • Hands-on experience with cluster management systems like Kubernetes, SkyPilot, Slurm, or comparable platforms.

Responsibilities

  • Define how Inco builds software and own the internal developer platform (CI/CD, build systems, test infrastructure, and source control).
  • Prototype agent harnesses and ship tooling to automate workflows and agent-driven engineering.
  • Collaborate with research, engineering, and production teams to turn workflows into reliable automation.
  • Drive technical direction and hands-on development while maintaining quality and reliability.
  • Help teams adopt new ways of working and scale developer productivity.

Skills

Linux
Docker
GPU computing
Python
Bash
CI/CD at scale
Monorepos

Tools

GitHub Actions
Buildkite
Jenkins
GitLab CI
Claude Code
Cursor
Codex
MCP servers
Humanize
Kubernetes
SkyPilot
Slurm

Job description

About the role

We are looking for a founding member to define how Inco builds software. You will own the internal developer platform (CI/CD, build systems, test infrastructure, and source control) while helping lead the shift to agent-driven engineering.

Your work will span developer tooling, automated research and experimentation, and production failure triage and remediation. You will work closely with other team members to understand their most demanding workflows, then turn those workflows into reliable automation and agent systems that reproduce results and expand what the team can accomplish. Just as importantly, you will earn trust across the organization and help teams adopt new ways of working.

You will set technical direction, make foundational decisions, and stay hands-on: prototyping agent harnesses and shipping the tooling yourself. The goal is a trusted agent-enabled environment that expands the team’s capacity and speed without sacrificing quality or reliability. Our organization is flat, and you will work directly with research, engineering, and production teams to carry ideas from inception through deployment.

About you
  • You are an effective change leader: you earn trust with technical peers, influence how teams work, and turn new tools and practices into durable habits

  • You are eager to invent new ways of working with LLMs and agents, pushing beyond the status quo to discover what agentic engineering can make possible

  • You have built internal developer platforms or dev-productivity infrastructure at scale, and you have integrated LLMs or coding agents into real engineering workflows, not just prototyped them

  • You reason across the full software development lifecycle: local dev, CI, testing, debugging, deployment

  • You treat internal tooling as a product and have real empathy for developer pain

  • You are drawn to the risk and upside of an early-stage startup

  • You embrace ambiguity and have a strong bias for action

  • You operate with a tech‑lead mentality regardless of title or years of experience

Requirements
  • Strong generalist engineering ability across the full stack: Linux, Docker, GPU computing, Python, Bash, and CI/CD at scale

  • Experience with monorepos, build systems and caching, test infrastructure, and CI/CD platforms such as GitHub Actions, Buildkite, Jenkins, or GitLab CI

  • Fluency with coding agents, agent harnesses, and orchestration systems such as Claude Code, Cursor, Codex, MCP servers, and Humanize, including sandboxed execution environments, agent observability, and cost and quality controls.

  • Experience integrating LLMs into engineering workflows, including agentic code review, test and documentation generation, and migrations with appropriate supervision checkpoints, rollback strategies, and evaluations

  • Hands‑on experience with cluster management systems such as Kubernetes, SkyPilot, Slurm, or comparable platforms

Bonus
  • Familiarity with LLM inference workloads and serving stacks, including model architectures, KV‑cache management, and quantization; PyTorch, vLLM, and SGLang

  • Familiarity with GPU environments, including NVIDIA drivers, CUDA, NCCL, and InfiniBand/RDMA

  • Experience supporting CI for large open‑source projects with 100+ contributors

  • Experience building observable, self‑healing platforms with Grafana dashboards, structured logging, actionable alerting, and agent‑driven incident triage and remediation

  • Experience improving operational reliability through stress testing, resilient CI/CD, and systematic reduction of flaky tests

Compensation & Benefits
  • Highly competitive salary and equity

  • Comprehensive health coverage for you and your dependents

  • Strong 401(k) match

  • Meals and snacks on us + discretionary productivity budget

Strong preference for in‑person in Palo Alto or Brooklyn.

About Inco

Inco AI (inco.ai) builds the agent‑native inference platform for tomorrow’s token economics, making advanced AI fast enough for real workflows and affordable enough to use at scale. We’re the researchers and engineers behind AWQ, DFlash, and TensorRT‑LLM, bringing frontier research into production.

Our platform ranked #1 in output speed on Artificial Analysis for every model we launched with, and our DFlash models have surpassed 10 million downloads on Hugging Face. Backed by B Capital, E14 Fund, and Tectonic Ventures, we serve customers across serverless, dedicated, and local AI deployments.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Member of Technical Staff, Developer Infrastructure & Agent Automation
Member of Technical Staff, Developer Infrastructure & Agent Automation

Ashby, Inc. • Palo Alto (CA)

On-site
USD 180,000 - 240,000
Highly competitive salary and equity
Comprehensive health coverage for you
Strong 401(k) match
+1
Member of Technical Staff, Production
Member of Technical Staff, Production

Ashby, Inc. • Palo Alto (CA)

On-site
USD 180,000 - 280,000
Health coverage
401(k) match
Meals and snacks
+1
Member of Technical Staff, General
Member of Technical Staff, General

Ashby, Inc. • Palo Alto (CA)

On-site
USD 180,000 - 300,000
Competitive salary & equity
Health coverage for you and dependents
Strong 401(k) match
+1
Member of Technical Staff, Inference Systems
Member of Technical Staff, Inference Systems

Ashby, Inc. • Palo Alto (CA)

On-site
USD 180,000 - 280,000
Competitive salary
Equity
Health coverage
+2
Member of Technical Staff, Inference Research
Member of Technical Staff, Inference Research

Ashby, Inc. • Palo Alto (CA)

On-site
USD 200,000 - 350,000
Health coverage
401(k) match
Meals and snacks
+2
Member of Technical Staff, Kernel Performance & Automation
Member of Technical Staff, Kernel Performance & Automation

Ashby, Inc. • Palo Alto (CA)

On-site
USD 180,000 - 280,000
Highly competitive salary and equity
Comprehensive health coverage for you/
Software Engineer, Full Stack Research and Development New York City · San Francisco View role →
Software Engineer, Full Stack Research and Development New York City · San Francisco View role →

Instalily, Inc. • New York (NY)

On-site
USD 150,000 - 190,000
Medical, Dental, Vision
401K
Stock options
+2
AI Platform Engineer
AI Platform Engineer

JustMarkets • United States

Remote
USD 180,000 - 250,000
20 paid vacation days per year
10 paid sick leave days per year
Public holidays as per list
+5
Platform Engineer - Inference
Platform Engineer - Inference

Subconscious Systems Technologies, Inc. • Boston (MA)

On-site
USD 180,000 - 230,000
Equity ownership
Health coverage
Unlimited PTO
+1
Member of Technical Staff – AI Agents & Internal Platforms
Member of Technical Staff – AI Agents & Internal Platforms

Morgan Pinnacle Group • New York (NY)

On-site
USD 150,000 - 300,000
Equity: Highly competitive equity