Member of Technical Staff, Developer Infrastructure & Agent Automation

Ashby, Inc.

Palo Alto (CA)

On-site

USD 180,000 - 240,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Highly competitive salary and equity
Comprehensive health coverage for you
Strong 401(k) match
Meals and snacks on us + discretionary

Job summary

Inco AI in Palo Alto, CA is seeking a founding Member of Technical Staff to define and own the internal developer platform, including CI/CD, build systems, test infra, and source control. You will prototype agent harnesses, ship tooling, and drive adoption across research, engineering, and production teams.

You'll set technical direction, stay hands-on, and turn demanding workflows into reliable automation and agent systems.

Qualifications

  • Strong generalist engineering across full stack: Linux, Docker, GPU computing, Python, Bash, and CI/CD at scale.
  • Experience with monorepos, build systems, caching, test infra, and CI/CD platforms such as GitHub Actions, Buildkite, Jenkins, or GitLab CI.
  • Fluency with coding agents, agent harnesses, and orchestration systems such as Claude Code, Cursor, Codex, MCP servers, and Humanize, including sandboxed execution environments, agent observability, and cost and quality controls.
  • Experience integrating LLMs into engineering workflows, including agentic code review, test and documentation generation, and migrations with supervision checkpoints, rollback strategies, and evaluations
  • Hands-on experience with cluster management systems such as Kubernetes, SkyPilot, Slurm, or comparable platforms

Responsibilities

  • Define and own the internal developer platform (CI/CD, build systems, test infra, source control) and drive agent-driven engineering.
  • Prototype agent harnesses, ship tooling, and establish a trusted agent-enabled environment across teams.
  • Set technical direction, make foundational decisions, and stay hands-on from inception through deployment.
  • Collaborate with research, engineering, and production teams to translate workflows into reliable automation and scalable agent systems.
  • Lead efforts to improve developer productivity and reduce friction through observable, self-healing platforms.

Skills

Change leadership
LLM/Agent innovation
Dev platform experience
SDLC awareness
Tooling as product
Startup mindset
Bias for action
Technical leadership

Tools

GitHub Actions
Buildkite
Jenkins
GitLab CI
Kubernetes
Claude Code
Cursor
Codex
MCP servers
Humanize
PyTorch
CUDA

Job description

Member of Technical Staff, Developer Infrastructure & Agent Automation

About the role

We are looking for a founding member to define how Inco builds software. You will own the internal developer platform (CI/CD, build systems, test infrastructure, and source control) while helping lead the shift to agent-driven engineering.

Your work will span developer tooling, automated research and experimentation, and production failure triage and remediation. You will work closely with other team members to understand their most demanding workflows, then turn those workflows into reliable automation and agent systems that reproduce results and expand what the team can accomplish. Just as importantly, you will earn trust across the organization and help teams adopt new ways of working.

You will set technical direction, make foundational decisions, and stay hands‑on: prototyping agent harnesses and shipping the tooling yourself. The goal is a trusted agent‑enabled environment that expands the team’s capacity and speed without sacrificing quality or reliability. Our organization is flat, and you will work directly with research, engineering, and production teams to carry ideas from inception through deployment.

About you
  • You are an effective change leader: you earn trust with technical peers, influence how teams work, and turn new tools and practices into durable habits

  • You are eager to invent new ways of working with LLMs and agents, pushing beyond the status quo to discover what agentic engineering can make possible

  • You have built internal developer platforms or dev‑productivity infrastructure at scale, and you have integrated LLMs or coding agents into real engineering workflows, not just prototyped them

  • You reason across the full software development lifecycle: local dev, CI, testing, debugging, deployment

  • You treat internal tooling as a product and have real empathy for developer pain

  • You are drawn to the risk and upside of an early‑stage startup

  • You embrace ambiguity and have a strong bias for action

  • You operate with a tech‑lead mentality regardless of title or years of experience

Requirements
  • Strong generalist engineering ability across the full stack: Linux, Docker, GPU computing, Python, Bash, and CI/CD at scale

  • Experience with monorepos, build systems and caching, test infrastructure, and CI/CD platforms such as GitHub Actions, Buildkite, Jenkins, or GitLab CI

  • Fluency with coding agents, agent harnesses, and orchestration systems such as Claude Code, Cursor, Codex, MCP servers, and Humanize, including sandboxed execution environments, agent observability, and cost and quality controls.

  • Experience integrating LLMs into engineering workflows, including agentic code review, test and documentation generation, and migrations with appropriate supervision checkpoints, rollback strategies, and evaluations

  • Hands‑on experience with cluster management systems such as Kubernetes, SkyPilot, Slurm, or comparable platforms

Bonus
  • Familiarity with LLM inference workloads and serving stacks, including model architectures, KV‑cache management, and quantization; PyTorch, vLLM, and SGLang

  • Familiarity with GPU environments, including NVIDIA drivers, CUDA, NCCL, and InfiniBand/RDMA

  • Experience supporting CI for large open‑source projects with 100+ contributors

  • Experience building observable, self‑healing platforms with Grafana dashboards, structured logging, actionable alerting, and agent‑driven incident triage and remediation

  • Experience improving operational reliability through stress testing, resilient CI/CD, and systematic reduction of flaky tests

Compensation & Benefits
  • Highly competitive salary and equity

  • Comprehensive health coverage for you and your dependents

  • Strong 401(k) match

  • Meals and snacks on us + discretionary productivity budget

Strong preference for in‑person in Palo Alto or Brooklyn.

About Inco

Inco AI (inco.ai) builds the agent‑native inference platform for tomorrow’s token economics. We build the inference layer that makes advanced AI fast enough for real workflows and affordable enough to use at scale. Agents are at the center of our work: when a single task chains dozens of model and tool calls, every gain in speed, cost, and reliability compounds.

We’re the researchers and engineers behind AWQ, DFlash, and TensorRT‑LLM, with decades of combined leadership in AI efficiency and prior successful exits. Our team connects frontier research with the engineering needed to bring fast, reliable inference to production at scale.

We operate on five principles:

  1. Operate at the frontier. The field moves every day, and so do we. We reinvent ourselves constantly and push the frontier forward with our research. We keep process light and decisions fast, so a good idea reaches production in days, not quarters. Legacy doesn’t slow us down.

  2. Mission over individuals. We are obsessed with our customers and humble in pursuit of the goal. We share credit, name mistakes early, and change our minds when the evidence says so. The question is always what moves the mission forward, never who was right.

  3. Amplify with agents. Code is free now; architecture and process aren’t. We hand agents everything they can own, from code to operations, and spend our own time on design, judgment, and the problems only people can solve.

  4. Protect the maker’s time. Focus is our scarcest resource. We keep meetings few and protect long, uninterrupted stretches of work. We automate overhead, cover meals, and handle logistics, so our hours go to research and product.

  5. Be a team player. We win as one team. We share context generously, step in wherever we’re needed, and hold each other to a high bar, because exceptional work comes from exceptional peers.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Member of Technical Staff, Developer Infrastructure & Agent Automation
Member of Technical Staff, Developer Infrastructure & Agent Automation

Inco AI • Palo Alto (CA)

On-site
USD 180,000 - 320,000
Salary & equity
Health coverage
401(k) match
+1
Member of Technical Staff, Inference Systems
Member of Technical Staff, Inference Systems

Ashby, Inc. • Palo Alto (CA)

On-site
USD 180,000 - 280,000
Competitive salary
Equity
Health coverage
+2
Member of Technical Staff, Inference Research
Member of Technical Staff, Inference Research

Ashby, Inc. • Palo Alto (CA)

On-site
USD 200,000 - 350,000
Health coverage
401(k) match
Meals and snacks
+2
Member of Technical Staff, Kernel Performance & Automation
Member of Technical Staff, Kernel Performance & Automation

Ashby, Inc. • Palo Alto (CA)

On-site
USD 180,000 - 280,000
Highly competitive salary and equity
Comprehensive health coverage for you/
Member of Technical Staff, General
Member of Technical Staff, General

Ashby, Inc. • Palo Alto (CA)

On-site
USD 180,000 - 300,000
Competitive salary & equity
Health coverage for you and dependents
Strong 401(k) match
+1
Member of Technical Staff, Production
Member of Technical Staff, Production

Ashby, Inc. • Palo Alto (CA)

On-site
USD 180,000 - 280,000
Health coverage
401(k) match
Meals and snacks
+1
Member of Technical Staff – AI Agents & Internal Platforms
Member of Technical Staff – AI Agents & Internal Platforms

Morgan Pinnacle Group • New York (NY)

On-site
USD 150,000 - 300,000
Equity: Highly competitive equity
Senior AI Engineer (Remote, Contract)
Senior AI Engineer (Remote, Contract)

Remote • San Francisco (CA)

Remote
USD 180,000 - 240,000
Fully remote work format
Paid time off and sick leave
Reduced summer hours
Member of Technical Staff, Agent Code
Member of Technical Staff, Agent Code

Cohere • New York (NY)

Hybrid
USD 180,000 - 240,000
Weekly lunch stipend
Health and dental benefits
RRSP matching & Pension
+4
Senior AI Engineer, Release Engineering
Senior AI Engineer, Release Engineering

Intercontinental Exchange (ICE) • Atlanta (GA)

On-site
USD 140,000 - 210,000