Senior Python Engineer (Agent & Infrastructure)

Hone

United States

Remote

USD 180,000 - 260,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Hone is seeking an experienced systems-focused engineer to own the execution layer of our AI infrastructure platform. You will develop Python services, manage containers, and integrate with Kubernetes across diverse environments.

The role bridges software engineering and DevOps, requiring deep knowledge of Docker, Kubernetes, and Linux internals, plus strong networking and OS-level programming skills.

Qualifications

  • 8+ years of development experience with a focus on systems programming.
  • Deep understanding of Kubernetes architecture beyond YAML; code that controls K8s.
  • Extensive Docker experience, including building and maintaining images.
  • Python for systems: automation, daemons or CLI tools using subprocess, socket, asyncio.
  • Networking fundamentals: HTTP/S, WebSockets, TCP/IP, proxies and reverse proxies.
  • Strong Linux internals and shell scripting.

Responsibilities

  • Agent development: design Python service to pull jobs, set up environments, execute ML pipelines.
  • Kubernetes integration: code that talks to K8s APIs, manage pod lifecycles, CRDs.
  • Resource management: dynamic GPU/CPU/memory allocation and container orchestration.
  • Systems programming: build robust daemons and services using OS primitives (systemd, signals).
  • Networking: troubleshoot and optimize TCP/IP, DNS, firewall traversal.

Skills

Systems programming
Kubernetes mastery
Networking fundamentals
Linux internals
Python for systems

Tools

Docker
Kubernetes
Python

Job description

We’re working with a top AI infrastructure platform that’s on track to 3X last year’s ARR. Their software sits underneath how ML teams run their work. It schedules jobs, manages GPU fleets and moves experiments from laptop to cluster, across cloud, on-prem and Kubernetes. Teams from fast-moving startups to large enterprises run production workloads on it.

About the role

You’ll own the execution layer of the platform: the components that spin up containers, manage GPUs and tunnel connections so everything works across very different environments. The role sits between software engineering and DevOps. You’ll write Python that orchestrates infrastructure, manages Docker containers, talks to the Kubernetes API and handles low-level networking.

Responsibilities
  • Agent development: design and optimize the agent, a Python service that pulls jobs, sets up environments and executes ML pipelines
  • Kubernetes integration: write logic that talks directly to the K8s APIs, manage pod lifecycles and handle CRDs
  • Resource management: implement dynamic allocation of GPU, CPU and memory, and container orchestration
  • Systems programming: build robust daemons and services that interact with OS-level primitives (systemd, signals, I/O streams)
  • Networking: troubleshoot and optimize TCP/IP connections, DNS resolution and firewall traversal so users stay connected
Requirements
  • 8+ years of development experience, with a strong focus on systems programming
  • Kubernetes mastery: a deep understanding of the architecture, beyond writing YAML. You know how to write code that controls K8s
  • Container internals: extensive Docker experience, including building and maintaining images
  • Python for systems: automation, daemons or CLI tools, using libraries like subprocess, socket and asyncio
  • Networking fundamentals: HTTP/S, WebSockets, TCP/IP, proxies and reverse proxies
  • OS knowledge: strong Linux internals and shell scripting
Nice to have
  • GPU hardware management (NVIDIA drivers, CUDA, NVIDIA Container Toolkit)
  • Building Kubernetes operators or controllers (Kopf or Operator SDK)
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior AI Platform Infrastructure Engineer
Senior AI Platform Infrastructure Engineer

DXC Luxoft • United States

Remote
USD 150,000 - 190,000
Python/AI Engineer
Python/AI Engineer

Matlen Silver • New York (NY)

Hybrid
USD 83,000 - 94,000
AI Infrastructure Engineer
AI Infrastructure Engineer

Oho Group • San Francisco (CA)

On-site
USD 180,000 - 240,000
Maintainer status on OSS project
Open-source contributions eligible for
GPU/ML compiler exposure
Senior Python Developer
Senior Python Developer

Valiant Technologies LLC • Houston (TX)

On-site
USD 180,000 - 240,000
Senior Python Developer
Senior Python Developer

Quantum Technologies LLC • Houston (TX)

On-site
USD 150,000 - 210,000
Senior AI Platform Developer using Python
Senior AI Platform Developer using Python

SANS • New York (NY)

On-site
USD 180,000 - 240,000
Python Engineer – AI Agents/Remote
Python Engineer – AI Agents/Remote

Apetan Consulting LLC • United States

On-site
USD 120,000 - 160,000
Software Engineer, Cloud Agents
Software Engineer, Cloud Agents

OpenAI, Inc. • San Francisco (CA)

Hybrid
USD 130,000 - 170,000
Senior Agent Engineer
Senior Agent Engineer

Job Envoy • Palo Alto (CA)

On-site
USD 180,000 - 240,000
Agent Engineer
Agent Engineer

Clera • United States

On-site
USD 180,000 - 260,000