Staff AI Developer Tools Engineer

Docker, Inc.; San Francisco (CA); Hybrid; USD 170,000 - 276,000; Full time

Benefits offered by this job

Remote-first by design

Flexibility

PTO

Job summary

Docker, Inc. is seeking a Staff Software Engineer to lead AI Developer Tools and the self-service platform at scale. You will own architecture for AI-powered tools, design patterns for LLM integration, and drive cross-team collaboration in a remote-first environment.

You will mentor engineers, influence product outcomes, and shape deployment, observability, and security standards while delivering production-ready AI tooling across Docker's engineering org.

Qualifications

• 8+ years of software engineering experience with leadership on production systems at scale.
• Hands-on production experience building LLM-powered applications, AI agents, or AI-assisted developer tools.
• Strong understanding of LLM APIs (OpenAI, Anthropic, and others), prompt engineering, agent orchestration, and practical uses of AI in software development workflows.
• Track record of designing and building scalable distributed systems and developer-facing platforms.
• Production experience with cloud-native infrastructure, Kubernetes, GitOps deployment patterns, observability systems, and CI/CD pipelines.
• Proficiency in Go (preferred), Rust, Java, or Python, with strong software engineering fundamentals.
• Experience designing developer tools, platform systems, or internal tools that other teams rely on.
• Track record of clarifying requirements and constraints with stakeholders before committing to a design.
• Leadership in complex, cross-team initiatives and mentoring engineers.
• Strong product and platform judgment balancing outcomes, UX, and trade-offs.
• Clear written and spoken communication for a remote, async-first company.
• Bachelor's degree in CS, Engineering, or related field, or equivalent experience.

Responsibilities

• Technical Leadership and Architecture: Set direction and own architecture for AI-powered tools and self-service platform.
• Turn ambiguous problems into clear requirements, plans, and staged decisions; assess scale, users, and constraints.
• Establish patterns and best practices for LLM integration, agent development, and production AI systems.
• Shape platform capabilities including deployment frameworks (ArgoCD/GitOps), observability (Grafana), security, and tooling.
• Design reliable, scalable infrastructure for hosting AI agents and tools.
• Recommend AI technology choices and trade-offs; align with business goals.
• Collaborate with management to align technical decisions with strategy.

Skills

LLM-powered applications

AI agents

Kubernetes

Go

Prompt engineering

Distributed systems

Developer-facing platforms

Cloud-native infrastructure

Software architecture

Mentoring engineers

Education

Bachelor's degree in Computer Science, Engineering, or related field

Tools

ArgoCD

GitOps

Grafana

CI/CD pipelines

Job description

Docker, Inc. is seeking a Staff Software Engineer to lead AI Developer Tools and the self-service platform at scale. You will own architecture for AI-powered tools, design patterns for LLM integration, and drive cross-team collaboration in a remote-first environment.

You will mentor engineers, influence product outcomes, and shape deployment, observability, and security standards while delivering production-ready AI tooling across Docker's engineering org.