AI Tooling Platform Engineer

ZYTE

United States

Remote

USD 120,000 - 190,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Remote‑friendly
Open‑source tech stack

Job summary

Zyte is seeking a Senior Software Engineer to join the Tooling team. You will build an internal AI agent platform, integrate new systems, and ship production features weekly, collaborating with a Principal Engineer and cross‑functional teams.

You will own end‑to‑end delivery, design scalable APIs, work with LangGraph, Langfuse, MCP protocols, and ensure security and access controls across a global, remote‑friendly environment.

Qualifications

  • 3+ years building and shipping production software, mostly in Python.
  • Has built and shipped with LangGraph at least one agent that real people use: tool calling, retrieval and embeddings, prompt and context design.
  • Hands-on experience with LLM APIs from the main providers, cost and token optimisation.
  • Hands-on with MCP or similar tool protocols, as a server and as a client.
  • Evaluates AI systems properly: test sets, LLM-as-judge, regressions when a prompt or a model changes; tracing and observability with Langfuse or similar.
  • Integrates APIs and data: SaaS APIs, SQL, data warehouses.
  • Experience with cloud infrastructure (Google Cloud and/or AWS): containers, managed databases, identity and access, CI/CD.
  • Uses AI coding agents every day and knows how to keep their output in check.
  • A sense for security and permissions: identity, least privilege, people see only what they are allowed to see.
  • Comfortable with version control (GitHub/Bitbucket).
  • Excellent written and spoken English, technical and non-technical.

Responsibilities

  • Build the platform with the Principal Engineer in Tooling: new capabilities every week, from design to production.
  • Connect new internal systems and SaaS tools to the platform: their APIs and data, how they fit a shared model, and who may see what.
  • Build agents and the tools they use, including MCP servers that agents across the company can call, and the context they need to answer well.
  • Own quality: evaluation sets and benchmarks, tracing, cost per answer, and fixing what users run into.
  • Turn proofs of concept into internal tools that run in production in the cloud, with security and access done properly.
  • Build with AI coding agents as the main way of working, with the specs, tests and reviews that keep the code sound.
  • Contribute to company-wide AI tooling initiatives: evaluating and standardising internal AI tools, cost and usage tracking, and agreed standards for AI-built internal apps; help other teams build on the platform.
  • Talk with the people who use the platform, across the company, to learn what to build next, and explain what was built to technical and non-technical audiences.

Skills

Python
LLM API usage
LangGraph
Langfuse
MCP protocols
Cloud (GCP/AWS)
API design
Security / IAM
Version control
Communication

Tools

LangGraph
Langfuse
MCP servers
PostgreSQL
Docker
Cloud platforms

Job description

Zyte is seeking a Senior Software Engineer to join the Tooling team. You will build an internal AI agent platform, integrate new systems, and ship production features weekly, collaborating with a Principal Engineer and cross‑functional teams.

You will own end‑to‑end delivery, design scalable APIs, work with LangGraph, Langfuse, MCP protocols, and ensure security and access controls across a global, remote‑friendly environment.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

AI Tooling Engineer - Remote
AI Tooling Engineer - Remote

ZYTE • United States

Remote
USD 120,000 - 190,000
Remote‑friendly
Open‑source tech stack
AI Tooling Engineer (Fully Remote)
AI Tooling Engineer (Fully Remote)

Undisclosed • United States

Remote
USD 120,000 - 180,000
Remote Senior Platform Engineer – AI Tooling & DevOps
Remote Senior Platform Engineer – AI Tooling & DevOps

ZenBusiness • United States

Remote
USD 125,000 - 150,000
Competitive benefits
Equity and RSUs
401k + match
+3
AI Tooling Engineer — Developer Platform & Tools
AI Tooling Engineer — Developer Platform & Tools

Selby Jennings • Chicago (IL)

On-site
USD 120,000 - 170,000
Remote Senior Platform Engineer — AI Tooling & CI/CD
Remote Senior Platform Engineer — AI Tooling & CI/CD

IAPMO Group • Austin (TX)

Hybrid
USD 125,000 - 150,000
Medical, Vision, Dental
401k + match
Equity / RSUs
+1
AI-Driven Quality Engineer — Automation & Testing
AI-Driven Quality Engineer — Automation & Testing

ZYTE • United States

Remote
USD 90,000 - 130,000
Senior AI Tooling Infra Engineer
Senior AI Tooling Infra Engineer

Zillow • United States

Remote
USD 160,000 - 210,000
Remote AI Tooling Engineer — Build Production Agents & Platform
Remote AI Tooling Engineer — Build Production Agents & Platform

Undisclosed • United States

Remote
USD 120,000 - 180,000
Senior AI Platform Engineer — Build Dependable Agents
Senior AI Platform Engineer — Build Dependable Agents

XU Group • United States

Remote
USD 180,000 - 240,000
AI Platform Engineering Manager
AI Platform Engineering Manager

Zuora Community • Foster City (CA)

On-site
USD 197,000 - 271,000
Competitive compensation
Bonus opportunities
Retirement programs
+2