AI Tooling Engineer - Remote

ZYTE

United States

Remote

USD 120,000 - 190,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Remote‑friendly
Open‑source tech stack

Job summary

Zyte is seeking a Senior Software Engineer to join the Tooling team. You will build an internal AI agent platform, integrate new systems, and ship production features weekly, collaborating with a Principal Engineer and cross‑functional teams.

You will own end‑to‑end delivery, design scalable APIs, work with LangGraph, Langfuse, MCP protocols, and ensure security and access controls across a global, remote‑friendly environment.

Qualifications

  • 3+ years building and shipping production software, mostly in Python.
  • Has built and shipped with LangGraph at least one agent that real people use: tool calling, retrieval and embeddings, prompt and context design.
  • Hands-on experience with LLM APIs from the main providers, cost and token optimisation.
  • Hands-on with MCP or similar tool protocols, as a server and as a client.
  • Evaluates AI systems properly: test sets, LLM-as-judge, regressions when a prompt or a model changes; tracing and observability with Langfuse or similar.
  • Integrates APIs and data: SaaS APIs, SQL, data warehouses.
  • Experience with cloud infrastructure (Google Cloud and/or AWS): containers, managed databases, identity and access, CI/CD.
  • Uses AI coding agents every day and knows how to keep their output in check.
  • A sense for security and permissions: identity, least privilege, people see only what they are allowed to see.
  • Comfortable with version control (GitHub/Bitbucket).
  • Excellent written and spoken English, technical and non-technical.

Responsibilities

  • Build the platform with the Principal Engineer in Tooling: new capabilities every week, from design to production.
  • Connect new internal systems and SaaS tools to the platform: their APIs and data, how they fit a shared model, and who may see what.
  • Build agents and the tools they use, including MCP servers that agents across the company can call, and the context they need to answer well.
  • Own quality: evaluation sets and benchmarks, tracing, cost per answer, and fixing what users run into.
  • Turn proofs of concept into internal tools that run in production in the cloud, with security and access done properly.
  • Build with AI coding agents as the main way of working, with the specs, tests and reviews that keep the code sound.
  • Contribute to company-wide AI tooling initiatives: evaluating and standardising internal AI tools, cost and usage tracking, and agreed standards for AI-built internal apps; help other teams build on the platform.
  • Talk with the people who use the platform, across the company, to learn what to build next, and explain what was built to technical and non-technical audiences.

Skills

Python
LLM API usage
LangGraph
Langfuse
MCP protocols
Cloud (GCP/AWS)
API design
Security / IAM
Version control
Communication

Tools

LangGraph
Langfuse
MCP servers
PostgreSQL
Docker
Cloud platforms

Job description

About Us

At Zyte, we eat data for breakfast and you can eat your breakfast anywhere and work for Zyte. Founded in 2010, we are a globally distributed team of over 225 Zytans working from over 28 countries who are on a mission to enable our customers to extract the data they need to continue to innovate and grow their businesses. We believe that all businesses deserve a smooth pathway to data. For more than a decade, Zyte has led the way in building powerful, easy-to-use tools to collect, format, and deliver web data, quickly, dependably, and at scale. And today, the data we extract helps thousands of organizations make smarter business decisions, secure competitive advantage, and drive sustainable growth.


Today, over 3,000 companies and 1 million developers rely on our tools and services to get the data they need from the web. This role sits in Zyte's Tooling team, working side by side with our Principal Engineer in Tooling on an internal agentic platform: one place that brings together what the company knows, today spread across many systems, so that people and their AI agents get that context in one place, each seeing only what they are allowed to see. We are looking for a builder: someone who has built AI agents and shipped them to real users, and who likes owning a product end to end, from talking with the people who use it to the code, the deployment and the numbers that say whether it works. The first version is already in use inside the company and grows every week.


Roles & Responsibilities


  • Build the platform with the Principal Engineer in Tooling: new capabilities every week, from design to production.

  • Connect new internal systems and SaaS tools to the platform: their APIs and data, how they fit a shared model, and who may see what.

  • Build agents and the tools they use, including MCP servers that agents across the company can call, and the context they need to answer well.

  • Own quality: evaluation sets and benchmarks, tracing, cost per answer, and fixing what users run into.

  • Turn proofs of concept into internal tools that run in production in the cloud, with security and access done properly.

  • Build with AI coding agents as the main way of working, with the specs, tests and reviews that keep the code sound.

  • Contribute to company-wide AI tooling initiatives: evaluating and standardising internal AI tools, cost and usage tracking, and agreed standards for AI-built internal apps; help other teams build on the platform.

  • Talk with the people who use the platform, across the company, to learn what to build next, and explain what was built to technical and non-technical audiences.


Requirements


  • 3+ years building and shipping production software, mostly in Python, with relational databases.

  • Has built and shipped with LangGraph at least one agent that real people use: tool calling, retrieval and embeddings, prompt and context design.

  • Hands‑on experience with LLM APIs from the main providers, cost and token optimisation.

  • Hands‑on with MCP or similar tool protocols, as a server and as a client.

  • Evaluates AI systems properly: test sets, LLM-as-judge, regressions when a prompt or a model changes; tracing and observability with Langfuse or similar.

  • Integrates APIs and data: SaaS APIs, SQL, data warehouses.

  • Experience with cloud infrastructure (Google Cloud and/or AWS): containers, managed databases, identity and access, CI/CD.

  • Uses AI coding agents every day and knows how to keep their output in check.

  • A sense for security and permissions: identity, least privilege, people see only what they are allowed to see.

  • Comfortable with version control (GitHub/Bitbucket).

  • Excellent written and spoken English, technical and non-technical.


Desired Skills


  • Familiarity with web data or web scraping.

  • Django and Postgres, including vector search with pgvector.

  • Enough frontend to build and change a chat interface (React, Next.js).

  • Has built internal tools that colleagues adopted.

  • Semantic layers or knowledge graphs.

  • Memory for agents, multi-agent setups.

  • Previous remote/distributed team experience.


By joining the Zyte team, you will:


  • Become part of a self‑motivated, progressive, multi‑cultural team.

  • Freedom and flexibility to work remotely.

  • Work with cutting-edge, open‑source technologies and tools - and shape the AI tooling the rest of the company relies on.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

AI Engineer
AI Engineer

Zyphra Technologies Inc. • San Francisco (CA)

On-site
USD 180,000 - 260,000
Comprehensive medical, dental, vision,
401(k) plan
Relocation and immigration support
+3
Senior AI Engineer
Senior AI Engineer

Zingly, Inc. • San Francisco (CA)

On-site
USD 180,000 - 240,000
Senior Product Manager, Self-Serve - Remote
Senior Product Manager, Self-Serve - Remote

ZYTE • United States

Remote
USD 140,000 - 190,000
Freedom to work from anywhere
Conferences & global team meetups
Open source and cutting-edge tools
Staff Engineer (Core & MLOps) - Remote
Staff Engineer (Core & MLOps) - Remote

ZYTE • United States

Remote
USD 180,000 - 240,000
Sr. Software Engineering Manager
Sr. Software Engineering Manager

zenbusiness • United States

Remote
USD 180,000 - 240,000
AI Tools and Methodologies Engineer
AI Tools and Methodologies Engineer

ZON Inc. • Prescott (AZ)

On-site
USD 120,000 - 180,000
AI Tooling Platform Engineer
AI Tooling Platform Engineer

ZYTE • United States

Remote
USD 120,000 - 190,000
Remote‑friendly
Open‑source tech stack
AI Engineer
AI Engineer

Bison • San Francisco (CA)

On-site
USD 180,000 - 240,000
Medical, dental, vision coverage
401(k) plan
Relocation support
+2
AI Engineer / AI Agent Developer - Zelh
AI Engineer / AI Agent Developer - Zelh

Zelh • United States

Hybrid
USD 120,000 - 190,000
Remote or on-site work
Equipment provided
Paid time off
Lead AI Engineer
Lead AI Engineer

Axya • United States

Remote
USD 180,000 - 240,000
Unlimited vacation
Health insurance
Flexible work schedule
+1