Senior LLM Engineer (Remote, Johannesburg)

Blacksmith Agency LLC; Johannesburg; A distancia; ZAR 900.000 - 1.300.000; Jornada completa

Descripción de la vacante

Blacksmith Agency is seeking a Senior LLM Engineer to own and ship our internal automation roadmap: production LLM and agent systems that real people on our team use every day. This builder role focuses on delivering real-world tooling, not academic research.

You will work with a US team, deploy across WordPress, Figma, Google Workspace, Slack, and MCP servers, and create robust evals and guardrails. This full-time remote role requires hands-on production experience and strong English

Formación

• 2+ years building production software in Python or TypeScript / Node.js.
• Has built and deployed at least one LLM or agent system with real users.
• Experience with tool use, evals, retries and human-in-the-loop approvals.
• Familiar with REST APIs, webhooks and cloud deployment.
• Excellent spoken English for cross-border collaboration.

Responsabilidades

• Own and ship internal automation roadmap: production LLM and agent systems.
• Build agents and workflows with tool use and function calling on Anthropic and OpenAI.
• Create evals and guardrails to prevent unsafe actions.
• Integrations with WordPress, Figma, Google Workspace, Slack and MCP servers.
• Develop internal tools that save hours in delivery and operations.

Conocimientos

Production software

LLM/agent systems

tool use/evals/failure handling

REST APIs/webhooks/cloud deployment

Strong English

Herramientas

Python

TypeScript/Node.js

Descripción del empleo

About The Role

Blacksmith Agency is building AI into every part of how we work. As Senior LLM Engineer at Blacksmith, you own and ship our internal automation roadmap: production LLM and agent systems that real people on our team use every day. This is a builder role, not research. You will not train models.

Blacksmith Agency

• Engineering
• Full time, your only job
• Remote (Latin America and South Africa)

About The Role

Blacksmith Agency is building AI into every part of how we work. As Senior LLM Engineer at Blacksmith, you own and ship our internal automation roadmap: production LLM and agent systems that real people on our team use every day. This is a builder role, not research. You will not train models.

We hire engineers who have already shipped an LLM system to production and can walk us through it in detail: what it did, how it was built, what broke and what they changed. This is a full-time seat and it has to be your only job.

What You Will Build

• Agents and workflows with tool use and function calling on Anthropic and OpenAI, with a framework or plain APIs.
• Evals that prove a change made things better, and guardrails that stop a model taking a wrong or unsafe action.
• Integrations connecting WordPress, Figma, Google Workspace, Slack and our internal systems, including MCP servers.
• Internal tools that take measurable hours off delivery, sales operations and project management.

What You Bring

• 2+ years building production software in Python or TypeScript / Node.js.
• At least one LLM or agent system you built yourself that ran in production with real users.
• Hands-on tool use, evals and failure handling: validating model output, retries, human approval.
• REST APIs, webhooks and cloud deployment.
• Strong spoken English. You will talk through technical decisions on live calls with a US team.

Not a fit if

• You freelance or contract for other clients and would keep them alongside this job.
• Your LLM work is demos, tutorials or chat prompting, or your focus is model training and research.