Remote Senior LLM Engineer: Production Automation & Tools

Blacksmith Agency LLC; Sur; Remote; COP 388,412,000 - 582,619,000; Full time

Job summary

Blacksmith Agency is seeking a Senior LLM Engineer to own and ship our internal automation roadmap: production LLM and agent systems used daily by the team. This is a builder role, not research, and you will not train models.

You will build agents and workflows with tool use and function calling, implement evals and guardrails, and create integrations with WordPress, Figma, Google Workspace, Slack and MCP servers.

Qualifications

• 2+ years building production software in Python or TypeScript / Node.js.
• At least one LLM or agent system you built yourself that ran in production with real users.
• Hands-on tool use, evals and failure handling: validating model output, retries, human approval.
• REST APIs, webhooks and cloud deployment.
• Strong spoken English. You will talk through technical decisions on live calls with a US team.

Responsibilities

• Build agents and workflows with tool use and function calling on Anthropic and OpenAI, with a framework or plain APIs.
• Create evals that prove changes improve outcomes and guardrails that prevent unsafe actions.
• Develop integrations connecting WordPress, Figma, Google Workspace, Slack and MCP servers.
• Develop internal tools that reduce hours in delivery, sales ops and project management.

Skills

Python

TypeScript

Node.js

LLM systems

Tools

REST APIs

Webhooks

Cloud deployment

Job description

Blacksmith Agency is seeking a Senior LLM Engineer to own and ship our internal automation roadmap: production LLM and agent systems used daily by the team. This is a builder role, not research, and you will not train models.

You will build agents and workflows with tool use and function calling, implement evals and guardrails, and create integrations with WordPress, Figma, Google Workspace, Slack and MCP servers.