AI Automation Engineer: Ship LLM-Powered Agents

Coalition, Inc.; United States; Remote; USD 115,000 - 168,000; Full time

Benefits offered by this job

100% medical, dental, and vision

401(k) with match

Flexible PTO

14 weeks parental leave + 8 weeks

Home office stipend & WeWork access

Wellness programs

Competitive compensation

Job summary

Coalition, Inc. is seeking a Software Engineer for the Automation team to advance AI-powered automation. You will author skills, wire agents to MCP-backed systems, and build evaluative pipelines that guide production deployments, collaborating with data engineers to ensure data quality for agent workflows.

You will join an hands-on, forward-deployed role closely aligned with business teams, shipping robust, auditable agent-based solutions and maintaining strong production discipline.

Qualifications

• Substantial hands-on experience shipping LLM-backed applications.
• Experience with MCP, skill or tool authoring, and orchestration.
• Evals: built eval sets and used them to make decisions.

Responsibilities

• Author skills: Turn a team's process, judgment, and edge cases into reusable skills that agents can invoke.
• Build within our agent architecture: Wire agents to the systems of record through MCP servers, compose skills and tools into working workflows, and add new MCP surface area when a system we need is not covered yet.
• Build evals: Define what 'correct' means with the business team before you build. Build the eval set, establish a baseline, and use it to make calls about what ships.
• Deploy and support agents: Take agents from prototype to production, including permissions, human-in-the-loop checkpoints, audit trails, and rollback.
• Partner with the data team: Work with our data engineers on the access, models, and quality of the data your agents read and write.

Skills

AI app building

Agent tooling

Evals

Agent coding

Core development

Business fluency

Ambiguity tolerance

Shipping discipline

5+ years exp

Tools

MCP servers

Cursor

Python

SQL

Git

Job description

Coalition, Inc. is seeking a Software Engineer for the Automation team to advance AI-powered automation. You will author skills, wire agents to MCP-backed systems, and build evaluative pipelines that guide production deployments, collaborating with data engineers to ensure data quality for agent workflows.

You will join an hands-on, forward-deployed role closely aligned with business teams, shipping robust, auditable agent-based solutions and maintaining strong production discipline.