Remote AI Backend Engineer — Python & LLM Production

Muttdata; United States; Remote; USD 140,000 - 190,000; Full time

Benefits offered by this job

Remote-first culture

Annual company retreat

Wellness or club stipend

Certifications covered (AWS, DBT, GCP,

Food credits

Job summary

Muttdata, a remote-first data products startup, is seeking an AI Backend Engineer (Python) to deploy LLM-based agents for a banking client. You will build on LangGraph/Langfuse, manage production pipelines on AWS, and ensure secure, scalable deployment across teams.

You’ll collaborate with cross-functional groups to implement robust templates, observability, and deployment processes, rotating to new challenges as agents go live.

Qualifications

• 4+ years backend experience in Python with production services.
• Experience taking LLM-based agents to production.
• Proficient in AWS, containers, CI/CD, and security controls.
• Familiarity with LLM evals, tracing, and observability tools.
• Strong written and verbal communication; able to document work.

Responsibilities

• Build agents on top of the platform’s scaffolding, including tool calling, integration with the bank’s internal APIs, state and conversation management, and guardrails.
• Take each agent to production on AWS: containers, CI/CD, secrets, permissions, networking, and the bank’s security controls.
• Define and run evals before going to production, and monitor with Langfuse once deployed (quality, latency, cost).
• Unblock technical and process issues together with the Identity, Security, DevSecOps, and Networking teams.
• Leave documentation and runbooks so the team can operate the agent independently, transferring knowledge before rotating to the next team.
• Feed what you learn in each rotation back into the platform: improvements to the agent template, the deployment pipeline, and observability.

Skills

Python backend

LLM integration

AWS & CI/CD

Observability & monitoring

Documentation & handoff

Tools

LangGraph

Langfuse

AWS

Docker/Kubernetes

Terraform

Job description

Muttdata, a remote-first data products startup, is seeking an AI Backend Engineer (Python) to deploy LLM-based agents for a banking client. You will build on LangGraph/Langfuse, manage production pipelines on AWS, and ensure secure, scalable deployment across teams.

You’ll collaborate with cross-functional groups to implement robust templates, observability, and deployment processes, rotating to new challenges as agents go live.