AI Backend Engineer (Python) — Forward Deployed

Muttdata; United States; Remote; USD 140,000 - 190,000; Full time

Benefits offered by this job

Remote-first culture

Annual company retreat

Wellness or club stipend

Certifications covered (AWS, DBT, GCP,

Food credits

Job summary

Muttdata, a remote-first data products startup, is seeking an AI Backend Engineer (Python) to deploy LLM-based agents for a banking client. You will build on LangGraph/Langfuse, manage production pipelines on AWS, and ensure secure, scalable deployment across teams.

You’ll collaborate with cross-functional groups to implement robust templates, observability, and deployment processes, rotating to new challenges as agents go live.

Qualifications

• 4+ years backend experience in Python with production services.
• Experience taking LLM-based agents to production.
• Proficient in AWS, containers, CI/CD, and security controls.
• Familiarity with LLM evals, tracing, and observability tools.
• Strong written and verbal communication; able to document work.

Responsibilities

• Build agents on top of the platform’s scaffolding, including tool calling, integration with the bank’s internal APIs, state and conversation management, and guardrails.
• Take each agent to production on AWS: containers, CI/CD, secrets, permissions, networking, and the bank’s security controls.
• Define and run evals before going to production, and monitor with Langfuse once deployed (quality, latency, cost).
• Unblock technical and process issues together with the Identity, Security, DevSecOps, and Networking teams.
• Leave documentation and runbooks so the team can operate the agent independently, transferring knowledge before rotating to the next team.
• Feed what you learn in each rotation back into the platform: improvements to the agent template, the deployment pipeline, and observability.

Skills

Python backend

LLM integration

AWS & CI/CD

Observability & monitoring

Documentation & handoff

Tools

LangGraph

Langfuse

AWS

Docker/Kubernetes

Terraform

Job description

Join Our Remote Data Products & Machine Learning Startup!

At Muttdata, we build innovative Data Products and Machine Learning solutions that help companies solve complex business challenges. As a fast-growing, remote-first startup, we’re passionate about technology, collaboration, and continuous learning.

We’re looking for a proactive, technically strong AI Backend Engineer (Python) — Forward Deployed to join our team. You’ll work on a strategic project for one of our banking clients, embedded within the bank’s AI platform team, taking LLM-based agents into production across the bank’s business units.

This is an embedded role: you join a team that has an agent to build or deploy, build it on top of the platform’s scaffolding (LangGraph, LiteLLM, Langfuse), take it to production through the bank’s controls, and leave the team able to operate it on their own. Once that agent is live, you move on to the next team. What you learn in each rotation feeds back into the platform as improvements to the template, observability, and deployment process.

This role requires strong ownership, solid architectural judgment, and the ability to build systems that are secure, performant, and built to scale. You’ll collaborate closely with cross-functional teams in a fast-paced, high-standards environment typical of the financial industry.

What We Do

• Leveraging our expertise, we build modern Machine Learning systems for demand planning and budget forecasting.
• Developing scalable data infrastructures, we enhance high-level decision-making, tailored to each client.
• Offering comprehensive Data Engineering and custom AI solutions, we optimize cloud-based systems.
• Using Generative AI, we help e-commerce platforms and retailers create higher-quality ads, faster.
• Building deep learning models, we enhance visual recognition and automation for various industries, improving product categorization, quality control, and information retrieval.
• Developing recommendation models, we personalize user experiences in e-commerce, streaming, and digital platforms, driving engagement and conversions.

Our Partnerships

• Amazon Web Services
• Astronomer
• Databricks

Our Values

• We are Data Nerds
• We are Open Team Players
• We Take Ownership
• We Have a Positive Mindset

Curious about what we’re up to? Check out our case studies and dive into our blog post to learn more about our culture and the exciting projects we’re working on!

Responsibilities

• Build agents on top of the platform’s scaffolding, including tool calling, integration with the bank’s internal APIs, state and conversation management, and guardrails.
• Take each agent to production on AWS: containers, CI/CD, secrets, permissions, networking, and the bank’s security controls.
• Define and run evals before going to production, and monitor with Langfuse once deployed (quality, latency, cost).
• Unblock technical and process issues together with the Identity, Security, DevSecOps, and Networking teams.
• Leave documentation and runbooks so the team can operate the agent independently, transferring knowledge before rotating to the next team.
• Feed what you learn in each rotation back into the platform: improvements to the agent template, the deployment pipeline, and observability.

Required Skills

• At least one LLM-based agent or system taken to production and operated, using LangGraph or an equivalent framework.
• 4+ years of backend experience in Python, with production services (FastAPI or another async framework).
• Ability to independently take a service from the repo to production on AWS: containers, CI/CD, and observability.
• Experience with LLM evaluation (evals, tracing, hallucination control) and agent observability (Langfuse or similar).
• Daily use of AI development tools (GitHub Copilot, Claude Code, Cursor).
• Ability to join a new team, quickly understand its context, and unblock issues with both technical and business stakeholders.
• Clear communication and a habit of documenting and handing off what you build.

Nice to have

• Experience in banking or fintech.
• Kubernetes and Terraform.
• API security (OAuth2/JWT).
• RAG and vector databases.
• Building your own MCP servers.
• Spec-Driven Development.
• Prior experience as an embedded client consultant or in a forward-deployed role.

Perks

• Remote-first cultur e – work from anywhere!
• Annual Mutters’ Trip – an unforgettable getaway with the team!
• Wellhub or sports club stipend to stay active
• AWS, DBT, Google Cloud, Azure & Databricks certifications fully covered
• Food credits via Pedidos Ya – because great work deserves great food.
• Birthday off + an extra vacation week (Mutt Week! )
• Referral bonuses – help us grow the team & get rewarded!
• Annual Mutters’ Trip – an unforgettable getaway with the team!
• Monthly Childcare Reimbursement – Because supporting families matters too