AI Software Engineer: LLM Orchestration & Multi-Agent AI

Machine Learning Technologies, LLC; Palo Alto (CA); On-site; USD 89,000 - 126,000; Full time

Job summary

Machine Learning Technologies, LLC is seeking an AI-focused Software Developer in Palo Alto. The role emphasizes Python development, LLM orchestration, and building agentic AI workflows and multi-agent systems.

You will design, implement, and deploy AI-powered applications across cloud environments with MCP integrations. The ideal candidate will have hands-on experience with LangGraph, Claude SDK, OpenAI/Anthropic SDKs, and containerized deployments using Docker and Kubernetes.

Qualifications

• Strong Python development experience; Go is a plus.
• LLM orchestration and Agentic AI workflows.
• Multi-agent systems and model governance.
• MCP integrations and custom MCP server development.

Responsibilities

• Design, develop, and maintain AI-powered applications using Python; Go development experience is a plus.
• Build and implement LLM orchestration and Agentic AI workflows.
• Design, develop, and manage multi-agent systems and model governance solutions.
• Implement MCP integrations and develop custom MCP servers.
• Build AI agents and workflows using LangGraph, Google ADK, Mastra, and Claude Agent SDK.
• Integrate LLM services using OpenAI SDK and Anthropic SDK.
• Develop and integrate REST and GraphQL APIs for AI-powered applications.
• Deploy and manage AI solutions across AWS and GCP cloud environments.
• Work with SQL and NoSQL databases for application data management.
• Implement Retrieval-Augmented Generation (RAG) solutions and vector database integrations.
• Use AI development tools such as Claude Code, GitHub Copilot, Cursor, and Windsurf.
• Implement AI evaluation, monitoring, observability, and cost optimization practices.
• Utilize Langfuse, LangSmith, and Braintrust for AI application tracking and evaluation.
• Containerize and deploy applications using Docker and Kubernetes.
• Collaborate with engineering teams to build scalable, reliable, and production-ready AI solutions.

Skills

Python

Go

LLM orchestration

Agentic AI workflows

Multi-agent systems

MCP integrations

API development

Tools

LangGraph

Google ADK

Mastra

Claude Agent SDK

OpenAI SDK

Anthropic SDK

Docker

Kubernetes

REST API

GraphQL API

Langfuse

LangSmith

Braintrust

Job description

Machine Learning Technologies, LLC is seeking an AI-focused Software Developer in Palo Alto. The role emphasizes Python development, LLM orchestration, and building agentic AI workflows and multi-agent systems.

You will design, implement, and deploy AI-powered applications across cloud environments with MCP integrations. The ideal candidate will have hands-on experience with LangGraph, Claude SDK, OpenAI/Anthropic SDKs, and containerized deployments using Docker and Kubernetes.