Agent Engineer for AI Agents & Production APIs

FriendliAI Inc.; San Francisco (CA); On-site; USD 150,000 - 230,000; Full time

Benefits offered by this job

Flexible working hours

Daily lunch and dinner provided

Health insurance

Top-tier equipment/hardware support

Job summary

FriendliAI Inc. is seeking an Agent Engineer to design and build agentic features in our platform, including document understanding, advanced RAG, and customer support automation.

You will develop the Friendli Agent API and production-ready agent applications to demonstrate real-world workflows for customers and the community. The role focuses on Python-based implementations, open-source model integration, and creating reliable, scalable agent features with strong developer documentation.

Qualifications

• 3+ years of software engineering experience, preferably backend, ML systems, or API development.
• Bachelor’s or Master’s degree in Computer Science, Computer Engineering, or equivalent.
• Strong programming skills in Python and experience with Python frameworks.
• Solid understanding of LLM workflows, agent patterns, or tool invocation systems.
• Experience designing and delivering production APIs.
• Familiarity with open-source LLMs and multimodal models (Hugging Face, LangChain, LlamaIndex).
• Strong foundations in cloud-native development.

Responsibilities

• Design, build, and maintain agent APIs and applications that deliver document understanding and other high-value features.
• Evaluate and integrate open-source models to power production-ready agent features where possible.
• Develop reference agent applications to showcase workflows and accelerate customer adoption.
• Collaborate with backend and infrastructure teams to integrate agents with deployment, orchestration, and monitoring systems.
• Ensure APIs are robust, developer-friendly, and enterprise-ready through strong design principles and documentation.
• Continuously improve the reliability, scalability, and performance of agent features in production.

Skills

Python

LLM workflows

API design

Open-source models

Cloud-native

Education

Bachelor’s or Master’s degree in CS/CE

Tools

Hugging Face

LangChain

LlamaIndex

Job description

FriendliAI Inc. is seeking an Agent Engineer to design and build agentic features in our platform, including document understanding, advanced RAG, and customer support automation.

You will develop the Friendli Agent API and production-ready agent applications to demonstrate real-world workflows for customers and the community. The role focuses on Python-based implementations, open-source model integration, and creating reliable, scalable agent features with strong developer documentation.