Sr. Software Engineer - AI Agent and LLM Applications

Super Micro Computer; San Jose (CA); On-site; USD 160,000 - 200,000; Full time

Job summary

Supermicro is seeking a Sr. Software Engineer to help build an AI Agent–powered platform for handling customer issues related to AI Servers and Racks.

You will design and implement multi-agent systems, develop tool interfaces, and integrate with ticketing and monitoring systems in a hybrid deployment environment. The role emphasizes strong Python skills, API design, and experience with LLMs and local model deployment.

Qualifications

• 2+ years in LLM applications or AI agent development.
• Experience building tool-using or multi-agent systems.
• Familiar with function calling, Tool use, and orchestration.
• Experience with RAG, vector databases, embeddings, retrieval tuning.
• Strong Python skills for API design and system integration.
• Experience with major LLM APIs and local model deployments.
• Ability to communicate with cross-functional teams.
• Experience integrating with ITSM or monitoring systems is a plus.
• Hands-on with frameworks like OpenClaw, LangGraph, CrewAI, or AutoGen is a plus.
• Experience with agent observability, cost control, or production deployment is a plus.
• Experience implementing human-in-the-loop or escalation mechanisms is a plus.

Responsibilities

• Design and implement Multi-Agent or Tool-using Agent systems (OpenClaw or other agent frameworks).
• Define, develop, and maintain Tools / Function Calling interfaces that agents can invoke.
• Integrate with external systems (ticket systems, databases, monitoring data, automation workflows, etc.).
• Build and optimize the RAG pipeline and integrate the existing Knowledge Base.
• Support hybrid deployment and switching between cloud models (e.g., Grok) and local models (e.g., Ollama).
• Implement agent execution flows, error handling, human-in-the-loop, and escalation mechanisms.
• Collaborate with the Automation team to ensure stable Tool interfaces and proper access control.
• Establish basic logging, tracing, and observability.

Skills

LLM agents

Tool-using agents

Function calling

RAG pipelines

Python API design

LLM API experience

Cross-functional comms

ITSM integration

OpenClaw

Agent observability

Human-in-the-loop

Tools

OpenClaw

LangGraph

CrewAI

AutoGen

Ollama

Job description

Select how often (in days) to receive an alert: Create Alert

Sr. Software Engineer - AI Agent and LLM Applications

Location: San Jose, California, United States

About Supermicro:

Supermicro® is a Top Tier provider of advanced server, storage, and networking solutions for Data Center, Cloud Computing, Enterprise IT, Hadoop/ Big Data, Hyperscale, HPC and IoT/Embedded customers worldwide. We are the #5 fastest growing company among the Silicon Valley Top 50 technology firms. Our unprecedented global expansion has provided us with the opportunity to offer a large number of new positions to the technology community. We seek talented, passionate, and committed engineers, technologists, and business leaders to join us.

Job Summary:

We are building an AI Agent–powered platform to handle customer issues related to AI Servers and Racks. The system will interact with customers via chatbot, analyze issue tickets, and generate troubleshooting steps for the on-site service team. This role focuses on the design, implementation, and system integration of the Agent platform.

Essential Duties and Responsibilities:

• Design and implement Multi-Agent or Tool-using Agent systems (using OpenClaw or other agent frameworks)
• Define, develop, and maintain Tools / Function Calling interfaces that agents can invoke
• Integrate with external systems (ticket systems, databases, monitoring data, automation workflows, etc.)
• Build and optimize the RAG pipeline and integrate the existing Knowledge Base
• Support hybrid deployment and switching between cloud models (e.g., Grok) and local models (e.g., Ollama)
• Implement agent execution flows, error handling, human-in-the-loop, and escalation mechanisms
• Collaborate with the Automation team to ensure stable Tool interfaces and proper access control
• Establish basic logging, tracing, and observability

Qualifications:

• Experience in LLM applications or AI Agent development (2+ years of experience is preferred)
• Hands-on experience building Tool-using Agents or Multi-Agent systems
• Familiarity with Function Calling / Tool Use and agent orchestration
• Experience implementing RAG (vector databases, embeddings, retrieval tuning)
• Strong Python skills with API design and system integration experience
• Experience with at least one major LLM API and local model deployment solutions
• Ability to communicate effectively with cross-functional teams (Automation, Domain SMEs)
• Experience integrating with ITSM, technical support, operations, or monitoring systems is a plus
• Hands-on experience with frameworks such as OpenClaw, LangGraph, CrewAI, or AutoGen is a plus
• Experience with agent observability, cost control, or production deployment is a plus
• Experience implementing human-in-the-loop or escalation mechanisms is a plus

Salary Range

$160,000 - $ 200,000

The salary offered will depend on several factors, including your location, level, education, training, specific skills, years of experience, and comparison to other employees already in this role. In addition to a comprehensive benefits package, candidates may be eligible for other forms of compensation, such as participation in bonus and equity award programs.

EEO Statement

Supermicro is an Equal Opportunity Employer and embraces diversity in our employee population. It is the policy of Supermicro to provide equal opportunity to all qualified applicants and employees without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, age, disability, protected veteran status or special disabled veteran, marital status, pregnancy, genetic information, or any other legally protected status.