Senior Software Engineer - AI Agents & LLM Pipelines

Supermicro; Wayne (CA); On-site; USD 160,000 - 200,000; Full time

Job summary

Supermicro is seeking a top-notch hands-on Sr. Software Engineer to work on PCIe, SAS/SATA, USB and other HW related areas of storage and server products. You will lead projects and provide technical expertise to support and enhance development efforts.

The role focuses on creating and maintaining AI agent pipelines, data processing from diverse sources, and presenting progress to stakeholders. Strong Python/ML/LLM skills and experience deploying production systems are required.

Qualifications

• Bachelor's degree in Computer Science, Mathematics, IT, or related field or equivalent practical experience.
• Production services experience in software engineering.
• Strong proficiency in Python and ML/LLM frameworks.
• Linux, Git, and Docker; SQL, NoSQL, and vector databases experience.
• Experience building/deploying production systems with LLMs.
• Strong problem-solving and communication skills.
• Hands-on with LLM tooling and agent frameworks (LangChain or similar).
• Familiar with MLOps practices and model evaluation frameworks.
• Experience integrating models via APIs and serving them at scale.

Responsibilities

• Create and maintain end-to-end AI agent pipelines for high-volume customer support and technical tickets.
• Connect and process data from multiple internal and external sources.
• Present demonstrations and updates to internal stakeholders.
• Define success metrics and iterate deployed services based on production feedback.

Skills

Python

ML/LLM frameworks

Linux

Docker

Git

SQL

NoSQL

Vector databases

LLM tooling

LangChain

MLOps

APIs

Education

Bachelor's degree in CS/Math/IT

Tools

LangChain

APIs

Job description

Supermicro is seeking a top-notch hands-on Sr. Software Engineer to work on PCIe, SAS/SATA, USB and other HW related areas of storage and server products. You will lead projects and provide technical expertise to support and enhance development efforts.

The role focuses on creating and maintaining AI agent pipelines, data processing from diverse sources, and presenting progress to stakeholders. Strong Python/ML/LLM skills and experience deploying production systems are required.