Senior Software Engineer - AI Pipelines & LLM Systems

Supermicro; San Jose (CA); On-site; USD 160,000 - 200,000; Full time

Benefits offered by this job

Bonus potential

Equity programs

Job summary

Supermicro is seeking a top-notch hands-on Sr. Software Engineer to work on PCIe, SAS/SATA, USB and other HW related areas of storage and server products.

As part of our small but important software engineering team, you will be responsible for leading the projects and provide technical expertise and recommendations to support and enhance our development projects. The ideal candidate has a strong background in software engineering, production services, and ML/LLM tooling, with experience

Qualifications

• Bachelor’s degree in CS/Math/IT or equivalent practical experience.
• Software engineering background with production services experience.
• Strong Python and ML/LLM framework skills.
• Proficiency with Linux, Git and Docker; experience with SQL/NoSQL and vector databases.
• Experience deploying production systems using large language models.
• Familiarity with LangChain or similar, and MLOps practices.

Responsibilities

• Create and maintain end-to-end AI agent pipelines for high-volume support and technical tickets.
• Connect and process data from diverse internal and external sources.
• Demonstrate updates to internal stakeholders and define success metrics.
• Iterate deployed services based on production feedback.

Skills

Python

ML/LLM frameworks

Problem solving

Communication skills

Education

Bachelor’s degree in CS/Math/IT

Tools

Linux

Git

Docker

LangChain

SQL/NoSQL

APIs

Vector databases

Job description

Supermicro is seeking a top-notch hands-on Sr. Software Engineer to work on PCIe, SAS/SATA, USB and other HW related areas of storage and server products.

As part of our small but important software engineering team, you will be responsible for leading the projects and provide technical expertise and recommendations to support and enhance our development projects. The ideal candidate has a strong background in software engineering, production services, and ML/LLM tooling, with experience