Senior AI/ML Software Engineer - Production LLM Pipelines

Supermicro

Wayne (CA)

On-site

USD 160,000 - 200,000

Full time

14 days+
Application generator

Stand out for this role — generate a tailored resume and cover letter in about a minute.

Get past ATS filters

Job summary

Supermicro is seeking a top-notch Sr. Software Engineer to work on PCIe, SAS/SATA, USB and other HW related areas of storage and server products. You will lead projects and provide technical expertise to support and enhance development efforts.

The role focuses on building and deploying AI-powered pipelines and services, with emphasis on data processing, model integration, and scalable production systems.

Qualifications

  • Bachelor's degree in Computer Science, Mathematics, IT, or related field (or equivalent practical experience).
  • Software engineering background with experience shipping production services.
  • Strong proficiency in Python and ML/LLM frameworks.
  • Proficiency with Linux, Git, and Docker. Experience with SQL, NoSQL, and vector databases.
  • Experience building and deploying production-ready systems that use large language models.
  • Strong problem-solving and communication skills.

Responsibilities

  • Create and maintain several end-to-end AI agent pipelines that handle high-volume customer support and technical tickets.
  • Connect and process data from various internal and external data sources.
  • Present demonstrations and updates to internal stakeholders.
  • Define success metrics and iterate deployed services based on production feedback.

Skills

Python
ML/LLM frameworks
Problem-solving
Communication
Data handling
LLM tooling
APIs

Education

Bachelor's degree in Computer Science, Mathematics, IT, or related field

Tools

Linux
Git
Docker
LangChain
Vector databases
SQL
NoSQL

Job description

Supermicro is seeking a top-notch Sr. Software Engineer to work on PCIe, SAS/SATA, USB and other HW related areas of storage and server products. You will lead projects and provide technical expertise to support and enhance development efforts.

The role focuses on building and deploying AI-powered pipelines and services, with emphasis on data processing, model integration, and scalable production systems.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior AI/ML Engineer for Production LLM Pipelines
Senior AI/ML Engineer for Production LLM Pipelines

Supermicro • Wayne (CA)

On-site
USD 160,000 - 200,000
Senior Software Engineer - AI Pipelines & LLM Systems
Senior Software Engineer - AI Pipelines & LLM Systems

Supermicro • San Jose (CA)

On-site
USD 160,000 - 200,000
Bonus potential
Equity programs
Senior Software Engineer - AI Agents & LLM Pipelines
Senior Software Engineer - AI Agents & LLM Pipelines

Supermicro • Wayne (CA)

On-site
USD 160,000 - 200,000
Senior AI/ML Engineer: Build Production Pipelines & LLMs
Senior AI/ML Engineer: Build Production Pipelines & LLMs

Supermicro • San Jose (CA)

On-site
USD 160,000 - 200,000
Sr. Software Engineer - AI/ML
Sr. Software Engineer - AI/ML

Supermicro • Wayne (CA)

On-site
USD 160,000 - 200,000
Sr. Software Engineer - Agentic AI
Sr. Software Engineer - Agentic AI

Supermicro • Wayne (CA)

On-site
USD 160,000 - 200,000
Sr. Software Engineer
Sr. Software Engineer

Supermicro • Wayne (CA)

On-site
USD 160,000 - 200,000
Sr. Software Engineer - AI/ML
Sr. Software Engineer - AI/ML

Supermicro • San Jose (CA)

On-site
USD 160,000 - 200,000
Sr. Software Engineer
Sr. Software Engineer

Supermicro • San Jose (CA)

On-site
USD 160,000 - 200,000
Bonus potential
Equity programs
Staff Data Center AI Infrastructure Product Manager
Staff Data Center AI Infrastructure Product Manager

Supermicro • San Jose (CA)

On-site
USD 200,000 - 230,000