Principal Software Engineer - Open Source AI Model Serving

EmbedAI

Raleigh (NC)

On-site

USD 100,000 - 130,000

Full time

14 days+

Get more replies from employers

Send a job-specific resume in minutes.

Job summary

EmbedAI in Raleigh, North Carolina is seeking a Subject Matter Expert in model serving and monitoring for their open source Open Data Hub project. You will actively engage in prominent open source communities including KServe, TrustyAI, Kubeflow, and HuggingFace.

The ideal candidate will thrive in a collaborative environment, designing and building model serving and explainability capabilities while integrating Red Hat and partner technologies into a cohesive platform. Passion for open source development is essential.

Qualifications

  • Experience with model serving and monitoring in open source projects.
  • Knowledge of KServe, TrustyAI, Kubeflow, and HuggingFace.
  • Strong collaboration skills and ability to work in cross-functional teams.

Responsibilities

  • Contribute as an expert in model serving and explainability.
  • Participate in open source communities and development teams.
  • Design and build reference architectures integrating various technologies.

Job description

EmbedAI in Raleigh, North Carolina is seeking a Subject Matter Expert in model serving and monitoring for their open source Open Data Hub project. You will actively engage in prominent open source communities including KServe, TrustyAI, Kubeflow, and HuggingFace.

The ideal candidate will thrive in a collaborative environment, designing and building model serving and explainability capabilities while integrating Red Hat and partner technologies into a cohesive platform. Passion for open source development is essential.

Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

Principal Software Engineer, OpenShift AI
Principal Software Engineer, OpenShift AI

EmbedAI • Raleigh (NC)

On-site
USD 100,000 - 130,000
Principal Software Engineer, OpenShift AI Lead
Principal Software Engineer, OpenShift AI Lead

Red Hat • Raleigh (NC)

On-site
USD 148,000 - 246,000
Comprehensive benefits
401(k) with company match
Paid time off & parental leave
Research Software Engineer — Open Source AI & Hybrid Cloud
Research Software Engineer — Open Source AI & Hybrid Cloud

Red Hat, LLC • Boston (MA)

Hybrid
USD 111,000 - 177,000
Senior Staff R&D AI Systems Engineer - Hybrid
Senior Staff R&D AI Systems Engineer - Hybrid

United States Digital Space LLC • Denver (CO)

Hybrid
USD 140,000 - 210,000
Inference Platform Engineer for Open-Source Models
Inference Platform Engineer for Open-Source Models

Together AI • San Francisco (CA)

On-site
USD 200,000 - 290,000
Health insurance
Startup equity
Principal Software Engineer - Red Hat OpenShift AI at Red Hat Raleigh, NC
Principal Software Engineer - Red Hat OpenShift AI at Red Hat Raleigh, NC

Red Hat • Raleigh (NC)

On-site
USD 148,000 - 246,000
Comprehensive benefits
401(k) with company match
Paid time off & parental leave
Research Software Engineer - AI, Open Source & Hybrid Cloud
Research Software Engineer - AI, Open Source & Hybrid Cloud

Red Hat, Inc. • Boston (MA)

Hybrid
USD 111,000 - 177,000
Senior SRE: AI Inference Platform - Remote
Senior SRE: AI Inference Platform - Remote

Jaide Health • San Francisco (CA)

On-site
USD 120,000 - 160,000
An open and inclusive culture and work environment
Weekly lunch stipend, in-office lunches & snacks
Full health and dental benefits
+2
Senior DevOps Engineer – ModelOps & CI/CD Automation
Senior DevOps Engineer – ModelOps & CI/CD Automation

Sas • Cary (NC)

Hybrid
USD 110,000 - 140,000
Senior AI Model Serving Engineer – Equity
Senior AI Model Serving Engineer – Equity

Sciforium • San Francisco (CA)

On-site
USD 190,000 - 250,000
Medical, dental, and vision insurance
401(k) plan
Daily lunch, snacks, and beverages
+2