Software Engineer, AI Framework

Black Sesame

San Jose, Northern (CA, KY)

Hybrid

USD 150,000 - 190,000

Full time

31 hours ago
Be an early applicant
Application generator

Stand out for this role — generate a tailored resume and cover letter in about a minute.

Get past ATS filters

Job summary

Black Sesame seeks an experienced AI/ML engineer to deploy AI inference and end-to-end enablement, AI framework integration, model accuracy, and performance tuning. You will develop high-quality software that enables state-of-the-art AI inference on BST Intelligence processors.

Responsibilities include building deep learning infrastructure, data pipelines, and real-time deployment pipelines, with a focus on low-precision inference, quantization, and continual latency/accuracy improvements.

Qualifications

  • MS or Ph.D. in Computer Science, Computer Engineering, Applied Math, or related field.
  • Ability to work independently, define project goals and scope, and lead your own development effort.
  • Strong Python or C/C++ programming and software design skills, including debugging, performance analysis, and test design.
  • Experience with Deep Learning Frameworks such as PyTorch, TensorFlow, and MXNet.
  • Experience with model acceleration techniques such as deep learning quantization, model pruning, and model distillation.
  • Nice-to-have: Experience with numerical methods.
  • Nice-to-have: Knowledge of computer architecture.
  • Nice-to-have: Experience with AI compilers.
  • Nice-to-have: Experience in model deployment within the autonomous driving industry.

Responsibilities

  • Contribute to deep learning infrastructure, data pipelines, tools and workflows that lay the foundation for building AI at scale.
  • Writing software to deploy AI models and pipelines in real time applications (inference).
  • Apply low precision inference, quantization, and compression of DNNs.
  • Continuously improve inference latency, accuracy and power consumption of DNNs.
  • Stay up to date with the latest research and innovations in deep learning, implement and experiment with new ideas

Skills

Python
C/C++
Software design
PyTorch
TensorFlow
MXNet

Education

MS or Ph.D. in Computer Science / Computer Engineering / Applied Math or related field

Tools

PyTorch
TensorFlow
MXNet

Job description

Home > Jobs > Software Engineer, AI Framework

Software Engineer, AI Framework

San Jose, US

2025-03-13

Job Qualification

Graduate with a MS, or Ph.D. degree in Computer Science, Computer Engineering, Applied Math, or related field.

Can work independently, define project goals and scope, and lead your own development effort.

Strong Python or C++/C programming and software design skills, including debugging, performance analysis, and test design.

Experience with Deep Learning Frameworks such as PyTorch, TensorFlow, and MXNet

Experience with model acceleration techniques such as deep learning quantization, model pruning, and model distillation.

Ways to stand out from the crowd:

Experience with numerical methods

Knowledge of computer architecture

Experience with AI compilers

Experience in model deployment within the autonomous driving industry

Job Description

We are looking for an experienced AI/ML engineer passionate about deploying AI inference and end to end enablement, AI framework integration, model accuracy, and performance analysis and tuning. You might be an ideal candidate if you are seeking to develop high quality, innovative, and scalable software that enables state of the art AI inference models to run efficiently and accurately on the BST Intelligence processors.

Responsibilities:

Contribute to deep learning infrastructure, data pipelines, tools and workflows that lay the foundation for building AI at scale.

Writing software to deploy AI models and pipelines in real time applications (inference).

Apply low precision inference, quantization, and compression of DNNs.

Continuously improve inference latency, accuracy and power consumption of DNNs.

Stay up to date with the latest research and innovations in deep learning, implement and experiment with new ideas

Job Location: 2290 N 1st. St. STE100 San Jose, CA 95131

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Software Engineer, AI Compiler
Software Engineer, AI Compiler

Black Sesame • San Jose (CA)

On-site
USD 120,000 - 170,000
AI Framework & Inference Engineer
AI Framework & Inference Engineer

Black Sesame • San Jose (CA), Northern (KY)

Hybrid
USD 150,000 - 190,000
AI Compiler Engineer — Real-Time Inference & Optimization
AI Compiler Engineer — Real-Time Inference & Optimization

Black Sesame • San Jose (CA)

On-site
USD 120,000 - 170,000
Senior/Sr. Staff AI Infrastructure Engineer, Inference & Optimization New San Jose, CA
Senior/Sr. Staff AI Infrastructure Engineer, Inference & Optimization New San Jose, CA

Didi Labs • San Jose (CA)

On-site
USD 170,000 - 351,000
SR DEEP LEARNING ENGINEER
SR DEEP LEARNING ENGINEER

Mumba Technologies, Inc. • California

On-site
USD 158,000 - 200,000
AI Engineer
AI Engineer

DataJobs • Sunnyvale (CA)

On-site
USD 62,000 - 69,000
Salary USD 45-50/hr
Dental insurance
Vision insurance
AI/ML Software Engineer / Senior software engineer/ Tech lead
AI/ML Software Engineer / Senior software engineer/ Tech lead

Expert Intelligence™ • San Francisco (CA)

On-site
USD 150,000 - 230,000
Competitive pay bonuses
Personalized PTO
Equal Opportunity employer
AI Perception Algorithm Engineer/Scientist
AI Perception Algorithm Engineer/Scientist

Black Sesame • San Jose (CA)

On-site
USD 100,000 - 130,000
Senior AI Software Engineer - Autonomous Systems
Senior AI Software Engineer - Autonomous Systems

AMD • San Jose (CA)

On-site
USD 180,000 - 240,000
Senior AI Infrastructure Engineer - Real-Time Inference
Senior AI Infrastructure Engineer - Real-Time Inference

Didi Labs • San Jose (CA)

Hybrid
USD 170,000 - 351,000