AI Inference & HPC Engineer – Performance & APIs

Topaz Labs

Emeryville (CA)

On-site

USD 90,000 - 150,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Full medical/dental/vision coverage
15 days PTO
5 personal days + holidays
401k matching
Equity and profit sharing

Job summary

Topaz Labs is seeking a Software Engineer to support and optimize our AI Engine. You will report to the Head of AI Engine and enhance performance, stability, and feature availability across internal APIs and production products.

You will bridge research and production, preparing new models for deployment and optimizing GPU/CPU workloads. The role requires hands-on experience with C/C++, API design, image processing, and multithreading, along with at least 1 year in a related field.

Qualifications

  • Hands-on experience with performance optimization, e.g. concurrency, multithreading, memory, speed, benchmarking, reliability
  • Experience architecting APIs for internal development
  • Hands-on experience implementing image processing or computational photography algorithms
  • Expert knowledge of C/C++
  • At least 1+ years of professional working experience in a related field

Responsibilities

  • Increase app performance, stability, and availability of new features
  • Simplify and improve the API of the framework
  • Serve as the technical bridge between the Deep Learning research team and production products
  • Help prepare new and updated models for production and assist with GPU/CPU optimization
  • Collaborate with hardware partners (NVIDIA, AMD, Intel, Apple) to optimize inference on their hardware

Skills

C/C++
API design
Performance optimization
Multithreading
GPU optimization
Image processing
Benchmarking

Tools

OpenCV
ffmpeg
ONNX
TensorRT

Job description

Topaz Labs is seeking a Software Engineer to support and optimize our AI Engine. You will report to the Head of AI Engine and enhance performance, stability, and feature availability across internal APIs and production products.

You will bridge research and production, preparing new models for deployment and optimizing GPU/CPU workloads. The role requires hands-on experience with C/C++, API design, image processing, and multithreading, along with at least 1 year in a related field.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

AI Inference & HPC Engineer: Performance & API
AI Inference & HPC Engineer: Performance & API

Topaz Labs • Dallas (TX)

On-site
USD 110,000 - 150,000
100% covered medical/dental/vision
15 days annual PTO
401k matching
+1
AI Performance Engineer – HPC, ARM & Distributed Inference
AI Performance Engineer – HPC, ARM & Distributed Inference

EngineersOfAI • Austin (TX)

On-site
USD 90,000 - 120,000
AI & HPC GPU Compute Performance Engineer
AI & HPC GPU Compute Performance Engineer

Cisco • San Jose (CA)

On-site
USD 150,000 - 190,000
Medical Insurance
Dental Insurance
Vision Insurance
+16
Performance Engineer, Inference Engine - High-Performance AI
Performance Engineer, Inference Engine - High-Performance AI

EngineersOfAI • San Francisco (CA)

Hybrid
USD 180,000 - 240,000
GPU Performance Engineer - AI Inference & Acceleration
GPU Performance Engineer - AI Inference & Acceleration

We Love AI Jobs • Los Angeles (CA)

Hybrid
USD 120,000 - 170,000
AI Inference Performance Engineer (GPU Kernels)
AI Inference Performance Engineer (GPU Kernels)

Intel Corporation • Folsom (CA)

Hybrid
USD 171,000 - 315,000
Stock bonuses
Health insurance
Retirement plan
+1
AI Inference Engineer: GPU Performance & Rust Stack
AI Inference Engineer: GPU Performance & Rust Stack

Perplexity • San Francisco (CA)

On-site
USD 140,000 - 210,000
Software Engineer, AI Inference / HPC
Software Engineer, AI Inference / HPC

Topaz Labs • Emeryville (CA)

On-site
USD 90,000 - 150,000
Full medical/dental/vision coverage
15 days PTO
5 personal days + holidays
+2
AI Inference Engineer — High-Performance GPU Systems
AI Inference Engineer — High-Performance GPU Systems

Perplexity • Palo Alto (CA)

On-site
USD 220,000 - 485,000
GenAI Performance Engineer: C++, Python, Rust Expert
GenAI Performance Engineer: C++, Python, Rust Expert

Mercor • New York (NY)

On-site
USD 110,000 - 170,000