Principal Software Engineer – Kernels

MixMode

Santa Clara (CA)

On-site

USD 150,000 - 200,000

Full time

14 days+

Get more replies from employers

Send a job-specific resume in minutes.

Job summary

MixMode is seeking a Principal Software Engineer to innovate and develop kernels for our advanced AI compute engine based in Santa Clara, CA. This role demands expertise in software development for next-generation hardware with a strong requirement for knowledge in C/C++ and Python.

The ideal candidate will have an MS or PhD with extensive experience in the industry, and experience working with AI frameworks and specialized hardware. The position offers a hybrid work model.

Qualifications

  • 12+ years of industry experience with an MS or 7+ years with a PhD.
  • Experience in implementing algorithms in C/C++ and Python.
  • Understanding of hardware architectures and computational graph mapping.

Responsibilities

  • Develop and maintain software kernels for AI hardware.
  • Work with compiler experts to build compiler infrastructure.
  • Optimize and trade off hardware-software co-design.

Skills

Proficient in C/C++
Proficient in Python development
Experience with FPGAs, DSPs, GPUs
Strong grasp of computer architecture

Education

MS or PhD in Computer Engineering, Math, Physics, or related degree

Tools

CUDA
Linux development environments

Job description

Location

Hybrid, working onsite at our Santa Clara, CA, headquarters 3-5 days per week.

The Role

Principal Software Engineer - Kernels

What you will do

The role requires you to be part of the team that helps productize the SW stack for our AI compute engine. As part of the software team, you will be responsible for the development, enhancement, and maintenance of software kernels for next‑generation AI hardware. You possess experience building software kernels for HW architectures and have a very strong understanding of hardware architectures and how to map algorithms to them. You understand how to map computational graphs generated by AI frameworks to the underlying architecture, and you have past experience working across all aspects of the full‑stack toolchain, optimizing and trading off hardware‑software co‑design. You can build and scale software deliverables in a tight development window. You will work with a team of compiler experts to build out the compiler infrastructure, working closely with other software (ML, systems) and hardware (mixed signal, DSP, CPU) experts in the company.

What you will bring
Minimum
  • MS in computer engineering, math, physics, or a related degree with 12+ years of industry experience or a PhD in computer engineering, math, physics, or a related degree with 7+ years of industry experience.
  • Strong grasp of computer architecture, data structures, system software, and machine learning fundamentals.
  • Proficient in C/C++ and Python development in Linux environments and using standard development tools.
  • Experience implementing algorithms in high‑level languages such as C/C++ and Python.
  • Experience implementing algorithms for specialized hardware such as FPGAs, DSPs, GPUs, and AI accelerators using libraries such as CUDA, etc.
  • Experience in implementing operators commonly used in ML workloads—GEMMs, Convolutions, BLAS, SIMD operators for operations like softmax, layer normalization, pooling, etc.
  • Experience with development for embedded SIMD vector processors such as Tensilica.
  • Self‑motivated team player with a strong sense of ownership and leadership.
Preferred
  • Prior startup, small team, or incubation experience.
  • Experience with ML frameworks such as TensorFlow and/or PyTorch.
  • Experience working with ML compilers and algorithms, such as MLIR, LLVM, TVM, Glow, etc.
  • Experience with a deep learning framework (such as PyTorch or TensorFlow) and ML models for CV, NLP, or recommendation.
  • Work experience at a cloud provider or AI compute/subsystem company.
Equal Opportunity Employment Policy

d-Matrix is proud to be an equal opportunity workplace and affirmative action employer. We’re committed to fostering an inclusive environment where everyone feels welcomed and empowered to do their best work. We hire the best talent for our teams, regardless of race, religion, color, age, disability, sex, gender identity, sexual orientation, ancestry, genetic information, marital status, national origin, political affiliation, or veteran status. Our focus is on hiring teammates with humble expertise, kindness, dedication and a willingness to embrace challenges and learn together every day.

Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

Principal Software Engineer - Kernels
Principal Software Engineer - Kernels

d-Matrix • Santa Clara (CA)

Hybrid
USD 120,000 - 180,000
Principal Software Engineer, Kernels
Principal Software Engineer, Kernels

D-Matrix Corp. • Santa Clara (CA), Northern (KY)

Hybrid
USD 250,000 - 350,000
Principal Software Engineer - Kernels
Principal Software Engineer - Kernels

d-Matrix inc. • Santa Clara (CA)

Hybrid
USD 120,000 - 160,000
Principal Software Engineer, SDK & Lowering Stack
Principal Software Engineer, SDK & Lowering Stack

d-Matrix • United States

On-site
USD 120,000 - 160,000
Software Engineer, Staff - SIMD Kernels
Software Engineer, Staff - SIMD Kernels

d-Matrix • Santa Clara (CA)

On-site
USD 120,000 - 150,000
Compiler Architect
Compiler Architect

d-Matrix inc. • Santa Clara (CA)

Hybrid
USD 130,000 - 180,000
Principal System Software Engineer, AI Inference Execution
Principal System Software Engineer, AI Inference Execution

d-Matrix • United States

Hybrid
USD 180,000 - 320,000
Principal System Software Engineer, AI Inference Execution
Principal System Software Engineer, AI Inference Execution

Entrada Ventures • Santa Clara (CA)

Hybrid
USD 180,000 - 260,000
Principal AI Kernel Engineer — HW/SW Co-Design (Hybrid)
Principal AI Kernel Engineer — HW/SW Co-Design (Hybrid)

D-Matrix Corp. • Santa Clara (CA), Northern (KY)

Hybrid
USD 250,000 - 350,000
Lead Software Engineer, Kernels
Lead Software Engineer, Kernels

MatX • Mountain View (CA)

Hybrid
USD 120,000 - 275,000
Equity
Health Insurance
PTO 4 wks
+2