Compiler & Runtime Engineer for AI Accelerator

TetraMem - Accelerate The World

San Jose (CA)

On-site

USD 135,000 - 165,000

Full time

13 hours ago
Be an early applicant

Get more replies from employers

Send a job-specific resume in minutes.

Job summary

TetraMem in San Jose, CA, seeks a software engineer to develop, maintain, and optimize the compiler, runtime, and SDK toolchain for analog CIM hardware. You will translate ML models into efficient workloads for the AI accelerator and implement features, tools, and optimizations to boost latency, throughput, memory use, and power efficiency.

Collaborate with compiler, ML, hardware, and validation teams to resolve issues and improve performance.

Qualifications

  • Bachelor’s or Master’s degree in CS/CE/EE or related field.
  • Experience developing embedded software for microcontroller-based or embedded computing platforms.
  • Strong programming in C/C++ for embedded systems and Python for ML development.
  • Solid understanding of software engineering principles, data structures, algorithms, and debugging techniques.

Responsibilities

  • Develop, maintain, and optimize software components within TetraMem’s compiler, runtime, and SDK toolchain for analog CIM hardware.
  • Translate ML models into efficient executable workloads for TetraMem’s AI accelerator architecture.
  • Implement features, debugging tools, and low-level optimizations to improve latency, throughput, memory utilization, and power efficiency.
  • Support integration of ML frameworks, model conversion pipelines, and deployment workflows for customer applications.
  • Collaborate with compiler, ML, hardware, and validation teams to resolve software issues and improve system performance.
  • Assist in benchmarking, profiling, and analyzing AI workloads to identify bottlenecks and optimization opportunities.
  • Support hardware bring-up, software validation, and demonstration of AI applications on TetraMem compute-in-memory platforms.
  • Write clean, maintainable, and well-documented production-quality code following software engineering best practices.
  • Participate in design reviews, code reviews, testing, and continuous improvement of the compiler and runtime software stack.
  • Stay current with advances in compiler tech, AI frameworks, and computer architecture to improve TetraMem’s software platform.

Skills

C/C++ for embedded systems
Python for ML development
Software debugging techniques
Linux development
CI/CD pipelines
Rust

Education

Bachelor’s or Master’s degree in Computer Science, Computer Engineering, Electrical Engineering, or related field

Tools

Zephyr RTOS
FreeRTOS
Git
Linux

Job description

TetraMem in San Jose, CA, seeks a software engineer to develop, maintain, and optimize the compiler, runtime, and SDK toolchain for analog CIM hardware. You will translate ML models into efficient workloads for the AI accelerator and implement features, tools, and optimizations to boost latency, throughput, memory use, and power efficiency.

Collaborate with compiler, ML, hardware, and validation teams to resolve issues and improve performance.

Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

ML Compiler Engineer for AI Hardware Accelerators
ML Compiler Engineer for AI Hardware Accelerators

TetraMem - Accelerate The World • San Jose (CA)

On-site
USD 160,000 - 300,000
Software Engineer I - Compiler & Runtime for Edge AI
Software Engineer I - Compiler & Runtime for Edge AI

TetraMem Inc • San Jose (CA)

On-site
USD 135,000 - 165,000
Full-time employee benefits
Equity eligibility
Compiler Engineer
Compiler Engineer

TetraMem - Accelerate The World • San Jose (CA)

On-site
USD 160,000 - 300,000
ML Compiler Engineer for AI Accelerators
ML Compiler Engineer for AI Accelerators

Amazon • Cupertino (CA)

On-site
USD 165,000 - 224,000
AI Compiler Engineer: ML Accelerator Optimizer
AI Compiler Engineer: ML Accelerator Optimizer

Black Sesame Technologies Inc • San Jose (CA)

On-site
USD 100,000 - 130,000
AI Compiler Engineer
AI Compiler Engineer

Black Sesame Technologies Inc • San Jose (CA)

On-site
USD 100,000 - 130,000
Software Engineer I – Compiler & Runtime
Software Engineer I – Compiler & Runtime

TetraMem Inc • San Jose (CA)

On-site
USD 135,000 - 165,000
Full-time employee benefits
Equity eligibility
Software Engineer I – Compiler & Runtime
Software Engineer I – Compiler & Runtime

TetraMem - Accelerate The World • San Jose (CA)

On-site
USD 135,000 - 165,000
MLIR Compiler Engineer for AI Hardware Backend Flexible PTO
MLIR Compiler Engineer for AI Hardware Backend Flexible PTO

Persimmons • San Jose (CA)

On-site
USD 120,000 - 150,000
Competitive salary and benefits package
Flexible PTO
401k
Senior MLIR Compiler Engineer for AI Silicon
Senior MLIR Compiler Engineer for AI Silicon

Ericsson GmbH • Austin (TX)

On-site
USD 140,000 - 190,000
Health benefits
401(k) plan
Paid time off
+1