Senior ML Compiler Engineer for AI Accelerators

TetraMem - Accelerate The World; San Jose (CA); On-site; USD 160,000 - 300,000; Full time

Job summary

TetraMem in San Jose, California, is seeking a Senior Compiler Engineer to design and maintain compiler toolchains that translate ML models from common frameworks into optimized workloads for our analog in-memory computing hardware.

You will develop runtimes, libraries, and SDKs to enable efficient deployment of AI applications on TetraMem accelerators, implement advanced optimizations, and collaborate with ML engineers and hardware teams to improve performance and usability.

Qualifications

• MS or PhD in Computer Engineering/CS/EE.
• 5+ years industry experience as a compiler engineer or developer.
• Experience developing compilers for GPU, dataflow compilers, or ML compilers.
• Startup mindset/experience.

Responsibilities

• Design, develop, and maintain compiler toolchains that translate ML models into optimized workloads for TetraMem’s analog in-memory computing hardware.
• Develop runtime systems, software libraries, and SDK components for AI apps on TetraMem accelerators.
• Implement compiler optimizations including graph transformations, operator fusion, memory optimization, scheduling, and code generation.
• Research and develop techniques to improve inference speed, latency, throughput, and power across AI workloads.
• Collaborate with ML engineers to support model conversion, validation, optimization, benchmarking, and deployment.
• Partner with hardware architects to co-design software/hardware features for performance and usability.
• Develop performance analysis, profiling, debugging, and benchmarking tools for AI workloads on TetraMem platforms.
• Integrate and support frameworks like PyTorch, TensorFlow, ONNX, etc.
• Lead technical design reviews and set best practices for scalable software development.
• Mentor junior engineers and help define the long-term roadmap for compiler, runtime, and SDK technologies.

Skills

Compiler engineering

GPU/ML compilers

Startup mindset

Leadership

Team collaboration

Education

MS or PhD in Computer Engineering/CS/EE

Tools

GCC

Clang

MLIR

LLVM

Job description

TetraMem in San Jose, California, is seeking a Senior Compiler Engineer to design and maintain compiler toolchains that translate ML models from common frameworks into optimized workloads for our analog in-memory computing hardware.

You will develop runtimes, libraries, and SDKs to enable efficient deployment of AI applications on TetraMem accelerators, implement advanced optimizations, and collaborate with ML engineers and hardware teams to improve performance and usability.