Software Engineer I – Compiler & Runtime

TetraMem - Accelerate The World; San Jose (CA); On-site; USD 135,000 - 165,000; Full time

Job summary

TetraMem in San Jose, CA, seeks a software engineer to develop, maintain, and optimize the compiler, runtime, and SDK toolchain for analog CIM hardware. You will translate ML models into efficient workloads for the AI accelerator and implement features, tools, and optimizations to boost latency, throughput, memory use, and power efficiency.

Collaborate with compiler, ML, hardware, and validation teams to resolve issues and improve performance.

Qualifications

• Bachelor’s or Master’s degree in CS/CE/EE or related field.
• Experience developing embedded software for microcontroller-based or embedded computing platforms.
• Strong programming in C/C++ for embedded systems and Python for ML development.
• Solid understanding of software engineering principles, data structures, algorithms, and debugging techniques.

Responsibilities

• Develop, maintain, and optimize software components within TetraMem’s compiler, runtime, and SDK toolchain for analog CIM hardware.
• Translate ML models into efficient executable workloads for TetraMem’s AI accelerator architecture.
• Implement features, debugging tools, and low-level optimizations to improve latency, throughput, memory utilization, and power efficiency.
• Support integration of ML frameworks, model conversion pipelines, and deployment workflows for customer applications.
• Collaborate with compiler, ML, hardware, and validation teams to resolve software issues and improve system performance.
• Assist in benchmarking, profiling, and analyzing AI workloads to identify bottlenecks and optimization opportunities.
• Support hardware bring-up, software validation, and demonstration of AI applications on TetraMem compute-in-memory platforms.
• Write clean, maintainable, and well-documented production-quality code following software engineering best practices.
• Participate in design reviews, code reviews, testing, and continuous improvement of the compiler and runtime software stack.
• Stay current with advances in compiler tech, AI frameworks, and computer architecture to improve TetraMem’s software platform.

Skills

C/C++ for embedded systems

Python for ML development

Software debugging techniques

Linux development

CI/CD pipelines

Rust

Education

Bachelor’s or Master’s degree in Computer Science, Computer Engineering, Electrical Engineering, or related field

Tools

Zephyr RTOS

FreeRTOS

Git

Linux

Job description

• Develop, maintain, and optimize software components within TetraMem’s compiler, runtime, and SDK toolchain for analog compute-in-memory (CIM) hardware.
• Work closely with senior engineers to translate machine learning models into efficient executable workloads for TetraMem’s AI accelerator architecture.
• Implement software features, debugging tools, and low-level optimizations to improve inference latency, throughput, memory utilization, and power efficiency.
• Support the integration of machine learning frameworks, model conversion pipelines, and deployment workflows for customer applications.
• Collaborate with compiler, machine learning, hardware, and validation teams to resolve software issues and improve overall system performance.
• Assist in benchmarking, profiling, and analyzing AI workloads to identify performance bottlenecks and recommend optimization opportunities.
• Support hardware bring-up, software validation, and demonstration of AI applications on TetraMem compute-in-memory platforms.
• Write clean, maintainable, and well-documented production-quality code while following software engineering best practices.
• Participate in design reviews, code reviews, testing, and continuous improvement of the compiler and runtime software stack.
• Stay current with advances in compiler technologies, AI frameworks, machine learning deployment, and computer architecture to continuously improve TetraMem’s software platform.

Responsibilities

• Develop, maintain, and optimize software components within TetraMem’s compiler, runtime, and SDK toolchain for analog compute-in-memory (CIM) hardware.
• Work closely with senior engineers to translate machine learning models into efficient executable workloads for TetraMem’s AI accelerator architecture.
• Implement software features, debugging tools, and low-level optimizations to improve inference latency, throughput, memory utilization, and power efficiency.
• Support the integration of machine learning frameworks, model conversion pipelines, and deployment workflows for customer applications.
• Collaborate with compiler, machine learning, hardware, and validation teams to resolve software issues and improve overall system performance.
• Assist in benchmarking, profiling, and analyzing AI workloads to identify performance bottlenecks and recommend optimization opportunities.
• Support hardware bring-up, software validation, and demonstration of AI applications on TetraMem compute-in-memory platforms.
• Write clean, maintainable, and well-documented production-quality code while following software engineering best practices.
• Participate in design reviews, code reviews, testing, and continuous improvement of the compiler and runtime software stack.
• Stay current with advances in compiler technologies, AI frameworks, machine learning deployment, and computer architecture to continuously improve TetraMem’s software platform.

Qualifications

Required Qualifications

• Bachelor’s or Master’s degree in Computer Science, Computer Engineering, Electrical Engineering, or a related technical field.
• Experience developing embedded software for microcontroller-based or embedded computing platforms.
• Strong programming skills in C/C++ for embedded systems and/or Python for machine learning application development.
• Solid understanding of software engineering principles, data structures, algorithms, and debugging techniques.
• Strong analytical and problem-solving skills with the ability to learn new technologies quickly.
• Excellent communication and collaboration skills, with the ability to work effectively in a fast-paced, cross-functional startup environment.
• Self-motivated with the ability to work independently while contributing to team objectives.

Preferred Qualifications

• Experience training, optimizing, quantizing, or deploying machine learning models on resource-constrained or edge AI hardware platforms.
• Experience developing compiler technologies, code generation, or machine learning model compilation.
• Experience with CI/CD pipelines, automated testing, and software release processes.
• Programming experience in Rust.
• Experience developing firmware for RTOS-based embedded systems, including integration with platforms such as Zephyr or FreeRTOS.
• Hands-on experience with edge AI platforms, embedded AI accelerators, or custom AI hardware.
• Experience using software profiling, debugging, and performance analysis tools to optimize low-level systems.
• Familiarity with Linux development environments, Git version control, and modern software development workflows.

Salary Range

$135,000 – $165,000 annually, plus full-time employee benefits and equity eligibility.

TetraMem celebrates diversity and is committed to creating an inclusive environment for all employees. We are proud to be an Equal Opportunity Employer and welcome applicants from all backgrounds.

Qualified candidates will receive consideration for employment without regard to race, color, religion, creed, sex, gender identity or expression, sexual orientation, national origin, ancestry, age, marital status, medical condition, disability, genetic information, military or veteran status, or any other characteristic protected by applicable federal, state, or local law.

TetraMem is committed to providing reasonable accommodations to qualified applicants with disabilities throughout the recruitment process. Applicants requiring accommodation may contact Human Resources for assistance.