Software Engineer I – Compiler & Runtime

TetraMem - Accelerate The World; San Jose (CA); On-site; USD 135,000 - 165,000; Full time

Job summary

TetraMem is hiring an embedded software engineer to develop, optimize, and integrate software for its CIM hardware stack in a fast-paced startup setting.

The role emphasizes turning ML models into efficient workloads, implementing low-level optimizations, and collaborating across compiler, ML, hardware, and validation teams to improve performance and energy efficiency.

Qualifications

• Bachelor’s or Master’s degree in CS/CE/EE or related field.
• Experience developing embedded software for microcontroller-based platforms.
• Strong C/C++ for embedded systems and/or Python for ML apps.
• Solid understanding of data structures, algorithms, and debugging.
• Fast learner with strong analytical and problem-solving skills.
• Excellent communication and collaboration in a fast-paced startup environment.
• Self-motivated with ability to work independently.

Responsibilities

• Develop, maintain, and optimize software within TetraMem’s toolchain.
• Translate ML models into efficient workloads for AI accelerator.
• Implement features, debugging tools, and low-level optimizations.
• Support ML frameworks, model conversions, and deployment workflows.
• Collaborate across compiler, ML, hardware, and validation teams.
• Benchmark, profile, and identify AI workload bottlenecks.
• Assist in hardware bring-up and software validation.
• Write clean, maintainable production code following best practices.
• Participate in design/code reviews and testing.
• Stay current with compiler tech, AI frameworks, and architecture.

Skills

Embedded software

C/C++

Python

Software engineering

Analytical skills

Problem solving

Communication

Collaboration

Self-motivation

Education

Bachelor's or Master's degree

Tools

Zephyr

FreeRTOS

Linux

Git

Rust

Job description

Responsibilities

• Develop, maintain, and optimize software components within TetraMem’s compiler, runtime, and SDK toolchain for analog compute-in-memory (CIM) hardware.
• Work closely with senior engineers to translate machine learning models into efficient executable workloads for TetraMem’s AI accelerator architecture.
• Implement software features, debugging tools, and low-level optimizations to improve inference latency, throughput, memory utilization, and power efficiency.
• Support the integration of machine learning frameworks, model conversion pipelines, and deployment workflows for customer applications.
• Collaborate with compiler, machine learning, hardware, and validation teams to resolve software issues and improve overall system performance.
• Assist in benchmarking, profiling, and analyzing AI workloads to identify performance bottlenecks and recommend optimization opportunities.
• Support hardware bring-up, software validation, and demonstration of AI applications on TetraMem compute-in-memory platforms.
• Write clean, maintainable, and well-documented production-quality code while following software engineering best practices.
• Participate in design reviews, code reviews, testing, and continuous improvement of the compiler and runtime software stack.
• Stay current with advances in compiler technologies, AI frameworks, machine learning deployment, and computer architecture to continuously improve TetraMem’s software platform.

Required Qualifications

• Bachelor’s or Master’s degree in Computer Science, Computer Engineering, Electrical Engineering, or a related technical field.
• Experience developing embedded software for microcontroller-based or embedded computing platforms.
• Strong programming skills in C/C++ for embedded systems and/or Python for machine learning application development.
• Solid understanding of software engineering principles, data structures, algorithms, and debugging techniques.
• Strong analytical and problem-solving skills with the ability to learn new technologies quickly.
• Excellent communication and collaboration skills, with the ability to work effectively in a fast-paced, cross-functional startup environment.
• Self-motivated with the ability to work independently while contributing to team objectives.

Preferred Qualifications

• Experience training, optimizing, quantizing, or deploying machine learning models on resource-constrained or edge AI hardware platforms.
• Experience developing compiler technologies, code generation, or machine learning model compilation.
• Experience with CI/CD pipelines, automated testing, and software release processes.
• Programming experience in Rust.
• Experience developing firmware for RTOS-based embedded systems, including integration with platforms such as Zephyr or FreeRTOS.
• Hands-on experience with edge AI platforms, embedded AI accelerators, or custom AI hardware.
• Experience using software profiling, debugging, and performance analysis tools to optimize low-level systems.
• Familiarity with Linux development environments, Git version control, and modern software development workflows.

Salary Range

$135,000 – $165,000 annually, plus full-time employee benefits and equity eligibility.

TetraMem celebrates diversity and is committed to creating an inclusive environment for all employees.

We are proud to be an Equal Opportunity Employer and welcome applicants from all backgrounds.

Qualified candidates will receive consideration for employment without regard to race, color, religion, creed, sex, gender identity or expression, sexual orientation, national origin, ancestry, age, marital status, medical condition, disability, genetic information, military or veteran status, or any other characteristic protected by applicable federal, state, or local law.

TetraMem is committed to providing reasonable accommodations to qualified applicants with disabilities throughout the recruitment process.

Applicants requiring accommodation may contact Human Resources for assistance.