Head of Software

TetraMem - Accelerate The World; San Jose (CA); On-site; USD 200,000 - 350,000; Full time

Job summary

TetraMem in the United States is seeking a seasoned Software Leader to define and execute the company’s software roadmap, spanning ML frameworks, compiler toolchains, SDKs, and embedded platforms.

You will build and scale a world-class software organization, set engineering standards, and drive architecture direction while collaborating with hardware and product teams to deliver integrated AI solutions for edge devices.

Qualifications

• 10+ years in software engineering with leadership roles in ML systems, compilers, embedded software, or AI infrastructure.
• Strong background in machine learning frameworks, model optimization, and AI inference systems.
• Deep understanding of compiler design and toolchains for specialized hardware or accelerators.
• Experience with embedded systems, firmware, and low-level performance optimization on FPGA or ASIC platforms.
• Proven ability to build and scale high-performing technical teams.
• Strong cross-functional leadership and communication skills.
• Experience working with hardware teams in a deep-tech or semiconductor environment preferred.

Responsibilities

• Software Strategy and Leadership: Define and execute TetraMem’s overall software roadmap, covering ML frameworks, compiler toolchains, SDKs, and embedded software platforms.
• Machine Learning Systems: Oversee ML model development for edge AI applications; drive optimization techniques for accelerators.
• Compiler and Toolchain Development: Lead development of compiler toolchains for in-memory computing hardware.
• Embedded and Systems Software: Guide design of embedded software, firmware, and drivers for FPGA/ASIC platforms.
• Cross-Functional Collaboration: Work with architecture, silicon design, and product teams; support customer engagements.
• Team Building and Mentorship: Recruit and mentor senior engineers across ML, compiler, and embedded software.

Skills

ML frameworks

Model optimization

Compiler design

Embedded software

Leadership

Cross-functional collaboration

Team mentorship

Communication skills

Job description

• Define and execute TetraMem’s overall software roadmap, covering machine learning frameworks, compiler toolchains, SDKs, and embedded software platforms. Build and scale a world-class software organization while setting engineering standards, processes, and long-term architecture direction.
• Oversee ML model development for edge AI applications. Drive advanced model optimization techniques including quantization, pruning, and compression tailored for TetraMem’s AI accelerators. Collaborate with hardware and SDK teams to enable efficient deployment across power- and memory-constrained environments.
• Compiler and Toolchain Development
• Lead development of compiler toolchains that translate deep learning models onto novel in-memory computing hardware. Innovate on inference optimization for speed, power efficiency, and performance. Ensure seamless integration with mainstream ML frameworks and industry workflows.
• Embedded and Systems Software
• Guide the design and optimization of embedded software, firmware, and drivers supporting FPGA and ASIC platforms. Ensure real-time performance, reliability, security, and scalability for AI workloads. Support system-level performance tuning across software and hardware boundaries.
• Cross-Functional Collaboration
• Work closely with architecture, silicon design, and product teams to deliver tightly integrated solutions. Support customer engagements, demos, and early deployments as the company moves from R&D into commercialization.
• Team Building and Mentorship
• Recruit, develop, and mentor senior engineers and technical leaders across ML, compiler, and embedded software teams. Foster a culture of innovation, execution excellence, and collaboration.
  

Responsibilities

• Software Strategy and Leadership
  • Define and execute TetraMem’s overall software roadmap, covering machine learning frameworks, compiler toolchains, SDKs, and embedded software platforms. Build and scale a world-class software organization while setting engineering standards, processes, and long-term architecture direction.
• Machine Learning Systems
  • Oversee ML model development for edge AI applications. Drive advanced model optimization techniques including quantization, pruning, and compression tailored for TetraMem’s AI accelerators. Collaborate with hardware and SDK teams to enable efficient deployment across power- and memory-constrained environments.
• Compiler and Toolchain Development
  • Lead development of compiler toolchains that translate deep learning models onto novel in-memory computing hardware. Innovate on inference optimization for speed, power efficiency, and performance. Ensure seamless integration with mainstream ML frameworks and industry workflows.
• Embedded and Systems Software
  • Guide the design and optimization of embedded software, firmware, and drivers supporting FPGA and ASIC platforms. Ensure real-time performance, reliability, security, and scalability for AI workloads. Support system-level performance tuning across software and hardware boundaries.
• Cross-Functional Collaboration
  • Work closely with architecture, silicon design, and product teams to deliver tightly integrated solutions. Support customer engagements, demos, and early deployments as the company moves from R&D into commercialization.
• Team Building and Mentorship
  • Recruit, develop, and mentor senior engineers and technical leaders across ML, compiler, and embedded software teams. Foster a culture of innovation, execution excellence, and collaboration.
    

Requirements

• 10+ years of experience in software engineering, with leadership roles in ML systems, compilers, embedded software, or AI infrastructure
• Strong background in machine learning frameworks, model optimization, and AI inference systems
• Deep understanding of compiler design and toolchains for specialized hardware or accelerators
• Experience with embedded systems, firmware, and low-level performance optimization on FPGA or ASIC platforms
• Proven ability to build and scale high-performing technical teams
• Strong cross-functional leadership and communication skills
• Experience working with hardware teams in a deep-tech or semiconductor environment preferred

Salary Range: $200,000 - $350,000 / year

TetraMem celebrates diversity and is committed to creating an inclusive environment for all employees. We are proud to be an Equal Opportunity Employer and welcome applicants from all backgrounds. Qualified candidates will receive consideration for employment without regard to race, color, religion, creed, sex, gender identity or expression, sexual orientation, national origin, ancestry, age, marital status, medical condition, disability, genetic information, military or veteran status, or any other characteristic protected by applicable federal, state, or local law.

TetraMem is committed to providing reasonable accommodations to qualified applicants with disabilities throughout the recruitment process. Applicants requiring accommodation may contact Human Resources for assistance.