Edge AI Systems Engineer - Lightweight ML & Embedded

TetraMem Inc.; San Jose (CA); Hybrid; USD 110,000 - 250,000; Full time

Job summary

TetraMem Inc. in San Jose, CA is hiring a senior ML engineer to develop, optimize, and deploy lightweight ML models for edge AI, with a focus on audio processing. You will work across hardware and software teams to productionize models on embedded platforms.

The role emphasizes research into efficient inference, model compression, and state-of-the-art techniques. You will mentor junior engineers, publish findings when applicable, and collaborate to advance the overall system architecture in a

Qualifications

• 5+ years of experience or PhD in Computer Science, Electrical Engineering, or related fields.
• Strong experience in machine learning, with a focus on edge AI and lightweight model deployment.
• Expertise in ML frameworks such as PyTorch, TensorFlow, JAX.
• Understanding of ML compiler and runtime design.
• Experience with Optimum, ONNX, TensorRT, TFLite/LiteRT, ncnn, or CoreML.
• Familiarity with hardware acceleration techniques.
• Experience in embedded system development.

Responsibilities

• Develop, optimize, and deploy lightweight ML models for edge AI applications, particularly for audio processing.
• Implement and optimize ML models on embedded platforms, including FPGA and custom ASIC solutions.
• Work closely with hardware and software teams to integrate ML models into production systems.
• Research and implement state-of-the-art ML techniques to enhance model efficiency, latency, and power consumption for embedded AI applications.
• Improve inference efficiency and model compression techniques, including quantization, pruning, and knowledge distillation.
• Collaborate with cross-functional teams to drive innovation and contribute to the overall system architecture.
• Provide technical leadership and mentorship to junior engineers.
• Publish research findings, present at conferences, and contribute to open-source projects when applicable.

Skills

Edge AI

ML model optimization

PyTorch

TensorFlow

C/C++

Python

Education

PhD in Computer Science or Electrical Engineering

5+ years experience in ML/edge AI

Tools

ONNX

TensorRT

TFLite/LiteRT

ncnn

Job description

TetraMem Inc. in San Jose, CA is hiring a senior ML engineer to develop, optimize, and deploy lightweight ML models for edge AI, with a focus on audio processing. You will work across hardware and software teams to productionize models on embedded platforms.

The role emphasizes research into efficient inference, model compression, and state-of-the-art techniques. You will mentor junior engineers, publish findings when applicable, and collaborate to advance the overall system architecture in a