AI Kernel Engineer

Quadric Inc.; Burlingame (CA); Hybrid; USD 110,000 - 270,000; Full time

Benefits offered by this job

Competitive salary

Equity

Health, dental, and vision

401(k) retirement plan

Unlimited PTO

In-office lunches

Caltrain access

Parking support

Downtown Burlingame office

Collaborative environment

Job summary

Quadric in Burlingame, CA is seeking an AI Kernel Engineer to enable a broad set of AI/LLM kernels to run efficiently on our platform. The role combines software and hardware optimization, kernel library development, and performance tuning for diverse hardware.

You will collaborate closely with the hardware and software teams in a hybrid office setting, with regular in-person days, code reviews, and onsite/offsite planning to align priorities and deliver impactful edge computing solutions.

Qualifications

• 5+ years of experience in AI kernel development and optimization.
• Experience with model and kernel inference performance profiling.
• Experience with CUDA, DSP, NEON or Triton-lang.
• Proficiency in C/C++ and Python; assembly language is a plus.
• Strong problem solving, debugging and communication skills.

Responsibilities

• Develop AI/LLM kernels/operators on Quadric platform for efficient inference
• Optimize the kernel performance for different hardware configurations and workloads
• Profile and analyze kernel performance in terms of compute, data and parallelism; identify micro-architecture and software bottlenecks and provide optimization solutions
• Optimize kernel C/C++ codes, maximize hardware utilization
• Collaborate across related areas of the AI inference stack to support team and business priorities
• Make Improvement to Quadric toolchain, compiler and runtime
• Provide technical support and documents to customers and developer community

Skills

AI kernel

Kernel optimization

Performance profiling

CUDA

DSP

NEON

Triton-lang

C/C++

Python

Debugging

Communication

Education

Bachelor's or Master’s in Computer Science and/or Electrical Engineering

Job description

Quadric has created an innovative general purpose neural processing unit (GPNPU) architecture. Quadric's co-optimized software and hardware is targeted to run neural network (NN) inference workloads in a wide variety of edge and endpoint devices, ranging from battery operated smart-sensor systems to high-performance automotive or autonomous vehicle systems. Unlike other NPUs or neural network accelerators in the industry today that can only accelerate a portion of a machine learning graph, the Quadric GPNPU executes both NN graph code and conventional C++ DSP and control code.

Role

The AI Kernel Engineer in Quadric plays the key role to enable a large number of AI kernels/operators to run efficiently on the Quadric platform. The AI Kernel Engineer at Quadric will [1] develop a highly efficient Quadric kernel library for a variety of AI/LLM models; [2] analyze the performance and optimize the kernel for different hardware configurations; This senior technical role demands deep knowledge of hardware architecture, compiler toolchain and optimization techniques.

Our preference is for a candidate located in the California Bay Area who can regularly collaborate from our Burlingame office. This role follows a hybrid schedule with at least two in-office days per week expected, but actual schedule may adjust depending on team and business need. We believe strong technical collaboration, rapid iteration, and shared problem-solving are well supported by working together in person. The team and company also gather periodically for onsite meetings and offsite events to connect, collaborate, and align on priorities.

Responsibilities

• Develop AI/LLM kernels/operators on Quadric platform for efficient inference
• Optimize the kernel performance for different hardware configurations and workloads
• Profile and analyze kernel performance in terms of compute, data and parallelism; identify micro-architecture and software bottlenecks and provide optimization solutions
• Optimize kernel C/C++ codes, maximize hardware utilization
• Collaborate across related areas of the AI inference stack to support team and business priorities
• Make Improvement to Quadric toolchain, compiler and runtime
• Provide technical support and documents to customers and developer community

• Bachelor’s or Master’s in Computer Science and/or Electric Engineering
• 5+ years of experience in AI kernel development and optimization
• experience with model and kernel inference performance profiling
• experience with at least one of the following compute development: CUDA, DSP, NEON, Triton-lang
• Proficiency in C/C++ and Python, experience with assembly language a plus
• Demonstrate good capability in problem solving, debug and communication

At Quadric, we value Integrity, Humility, and Happiness. What we expect from one another is simple and clear: Initiative, Collaboration, and Completion. We are a collaborative team focused on building something extraordinary in the edge computing space.

• Competitive salary and meaningful equity
• Medical, dental, and vision plan options starting on day one
• 401(k) retirement plan
• Flexible paid time off (unlimited, non-accrual) to support work-life balance
• When working in-office, enjoy company-provided lunches and a stocked kitchen
• Convenient office location within walking distance of the Caltrain station
• Support for commuting, including monthly parking or Caltrain passes
• Downtown Burlingame office location, close to shops, cafes, and local amenities
• A politics-free, highly collaborative environment where talented people can do their best work and make an immediate impact
• The opportunity to build long-term career relationships in a company that values strong personal connections alongside professional excellence

The base salary range for this position is $110,000 to $270,000. This range reflects the full span of levels and geographies at which Quadric hires for this role. The actual base salary offered will depend on a number of factors, including the specific level of the role, years and depth of relevant experience, technical skills and competencies, the criticality of the role to the business, internal equity, and work location. In addition to base salary, this role is eligible for equity and a discretionary annual performance bonus as applicable to the role and level.

Quadric also offers the generous benefits package outlined above and other programs designed to support your health and wellbeing.

Founded in 2016 and based in downtown Burlingame, California, Quadric is building the world’s first supercomputer designed for the real-time needs of edge devices. Quadric aims to empower developers in every industry with superpowers to create tomorrow’s technology, today. The company was co-founded by technologists from MIT and Carnegie Mellon, who were previously the technical co-founders of the Bitcoin computing company 21.

Quadric is proud to be an equal opportunity employer. We are committed to creating an inclusive environment where people from all backgrounds can do their best work. We consider all qualified applicants without regard to race, color, religion, sex, gender identity or expression, sexual orientation, national origin, age, disability, veteran status, or any other protected characteristic under applicable law.

By submitting an application, you acknowledge that Quadric will collect and process your personal information as part of the hiring process. Please review our Privacy Policy to understand how we handle your data.