Senior AI Compiler & Runtime Architect

HTEC; California; Hybrid; USD 200,000 - 350,000; Full time

Benefits offered by this job

Medical, dental, and vision coverage

401(k) with Company match

Unlimited vacation

Paid holidays

Paid leave for personal events

Parental benefits

Employee assistance program

Job summary

HTEC Group, Inc. is seeking a Principal AI Compiler & Runtime Engineer to help shape the software foundation for next-generation AI compute platforms.

You will work on compiler technologies, AI runtimes, graph optimization, and hardware-aware execution in close collaboration with inference engineers, ML scientists, and hardware specialists. This role offers the opportunity to optimize software for emerging AI hardware, accelerate development, and influence how modern ML workloads are

Qualifications

• BSc, MSc, or PhD in Computer Science, Engineering, Mathematics, or a related discipline.
• Strong programming skills in C/C++ and/or Python in Linux environments using common development tools.
• Solid understanding of machine learning fundamentals and modern AI workloads.
• Experience applying AI technologies to software engineering, performance optimization, and hardware-aware design challenges.

Responsibilities

• Build and optimize compiler and runtime infrastructure for modern AI workloads.
• Enable efficient execution of machine learning models across GPUs, NPUs, TPUs, and custom AI accelerators.
• Apply modern AI technologies to improve software development, system optimization, and software-hardware co-design processes.
• Collaborate with inference, systems, and hardware teams to improve software-hardware co-design.
• Investigate and resolve performance bottlenecks through profiling, benchmarking, and system-level analysis.

Skills

C/C++

Python

Machine Learning

Education

BSc/MSc/PhD in CS/Engineering/Math

Tools

MLIR

LLVM

XLA

ONNX Runtime

TensorRT

Job description

HTEC Group, Inc. is seeking a Principal AI Compiler & Runtime Engineer to help shape the software foundation for next-generation AI compute platforms.

You will work on compiler technologies, AI runtimes, graph optimization, and hardware-aware execution in close collaboration with inference engineers, ML scientists, and hardware specialists. This role offers the opportunity to optimize software for emerging AI hardware, accelerate development, and influence how modern ML workloads are