Software Engineer - Compiler

CentML; United States; Remote; USD 80,000 - 100,000; Full time

Job summary

Join a forward-thinking company dedicated to democratizing AI through innovative compiler technology. As a compiler engineer, you will develop high-performance GPU kernels and collaborate with teams to enhance AI programmability and performance. This role offers the chance to work with cutting-edge technologies and contribute to the evolution of machine learning systems. With a focus on inclusivity and professional development, this opportunity promises a dynamic work environment where your skills can shine. If you are passionate about AI and eager to make a significant impact, this is the perfect role for you.

Benefits

Employee stock options

Best-in-class medical and dental benefits

Parental Leave top-up for 6 months

Professional development budget

Flexible vacation time

Qualifications

• 2+ years of experience in compiler development or GPGPU programming.
• Strong coding skills in Python, C++, CUDA, or OpenCL.

Responsibilities

• Develop high-performance GPU kernels using the Hidet compiler.
• Implement compiler optimizations for AI workloads on GPU and CPU.

Skills

Python

C++

CUDA

OpenCL

Compiler Development

GPGPU Programming

Performance Engineering

Algorithms and Data Structures

Operating Systems

Computer Architecture

Education

Bachelor's Degree in Computer Science

Master's Degree in Computer Science

Tools

Hidet Compiler

PyTorch

JAX

TensorFlow

TVM

IREE

XLA

MLIR

LLVM

Job description

About Us

We believe AI will fundamentally transform how people live and work. CentML's mission is to massively reduce the cost of developing and deploying ML models so we can enable anyone to harness the power of AI and everyone to benefit from its potential.

Our founding team is made up of experts in AI, compilers, and ML hardware and has led efforts at companies like Amazon, Google, Microsoft Research, Nvidia, Intel, Qualcomm, and IBM. Our co-founder and CEO, Gennady Pekhimenko, is a world-renowned expert in ML systems who holds multiple academic and industry research awards from Google, Amazon, Facebook, and VMware.

Overview:

We are seeking highly motivated and skilled compiler engineers to join our team in developing a state-of-the-art compiler for machine learning systems. Are you interested in pushing the frontier of AI programmability and performance? Do you like building kernels and tools that make programs run with the speed of light? As a compiler engineer, you will play a critical role in developing high-performance GPU kernels using the Hidet compiler, extending the compiler with new capabilities, and deploying it in collaboration with peer teams to accelerate LLM inference and training.

Join our team, and help us in our mission to democratize AI for the world!

Responsibilities:

1. Write modular, high-quality code for the Hidet compiler in Python/C++.
2. Implement new and classical compiler optimizations to accelerate the performance of AI workloads on GPU and CPU.
3. Build highly efficient GPU kernels using Hidet Python-based DSL.
4. Write tests and benchmarks to validate and evaluate our solutions.
5. Collaborate with peer teams to deploy the compiler in inference and training systems.

Who you are:

1. Bachelor’s or higher degree in Computer Science or related technical field.
2. Strong coding skills in Python, C++, CUDA, or OpenCL.
3. Excellent communication skills and the ability to work in a team.
4. 2+ years of industry or academic experience in compiler development, GPGPU programming, or performance engineering.
5. Experience or interest in accelerating AI workloads.
6. Solid fundamentals in other computer science and computer engineering topics: algorithms and data structures, operating systems, computer architecture, etc.

You will stand out from the crowd if you have:

1. Experience with ML systems, such as PyTorch, JAX, or TensorFlow.
2. Experience with ML compilers, such as TVM, IREE, XLA, pytorch.compile, etc.
3. Experience developing high-performance kernels for NVIDIA or AMD GPUs.
4. Experience with AI accelerator hardware.
5. Experience with MLIR or LLVM.
6. Contributions to open-source projects.
7. Strong publication record in ML, HPC, compiler or computer system conferences.

Benefits & Perks

1. An open and inclusive work environment.
2. Employee stock options.
3. Best-in-class medical and dental benefits.
4. Parental Leave top-up for 6 months.
5. Professional development budget.
6. Flexible vacation time to promote a healthy work-life blend.

We are an equal opportunity employer and value diversity at our company. We do not discriminate on the basis of race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, disability, and any other protected ground of discrimination under applicable human rights legislation.

CentML strives to respect the dignity and independence of people with disabilities and is committed to giving them the same opportunity to succeed as all other employees.

Inclusiveness is core to our culture at CentML, and we strive to ensure you get the most from your interview experience. CentML makes reasonable accommodations for applicants with disabilities. If a reasonable accommodation is needed to participate in the job application or interview process, please reach out to the Talent team.