Infrastructure Kernel Engineer for Scalable AI Training

Thinkingmachines; San Francisco (CA); On-site; USD 350,000 - 475,000; Full time

Benefits offered by this job

Generous health, dental, and vision benefits

Unlimited PTO

Paid parental leave

Relocation support

Job summary

Thinking Machines in San Francisco is seeking an Infrastructure Research Engineer to design and optimize ML kernels for large-scale language model training. The ideal candidate will collaborate with research teams to improve performance and efficiency across advanced AI systems.

With a Bachelor's degree in a relevant field, you will utilize your strong engineering skills in a highly collaborative environment. The role offers a competitive compensation range and excellent benefits, encouraging individuals with a passion for AI technology.

Qualifications

• Bachelor’s degree or equivalent in computer science, electrical engineering, or similar.
• Strong engineering skills for performant code and debugging.
• Understanding of deep learning frameworks like PyTorch or JAX.

Responsibilities

• Design and implement custom ML kernels for large-scale language models.
• Reduce memory bandwidth bottlenecks in kernel compute efficiency.
• Develop and maintain performance benchmarks for internal model training.

Skills

CUDA

CuTe

Triton

Deep learning frameworks (e.g., PyTorch, JAX)

Performance optimization

Collaborative environment

Education

Bachelor’s degree in computer science or equivalent

Tools

ML kernels

GPUs

Job description

Thinking Machines in San Francisco is seeking an Infrastructure Research Engineer to design and optimize ML kernels for large-scale language model training. The ideal candidate will collaborate with research teams to improve performance and efficiency across advanced AI systems.

With a Bachelor's degree in a relevant field, you will utilize your strong engineering skills in a highly collaborative environment. The role offers a competitive compensation range and excellent benefits, encouraging individuals with a passion for AI technology.