Senior GPU Codegen Engineer for ML Inference (Remote)

Ladders; United States; Remote; USD 152,000 - 288,000; Full time

Benefits offered by this job

Leading engineers

Generative AI inference

Collaborative environment

Job summary

The Ladders seeks a Senior Software Engineer specializing in GPU code generation for ML inference. You will design and optimize compiler/runtime techniques with hardware and AI specialists to improve speed, correctness, and scalability.

This remote role emphasizes strong C++ and Python development for tooling and performance analysis, profiling workloads, and contributing to cutting-edge generative AI inference workloads.

Qualifications

• BS, MS, or PhD in CS/CE or related, or equivalent experience.
• 4+ years of relevant software development experience
• Strong proficiency in C++
• Understanding of GPU architecture and parallel programming concepts
• Rigorous approach to performance analysis and debugging with a focus on numerical correctness
• Strong problem-solving and communication skills, with the ability to work independently and collaboratively

Responsibilities

• Design and implement efficient GPU code generation techniques for machine learning inference
• Develop compiler optimizations such as operator fusion and dynamic scheduling
• Profile workloads and analyze GPU code to identify bottlenecks
• Develop maintainable software in C++ and Python for tooling and performance analysis
• Collaborate with GPU architects and deep learning experts to guide design

Skills

C++ proficiency

GPU architecture knowledge

Performance analysis

Communication

Independent work

Python

Education

BS/MS/PhD in CS/CE or related

Job description

The Ladders seeks a Senior Software Engineer specializing in GPU code generation for ML inference. You will design and optimize compiler/runtime techniques with hardware and AI specialists to improve speed, correctness, and scalability.

This remote role emphasizes strong C++ and Python development for tooling and performance analysis, profiling workloads, and contributing to cutting-edge generative AI inference workloads.