Machine Learning Engineer (Remote)

7Seventy Recruiting

United States

On-site

USD 150,000 - 190,000

Full time

31 hours ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

7Seventy Recruiting seeks a Machine Learning Engineer focused on Kernels to design and optimize custom GPU kernels for high-performance AI workloads. You will work on low-level implementations to boost computational efficiency across distributed environments.

The role involves C++, CUDA, performance profiling, and hardware-aware optimization, collaborating with researchers to translate ML advances into production-ready software for scalable systems.

Qualifications

  • 2+ years of GPU programming, parallel computing, or systems-level optimization.
  • Experience optimizing workloads for distributed and heterogeneous environments.
  • Familiarity with low-level backends and performance diagnostics.

Responsibilities

  • Design, implement, and optimize custom GPU/accelerator kernels for ML workloads.
  • Profile and benchmark ML workloads to identify bottlenecks and apply low-level optimizations.
  • Collaborate with ML researchers to translate algorithms into production-ready code.
  • Evaluate accelerator hardware and technologies (CUDA, ROCm, TPUs) to guide kernel design.
  • Document optimization techniques and share best practices with teams.

Skills

C++
CUDA
Parallel computing
Performance profiling
Hardware acceleration
Distributed computing

Education

Bachelor's degree
Master's degree
Ph.D. or equivalent

Tools

CUDA toolkit
ROCm
TPUs

Job description

Experience: 2+ years in GPU programming, parallel computing, or systems-level optimization

Core Areas: GPU Kernel Development, Machine Learning Workload Optimization, CUDA, C++, Parallel Computing, Performance Profiling, Hardware Acceleration, Distributed Computing

Compensation: $150,000 – $190,000 per year

About the Role

This opportunity is for a Machine Learning Engineer - Kernels specializing in custom GPU and accelerator kernel development for high-performance AI and machine learning workloads. The role focuses on designing efficient low-level implementations, optimizing computational performance, and translating advances in machine learning algorithms into reliable, production-ready code.

The position combines GPU programming, parallel computing, hardware-aware optimization, and machine learning infrastructure. Work involves C++, CUDA, performance profiling, benchmarking, and optimization across distributed and heterogeneous computing environments. The engineer will collaborate with researchers, evaluate hardware developments involving CUDA, ROCm, and TPUs, and contribute to engineering practices that improve computational efficiency for advanced AI workloads.

What You'll Do
  • Design, develop, and implement custom GPU and accelerator kernels to maximize computational performance for machine learning workloads.
  • Profile and benchmark performance-critical ML workloads, identify computational bottlenecks, and implement low-level optimizations to improve execution efficiency.
  • Collaborate with machine learning researchers to translate algorithmic advances into efficient, production-ready software implementations.
  • Evaluate developments in accelerator hardware and programming technologies, including CUDA, ROCm, and TPUs, to guide kernel design and optimization decisions.
  • Document low-level optimization techniques and share performance engineering best practices with technical teams.
Qualifications
Required Experience
  • At least 2 years of professional experience in GPU programming, parallel computing, or systems-level performance optimization.
  • Experience optimizing computational workloads for distributed and heterogeneous computing environments.
Required Skills
  • Strong programming skills in C++, CUDA, or comparable low-level programming languages used for performance-intensive computing.
  • Familiarity with machine learning frameworks and their low-level computational backends.
  • Ability to use profiling tools and performance diagnostics to investigate execution behavior and identify optimization opportunities.
  • Strong understanding of performance-oriented programming and the interaction between algorithms and hardware.
  • Detail-oriented approach to engineering, with a strong focus on computational efficiency and performance optimization.
  • Ability to collaborate effectively on research-driven engineering challenges and contribute to technically ambitious development work.
Education
  • Bachelor's, Master's, or Ph.D. degree in Computer Science, Electrical Engineering, or a related field, or equivalent practical experience.
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Machine Learning Engineer - Kernels
Machine Learning Engineer - Kernels

7Seventy • Northern (KY)

On-site
USD 150,000 - 190,000
CUDA Engineer - Kernel Optimization - AI Trainer
CUDA Engineer - Kernel Optimization - AI Trainer

Mercor • Chicago (IL)

On-site
USD 83,000 - 165,000
Machine Learning Engineer — GPU Kernel
Machine Learning Engineer — GPU Kernel

Institute of Foundation Models • Sunnyvale (CA)

On-site
USD 150,000 - 450,000
Comprehensive medical, dental, and视觉 V
Bonus
401K Plan
+4
Software Engineer - GPU Kernel
Software Engineer - GPU Kernel

FriendliAI • San Francisco (CA)

On-site
USD 120,000 - 150,000
Flexible working hours
Daily lunch and dinner
Health check-up support
+3
GPU Kernel Engineer: High-Performance ML & CUDA
GPU Kernel Engineer: High-Performance ML & CUDA

7Seventy Recruiting • United States

On-site
USD 150,000 - 190,000
CUDA Engineer - Kernel Optimization
CUDA Engineer - Kernel Optimization

Mercor • San Francisco (CA)

On-site
USD 165,000 - 276,000
GPU Kernel Engineer — High-Performance ML & Acceleration
GPU Kernel Engineer — High-Performance ML & Acceleration

7Seventy • Northern (KY)

On-site
USD 150,000 - 190,000
KERNEL ENGINEER
KERNEL ENGINEER

MakerMaker • San Francisco (CA)

On-site
USD 180,000 - 240,000
GPU Kernel Engineer — High-Performance ML at Scale
GPU Kernel Engineer — High-Performance ML at Scale

The Consensus • San Francisco (CA)

On-site
USD 120,000 - 160,000
Competitive compensation with equity
100% medical, dental, and vision insurance coverage
Flexible PTO policy including a Winter Break
+2
GPU Kernel Developer - Fully Remote | Upto $90/hr
GPU Kernel Developer - Fully Remote | Upto $90/hr

mercor • United States

Remote
USD 96,000 - 124,000