Senior AI Inference Performance Engineer (Remote)

DigitalOcean; San Francisco (CA); Remote; USD 167,200 - 209,000; Full time

Benefits offered by this job

Competitive salary

Flexible time off policy

Employee Assistance Program

Reimbursement for conferences and education

Access to LinkedIn Learning courses

Job summary

A leading cloud infrastructure company is seeking a Senior Engineer 2 to join their AI Inference Optimization team. The role involves leading the technical strategy for performance architecture and addressing complex performance issues ensuring industry-leading service. Successful candidates will have over 5 years of experience in high-performance computing and a strong understanding of GPU architectures. The position offers a competitive salary range along with remote work flexibility and numerous professional development benefits.

Qualifications

• 5+ years of experience in high-performance computing or AI infrastructure.
• Familiar with Gen AI (LLM, VLM, LMM) models and their requirements.
• Hands-on experience with performance optimizations in distributed GPU environments.
• Keen understanding of memory bandwidth and compute utilization bottlenecks.

Responsibilities

• Lead technical strategy for performance optimizations in inference engine.
• Engineer solutions for complex performance issues related to deep learning.
• Implement cutting-edge optimization techniques for AI models.
• Advise on hardware procurement and software integration for GPU.
• Mentor team through code reviews and design processes.
• Collaborate with Product Management to translate hardware limits into features.
• Maintain presence in AI and GPU optimization communities.

Skills

High-performance computing

AI infrastructure

Attention-layer optimizations

Parallelization strategies

NVIDIA GPU architecture

AMD GPU architecture

Open-source software

System design

Tools

CUDA

ROCm

TensorRT

OpenAI Triton

Job description

A leading cloud infrastructure company is seeking a Senior Engineer 2 to join their AI Inference Optimization team. The role involves leading the technical strategy for performance architecture and addressing complex performance issues ensuring industry-leading service. Successful candidates will have over 5 years of experience in high-performance computing and a strong understanding of GPU architectures. The position offers a competitive salary range along with remote work flexibility and numerous professional development benefits.