LLM/VLM Inference Optimization Engineer

ByteDance; Seattle (WA); On-site; USD 232,560 - 427,500; Full time

Benefits offered by this job

Medical, dental, and vision insurance

401(k) savings plan with company match

Paid parental leave

Generous paid holidays and sick days

Job summary

ByteDance is seeking a Research Engineer - LLM/VLM Inference Optimization in Seattle. The role involves designing and optimizing high-performance inference systems for large-scale LLMs and VLMs, requiring expertise in C/C++ and Python, and familiarity with GPU optimization techniques.

Ideal candidates will have a Bachelor's degree in Computer Science or related fields and experience in production-level inference systems. Benefits include competitive salaries, comprehensive health insurance, and generous paid time off.

Qualifications

• Bachelor's degree or above in Computer Science, Electrical Engineering, or related.
• Strong proficiency in C/C++ and Python.
• Experience deploying LLM/VLM inference at production scale.
• Familiarity with GPU architecture.
• Experience with performance optimization.

Responsibilities

• Design and optimize high-performance inference systems for large-scale LLMs and VLMs.
• Build model inference engines using advanced optimization techniques.
• Collaborate with research teams to identify performance issues.

Skills

C/C++ programming

Python

Algorithms and data structures

Machine learning frameworks (e.g., PyTorch, TensorFlow)

GPU architecture optimization

Education

Bachelor's degree in Computer Science or related field

Tools

CUDA

TensorRT

Triton

Job description

ByteDance is seeking a Research Engineer - LLM/VLM Inference Optimization in Seattle. The role involves designing and optimizing high-performance inference systems for large-scale LLMs and VLMs, requiring expertise in C/C++ and Python, and familiarity with GPU optimization techniques.

Ideal candidates will have a Bachelor's degree in Computer Science or related fields and experience in production-level inference systems. Benefits include competitive salaries, comprehensive health insurance, and generous paid time off.