Remote AI Optimization Engineer - Max Throughput & Cost

United States Digital Space LLC; United States; Remote; USD 90,000 - 110,000; Full time

Job summary

Bright Vision Technologies is seeking an AI Optimization Engineer to maximize throughput, minimize latency, and reduce cost across training and inference workloads for large neural network systems. This role spans from kernel optimization to distributed system tuning, requiring deep GPU architecture and memory management expertise.

You will collaborate with product, design, engineering, operations, and business stakeholders to translate ambiguous requirements into robust, production-grade

Qualifications

• Bachelor’s or Master’s degree in Computer Science, Computer Engineering, or a related field.
• Six or more years of experience in performance engineering, ML systems, or HPC.
• Strong proficiency in Python and C++.
• Hands-on experience optimizing deep learning workloads on modern GPUs.
• Deep understanding of distributed training and inference techniques.
• Experience with profiling tools across CPU, GPU, and distributed systems.
• Familiarity with model compression techniques and their accuracy implications.
• Strong grasp of memory hierarchies, communication primitives, and parallelism strategies.
• Excellent measurement, debugging, and analytical reasoning skills.
• Strong communication and collaboration skills.

Responsibilities

• Optimize AI workloads from kernel level to distributed system tuning.
• Measure, instrument, and optimize throughput, latency, and costs in production deployments.
• Collaborate with cross-functional teams to translate ambiguous requirements into robust solutions.
• Mentor junior engineers and contribute to design and code reviews.

Skills

Python

C++

Performance engineering

ML systems

GPU optimization

Distributed training

Profiling tools

Memory hierarchies

Debugging

Communication

Education

Bachelor’s or Master’s degree in CS/CE

Tools

Triton

CUTLASS

TensorRT-LLM

DeepSpeed

vLLM

Job description

Bright Vision Technologies is seeking an AI Optimization Engineer to maximize throughput, minimize latency, and reduce cost across training and inference workloads for large neural network systems. This role spans from kernel optimization to distributed system tuning, requiring deep GPU architecture and memory management expertise.

You will collaborate with product, design, engineering, operations, and business stakeholders to translate ambiguous requirements into robust, production-grade