Remote Model Optimization Engineer — AI Performance

Bright Vision Technologies; United States; Remote; USD 150,000 - 175,000; Full time

Job summary

Bright Vision Technologies is seeking a Model Optimization Engineer to maximize throughput, minimize latency, and reduce cost across training and inference workloads for large neural network systems.

The role spans the full stack from low-level kernel optimization to distributed system tuning, requiring deep understanding of GPU architecture, model parallelism, memory management, and compiler-level optimization.

Qualifications

• Bachelor’s or Master’s degree in CS/CE or related field.
• 6+ years in performance engineering, ML systems, or HPC.
• Proficiency in Python and C++.
• Experience optimizing DL workloads on GPUs.
• Strong profiling across CPU/GPU/distributed systems.
• Excellent measurement and debugging skills.
• Strong communication and collaboration.

Responsibilities

• Optimize throughput, reduce latency, and cut costs for training and inference of large neural networks.
• Span kernel optimization to distributed system tuning for production AI workloads.
• Collaborate with product, design, engineering, operations, and business stakeholders to translate requirements into robust solutions.
• Mentor junior engineers and participate in code reviews and design reviews.

Skills

Python

C++

Performance engineering

ML systems

HPC

Distributed training

Profiling tools

Memory hierarchies

Debugging

Communication

Education

Bachelor's or Master’s in CS/CE

Tools

Triton

CUTLASS

TensorRT-LLM

DeepSpeed

vLLM

Job description

Bright Vision Technologies is seeking a Model Optimization Engineer to maximize throughput, minimize latency, and reduce cost across training and inference workloads for large neural network systems.

The role spans the full stack from low-level kernel optimization to distributed system tuning, requiring deep understanding of GPU architecture, model parallelism, memory management, and compiler-level optimization.