Senior AI Performance Engineer - Remote

Bright Vision Technologies; Monroeville (Allegheny County); Remote; USD 100,000 - 150,000; Full time

Benefits offered by this job

Remote work

Equal opportunity employer

Job summary

Bright Vision Technologies is seeking an AI Performance Engineer to join our remote U.S. team. You will profile and optimize end-to-end AI training and inference pipelines to maximize throughput, minimize latency, and reduce cost across data loading, compute, and memory.

The role requires 10+ years of experience in performance engineering and deep learning workloads on GPUs, with strong Python/C++ skills and a track record in distributed training and inference optimizations.

Qualifications

• Bachelor’s or Master’s degree in CS/CE or related field.
• 10+ years of experience in performance engineering, ML systems, or HPC.
• Strong proficiency in Python and C++.
• Hands‑on experience optimizing deep learning workloads on modern GPUs.
• Deep understanding of distributed training and inference techniques.
• Experience with profiling tools across CPU, GPU, and distributed systems.
• Familiarity with model compression techniques and their accuracy implications.
• Strong grasp of memory hierarchies, communication primitives, and parallelism strategies.
• Excellent measurement, debugging, and analytical reasoning skills.
• Strong communication and collaboration skills.

Responsibilities

• Profile and optimize end-to-end AI training and inference pipelines for throughput, latency, and cost.
• Identify and eliminate bottlenecks across data loading, model compute, communication, and memory.
• Tune quantization, sparsity, and pruning to reduce footprint and accelerate inference.
• Optimize distributed training using tensor parallelism, pipeline parallelism, FSDP, and ZeRO-style sharding.
• Tune attention implementations using FlashAttention and related techniques.
• Implement KV cache optimization, continuous batching, and speculative decoding for LLM serving.
• Drive compiler-level optimizations using Triton, XLA, TorchInductor, or TVM.
• Evaluate new hardware and software offerings and advise on adoption.
• Document performance tuning playbooks and share findings broadly.
• Stay current with AI systems research and translate advances into production improvements.

Skills

Python

C++

Performance engineering

ML systems

GPU optimization

Education

Bachelor’s or Master’s degree in Computer Science/Engineering

Tools

Triton

XLA

TorchInductor

TVM

TensorRT

Job description

Bright Vision Technologies is seeking an AI Performance Engineer to join our remote U.S. team. You will profile and optimize end-to-end AI training and inference pipelines to maximize throughput, minimize latency, and reduce cost across data loading, compute, and memory.

The role requires 10+ years of experience in performance engineering and deep learning workloads on GPUs, with strong Python/C++ skills and a track record in distributed training and inference optimizations.