Senior AI Systems Performance Engineer (Remote)

Bright Vision Technologies; Huntersville (NC); On-site; USD 130,000 - 180,000; Full time

Benefits offered by this job

Remote work

Job summary

Bright Vision Technologies is seeking a highly experienced AI Systems Performance Specialist with 10+ years in AI infrastructure, machine learning systems, High-Performance Computing (HPC), and performance engineering. The ideal candidate will optimize AI training and inference workloads for maximum performance, scalability, reliability, and cost efficiency.

This role requires deep expertise in GPU optimization, distributed training, LLM inference, Python, C++, CUDA, and production AI systems.

Qualifications

• Bachelor's or Master's degree in Computer Science, Computer Engineering, Electrical Engineering, AI, or related field.
• 10+ years of professional experience in performance engineering, AI infra, HPC, or distributed computing.
• Expert-level Python and C++ programming.
• Experience optimizing GPU-accelerated AI workloads with CUDA and distributed training frameworks.
• Strong knowledge of LLMs, deep learning frameworks, model serving, and production AI inference.

Responsibilities

• Optimize AI training and inference pipelines for throughput, latency, scalability, and efficiency.
• Analyze and improve GPU utilization, memory, kernel execution, and multi-GPU performance.
• Design and implement optimization techniques (quantization, pruning, mixed precision, batching, caching, speculative decoding, model parallelism).
• Profile AI applications with industry tools and identify bottlenecks across compute, memory, networking, and storage.
• Optimize distributed training and inference using NCCL, DeepSpeed, PyTorch Distributed, Ray, MPI, or similar frameworks.
• Collaborate with researchers, ML engineers, platform engineers, and infra teams to improve model performance and reliability.
• Build automated benchmarking frameworks, performance dashboards, monitoring solutions, and regression tests.
• Evaluate emerging AI hardware and optimization technologies to enhance enterprise AI capabilities.
• Drive AI infra cost optimization through cloud optimization and FinOps best practices.
• Mentor engineering teams and provide technical leadership on AI systems architecture and GPU optimization.

Skills

Python

C++

GPU optimization

Distributed training

LLMs

Education

Bachelor's or Master's in CS/CE/AI

Tools

NVIDIA Nsight Systems

Nsight Compute

PyTorch Profiler

TensorBoard

CUDA toolkit

DeepSpeed

Job description

Bright Vision Technologies is seeking a highly experienced AI Systems Performance Specialist with 10+ years in AI infrastructure, machine learning systems, High-Performance Computing (HPC), and performance engineering. The ideal candidate will optimize AI training and inference workloads for maximum performance, scalability, reliability, and cost efficiency.

This role requires deep expertise in GPU optimization, distributed training, LLM inference, Python, C++, CUDA, and production AI systems.