Model Optimization Engineer

Bright Vision Technologies; United States; Remote; USD 150,000 - 175,000; Full time

Job summary

Bright Vision Technologies is seeking a Model Optimization Engineer to maximize throughput, minimize latency, and reduce cost across training and inference for large neural network systems. You will optimize from kernel-level code to distributed systems, working with GPU architectures, model parallelism, memory management, and compiler-level techniques.

The role requires 6+ years in performance engineering, deep learning workloads on GPUs, and strong Python/C++.

Qualifications

• Bachelor’s or Master’s degree in Computer Science, Computer Engineering, or a related field.
• Six+ years of experience in performance engineering, ML systems, or HPC.
• Strong proficiency in Python and C++.
• Hands-on experience optimizing deep learning workloads on modern GPUs.
• Deep understanding of distributed training and inference techniques.
• Experience with profiling tools across CPU, GPU, and distributed systems.
• Familiarity with model compression techniques and their accuracy implications.
• Strong grasp of memory hierarchies, communication primitives, and parallelism strategies.
• Excellent measurement, debugging, and analytical reasoning skills.
• Strong communication and collaboration skills.

Responsibilities

• Optimize throughput, latency, and cost across training and inference workloads for large neural networks.
• Span the full stack from low-level kernel optimization to distributed system tuning.
• Work with cross-functional teams to translate requirements into engineered solutions.
• Mentor junior engineers and contribute to design and code reviews.

Skills

Python

C++

Performance engineering

GPU optimization

Distributed systems

Profiling tools

Education

Bachelor’s or Master’s degree in Computer Science or Computer Engineering

Tools

Triton

CUTLASS

TensorRT

Job description

Bright Vision Technologies is a technology consulting and software development company delivering cloud, AI, data, and enterprise solutions across the United States.

This is a fantastic opportunity to join an established and well-respected organization offering tremendous career growth potential.

Job Title: Model Optimization Engineer
Location: 100% Remote (U.S.)
Position Type: Full-time, Direct W2
Salary Range: $150,000–$175,000 Annually
Experience Required: 6+ years

Sponsorship: U.S. Citizens, Green Card Holders, EAD Holders, and H-1B transfer candidates are encouraged to apply. We are unable to sponsor new H-1B visa petitions for this position.

Job Summary:
We are seeking an Model Optimization Engineer to focus on extracting maximum throughput, minimizing latency, and reducing cost across training and inference workloads for large neural network systems. The role spans the full stack from low-level kernel optimization to distributed system tuning, requiring deep understanding of GPU architecture, model parallelism, memory management, and compiler-level optimization. The ideal candidate has demonstrated impact on production AI workloads, with strong instrumentation and measurement discipline that enables rigorous, data-driven optimization decisions. In this role you will work closely with cross-functional partners — product, design, engineering, operations, and business stakeholders — to translate ambiguous requirements into well-engineered solutions, and will be expected to raise the bar through code review, design review, and mentorship of more junior engineers. The successful candidate brings strong engineering discipline, a clear communication style, and a track record of shipping meaningful work that holds up well in production.

Required Qualifications

• Bachelor’s or Master’s degree in Computer Science, Computer Engineering, or a related field.
• Six or more years of experience in performance engineering, ML systems, or HPC.
• Strong proficiency in Python and C++.
• Hands-on experience optimizing deep learning workloads on modern GPUs.
• Deep understanding of distributed training and inference techniques.
• Experience with profiling tools across CPU, GPU, and distributed systems.
• Familiarity with model compression techniques and their accuracy implications.
• Strong grasp of memory hierarchies, communication primitives, and parallelism strategies.
• Excellent measurement, debugging, and analytical reasoning skills.
• Strong communication and collaboration skills.

Preferred Qualifications

• Experience optimizing LLM inference at production scale.
• Contributions to vLLM, TensorRT-LLM, DeepSpeed, or similar projects.
• Familiarity with custom kernel authoring in Triton or CUTLASS.
• Experience with FinOps for AI workloads.
• Publications or talks on AI systems performance.

Bright Vision Technologies is an Equal Opportunity Employer.

Equal Employment Opportunity (EEO) Statement

Bright Vision Technologies (BV Teck) is committed to equal employment opportunity (EEO) for all employees and applicants without regard to race, color, religion, sex, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, veteran status, or any other protected status as defined by applicable federal, state, or local laws. This commitment extends to all aspects of employment, including recruitment, hiring, training, compensation, promotion, transfer, leaves of absence, termination, layoffs, and recall.

BV Teck expressly prohibits any form of workplace harassment or discrimination. Any improper interference with employees’ ability to perform their job duties may result in disciplinary action up to and including termination of employment.