Senior LLM Engineer — Remote, Production-Ready AI

Bright Vision Technologies; Monroeville (Allegheny County); Remote; USD 100,000 - 150,000; Full time

Job summary

Bright Vision Technologies is seeking an LLM Engineer to design, execute, and operationalize fine-tuning workflows for large language models across supervised, preference-based, and RL methods. You will build scalable training pipelines, curate datasets, and ensure rigorous evaluation while balancing data quality, compute, and shipping velocity.

The role requires deep ML experience, production-grade engineering, and strong collaboration with product, design, and operations teams.

Qualifications

• Master’s or PhD in Computer Science, ML, or related field, or equivalent experience.
• Six+ years of combined ML research and engineering experience with substantial LLM exposure.
• Strong proficiency in Python and modern deep learning frameworks, especially PyTorch.
• Hands-on experience fine-tuning transformer-based language models at non-trivial scale.
• Familiarity with distributed training strategies including FSDP, ZeRO, and pipeline parallelism.
• Experience with RLHF, DPO, or other preference optimization techniques.
• Strong understanding of evaluation methodology, benchmarks, and human evaluation design.
• Experience operating training jobs on GPU clusters and recovery from failures.

Responsibilities

• Design and execute fine-tuning experiments for LLMs using supervised, DPO, RLHF, and related techniques.
• Lead dataset construction, curation, and QA for instruction tuning and preference data.
• Build scalable training pipelines on modern distributed training frameworks.
• Tune hyperparameters, optimizer configs, and stability strategies for large-model fine-tuning.
• Implement parameter-efficient fine-tuning techniques such as LoRA, QLoRA, adapters.
• Design rigorous evaluation suites including automated benchmarks and human evaluation.

Skills

Python

PyTorch

LLM training

Distributed training

RLHF/DPO

Dataset construction

Education

Master’s or PhD in CS/ML

Tools

FSDP

ZeRO

LoRA

Job description

Bright Vision Technologies is seeking an LLM Engineer to design, execute, and operationalize fine-tuning workflows for large language models across supervised, preference-based, and RL methods. You will build scalable training pipelines, curate datasets, and ensure rigorous evaluation while balancing data quality, compute, and shipping velocity.

The role requires deep ML experience, production-grade engineering, and strong collaboration with product, design, and operations teams.