Senior LLM Training & Post-Training Engineer

Socket.dev; New York (NY); Hybrid; USD 165,000 - 310,000; Full time

Benefits offered by this job

Comprehensive Health Coverage

Meaningful Equity

401(k) matching + pension

Unlimited PTO and holidays

Hybrid work model

In-office meals

Job summary

Lightning AI in the United States is seeking a Senior Research Engineer to advance transformer-based language models from research to production. You will design and optimize training, evaluation, and deployment workflows across distributed systems, PyTorch, and AI infrastructure.

You will collaborate with researchers, infrastructure engineers, and customers to improve model quality, training efficiency, and developer productivity while building scalable, production-ready AI systems.

Qualifications

• Experience training, fine-tuning, evaluating, and optimizing transformer-based language models using PyTorch.
• Experience with modern LLM training and post-training techniques (SFT, RLHF, etc.).
• Strong distributed training understanding and multi-GPU systems.
• Production-quality Python software and research tooling experience.
• Ability to design experiments and debug complex training issues.

Responsibilities

• Design, build, and optimize LLM training and post-training pipelines.
• Improve model quality through supervised fine-tuning and reinforcement learning experiments.
• Build and improve PyTorch-based training infrastructure and workflows.
• Optimize distributed training across multi-GPU environments.
• Collaborate with customers to translate workloads into platform improvements.
• Partner with research, infra, and platform teams to productionize AI systems.
• Contribute to open-source via new features and docs.

Skills

Transformer language models training

PyTorch

Distributed training

Python software engineering

Experiment design & debugging

Communication & collaboration

Education

Master's degree or PhD in ML/AI/CS

Tools

DeepSpeed

Megatron-LM

Hugging Face Transformers

CUDA

TRL / PEFT

Job description

Lightning AI in the United States is seeking a Senior Research Engineer to advance transformer-based language models from research to production. You will design and optimize training, evaluation, and deployment workflows across distributed systems, PyTorch, and AI infrastructure.

You will collaborate with researchers, infrastructure engineers, and customers to improve model quality, training efficiency, and developer productivity while building scalable, production-ready AI systems.