Research Engineer (Pre-training & Post-training)
Only for registered members
San Francisco (CA)
On-site
USD 120,000 - 180,000
Full time
30+ days ago
Job summary
An innovative firm is seeking a Research Engineer specializing in pre-training and post-training of large-scale language models. This role is pivotal in enhancing human-AI interactions through advanced audio intelligence. The ideal candidate will spearhead the optimization of model performance using cutting-edge techniques like reinforcement learning and generative modeling. You'll collaborate with cross-functional teams to develop robust data pipelines and ensure seamless integration of workflows. Join a forward-thinking company where your expertise will shape the future of multimodal AI systems and push the boundaries of technology.
Qualifications
- 4-5 years of experience in training large language models and optimizing performance.
- Strong background in distributed systems and scaling model training infrastructure.
Responsibilities
- Lead pre-training and fine-tuning of large-scale language models for optimal performance.
- Build scalable data pipelines for multimodal AI training involving audio and text.
Skills
Training large language models (LLMs)
Distributed systems
Compute efficiency
Data pipeline management
RLHF (Reinforcement Learning from Human Feedback)
Python
PyTorch
GANs (Generative Adversarial Networks)
Diffusion models
Cloud platforms (AWS, GCP, Azure)
Tools
Fully Sharded Data Parallel
Job description
Land a better
job faster
job faster
