Sr. Distinguished Applied Researcher

Capital One; San Francisco (CA); On-site; USD 120,000 - 180,000; Full time

Benefits offered by this job

Comprehensive health benefits

Financial benefits

Inclusive workplace environment

Job summary

A leading financial institution is seeking an NLP specialist with a PhD or equivalent experience for a role involving training large language models. The ideal candidate will have extensive experience in optimizing model performance and a strong record of technical publications. This role offers a comprehensive benefits package and requires the ability to work on large-scale model training teams.

Qualifications

• Core contributor to a team that has trained large language models.
• Numerous publications at leading conferences related to LLM pre-training.
• Demonstrated ability to guide technical direction in a model training team.

Responsibilities

• Train and optimize large language models.
• Manage multi-node GPU clusters for model training.
• Guide and mentor a team in LLM development.

Skills

NLP

Model training optimization

Technical publications

Cluster management

Education

PhD in NLP or Masters with 10 years of industrial NLP research experience

Tools

Deep Speed

Nemo

Job description

* PhD focus on NLP or Masters with 10 years of industrial NLP research experience* Core contributor to team that has trained a large language model from scratch (10B + parameters, 500B+ tokens)* Numerous publications at ACL, NAACL and EMNLP, Neurips, ICML or ICLR on topics related to the pre-training of large language models (e.g. technical reports of pre-trained LLMs, SSL techniques, model pre-training optimization)* Has worked on an LLM (open source or commercial) that is currently available for use* Demonstrated ability to guide the technical direction of a large-scale model training team* Experience working with 500+ node clusters of GPUs Has worked on LLM scaled to 70B parameters and 1T+ tokens* Experience with common training optimization frameworks (deep speed, nemo)Capital One offers a comprehensive, competitive, and inclusive set of health, financial and other benefits that support your total well-being. Learn more at the . Eligibility varies based on full or part-time status, exempt or non-exempt status, and management level.