LLM Pre-Training Research Engineer

JetBrains; Netherlands; Hybrid; EUR 90,000 - 120,000; Full time

Job summary

JetBrains is building AI capabilities across its developer tools. We are creating a platform that provides AI features to all JetBrains products.

You’ll work on training foundation models for coding tasks and deploying them to end users around the globe. In this role you’ll convert business requirements into technical specs, train LLMs from scratch on a large GPU cluster, and collect datasets for pre-training and fine-tuning.

Qualifications

• Experience in design, deployment, and support of production ML systems.
• Strong theoretical background in NLP and transformer-based approaches.
• Proficiency with PyTorch and NLP libraries.
• Experience in distributed training of multi-billion parameter models.
• Attention to detail and strong communication skills.

Responsibilities

• Convert business requirements into technical specifications with stakeholders.
• Train LLMs from scratch on a large GPU cluster.
• Collect and process pre-training and fine-tuning datasets.
• Support and improve existing subsystems.

Skills

NLP proficiency

PyTorch

Distributed training

LLM concepts

Communication skills

Tools

HuggingFace

Kubeflow

TensorRT

Job description

JetBrains is building AI capabilities across its developer tools. We are creating a platform that provides AI features to all JetBrains products.

You’ll work on training foundation models for coding tasks and deploying them to end users around the globe. In this role you’ll convert business requirements into technical specs, train LLMs from scratch on a large GPU cluster, and collect datasets for pre-training and fine-tuning.