Foundation Model Engineer - Particle Physics

Big Science Sweden; Genf; Hybrid; CHF 90,000 - 120,000; Full time

Job summary

CERN IT-CE group is exploring the development of a foundation model tailored to particle physics, capable of interpreting particle behavior in HEP detectors and supporting experimental data processing.

The role involves designing and training transformer-based architectures using calorimeter data, exploring self-supervised learning for multi-task capabilities, and optimizing for computational efficiency. Availability is immediate.

Qualifications

• Master's degree with 2–6 years of professional experience since graduation or a PhD with up to 3 years of experience
• You are a national of a CERN Member State or Associate Member State; certain national exclusions apply
• No prior CERN fellow or graduate contract
• Eligibility criteria specified for this position

Responsibilities

• Design and train transformer-based architectures using calorimeter data from collider experiments
• Explore self-supervised learning to enable multi-task capabilities
• Optimize for computational efficiency in model training and inference

Skills

Deep Learning

Transformer models

Scientific data

Education

Master's degree in CS or related field

PhD in CS or related field

Tools

Transformer architectures

Job description

CERN IT-CE group is exploring the development of a foundation model tailored to particle physics, capable of interpreting particle behavior in HEP detectors and supporting experimental data processing.

The role involves designing and training transformer-based architectures using calorimeter data, exploring self-supervised learning for multi-task capabilities, and optimizing for computational efficiency. Availability is immediate.