Senior Python AI Engineer — LLM Training & Evaluation

Hired; Italia; In loco; EUR 60.000 - 80.000; Tempo pieno

Descrizione del lavoro

Hired in Italy is seeking a Senior Python Developer to help an LLM-focused client enhance large language models. You will design, implement, and optimize Python code for training and evaluating AI models, and collaborate with researchers to improve data pipelines.

The role emphasizes supervised fine-tuning, RLHF, and robust benchmarking; you will help rank model responses and contribute to data generation and model optimization efforts with a global team.

Competenze

• Proficiency in Python and AI/ML frameworks.
• Experience with supervised fine-tuning (SFT) and reinforcement learning with human feedback (RLHF).
• Strong understanding of evaluation strategies and benchmarking processes for AI models.
• Ability to design and implement Python code for data generation and model optimization.
• Familiarity with AI model response evaluation and ranking methodologies.

Mansioni

• Design, develop, and maintain Python code to train and optimize AI models.
• Conduct evaluations to benchmark model performance and analyze results.
• Evaluate and rank AI model responses to user queries across domains.
• Lead supervised fine-tuning efforts and build task-specific datasets.
• Collaborate with researchers and annotators to refine reward models.

Conoscenze

Python

AI/ML frameworks

SFT

RLHF

Evaluation strategies

Strumenti

PyTorch

TensorFlow

Descrizione del lavoro

Hired in Italy is seeking a Senior Python Developer to help an LLM-focused client enhance large language models. You will design, implement, and optimize Python code for training and evaluating AI models, and collaborate with researchers to improve data pipelines.

The role emphasizes supervised fine-tuning, RLHF, and robust benchmarking; you will help rank model responses and contribute to data generation and model optimization efforts with a global team.