Python Engineer (Remote)

Hired; Perugia; Remoto; EUR 106.000 - 158.000; Tempo pieno

Descrizione del lavoro

Hired in a remote role is seeking a Senior Python Developer to help an AI-focused client advance large language models. You will design and optimize Python code for data generation, training, and evaluation.

You will work with researchers to benchmark performance, rank model responses, and contribute to RLHF and SFT workflows, helping improve reliability and alignment across domains. This role offers global collaboration and a fully remote setup.

Competenze

• Proficiency in Python and AI/ML libraries for building and optimizing models.
• Experience with supervised fine-tuning (SFT) and reinforcement learning with human feedback (RLHF).
• Strong understanding of evaluation and benchmarking for AI models.
• Ability to design Python code for data generation and model optimization.
• Familiarity with evaluating and ranking AI model responses.

Mansioni

• Design, develop, and maintain Python code to train and optimize AI models.
• Conduct evaluations to benchmark model performance and drive improvement.
• Evaluate and rank AI model responses across domains per criteria.
• Lead supervised fine-tuning and create task-specific datasets.
• Collaborate with researchers and annotators to refine reward models.

Conoscenze

Python

AI/ML frameworks

SFT

RLHF

Evaluation strategies

Benchmarking

Data generation

Model optimization

Ranking methodologies

Descrizione del lavoro

• Role: Python Engineer (Remote)
• Location: Remote (Work from Anywhere)

Role Overview:

We are hiring for one of our clients, seeking a Senior Python Developer to assist a foundational LLM company in enhancing their large language models. The goal is to provide high-quality proprietary data for fine-tuning and benchmarking model performance.

Key Responsibilities:

• Design, develop, and maintain efficient, high-quality Python code to train and optimize AI models.
• Conduct evaluations to benchmark model performance and analyze results for continuous improvement.
• Evaluate and rank AI model responses to user queries across diverse domains, ensuring alignment with predefined criteria.
• Lead efforts in supervised fine-tuning, including creating and maintaining high-quality, task-specific datasets.
• Collaborate with researchers and annotators to execute reinforcement learning with human feedback and refine reward models.

Required Skills & Qualifications:

• Proficiency in Python and related frameworks/libraries for AI/ML tasks.
• Experience with supervised fine-tuning (SFT) and reinforcement learning with human feedback (RLHF).
• Strong understanding of evaluation strategies and benchmarking processes for AI models.
• Ability to design and implement Python code for data generation and model optimization.
• Familiarity with AI model response evaluation and ranking methodologies.

More About the Opportunity:

This role offers a unique opportunity to work with a global leader in artificial intelligence, contributing to the advancement of large language models. Candidates will collaborate with top researchers and engineers in the field.

Equal Opportunity Employer:

We hire based on skills and expertise. All qualified candidates are welcome regardless of background, experience, or prior employment history. Applications are reviewed solely on demonstrated technical ability and qualifications.