Senior Python AI Engineer: Model Tuning & Benchmarking

Hired; Colombia; Presencial; COP 120.000.000 - 180.000.000; Jornada completa

Descripción de la vacante

Hired is seeking a Senior Python Developer to join a foundational LLM company focused on data for fine-tuning and benchmarking large language models. You will design, develop, and optimize Python code to train AI models, and contribute to evaluating and ranking model responses across domains.

You will collaborate with researchers and annotators to implement supervised fine-tuning (SFT) and reinforcement learning with human feedback (RLHF), helping push the performance and quality of cutting-edge

Formación

• Proficiency in Python for AI/ML tasks.
• Experience with supervised fine-tuning (SFT) and RLHF.
• Strong understanding of evaluation and benchmarking for AI models.
• Ability to design Python code for data generation and model optimization.
• Familiarity with evaluating and ranking AI model responses.

Responsabilidades

• Design, develop, and maintain efficient Python code to train and optimize AI models.
• Conduct evaluations to benchmark model performance and analyze results for improvement.
• Evaluate and rank AI model responses to user queries across domains.
• Lead efforts in supervised fine-tuning, creating and maintaining high-quality datasets.
• Collaborate with researchers and annotators to refine reward models through RLHF.

Conocimientos

Python

SFT (supervised fine-tuning)

RLHF (reinforcement learning withHuman

Evaluation strategies

Data generation

Model ranking

Descripción del empleo

Hired is seeking a Senior Python Developer to join a foundational LLM company focused on data for fine-tuning and benchmarking large language models. You will design, develop, and optimize Python code to train AI models, and contribute to evaluating and ranking model responses across domains.

You will collaborate with researchers and annotators to implement supervised fine-tuning (SFT) and reinforcement learning with human feedback (RLHF), helping push the performance and quality of cutting-edge