Senior Python AI Engineer - LLM Fine-Tuning & Evaluation

Hired; United States; On-site; USD 140,000 - 200,000; Full time

Job summary

Hired is seeking a Senior Python Developer to join a foundational LLM project. You will design and optimize Python code to train AI models, evaluate performance, and rank model responses across domains. The role includes leading supervised fine-tuning and collaborating with researchers and annotators on reward models.

You will work with a global AI leader on data generation for fine-tuning and benchmarking, contributing to state-of-the-art language model development in a dynamic environment.

Qualifications

• Proficiency in Python and ML libraries/frameworks.
• Experience with supervised fine-tuning (SFT) and reinforcement learning with human feedback (RLHF).
• Strong understanding of evaluation/benchmarking for AI models.
• Ability to design Python code for data generation and model optimization.
• Familiarity with model response evaluation and ranking methods.

Responsibilities

• Design, develop, and maintain Python code to train and optimize AI models.
• Conduct evaluations to benchmark model performance and improve results.
• Evaluate and rank AI model responses to user queries across domains.
• Lead supervised fine-tuning and maintain task-specific datasets.
• Collaborate with researchers and annotators to refine reward models.

Skills

Python

SFT

RLHF

Evaluation strategies

Data generation

Job description

Hired is seeking a Senior Python Developer to join a foundational LLM project. You will design and optimize Python code to train AI models, evaluate performance, and rank model responses across domains. The role includes leading supervised fine-tuning and collaborating with researchers and annotators on reward models.

You will work with a global AI leader on data generation for fine-tuning and benchmarking, contributing to state-of-the-art language model development in a dynamic environment.