Senior Python AI Engineer (Remote) - LLM & Fine-Tuning

Hired; Pakistan; On-site; PKR 1,800,000 - 3,000,000; Full time

Job summary

Hired is seeking a Senior Python Developer to assist a foundational LLM company in enhancing large language models. You will design and optimize Python code for training and benchmarking AI models, and lead supervised fine-tuning while contributing to RLHF efforts.

You will collaborate with researchers and annotators to refine reward models and evaluate model responses. This role provides exposure to leading AI research teams and opportunities to impact model performance globally.

Qualifications

• Proficiency in Python and related frameworks/libraries for AI/ML tasks.
• Experience with supervised fine-tuning (SFT) and reinforcement learning with human feedback (RLHF).
• Strong understanding of evaluation strategies and benchmarking processes for AI models.
• Ability to design and implement Python code for data generation and model optimization.
• Familiarity with AI model response evaluation and ranking methodologies.

Responsibilities

• Design, develop, and maintain efficient, high-quality Python code to train and optimize AI models.
• Conduct evaluations to benchmark model performance and analyze results for continuous improvement.
• Evaluate and rank AI model responses to user queries across diverse domains, ensuring alignment with predefined criteria.
• Lead efforts in supervised fine-tuning, including creating and maintaining high-quality, task-specific datasets.
• Collaborate with researchers and annotators to execute reinforcement learning with human feedback and refine reward models.

Skills

Python programming

AI/ML libraries

SFT and RLHF

Model evaluation

Data generation

Tools

PyTorch

Job description

Hired is seeking a Senior Python Developer to assist a foundational LLM company in enhancing large language models. You will design and optimize Python code for training and benchmarking AI models, and lead supervised fine-tuning while contributing to RLHF efforts.

You will collaborate with researchers and annotators to refine reward models and evaluate model responses. This role provides exposure to leading AI research teams and opportunities to impact model performance globally.