Professional Services AI Training Specialist — Task Creation & Model Evaluation (Contract)

Rise Data Labs

Turkey

On-site

TRY 350,000 - 600,000

Full time

12 hours ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Rise Data Labs is seeking a Professional Services AI Training Specialist to design realistic professional services tasks and rubrics based on real client work, with a focus on accounting and audit. You will author benchmarks, grade AI outputs, and collaborate with domain experts to ensure consistent, high-quality results.

You will also review client-facing work products, prepare reference materials, and participate in calibration sessions to align scoring standards across projects.

Qualifications

  • Prior hands-on experience in accounting/audit (CPA or equivalent preferred), management or strategy consulting, HR, marketing/business services, or another professional services engagement-based role
  • Comfort reviewing detailed client-facing work product line by line
  • Prior experience with AI model training, evaluation, or benchmark development is a plus

Responsibilities

  • Create realistic task scenarios based on real client work and engagements
  • Supply reference materials (financial statements, engagement letters, project reports)
  • Write rubrics detailing exactly what a correct deliverable requires
  • Grade AI-generated deliverables against the rubric
  • Join calibration sessions with other experts to ensure consistent scoring

Skills

Accounting/Audit
Management Consulting
Strategy Consulting
HR
Marketing & Business Services

Tools

AI model training
Benchmark development

Job description

About Rise Data Labs

Rise Data Labs is a leading AI training and data annotation company that specializes in creating high-quality training data for artificial intelligence systems. We work with top AI companies and research institutions to improve machine learning models through expert human annotation and validation. Our team of domain specialists, subject matter experts, and quality assurance professionals work across various fields including accounting, consulting, HR, marketing services, and other professional and business services. We pride ourselves on our attention to detail, domain expertise, and commitment to delivering accurate, high-quality training data.

Job Overview

As a Professional Services AI Training Specialist at Rise Data Labs, you will play a crucial role in training and enhancing AI models specifically tailored for the professional services domain. This role goes beyond traditional annotation and labeling - you'll author realistic, economically valuable professional services tasks and rubrics based on real client work, then grade AI-generated deliverables against them. We're especially focused on accounting and audit expertise right now, but are open to related professional service backgrounds as well.

What You'll Do
  • Create realistic task scenarios based on real client or engagement work - e.g., reviewing financial statements and audit workpapers, building a consulting deliverable, preparing an HR or compliance report, or drafting a client-facing proposal or analysis
  • Supply the kinds of reference materials you'd normally work from (financial statements, engagement letters, project reports, supporting schedules)
  • Write detailed rubrics specifying exactly what a correct deliverable requires - accurate figures/formulas, proper file structure, professional formatting
  • Grade AI-generated deliverables (often Excel workbooks, Word documents, or PDF reports) against your rubric
  • Join calibration sessions with other experts to ensure consistent scoring across the benchmark
Preferred Qualifications
  • Prior hands-on experience in one or more of: accounting/audit (CPA or equivalent preferred), management or strategy consulting, HR, marketing/business services, or another professional services engagement-based role
  • Comfort reviewing detailed client-facing work product line by line
  • Prior experience with AI model training, evaluation, or benchmark development is a plus

What We Offer At Rise Data Labs, we value our contributors and strive to create a supportive, flexible working environment. We offer opportunities for professional development in the AI field and the chance to work on innovative projects that directly shape the future of AI in professional services work.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

AI Training Specialist: Pro Services Task Design Evaluation
AI Training Specialist: Pro Services Task Design Evaluation

Rise Data Labs • Turkey

On-site
TRY 350,000 - 600,000
Government & Public Sector AI Training Specialist — Task Creation & Model Evaluation
Government & Public Sector AI Training Specialist — Task Creation & Model Evaluation

Rise Data Labs • Turkey

On-site
TRY 240,000 - 360,000
Flexible working environment
Professional development opportunities
AI Training Specialist - JavaScript Focus
AI Training Specialist - JavaScript Focus

Rise Data Labs • Turkey

Remote
TRY 207,000 - 344,000
Competitive pay
Flexible hours
Professional development
JavaScript AI Training Specialist
JavaScript AI Training Specialist

Rise Data Labs • Turkey

Remote
TRY 200,000 - 320,000
Video Production Specialist for AI Training
Video Production Specialist for AI Training

Rise Data Labs • Turkey

Remote
TRY 3,027,000 - 4,541,000
Competitive compensation
Flexible working hours
Career growth opportunities
AI Training Specialist - HTML Coding Expert
AI Training Specialist - HTML Coding Expert

Rise Data Labs • Turkey

Remote
TRY 450,000 - 600,000
AI Training Specialist - Java Expert
AI Training Specialist - Java Expert

Rise Data Labs • Turkey

Remote
TRY 413,000 - 827,000
Competitive hourly rates
Professional development opportunities
Challenging AI projects
Public Sector AI Training Architect
Public Sector AI Training Architect

Rise Data Labs • Turkey

On-site
TRY 240,000 - 360,000
Flexible working environment
Professional development opportunities
AI Sound Engineering Specialist
AI Sound Engineering Specialist

Rise Data Labs • Turkey

Remote
TRY 276,000 - 413,000
Competitive hourly rates
Flexible work hours
Remote-first environment
Synthetic Chemistry AI Trainer Specialist
Synthetic Chemistry AI Trainer Specialist

Rise Data Labs • Turkey

Remote
TRY 551,000 - 1,102,000
Competitive hourly rates
Flexible working hours
Professional development opportunities