AI Data Quality & Evaluation Specialist

Welo Data; New York (NY); On-site; USD 38,641 - 55,035; Full time

Benefits offered by this job

Paid Vacation: 6 days

Medical, Dental, and Vision Insurance

401(k) Retirement Plan

Free Gourmet Food

Job summary

Welo Data is seeking a Data Labeling Associate to evaluate AI outputs and enhance model behaviors. This full-time role is based in New York City and requires strong structured writing and attention to detail, as you’ll actively contribute to refining AI system evaluations.

Candidates should possess a Bachelor's degree, native Australian English proficiency, and ideally 1-2 years of relevant writing experience. Benefits include medical insurance, paid vacation, and free meals.

Qualifications

• 1–2 years of professional writing experience required.
• Strong understanding of safety considerations in GenAI data delivery.
• Comfortable applying complex writing rules consistently.

Responsibilities

• Evaluate AI model outputs and provide high-quality feedback.
• Perform audit-based reviews of data and model behavior.
• Contribute to improving evaluation frameworks.

Skills

Native-level Australian English proficiency

Strong structured writing skills

Critical thinking

Attention to detail

Communication skills

Education

Bachelor's degree or higher

Job description

Welo Data is seeking a Data Labeling Associate to evaluate AI outputs and enhance model behaviors. This full-time role is based in New York City and requires strong structured writing and attention to detail, as you’ll actively contribute to refining AI system evaluations.

Candidates should possess a Bachelor's degree, native Australian English proficiency, and ideally 1-2 years of relevant writing experience. Benefits include medical insurance, paid vacation, and free meals.