Onsite AI Data Quality & Model Evaluation Analyst

Welo Data; Washington (District of Columbia); On-site; USD 63,000 - 77,000; Full time

Benefits offered by this job

Paid Vacation: 6 days

Paid Company Holidays: 2 days

Medical, Dental, and Vision Insurance

401(k) Retirement Plan

Free Gourmet Food

Commuter Benefits

Job summary

Welo Data is seeking a Data Labeling Associate to engage directly with cutting-edge AI systems in Washington. This full-time position requires evaluating AI outputs and enhancing data quality through meticulous feedback and collaborative discussions.

Ideal candidates possess strong Canadian English proficiency, critical thinking skills, and a Bachelor's degree. The role offers a unique opportunity to influence AI behavior and performance.

Qualifications

• 1-2 years of professional writing experience.
• Ability to make sound judgment calls in ambiguous situations.
• Experience in data quality, QA, annotation, or analysis is beneficial.

Responsibilities

• Evaluate AI model outputs and provide structured feedback.
• Perform audit-based reviews of data and model behavior.
• Contribute to improving evaluation frameworks.
• Identify trends in model performance and communicate insights.

Skills

Native-level Canadian English proficiency

Strong, structured writing skills

Critical thinking

Attention to detail

Proficiency in applying complex writing rules

Understanding of safety considerations in GenAI

Education

Bachelor’s degree or higher

Job description

Welo Data is seeking a Data Labeling Associate to engage directly with cutting-edge AI systems in Washington. This full-time position requires evaluating AI outputs and enhancing data quality through meticulous feedback and collaborative discussions.

Ideal candidates possess strong Canadian English proficiency, critical thinking skills, and a Bachelor's degree. The role offers a unique opportunity to influence AI behavior and performance.