Annotation Judge - Real Estate

Creative People; United States; Vor Ort; USD 60.000 - 80.000; Vollzeit

Zusammenfassung

Creative People is seeking an Annotation Judge to enhance their AI/ML efforts in personalized home recommendations. This pivotal role involves reviewing annotated data, ensuring quality, and collaborating with engineers and data scientists.

The ideal candidate will have at least 3 years as a licensed real estate agent and a deep interest in AI. A Bachelor's degree in English or Linguistics is required. The position emphasizes detailed evaluation and communication skills to optimize AI interactions in the real estate market.

Qualifikationen

• 3+ years of experience as a licensed real estate agent or broker.
• Deep interest in Artificial Intelligence and experience with AI-generated content.
• Experience on NLP projects focusing on transcriptions, localization, translation.

Aufgaben

• Review and evaluate annotated data for quality.
• Provide feedback to improve accuracy.
• Collaborate with engineers to optimize model performance.
• Maintain annotation guidelines and best practices.
• Provide training data for establishing Ground Truth.
• Suggest improvements for training content.

Kenntnisse

Attention to detail

Curiosity for language subtleties

Collaboration

Ausbildung

Bachelor's degree in English, Linguistics or a related field

Tools

Natural Language Processing tools

Jobbeschreibung

Our client is a major real estate marketplace looking to improve their Artificial Intelligence (AI) and Machine Learning (ML) team efforts for personalized home recommendations. They are only looking for people licensed in Seattle, Los Angeles, or San Francisco!

About the role: The Annotation Judge plays a crucial role in fine‑tuning and calibrating AI/ML processes that handle verbal interactions, between home buyers and real estate agents for example. Works directly with experienced Operations Managers, ML Engineers, Data Scientist, Software Developers and Natural Language experts.

Responsible for ensuring the quality of a number of possible elements related to our projects. Projects such as reviewing the accuracy and humanlike traits of automated chatbots answers, to the classification of elements of a conversation annotated automatically or the review of search results based on understanding of complex users queries.

Plays an essential role in defining clear guidelines which may be used by non-native English speakers. Attention to detail and natural curiosity for language subtleties and AI models is perfect!

MAJOR RESPONSIBILITIES

• Review and/or evaluate annotated data to ensure it meets quality standards and project requirements.
• Provide feedback and guidance to engineers to improve accuracy.
• Collaborate with engineers and data scientists to optimize model performance based on annotated data.
• Develop and maintain annotation guidelines and best practices.
• Provide training data to engineers to establish Ground Truth data.
• Provide input/examples on Training content.
• Identify gaps in training content and suggest improvements.

MINIMUM QUALIFICATIONS

• Minimum of 3+ years of active experience as a licensed real estate agent or broker, demonstrating a deep understanding of the real estate transaction process.
• Demonstrated deep interest and curiosity in Artificial Intelligence, including experience reviewing or evaluating AI-generated content.
• Bachelor's degree in English, Linguistics or a related field.
• Experience working on Natural Language Processing projects with a focus on transcriptions, localization, translation.
• Excellent attention to detail and analytical skills.
• Ability to work effectively in a collaborative team environment.
• Experience with tools and software used for Natural Language Processing annotation is a plus.