Alpha Telescopii - Entertainment Media Content Rater (Remote in Philippines)

About the Role Are you passionate about pop culture, films, television, and the ever-evolving world of streaming media? We are seeking dynamic Entertainment Media Content Contributors to join our team!

In this role, you’ll review and evaluate model-generated responses to user queries about entertainment media, ensuring accuracy, relevance, and quality. Your expertise will help shape outputs that resonate with fans of cinematic universes, episodic storytelling, and pop culture at large. What you will do:

• Review contributor evaluations of model-generated responses to ensure adherence to project-specific guidelines and rubric dimensions.
• Verify that contributors consistently apply all instructions, constraints, and evaluation criteria when assessing model responses.
• Confirm that contributors accurately identify factual errors, hallucinations, or missing information in model responses, ensuring evaluations reflect whether responses fulfill the user query.
• Ensure contributor-selected options align appropriately with rubric dimensions and are justified by the evidence present in the model response.
• Review open-text comments provided by contributors, ensuring they identify areas of opportunity, weaknesses, or limitations that may not have been captured by rubric criteria.
• Provide detailed feedback on contributor performance, highlighting areas for improvement and ensuring evaluations are consistently high-quality. Project Details:
• Location: Remote in the