E-Commerce Model Prompt Evaluator

Role Overview We are seeking experienced e-commerce professionals to author and verify high-quality open-ended prompts for AI model evaluation. You will craft and review practical, unambiguous e-commerce problems across core subdomains, assessing AI reasoning quality and helping establish rigorous evaluation standards for frontier language models. You will be assigned one of two task types: Authoring Task Create 5 original, open-ended prompts from your assigned subdomain at varying difficulty levels (undergraduate, advanced undergraduate, or graduate/professional). Prompts should require human judgment to evaluate the quality of the AI's response, such as strategic analysis, campaign design, or data-driven decision making. Verification Task Review 5 authored prompts for clarity, scope alignment, difficulty accuracy, and uniqueness. Edit prompts and difficulty ratings where needed. E-Commerce Subdomains Covered Pricing Strategy, Sales Analytics, Marketing (incl. digital marketing, customer acquisition, retention, and campaign management). Key Responsibilities

\- Author clear, unambiguous, open-ended e-commerce prompts that elicit evaluable AI responses

\- Verify prompts are within the scope of the assigned subdomain and correctly rated for

difficulty

\- Ensure all 5 prompts in a task are sufficiently distinct from one another with varying

difficulty levels

\- Apply expert judgment to assess the depth and quality of e-commerce reasoning required

\- Edit prompts and difficulty assignments where standards are not met Ideal Qualifications

\- Master's degree or higher in Business, Marketing, Economics, Data Science, or a closely

related field

\- 2–6 years of professional experience in e-commerce, digital marketing, retail analytics, or

a related field

\- Strong understanding of pricing strategy, sales funnel analytics, and performance marketing

\- Experience with platforms such as Amazon Seller Central, Shopify, or major ad platforms is a

plus

\- Excellent written English and ability to craft precise, well-scoped technical questions More About the Opportunity

\- Expected commitment: 10+ hours/week

\- Asynchronous, fully remote work