Procurement & Vendor Management Expert

Build realistic procurement and vendor management evaluations

Create benchmark tasks that test whether AI systems can complete real procurement and vendor management work. Translate practical workflows into demanding assignments with clear reference materials and objective grading criteria. Prior AI experience is not required; the emphasis is on direct professional knowledge and sound judgment.

Responsibilities

• Design tasks involving supplier assessment, bid comparison, vendor risk analysis, and contract review, with multiple steps and enough context for a reviewer to evaluate the result.
• Write clear task instructions and prepare or source the supporting RFP responses, pricing schedules, contracts, SLAs, and risk assessments.
• Define grading criteria that let two qualified reviewers reach the same conclusion about the same output.
• Test the ability to interpret the supplied materials and make judgments, rather than simply retrieve information.
• Identify ambiguous tasks or outputs that cannot be graded reliably, and flag them instead of submitting them as finished work.
• Deliver approved tasks on schedule and meet the required quality standard.

Relevant experience

• At least five years of direct responsibility in procurement, sourcing, supplier assessment, or vendor management. Experience must include doing and owning the work, rather than only supervising it or working alongside it.
• Experience developing or applying structured standards such as supplier scorecards, weighted bid criteria, vendor risk frameworks, or category strategies.
• Comfort working across contracts, spreadsheets, and reports. CIPS, CPSM, or equivalent certification is helpful but optional.
• Strong written and spoken English, with B2 as the minimum and C1 preferred.
• AI or large language model evaluation experience is welcome but is not a prerequisite.

Contract and selection

The contract is fully remote, with no geographic restrictions. Pay is up to $90 per hour equivalent, and a task is expected to take approximately ten hours.

Selection includes screening questions and an AI interview specific to this role, followed by onboarding. The interview presents your domain experience for the client's review. Applicants who have interviewed previously are still asked to complete the interview for this particular role, with a profile review before onboarding.