Fine-Tuning

Adapting a pretrained model to a specific task or domain by continuing training on new data.

Definition

Fine-tuning continues the training of a foundation model on a smaller, focused dataset to specialize it. SFT and RLHF are types of fine-tuning. From a worker's view, fine-tuning gigs need either example outputs (SFT) or rankings (RLHF).

Examples

  • Fine-tuning Llama on legal contracts
  • Fine-tuning GPT on customer-support transcripts

Related terms

Looking for actual gigs that use Fine-Tuning? Browse all live listings or filter by $100+/hr.