SFT (Supervised Fine-Tuning)
The technical name for instruction tuning — supervised learning on (input, ideal-output) pairs.
Definition
SFT is the formal name for instruction tuning. The model is shown examples of correct outputs and trained to imitate them. SFT data is more expensive than preference data per item but produces sharper instruction-following behavior.
Examples
- Writing the gold-standard answer to a hard physics problem
- Producing model-quality summaries of long documents
Related terms
Instruction Tuning
Training a base model to follow human instructions by showing it examples of good responses.
Fine-Tuning
Adapting a pretrained model to a specific task or domain by continuing training on new data.
Preference Data
Pairs of AI outputs labeled "A is better than B" — the raw fuel for RLHF.
Looking for actual gigs that use SFT (Supervised Fine-Tuning)? Browse all live listings or filter by $100+/hr.