Reasoning from scratch, round number 5! This time, talking about log-probability scoring (also a great fundamental concept for loss functions like cross-entropy in pre-training and distillation) and self-refinement. 00:00 Introduction and inference-time scaling recap 05:02
Reasoning From Scratch Round 5
Sebastian Raschka’s fifth Reasoning from Scratch video covers log-probability scoring, its role in cross-entropy losses for pretraining and distillation, and self-refinement.