TRAINSPOTTER run diagnostic
source
examples/overfitting.trainer_state.json
format
hf
steps
0–799
generated
2026-10-01 17:38 UTC
0error
1warning
0info

train/loss / eval/loss

train/losseval/loss0120200400600

lr

00.20.40200400600

grad_norm

01230200400600

eval/accuracy

00.50200400600

step_time

00.00010.000202004006000.000334

Findings log

WARN steps 125–799 overfitting

Overfitting onset

Best eval/loss was 0.526 at step 125; it's since risen to 0.5554 (5.6%, slope p<0.0001). Meanwhile train/loss kept falling over the same range (slope < 0) -- the classic overfitting signature.

best_step=125   best_value=0.526   current_value=0.5554   relative_rise=0.05591   slope_p_value=0

  • Use the checkpoint at step 125 (best eval/loss), not the last one.
  • Add or increase regularization: weight decay, dropout, data augmentation.
  • Reduce model capacity or train for fewer steps / add early stopping.
  • Get more training data, or de-duplicate against the eval set if overlap is possible.