blocks_to_swap is supported for validation loss now

This commit is contained in:
rockerBOO
2025-09-08 14:28:55 -04:00
parent 78685b9c5f
commit fe4c18934c

View File

@@ -577,7 +577,7 @@ validation_split = 1.0 # Will use this full subset as a validation subset.
**Notes:**
* Validation loss calculation uses fixed timestep sampling and random seeds to reduce loss variation due to randomness for more stable evaluation.
* Currently, validation loss is not supported when using `--blocks_to_swap` or Schedule-Free optimizers (`AdamWScheduleFree`, `RAdamScheduleFree`, `ProdigyScheduleFree`).
* Currently, validation loss is not supported when using Schedule-Free optimizers (`AdamWScheduleFree`, `RAdamScheduleFree`, `ProdigyScheduleFree`).
<details>
<summary>日本語</summary>