1914 Commits

This Branch

This Branch

All Branches

Author	SHA1	Message	Date
rockerBOO	dd3b846b54	Install pytorch first to pin version	2024-11-29 16:18:05 -05:00
rockerBOO	e59e276fb9	Add dadaptation	2024-11-29 16:03:29 -05:00
rockerBOO	2dd063a679	add torch torchvision accelerate versions	2024-11-29 15:57:31 -05:00
rockerBOO	c7cadbc8c7	Add pytest testing	2024-11-29 15:52:03 -05:00
kohya-ss	2a61fc0784	docs: fix typo from block_to_swap to blocks_to_swap in README	2024-11-20 21:20:35 +09:00
Kohya S	2a188f07e6	Fix to work DOP with bock swap	2024-11-17 16:12:10 +09:00
Kohya S.	0047bb1fc3	Merge pull request #1779 from kohya-ss/faster-block-swap ... Improve block swap speed and apply to LoRA	2024-11-14 19:47:10 +09:00
Kohya S	fd2d879ac8	docs: update README	2024-11-14 19:43:08 +09:00
Kohya S	5c5b544b91	refactor: remove unused prepare_split_model method from FluxNetworkTrainer	2024-11-14 19:35:43 +09:00
Kohya S	2bb0f547d7	update grad hook creation to fix TE lr in sd3 fine tuning	2024-11-14 19:33:12 +09:00
Kohya S	2cb7a6db02	feat: add block swap for FLUX.1/SD3 LoRA training	2024-11-12 21:39:13 +09:00
Kohya S	17cf249d76	Merge branch 'sd3' into faster-block-swap	2024-11-12 08:49:15 +09:00
Kohya S	cde90b8903	feat: implement block swapping for FLUX.1 LoRA (WIP)	2024-11-12 08:49:05 +09:00
Kohya S	3fe94b058a	update comment	2024-11-12 08:09:07 +09:00
Kohya S.	92482c7a07	Merge pull request #1774 from sdbds/avif_get_imagesize ... Support avif get image size	2024-11-12 08:02:16 +09:00
Kohya S	7feaae5f06	Merge branch 'sd3' into faster-block-swap	2024-11-11 21:16:01 +09:00
Kohya S	02bd76e6c7	Refactor block swapping to utilize custom offloading utilities	2024-11-11 21:15:36 +09:00
sdbds	26bd4540a6	init	2024-11-11 09:25:28 +08:00
Kohya S	8fac3c3b08	update README	2024-11-09 19:56:02 +09:00
Kohya S.	2a2042a762	Merge pull request #1770 from feffy380/fix-size-from-cache ... fix: sort order when getting image size from cache file	2024-11-09 19:51:03 +09:00
feffy380	b3248a8eef	fix: sort order when getting image size from cache file	2024-11-07 14:31:05 +01:00
Kohya S	186aa5b97d	fix illeagal block is swapped #1764	2024-11-07 22:16:05 +09:00
Kohya S	b8d3feca77	Merge branch 'sd3' into faster-block-swap	2024-11-07 21:43:48 +09:00
Kohya S	123474d784	Merge branch 'sd3' of https://github.com/kohya-ss/sd-scripts into sd3	2024-11-07 21:43:37 +09:00
Kohya S	e877b306c8	Merge branch 'dev' into sd3	2024-11-07 21:43:04 +09:00
Kohya S	6adb69be63	Merge branch 'main' into dev	2024-11-07 21:42:44 +09:00
Kohya S.	387b40ea37	Merge pull request #1769 from Dango233/patch-1 ... Update README.md	2024-11-07 21:41:12 +09:00
Kohya S	e5ac095749	add about dev and sd3 branch to README v0.8.8	2024-11-07 21:39:47 +09:00
Dango233	5eb6d209d5	Update README.md	2024-11-07 20:33:31 +08:00
Kohya S.	f264f4091f	Update README.md	2024-11-07 21:30:31 +09:00
Kohya S	5e86323f12	Update README and clean-up the code for SD3 timesteps	2024-11-07 21:27:12 +09:00
Kohya S.	588ea9e123	Merge pull request #1768 from Dango233/dango/timesteps_fix ... Dango/timesteps fix	2024-11-07 20:56:04 +09:00
Dango233	bafd10d558	Fix typo	2024-11-07 18:21:04 +08:00
Dango233	e54462a4a9	Fix SD3 trained lora loading and merging	2024-11-07 09:54:12 +00:00
Dango233	40ed54bfc0	Simplify Timestep weighting ... * Remove diffusers dependency in ts & sigma calc * support Shift setting * Add uniform distribution * Default to Uniform distribution and shift 1	2024-11-07 09:53:54 +00:00
Kohya S	43849030cf	Fix to work without latent cache #1758	2024-11-06 21:33:28 +09:00
Kohya S	aab943cea3	remove unused weight swapping functions from utils.py	2024-11-05 23:27:41 +09:00
Kohya S	81c0c965a2	faster block swap	2024-11-05 21:22:42 +09:00
Kohya S	5e32ee26a1	fix crashing in DDP training closes #1751	2024-11-02 15:32:16 +09:00
Kohya S	e0db59695f	update multi-res training in SD3.5M	2024-11-02 11:13:04 +09:00
Kohya S.	264328d117	Merge pull request #1719 from kohya-ss/sd3_5_support ... SD3.5 Large support	2024-11-01 21:55:48 +09:00
Kohya S	82daa98fe8	remove duplicate resolution for scaled pos embed	2024-11-01 21:43:47 +09:00
Kohya S	9aa6f52ac3	Fix memory leak in latent caching. bmp failed to cache	2024-11-01 21:43:21 +09:00
Kohya S	830df4abcc	Fix crashing if image is too tall or wide.	2024-10-31 21:39:07 +09:00
Kohya S	9e23368e3d	Update SD3 training	2024-10-31 19:58:41 +09:00
Kohya S	1434d8506f	Support SD3.5M multi resolutional training	2024-10-31 19:58:22 +09:00
Kohya S	70a179e446	Fix to use SDPA instead of xformers	2024-10-30 14:34:19 +09:00
Kohya S	8c3c825b5f	Merge branch 'sd3_5_support' of https://github.com/kohya-ss/sd-scripts into sd3_5_support	2024-10-30 12:51:55 +09:00
Kohya S	bdddc20d68	support SD3.5M	2024-10-30 12:51:49 +09:00
kohya-ss	b502f58488	Fix emb_dim to work.	2024-10-29 23:29:50 +09:00