1879 Commits

This Branch

This Branch

All Branches

Author	SHA1	Message	Date
Dango233	e54462a4a9	Fix SD3 trained lora loading and merging	2024-11-07 09:54:12 +00:00
Dango233	40ed54bfc0	Simplify Timestep weighting ... * Remove diffusers dependency in ts & sigma calc * support Shift setting * Add uniform distribution * Default to Uniform distribution and shift 1	2024-11-07 09:53:54 +00:00
Kohya S	43849030cf	Fix to work without latent cache #1758	2024-11-06 21:33:28 +09:00
Kohya S	5e32ee26a1	fix crashing in DDP training closes #1751	2024-11-02 15:32:16 +09:00
Kohya S	e0db59695f	update multi-res training in SD3.5M	2024-11-02 11:13:04 +09:00
Kohya S.	264328d117	Merge pull request #1719 from kohya-ss/sd3_5_support ... SD3.5 Large support	2024-11-01 21:55:48 +09:00
Kohya S	82daa98fe8	remove duplicate resolution for scaled pos embed	2024-11-01 21:43:47 +09:00
Kohya S	9aa6f52ac3	Fix memory leak in latent caching. bmp failed to cache	2024-11-01 21:43:21 +09:00
Kohya S	830df4abcc	Fix crashing if image is too tall or wide.	2024-10-31 21:39:07 +09:00
Kohya S	9e23368e3d	Update SD3 training	2024-10-31 19:58:41 +09:00
Kohya S	1434d8506f	Support SD3.5M multi resolutional training	2024-10-31 19:58:22 +09:00
Kohya S	70a179e446	Fix to use SDPA instead of xformers	2024-10-30 14:34:19 +09:00
Kohya S	8c3c825b5f	Merge branch 'sd3_5_support' of https://github.com/kohya-ss/sd-scripts into sd3_5_support	2024-10-30 12:51:55 +09:00
Kohya S	bdddc20d68	support SD3.5M	2024-10-30 12:51:49 +09:00
kohya-ss	b502f58488	Fix emb_dim to work.	2024-10-29 23:29:50 +09:00
kohya-ss	c9a1417157	Merge branch 'sd3' into sd3_5_support	2024-10-29 22:30:01 +09:00
kohya-ss	ce5b532582	Fix additional LoRA to work	2024-10-29 22:29:24 +09:00
Kohya S	1e2f7b0e44	Support for checkpoint files with a mysterious prefix "model.diffusion_model."	2024-10-29 22:11:04 +09:00
kohya-ss	80bb3f4ecf	Merge branch 'sd3_5_support' of https://github.com/kohya-ss/sd-scripts into sd3_5_support	2024-10-29 21:52:08 +09:00
kohya-ss	d4e19fbd5e	Support Lora	2024-10-29 21:52:04 +09:00
kohya-ss	0af4edd8a6	Fix split_qkv	2024-10-29 21:51:56 +09:00
Kohya S	75554867ce	Fix error on saving T5XXL	2024-10-29 08:34:31 +09:00
Kohya S	af8e216035	Fix sample image gen to work with block swap	2024-10-28 22:08:57 +09:00
kohya-ss	1065dd1b56	Fix to work dropout_rate for TEs	2024-10-27 19:36:36 +09:00
kohya-ss	d4f7849592	prevent unintended cast for disk cached TE outputs	2024-10-27 19:35:56 +09:00
kohya-ss	a1255d637f	Fix SD3 LoRA training to work (WIP)	2024-10-27 17:03:36 +09:00
Kohya S	db2b4d41b9	Add dropout rate arguments for CLIP-L, CLIP-G, and T5, fix Text Encoders LoRA not trained	2024-10-27 16:42:58 +09:00
Kohya S	b649bbf2b6	Merge branch 'sd3' into sd3_5_support	2024-10-27 10:20:35 +09:00
Kohya S	731664b8c3	Merge branch 'dev' into sd3	2024-10-27 10:20:14 +09:00
Kohya S	e070bd9973	Merge branch 'main' into dev	2024-10-27 10:19:55 +09:00
Kohya S	ca44e3e447	reduce VRAM usage, instead of increasing main RAM usage	2024-10-27 10:19:05 +09:00
Kohya S	150579db32	Merge branch 'sd3' into sd3_5_support	2024-10-26 22:03:41 +09:00
Kohya S	8549669f89	Merge branch 'dev' into sd3	2024-10-26 22:02:57 +09:00
Kohya S	900d551a6a	Merge branch 'main' into dev	2024-10-26 22:02:36 +09:00
Kohya S	56b4ea963e	Fix LoRA metadata hash calculation bug in svd_merge_lora.py, sdxl_merge_lora.py, and resize_lora.py closes #1722	2024-10-26 22:01:10 +09:00
kohya-ss	014064fd81	fix sample image generation without seed failed close #1726	2024-10-26 18:59:45 +09:00
kohya-ss	56bf761164	fix errors in SD3 LoRA training with Text Encoders close #1724	2024-10-26 17:29:24 +09:00
kohya-ss	0031d916f0	add latent scaling/shifting	2024-10-25 23:20:38 +09:00
kohya-ss	d2c549d7b2	support SD3 LoRA	2024-10-25 21:58:31 +09:00
Kohya S	f52fb66e8f	Merge branch 'sd3' into sd3_5_support	2024-10-25 19:03:58 +09:00
Kohya S	5fba6f514a	Merge branch 'dev' into sd3	2024-10-25 19:03:27 +09:00
Kohya S	b1e6504007	update README	2024-10-25 18:56:25 +09:00
Kohya S.	b8ae745d0c	Merge pull request #1717 from catboxanon/fix/remove-vpred-warnings ... Remove v-pred warnings	2024-10-25 18:49:40 +09:00
Kohya S.	c632af860e	Merge pull request #1715 from catboxanon/vpred-ztsnr-fixes ... Update debiased estimation loss function to accommodate V-pred	2024-10-25 18:48:14 +09:00
Kohya S	f8c5146d71	support block swap with fused_optimizer_pass	2024-10-24 22:02:05 +09:00
Kohya S	0286114bd2	support SD3.5L, fix final saving	2024-10-24 21:28:42 +09:00
Kohya S	e3c43bda49	reduce memory usage in sample image generation	2024-10-24 20:35:47 +09:00
Kohya S	623017f716	refactor SD3 CLIP to transformers etc.	2024-10-24 19:49:28 +09:00
catboxanon	be14c06267	Remove v-pred warnings ... Different model architectures, such as SDXL, can take advantage of v-pred. It doesn't make sense to include these warnings anymore.	2024-10-22 12:13:51 -04:00
catboxanon	0e7c592933	Remove scale_v_pred_loss_like_noise_pred deprecation ... https://github.com/kohya-ss/sd-scripts/pull/1715#issuecomment-2427876376	2024-10-22 11:19:34 -04:00