195 Commits

Author	SHA1	Message	Date
Kohya S	e070bd9973	Merge branch 'main' into dev	2024-10-27 10:19:55 +09:00
Kohya S	ca44e3e447	reduce VRAM usage, instead of increasing main RAM usage	2024-10-27 10:19:05 +09:00
Kohya S	900d551a6a	Merge branch 'main' into dev	2024-10-26 22:02:36 +09:00
Kohya S	56b4ea963e	Fix LoRA metadata hash calculation bug in svd_merge_lora.py, sdxl_merge_lora.py, and resize_lora.py closes #1722	2024-10-26 22:01:10 +09:00
Kohya S	d7e14721e2	Merge branch 'main' into dev	2024-09-19 21:15:19 +09:00
Kohya S	9c757c2fba	fix SDXL block index to match LBW	2024-09-19 21:14:57 +09:00
Kohya S	93d9fbf607	improve OFT implementation closes #944	2024-09-13 22:37:11 +09:00
Kohya S	43ad73860d	Merge branch 'main' into dev	2024-09-13 21:29:51 +09:00
Kohya S	b755ebd0a4	add LBW support for SDXL merge LoRA	2024-09-13 21:29:31 +09:00
Kohya S	f4a0bea6dc	format by black	2024-09-13 21:26:06 +09:00
terracottahaniwa	734d2e5b2b	Support Lora Block Weight (LBW) to svd_merge_lora.py (#1575) ... * support lora block weight * solve license incompatibility * Fix issue: lbw index calculation	2024-09-13 20:45:35 +09:00
Kohya S	9d2860760d	Merge branch 'main' into dev	2024-09-13 19:48:53 +09:00
Kohya S	3387dc7306	formatting, update README	2024-09-13 19:45:42 +09:00
Kohya S	57ae44eb61	refactor to make safer	2024-09-13 19:45:00 +09:00
Maru-mee	1d7118a622	Support : OFT merge to base model (#1580) ... * Support : OFT merge to base model * Fix typo * Fix typo_2 * Delete unused parameter 'eye'	2024-09-13 19:01:36 +09:00
Kohya S	afb971f9c3	fix SD1.5 LoRA extraction #1490	2024-08-22 21:33:15 +09:00
Kohya S	1a104dc75e	make forward/backward pathes same ref #1363	2024-06-09 19:26:36 +09:00
rockerBOO	00513b9b70	Add LoRA+ LR Ratio info message to logger	2024-05-23 22:27:12 -04:00
Kohya S	146edce693	support Diffusers' based SDXL LoRA key for inference	2024-05-18 11:05:04 +09:00
Kohya S	16677da0d9	fix create_network_from_weights doesn't work	2024-05-12 22:15:07 +09:00
Kohya S	44190416c6	update docs etc.	2024-05-12 17:01:20 +09:00
Kohya S	3c8193f642	revert lora+ for lora_fa	2024-05-12 17:00:51 +09:00
Kohya S	3fd8cdc55d	fix dylora loraplus	2024-05-06 14:03:19 +09:00
Kohya S	7fe81502d0	update loraplus on dylora/lofa_fa	2024-05-06 11:09:32 +09:00
Kohya S	58c2d856ae	support block dim/lr for sdxl	2024-05-03 22:18:20 +09:00
Kohya S	969f82ab47	move loraplus args from args to network_args, simplify log lr desc	2024-04-29 20:04:25 +09:00
Kohya S	834445a1d6	Merge pull request #1233 from rockerBOO/lora-plus ... Add LoRA+ support	2024-04-29 18:05:12 +09:00
rockerBOO	68467bdf4d	Fix unset or invalid LR from making a param_group	2024-04-11 17:33:19 -04:00
rockerBOO	75833e84a1	Fix default LR, Add overall LoRA+ ratio, Add log ... `--loraplus_ratio` added for both TE and UNet Add log for lora+	2024-04-08 19:23:02 -04:00
rockerBOO	1933ab4b48	Fix default_lr being applied	2024-04-03 12:46:34 -04:00
Kohya S	b748b48dbb	fix attention couple+deep shink cause error in some reso	2024-04-03 12:43:08 +09:00
rockerBOO	c7691607ea	Add LoRA-FA for LoRA+	2024-04-01 15:43:04 -04:00
rockerBOO	f99fe281cb	Add LoRA+ support	2024-04-01 15:38:26 -04:00
Yuta Hayashibe	5d5f39b6e6	Replaced print with logger	2024-02-25 01:24:11 +09:00
Kohya S	8b7c14246a	some log output to print	2024-02-24 20:50:00 +09:00
Kohya S	52b3799989	fix format, add new conv rank to metadata comment	2024-02-24 20:49:41 +09:00
Kohya S	0e703608f9	Merge branch 'dev' into resize_lora-add-rank-for-conv	2024-02-24 20:09:38 +09:00
Kohya S	fb9110bac1	format by black	2024-02-24 20:00:57 +09:00
Kohya S	86279c8855	Merge branch 'dev' into DyLoRA-xl	2024-02-24 19:18:36 +09:00
tamlog06	a6f1ed2e14	fix dylora create_modules error	2024-02-18 13:20:47 +00:00
Kohya S	baa0e97ced	Merge branch 'dev' into dev_device_support	2024-02-17 11:54:07 +09:00
Kohya S	cbe9c5dc06	supprt deep shink with regional lora, add prompter module	2024-02-12 14:17:27 +09:00
Kohya S	358ca205a3	Merge branch 'dev' into dev_device_support	2024-02-12 13:01:54 +09:00
Yuta Hayashibe	5f6bf29e52	Replace print with logger if they are logs (#905) ... * Add get_my_logger() * Use logger instead of print * Fix log level * Removed line-breaks for readability * Use setup_logging() * Add rich to requirements.txt * Make simple * Use logger instead of print --------- Co-authored-by: Kohya S <52813779+kohya-ss@users.noreply.github.com>	2024-02-04 18:14:34 +09:00
mgz	1492bcbfa2	add --new_conv_rank option ... update script to also take a separate conv rank value	2024-02-03 23:18:55 -06:00
mgz	bf2de5620c	fix formatting in resize_lora.py	2024-02-03 20:09:37 -06:00
Disty0	a6a2b5a867	Fix IPEX support and add XPU device to device_utils	2024-01-31 17:32:37 +03:00
Kohya S	2ca4d0c831	Merge pull request #1054 from akx/mps ... Device support improvements (MPS)	2024-01-31 21:30:12 +09:00
mgz	d4b9568269	fix broken import in svd_merge_lora script ... remove missing import, and remove unused imports	2024-01-28 11:59:07 -06:00
Aarni Koskela	478156b4f7	Refactor device determination to function; add MPS fallback	2024-01-23 14:29:03 +02:00