 v0xie
|
7e1bd3e3c3
|
refactor: syntax and add 0.0 on new line
|
2024-07-19 13:44:22 -07:00 |
|
|
v0xie
|
a5f66b5003
|
feature: beta scheduler
|
2024-07-18 15:53:54 -07:00 |
|
|
v0xie
|
663a4d80df
|
add new sampler DDIM CFG++
|
2024-06-16 17:47:21 -07:00 |
|
|
v0xie
|
a669b8a6bc
|
fix: remove script callbacks in ordered_callbacks_map
|
2024-04-01 12:51:09 -07:00 |
|
|
v0xie
|
07805cbeee
|
fix: AttributeError when attempting to reshape rescale by org_module weight
|
2024-03-14 17:05:14 -07:00 |
|
|
v0xie
|
eb6f2df826
|
Revert "fix: add butterfly_factor fn"
This reverts commit 81c16c965e.
|
2024-02-08 22:00:15 -08:00 |
|
|
v0xie
|
613b0d9548
|
doc: add boft comment
|
2024-02-08 21:58:59 -08:00 |
|
|
v0xie
|
325eaeb584
|
fix: get boft params from weight shape
|
2024-02-08 11:55:05 -08:00 |
|
|
v0xie
|
2f1073dc6e
|
style: fix lint
|
2024-02-07 04:55:11 -08:00 |
|
|
v0xie
|
81c16c965e
|
fix: add butterfly_factor fn
|
2024-02-07 04:54:14 -08:00 |
|
|
v0xie
|
a4668a16b6
|
fix: calculate butterfly factor
|
2024-02-07 04:51:22 -08:00 |
|
|
v0xie
|
9588721197
|
feat: support LyCORIS BOFT
|
2024-02-07 04:49:17 -08:00 |
|
|
v0xie
|
fd383140cf
|
fix: wrong devices for eye and constraint
|
2024-01-22 02:52:34 -08:00 |
|
|
v0xie
|
eb667e715a
|
feat: LyCORIS/kohya OFT network support
|
2023-11-15 18:28:48 -08:00 |
|
|
v0xie
|
d6d0b22e66
|
fix: ignore calc_scale() for COFT which has very small alpha
|
2023-11-15 03:08:50 -08:00 |
|
|
v0xieandGitHub
|
7edd50f304
|
Merge pull request #2 from v0xie/network-oft-change-impl
Use same updown implementation for LyCORIS OFT as kohya-ss OFT
|
2023-11-04 15:06:04 -07:00 |
|
|
v0xie
|
bbf00a96af
|
refactor: remove unused function
|
2023-11-04 14:56:47 -07:00 |
|
|
v0xie
|
329c8bacce
|
refactor: use same updown for both kohya OFT and LyCORIS diag-oft
|
2023-11-04 14:54:36 -07:00 |
|
|
v0xieandGitHub
|
1dd25be037
|
Merge pull request #1 from v0xie/oft-faster
Support LyCORIS diag-oft OFT implementation (minus MultiheadAttention layer), maintains support for kohya-ss OFT
|
2023-11-03 19:47:27 -07:00 |
|
|
v0xie
|
f6c8201e56
|
refactor: move factorization to lyco_helpers, separate calc_updown for kohya and kb
|
2023-11-03 19:35:15 -07:00 |
|
|
v0xie
|
fe1967a4c4
|
skip multihead attn for now
|
2023-11-03 17:52:55 -07:00 |
|
|
v0xie
|
d727ddfccd
|
no idea what i'm doing, trying to support both type of OFT, kblueleaf diag_oft has MultiheadAttn which kohya's doesn't?, attempt create new module based off network_lora.py, errors about tensor dim mismatch
|
2023-11-02 00:13:11 -07:00 |
|
|
v0xie
|
65ccd6305f
|
detect diag_oft type
|
2023-11-02 00:11:32 -07:00 |
|
|
v0xie
|
a2fad6ee05
|
test implementation based on kohaku diag-oft implementation
|
2023-11-01 22:34:27 -07:00 |
|
|
v0xie
|
6523edb8a4
|
style: conform style
|
2023-10-22 09:31:15 -07:00 |
|
|
v0xie
|
3b8515d2c9
|
fix: multiplier applied twice in finalize_updown
|
2023-10-22 09:27:48 -07:00 |
|
|
v0xie
|
4a50c9638c
|
refactor: remove used OFT functions
|
2023-10-22 08:54:24 -07:00 |
|
|
v0xie
|
de8ee92ed8
|
fix: use merge_weight to cache value
|
2023-10-21 17:37:17 -07:00 |
|
|
v0xie
|
76f5abdbdb
|
style: cleanup oft
|
2023-10-21 16:07:45 -07:00 |
|
|
v0xie
|
fce86ab7d7
|
fix: support multiplier, no forward pass hook
|
2023-10-21 16:03:54 -07:00 |
|
|
v0xie
|
7683547728
|
fix: return orig weights during updown, merge weights before forward
|
2023-10-21 14:42:24 -07:00 |
|
|
v0xie
|
2d8c894b27
|
refactor: use forward hook instead of custom forward
|
2023-10-21 13:43:31 -07:00 |
|
|
v0xie
|
0550659ce6
|
style: fix ambiguous variable name
|
2023-10-19 13:13:02 -07:00 |
|
|
v0xie
|
d10c4db57e
|
style: formatting
|
2023-10-19 12:52:14 -07:00 |
|
|
v0xie
|
321680ccd0
|
refactor: fix constraint, re-use get_weight
|
2023-10-19 12:41:17 -07:00 |
|
|
v0xie
|
eb01d7f0e0
|
faster by calculating R in updown and using cached R in forward
|
2023-10-18 04:56:53 -07:00 |
|
|
v0xie
|
853e21d98e
|
faster by using cached R in forward
|
2023-10-18 04:27:44 -07:00 |
|
|
v0xie
|
1c6efdbba7
|
inference working but SLOW
|
2023-10-18 04:16:01 -07:00 |
|
|
v0xie
|
ec718f76b5
|
wip incorrect OFT implementation
|
2023-10-17 23:35:50 -07:00 |
|
|
v0xie
|
906d1179e9
|
support inference with LyCORIS GLora networks
|
2023-10-11 21:26:58 -07:00 |
|
