Ryan Dick
c7b84cf012
WIP - first pass at overhauling ModelCache to work with partial loads.
2024-12-05 23:03:40 +00:00
Ryan Dick
8e409e3436
Delete experimental torch device autocasting solutions and clean up TorchFunctionAutocastDeviceContext.
2024-12-05 19:36:44 +00:00
Ryan Dick
987393853c
Create CachedModelOnlyFullLoad class.
2024-12-05 18:43:50 +00:00
Ryan Dick
91c5af1b95
Move CachedModelWithPartialLoad into the main model_cache/ directory.
2024-12-05 18:21:26 +00:00
Ryan Dick
5c67dd507a
Get rid of ModelLocker. It was an unnecessary layer of indirection.
2024-12-05 16:59:40 +00:00
Ryan Dick
2ff928ec17
Move lock(...) and unlock(...) logic from ModelLocker to the ModelCache and make a bunch of ModelCache properties/methods private.
2024-12-05 16:11:40 +00:00
Ryan Dick
4327bbe77e
Pull get_model_cache_key(...) out of ModelCache. The ModelCache should not be concerned with implementation details like the submodel_type.
2024-12-04 22:53:57 +00:00
Ryan Dick
ad1c0d37ef
Rename model_cache_default.py -> model_cache.py.
2024-12-04 22:45:30 +00:00
Ryan Dick
9708d87946
Remove ModelCacheBase.
2024-12-04 22:05:34 +00:00
Ryan Dick
3ad44f7850
Move CacheStats to its own file.
2024-12-04 21:56:50 +00:00
Ryan Dick
9a482981b2
Move CacheRecord out to its own file.
2024-12-04 21:53:19 +00:00
Ryan Dick
6b02362b12
Rip out ModelLockerBase.
2024-12-04 21:47:11 +00:00
Ryan Dick
8fec4ec91c
Tidy up CachedModel and improve unit test coverage.
2024-12-04 20:28:31 +00:00
Ryan Dick
693e421970
Alternative implementation with torch.nn.Linear module streaming.
2024-12-03 22:32:15 +00:00
Ryan Dick
dc14104bc8
Add TorchFunctionAutocastContext
2024-12-03 19:26:46 +00:00
Ryan Dick
f286a1d1f3
Remove debug logs.
2024-12-03 18:04:55 +00:00
Ryan Dick
9dc86b2b71
Add basic CachedModel class with features for partial load/unload.
2024-12-03 17:12:22 +00:00
Ryan Dick
2cab689b79
Naive TorchAutocastContext.
2024-12-03 14:55:43 +00:00
psychedelicious
f8c7adddd0
feat(ui): add vietnamese to language picker
...
Closes #7384
2024-12-02 08:12:14 -05:00
psychedelicious
17da1d92e9
fix(ui): remove "adding to" text on Invoke tooltip on Workflows/Upscaling tabs
...
The "adding to" text indicates if images are going to the gallery or staging area. This info is relevant only to the canvas tab, but was displayed on Upscaling and Workflows tabs. Removed it from those tabs.
2024-12-02 08:08:16 -05:00
psychedelicious
1cc57a4854
chore(ui): lint
2024-12-02 07:59:12 -05:00
psychedelicious
3993fae331
fix(ui): unable to invoke w/ empty inpaint mask or raster layer
...
Removed the empty state checks for these layer types - it's always OK to invoke when they are empty.
2024-12-02 07:59:12 -05:00
psychedelicious
1446526d55
tidy(ui): translation keys for canvas layer warnings
2024-12-02 07:59:12 -05:00
psychedelicious
62c024e725
feat(ui): add gallery image ctx menu items to create ref image from image
...
Appears these actions disappeared at some point. Restoring them.
2024-12-02 07:52:58 -05:00
psychedelicious
1e92bb4e94
fix(ui): ref image defaults to prev ref image's image selection
...
A redux selector is used to get the "default" IP Adapter. The selector uses the model list query result to select an IP Adapter model to be preset by default.
The selector is memoized, so if we mutate the returned default IP Adapter state, it mutates the result of the selector for all consumers.
For example, the `image` property of the default IP Adapter selector result is `null`. When we set the `image` property of the selector result while creating an IP Adapter, this does not trigger the selector to recompute its result. We end up setting the image for the selector result directly, and all other consumers now have that same image set.
Solution - we need to clone the selector result everywhere it is used. This was missed in a few spots, causing the issue.
2024-12-02 07:48:39 -05:00
psychedelicious
db6398fdf6
feat(ui): less confusing empty state for rg ref images
...
It was easy to misunderstand the empty state for a regional guidance reference image. There was no label, so it seemed like it was the whole region that was empty.
This small change adds the "Reference Image" heading to the empty state, so it's clear that the empty state messaging refers to this reference image, not the whole regional guidance layer.
2024-12-02 07:46:10 -05:00
Riccardo Giovanetti
ebd73a2ac2
translationBot(ui): update translation (Italian)
...
Currently translated at 98.7% (1622 of 1643 strings)
Co-authored-by: Riccardo Giovanetti <riccardo.giovanetti@gmail.com>
Translate-URL: https://hosted.weblate.org/projects/invokeai/web-ui/it/
Translation: InvokeAI/Web UI
2024-12-02 02:13:51 -08:00
Hosted Weblate
8ee95cab00
translationBot(ui): update translation files
...
Updated by "Cleanup translation files" hook in Weblate.
Co-authored-by: Hosted Weblate <hosted@weblate.org>
Translate-URL: https://hosted.weblate.org/projects/invokeai/web-ui/
Translation: InvokeAI/Web UI
2024-12-02 02:13:51 -08:00
Linos
d1184201a8
translationBot(ui): update translation (Vietnamese)
...
Currently translated at 100.0% (1643 of 1643 strings)
translationBot(ui): update translation (Vietnamese)
Currently translated at 100.0% (1638 of 1638 strings)
Co-authored-by: Linos <linos.coding@gmail.com>
Translate-URL: https://hosted.weblate.org/projects/invokeai/web-ui/vi/
Translation: InvokeAI/Web UI
2024-12-02 02:13:51 -08:00
Nik Nikovsky
5887891654
translationBot(ui): update translation (Polish)
...
Currently translated at 4.9% (81 of 1638 strings)
Co-authored-by: Nik Nikovsky <zejdzztegomaila@gmail.com>
Translate-URL: https://hosted.weblate.org/projects/invokeai/web-ui/pl/
Translation: InvokeAI/Web UI
2024-12-02 02:13:51 -08:00
Riku
765ca4e004
translationBot(ui): update translation (German)
...
Currently translated at 69.7% (1142 of 1638 strings)
Co-authored-by: Riku <riku.block@gmail.com>
Translate-URL: https://hosted.weblate.org/projects/invokeai/web-ui/de/
Translation: InvokeAI/Web UI
2024-12-02 02:13:51 -08:00
Riku
159b00a490
fix(app): adjust session queue api type
2024-12-01 20:06:05 -08:00
Riku
3fbf6f2d2a
chore(ui): update typegen schema
2024-12-01 19:56:09 -08:00
Riku
931fca7cd1
fix(ui): call cancel instead of clear queue
2024-12-01 19:53:12 -08:00
Riku
db84a3a5d4
refactor(ui): move clear queue hook to separate file
2024-12-01 19:42:25 -08:00
psychedelicious
ca8313e805
feat(ui): add new layer from image menu items for staging area
...
The layers are disabled when created so as to not interfere with the canvas state.
2024-12-01 19:37:49 -08:00
psychedelicious
df849035ee
feat(ui): allow setting isEnabled, isLocked and name in createNewCanvasEntityFromImage util
2024-12-01 19:37:49 -08:00
psychedelicious
8d97fe69ca
feat(ui): use imageDTOToFile in staging area save to gallery button
2024-12-01 19:37:49 -08:00
psychedelicious
9044e53a9b
feat(ui): add imageDTOToFile util
2024-12-01 19:37:49 -08:00
Jonathan
6012b0f912
Update flux_text_encoder.py
...
Updated version number for FLUX Text Encoding.
2024-11-30 08:29:21 -05:00
Jonathan
bb0ed5dc8a
Update flux_denoise.py
...
Updated node version for FLUX Denoise.
2024-11-30 08:29:21 -05:00
Ryan Dick
021552fd81
Avoid unnecessary dtype conversions with rope encodings.
2024-11-29 12:32:50 -05:00
Ryan Dick
be73dbba92
Use view() instead of rearrange() for better performance.
2024-11-29 12:32:50 -05:00
Ryan Dick
db9c0cad7c
Replace custom RMSNorm implementation with torch.nn.functional.rms_norm(...) for improved speed.
2024-11-29 12:32:50 -05:00
psychedelicious
7d488a5352
feat(ui): add delete button to regional ref image empty state
2024-11-29 15:51:24 +10:00
psychedelicious
4d7667f63d
fix(ui): add missing translations
2024-11-29 15:43:49 +10:00
psychedelicious
08704ee8ec
feat(ui): use canvas layer validators in control/ip adapter graph builders
2024-11-29 15:32:48 +10:00
psychedelicious
5910892c33
Merge remote-tracking branch 'origin/main' into ryan/flux-regional-prompting
2024-11-29 15:19:39 +10:00
psychedelicious
46a09d9e90
feat(ui): format warnings tooltip
2024-11-29 13:32:51 +10:00
psychedelicious
df0c7d73f3
feat(ui): use regional guidance validation utils in graph builders
2024-11-29 13:26:09 +10:00
