psychedelicious
df849035ee
feat(ui): allow setting isEnabled, isLocked and name in createNewCanvasEntityFromImage util
2024-12-01 19:37:49 -08:00
psychedelicious
8d97fe69ca
feat(ui): use imageDTOToFile in staging area save to gallery button
2024-12-01 19:37:49 -08:00
psychedelicious
9044e53a9b
feat(ui): add imageDTOToFile util
2024-12-01 19:37:49 -08:00
Jonathan
6012b0f912
Update flux_text_encoder.py
...
Updated version number for FLUX Text Encoding.
2024-11-30 08:29:21 -05:00
Jonathan
bb0ed5dc8a
Update flux_denoise.py
...
Updated node version for FLUX Denoise.
2024-11-30 08:29:21 -05:00
Ryan Dick
021552fd81
Avoid unnecessary dtype conversions with rope encodings.
2024-11-29 12:32:50 -05:00
Ryan Dick
be73dbba92
Use view() instead of rearrange() for better performance.
2024-11-29 12:32:50 -05:00
Ryan Dick
db9c0cad7c
Replace custom RMSNorm implementation with torch.nn.functional.rms_norm(...) for improved speed.
2024-11-29 12:32:50 -05:00
Ryan Dick
54b7f9a063
FLUX Regional Prompting ( #7388 )
...
## Summary
This PR adds support for regional prompting with FLUX.
### Example 1
Global prompt: `An architecture rendering of the reception area of a
corporate office with modern decor.`
<img width="1386" alt="image"
src="https://github.com/user-attachments/assets/c8169bdb-49a9-44bc-bd9e-58d98e09094b ">
## QA Instructions
- [x] Test that there is no slowdown in the base case with a single
global prompt.
- [x] Test image fully covered by regional masks.
- [x] Test image covered by region masks with small gaps.
- [x] Test region masks with large unmasked ‘background’ regions
- [x] Test region masks with significant overlap
- [x] Test multiple global prompts.
- [x] Test no global prompt.
- [x] Test regional negative prompts (It runs... but results are not
great. Needs more tuning to be useful.)
- Test compatibility with:
- [x] ControlNet
- [x] LoRA
- [x] IP-Adapter
## Remaining TODO
- [x] Disable the following UI features for FLUX prompt regions:
negative prompts, reference images, auto-negative.
## Checklist
- [x] _The PR has a short but descriptive title, suitable for a
changelog_
- [x] _Tests added / updated (if applicable)_
- [x] _Documentation added / updated (if applicable)_
- [ ] _Updated `What's New` copy (if doing a release after this PR)_
2024-11-29 08:56:42 -05:00
psychedelicious
7d488a5352
feat(ui): add delete button to regional ref image empty state
2024-11-29 15:51:24 +10:00
psychedelicious
4d7667f63d
fix(ui): add missing translations
2024-11-29 15:43:49 +10:00
psychedelicious
08704ee8ec
feat(ui): use canvas layer validators in control/ip adapter graph builders
2024-11-29 15:32:48 +10:00
psychedelicious
5910892c33
Merge remote-tracking branch 'origin/main' into ryan/flux-regional-prompting
2024-11-29 15:19:39 +10:00
psychedelicious
46a09d9e90
feat(ui): format warnings tooltip
2024-11-29 13:32:51 +10:00
psychedelicious
df0c7d73f3
feat(ui): use regional guidance validation utils in graph builders
2024-11-29 13:26:09 +10:00
psychedelicious
3905c97e32
feat(ui): return translation keys from validation utils instead of translated strings
2024-11-29 13:25:09 +10:00
psychedelicious
0be796a808
feat(ui): use layer validation utils in invoke readiness utils
2024-11-29 13:14:26 +10:00
psychedelicious
7dd33b0f39
feat(ui): add indicator to canvas layer headers, displaying validation warnings
...
If there are any issues with the layer, the icon is displayed. If the layer is disabled, the icon is greyed out but still visible.
2024-11-29 13:13:47 +10:00
psychedelicious
484aaf1595
feat(ui): add canvas layer validation utils
...
These helpers consolidate layer validation checks. For example, checking that the layer has content drawn, is compatible with the selected main model, has valid reference images, etc.
2024-11-29 13:12:32 +10:00
psychedelicious
c276b60af9
tidy(ui): use object for addRegions graph builder util arg
2024-11-29 08:49:41 +10:00
Ryan Dick
5d8dd6e26e
Fix FLUX regional negative prompts.
2024-11-28 18:49:29 +00:00
Emmanuel Ferdman
5bca68d873
docs: update code of conduct reference
...
Signed-off-by: Emmanuel Ferdman <emmanuelferdman@gmail.com>
2024-11-27 17:38:33 -08:00
Ryan Dick
64364e7911
Short-circuit if there are no region masks in FLUX and don't apply attention masking.
2024-11-27 22:40:10 +00:00
Ryan Dick
6565cea039
Comment unused _prepare_unrestricted_attn_mask(...) for future reference.
2024-11-27 22:16:44 +00:00
Ryan Dick
3ebd8d6c07
Delete outdated TODO comment.
2024-11-27 22:13:25 +00:00
Ryan Dick
e970185161
Tweak flux regional prompting attention scheme based on latest experimentation.
2024-11-27 22:13:07 +00:00
Ryan Dick
fa5653cdf7
Remove unused 'denoise' param to addRegions().
2024-11-27 17:08:42 +00:00
Ryan Dick
9a7b000995
Update frontend to support regional prompts with FLUX in the canvas.
2024-11-27 17:04:43 +00:00
Ryan Dick
3a27242838
Bump transformers. The main motivation for this bump is to ingest a fix for DepthAnything postprocessing artifacts.
2024-11-27 07:46:16 -08:00
Ryan Dick
8cfb032051
Add utility ImagePanelLayoutInvocation for working with In-Context LoRA workflows.
2024-11-26 20:58:31 -08:00
Ryan Dick
06a9d4e2b2
Use a Textarea component for the FluxTextEncoderInvocation prompt field.
2024-11-26 20:58:31 -08:00
Brandon Rising
ed46acee79
fix: Fail scan on InvalidMagicError in picklescan, update default for read_checkpoint_meta to scan unless explicitly told not to
2024-11-26 16:17:12 -05:00
Ryan Dick
b54463d294
Allow regional prompting background regions to attend to themselves and to the entire txt embedding.
2024-11-26 17:57:31 +00:00
Ryan Dick
faee79dc95
Distinguish between restricted and unrestricted attn masks in FLUX regional prompting.
2024-11-26 16:55:52 +00:00
Mary Hipp
965cd76e33
lint fix
2024-11-26 11:25:53 -05:00
Mary Hipp
e5e8cbf34c
shorten reference image mode descriptions;
2024-11-26 11:25:53 -05:00
Mary Hipp
3412a52594
(ui): updates various informational tooltips, adds descriptons to IP adapter method options
2024-11-26 11:25:53 -05:00
Ryan Dick
e01f66b026
Apply regional attention masks in the single stream blocks in addition to the double stream blocks.
2024-11-25 22:40:08 +00:00
Ryan Dick
53abdde242
Update Flux RegionalPromptingExtension to prepare both a mask with restricted image self-attention and a mask with unrestricted image self attention.
2024-11-25 22:04:23 +00:00
Ryan Dick
94c088300f
Be smarter about selecting the global CLIP embedding for FLUX regional prompting.
2024-11-25 20:15:04 +00:00
Ryan Dick
3741a6f5e0
Fix device handling for regional masks and apply the attention mask in the FLUX double stream block.
2024-11-25 16:02:03 +00:00
Kent Keirsey
059336258f
Create SECURITY.md
2024-11-25 04:10:03 -08:00
Ryan Dick
2c23b8414c
Use a single global CLIP embedding for FLUX regional guidance.
2024-11-22 23:01:43 +00:00
Mary Hipp
271cc52c80
fix(ui): use token for download if its in store
2024-11-22 12:08:05 -05:00
Ryan Dick
20356c0746
Fixup the logic for preparing FLUX regional prompt attention masks.
2024-11-21 22:46:25 +00:00
psychedelicious
e44458609f
chore: bump version to v5.4.3rc1
2024-11-21 10:32:43 -08:00
psychedelicious
69d86a7696
feat(ui): address feedback
2024-11-21 09:54:35 -08:00
Hippalectryon
56db1a9292
Use proxyrect and setEntityPosition to sync transformer position
2024-11-21 09:54:35 -08:00
Hippalectryon
cf50e5eeee
Make sure the canvas is focused
2024-11-21 09:54:35 -08:00
Hippalectryon
c9c07968d2
lint
2024-11-21 09:54:35 -08:00
