7fc3ccdcc2
Add that nvidia cosmos is supported to the README.
2025-01-16 21:17:18 -05:00
55add50220
Bump ComfyUI version to v0.3.12
Python Linting / Run Ruff (push) Failing after 40s
Build package / Build Test (3.10) (push) Failing after 37s
Build package / Build Test (3.11) (push) Failing after 36s
Build package / Build Test (3.12) (push) Failing after 35s
Build package / Build Test (3.9) (push) Failing after 34s
2025-01-16 18:11:57 -05:00
0aa2368e46
Fix some cosmos fp8 issues.
2025-01-16 17:45:37 -05:00
cca96a85ae
Fix cosmos VAE failing with videos longer than 121 frames.
2025-01-16 16:30:06 -05:00
619b8cde74
Bump ComfyUI version to 0.3.11
Python Linting / Run Ruff (push) Failing after 42s
Build package / Build Test (3.10) (push) Failing after 35s
Build package / Build Test (3.11) (push) Failing after 33s
Build package / Build Test (3.12) (push) Failing after 30s
Build package / Build Test (3.9) (push) Failing after 35s
2025-01-16 14:54:48 -05:00
31831e6ef1
Code refactor.
2025-01-16 07:23:54 -05:00
88ceb28e20
Tweak hunyuan memory usage factor.
2025-01-16 06:31:03 -05:00
23289a6a5c
Clean up some debug lines.
2025-01-16 04:24:39 -05:00
9d8b6c1f46
More accurate memory estimation for cosmos and hunyuan video.
2025-01-16 03:48:40 -05:00
6320d05696
Slightly lower hunyuan video memory usage.
2025-01-16 00:23:01 -05:00
25683b5b02
Lower cosmos diffusion model memory usage.
2025-01-15 23:46:42 -05:00
4758fb64b9
Lower cosmos VAE memory usage by a bit.
2025-01-15 22:57:52 -05:00
008761166f
Optimize first attention block in cosmos VAE.
2025-01-15 21:48:46 -05:00
bfd5dfd611
3.13 doesn't work yet.
2025-01-15 20:32:44 -05:00
55ade36d01
Remove python 3.8 from test-build workflow.
2025-01-15 20:24:55 -05:00
2e20e399ea
Add minimum numpy version to requirements.txt
2025-01-15 20:19:56 -05:00
3baf92d120
CosmosImageToVideoLatent batch_size now does something.
2025-01-15 17:19:59 -05:00
1709a8441e
Use latest python 3.12.8 the portable release.
2025-01-15 14:50:40 -05:00
cba58fff0b
Remove unsafe embedding load for very old pytorch.
2025-01-15 04:32:23 -05:00
2feb8d0b77
Force safe loading of files in torch format on pytorch 2.4+
...
If this breaks something for you make an issue.
2025-01-15 03:50:27 -05:00
5b657f8c15
Allow setting start and end image in CosmosImageToVideoLatent.
2025-01-15 00:41:35 -05:00
2cdbaf5169
Add SetFirstSigma node ( #6459 )
...
Useful for models utilizing ztSNR. See: https://arxiv.org/abs/2409.15997
2025-01-14 19:05:45 -05:00
c78a45685d
Rewrite res_multistep sampler and implement res_multistep_cfg_pp sampler. ( #6462 )
2025-01-14 18:20:06 -05:00
3aaabb12d4
Implement Cosmos Image/Video to World (Video) diffusion models.
...
Use CosmosImageToVideoLatent to set the input image/video.
2025-01-14 05:14:10 -05:00
1f1c7b7b56
Remove useless code.
2025-01-13 03:52:37 -05:00
90f349f93d
Add res_multistep sampler from the cosmos code.
...
This sampler should work with all models.
2025-01-12 03:10:07 -05:00
b9d9bcba14
fixed a bug where a relative path was not converted to a full path ( #6395 )
...
Signed-off-by: bigcat88 <bigcat88@icloud.com >
2025-01-11 19:19:51 -05:00
42086af123
Merge ruff.toml into pyproject.toml ( #6431 )
2025-01-11 12:52:46 -05:00
6c9bd11fa3
Hooks Part 2 - TransformerOptionsHook and AdditionalModelsHook ( #6377 )
...
* Add 'sigmas' to transformer_options so that downstream code can know about the full scope of current sampling run, fix Hook Keyframes' guarantee_steps=1 inconsistent behavior with sampling split across different Sampling nodes/sampling runs by referencing 'sigmas'
* Cleaned up hooks.py, refactored Hook.should_register and add_hook_patches to use target_dict instead of target so that more information can be provided about the current execution environment if needed
* Refactor WrapperHook into TransformerOptionsHook, as there is no need to separate out Wrappers/Callbacks/Patches into different hook types (all affect transformer_options)
* Refactored HookGroup to also store a dictionary of hooks separated by hook_type, modified necessary code to no longer need to manually separate out hooks by hook_type
* In inner_sample, change "sigmas" to "sampler_sigmas" in transformer_options to not conflict with the "sigmas" that will overwrite "sigmas" in _calc_cond_batch
* Refactored 'registered' to be HookGroup instead of a list of Hooks, made AddModelsHook operational and compliant with should_register result, moved TransformerOptionsHook handling out of ModelPatcher.register_all_hook_patches, support patches in TransformerOptionsHook properly by casting any patches/wrappers/hooks to proper device at sample time
* Made hook clone code sane, made clear ObjectPatchHook and SetInjectionsHook are not yet operational
* Fix performance of hooks when hooks are appended via Cond Pair Set Props nodes by properly caching between positive and negative conds, make hook_patches_backup behave as intended (in the case that something pre-registers WeightHooks on the ModelPatcher instead of registering it at sample time)
* Filter only registered hooks on self.conds in CFGGuider.sample
* Make hook_scope functional for TransformerOptionsHook
* removed 4 whitespace lines to satisfy Ruff,
* Add a get_injections function to ModelPatcher
* Made TransformerOptionsHook contribute to registered hooks properly, added some doc strings and removed a so-far unused variable
* Rename AddModelsHooks to AdditionalModelsHook, rename SetInjectionsHook to InjectionsHook (not yet implemented, but at least getting the naming figured out)
* Clean up a typehint
2025-01-11 12:20:23 -05:00
ee8a7ab69d
Fast latent preview for Cosmos.
2025-01-11 04:41:24 -05:00
9c773a241b
Add pyproject.toml ( #6386 )
...
* Add pyproject.toml
* doc
* Static version file
* Add github action to sync version.py
* Change trigger to PR
* Fix commit
* Grant pr write permission
* nit
* nit
* Don't run on fork PRs
* Rename version.py to comfyui_version.py
2025-01-11 03:09:25 -05:00
adea2beb5c
Add edm option to ModelSamplingContinuousEDM for Cosmos.
...
You can now use this node with "edm" selected to control the sigma_max and
sigma_min of the Cosmos model sampling.
2025-01-11 02:18:42 -05:00
2ff3104f70
WIP support for Nvidia Cosmos 7B and 14B text to world (video) models.
2025-01-10 09:14:16 -05:00
129d8908f7
Add argument to skip the output reshaping in the attention functions.
2025-01-10 06:27:37 -05:00
ff838657fa
Cleaner handling of attention mask in ltxv model code.
2025-01-09 07:12:03 -05:00
2307ff6746
Improve some logging messages.
2025-01-08 19:05:22 -05:00
d0f3752e33
Properly calculate inner dim for t5 model.
...
This is required to support some different types of t5 models.
2025-01-07 17:33:03 -05:00
c515bdf371
fixed: robust loading comfy.settings.json ( #6383 )
...
https://github.com/comfyanonymous/ComfyUI/issues/6371
2025-01-07 16:03:56 -05:00
4209edf48d
Make a few more samplers deterministic.
2025-01-07 02:12:32 -05:00
d055325783
Document get_attr and get_model_object ( #6357 )
...
* Document get_attr and get_model_object
* Update model_patcher.py
* Update model_patcher.py
* Update model_patcher.py
2025-01-06 20:12:22 -05:00
eeab420c70
Update frontend to v1.6.18 ( #6368 )
2025-01-06 18:42:45 -05:00
916d1e14a9
Make ancestral samplers more deterministic.
2025-01-06 03:04:32 -05:00
c496e53519
In inner_sample, change "sigmas" to "sampler_sigmas" in transformer_options to not conflict with the "sigmas" that will overwrite "sigmas" in _calc_cond_batch ( #6360 )
2025-01-06 01:36:47 -05:00
7da85fac3f
Update CODEOWNERS ( #6338 )
...
Adding yoland and robin to web dir
2025-01-05 04:33:49 -05:00
b65b83af6f
Add update-frontend github action ( #6336 )
...
* Add update-frontend github action
* Update secrets
* nit
2025-01-05 04:32:11 -05:00
c8a3492c22
Make the device an optional parameter in the clip loaders.
2025-01-05 04:29:36 -05:00
5cbf79787f
Add advanced device option to clip loader nodes.
...
Right click the "Load CLIP" or DualCLIPLoader node and "Show Advanced".
2025-01-05 01:46:11 -05:00
d45ebb63f6
Remove old unused function.
2025-01-04 07:20:54 -05:00
caa6476a69
Update web content to release v1.6.17 ( #6337 )
...
* Update web content to release v1.6.17
* Remove js maps
2025-01-03 16:22:08 -05:00
45671cda0b
Update web content to release v1.6.16 ( #6335 )
...
* Update web content to release v1.6.16
2025-01-03 13:56:46 -05:00
comfyanonymous