comfyanonymous 2640acb31c

Update qwen tokenizer to add qwen 3 tokens. (#11029) ...

Doesn't actually change anything for current workflows because none of the
current models have a template with the think tokens.

2025-12-01 17:13:48 -05:00

..

ace_lyrics_tokenizer

Initial ACE-Step model implementation. (#7972)

2025-05-07 08:33:34 -04:00

byt5_tokenizer

Support hunyuan image 2.1 regular model. (#9792)

2025-09-10 02:05:07 -04:00

hydit_clip_tokenizer

Basic hunyuan dit implementation. (#4102)

2024-07-25 18:21:08 -04:00

llama_tokenizer

Basic Hunyuan Video model support.

2024-12-16 19:35:40 -05:00

qwen25_tokenizer

Update qwen tokenizer to add qwen 3 tokens. (#11029)

2025-12-01 17:13:48 -05:00

t5_pile_tokenizer

Better tokenizing code for AuraFlow.

2024-07-12 01:15:25 -04:00

t5_tokenizer

Refactor: Move some code to the comfy/text_encoders folder.

2024-07-15 17:36:24 -04:00

ace_text_cleaners.py

Make japanese hiragana and katakana characters work with ACE. (#7997)

2025-05-08 03:32:36 -04:00

ace.py

Make japanese hiragana and katakana characters work with ACE. (#7997)

2025-05-08 03:32:36 -04:00

aura_t5.py

More flexible long clip support.

2025-04-15 10:32:21 -04:00

bert.py

P2 of qwen edit model. (#9412)

2025-08-18 22:38:34 -04:00

byt5_config_small_glyph.json

Support hunyuan image 2.1 regular model. (#9792)

2025-09-10 02:05:07 -04:00

cosmos.py

More flexible long clip support.

2025-04-15 10:32:21 -04:00

flux.py

Lower vram usage for flux 2 text encoder. (#10887)

2025-11-25 14:58:39 -05:00

genmo.py

More flexible long clip support.

2025-04-15 10:32:21 -04:00

hidream.py

Add a T5TokenizerOptions node to set options for the T5 tokenizer. (#7803)

2025-04-25 19:36:00 -04:00

hunyuan_image.py

Don't add template to qwen2.5vl when template is in prompt. (#10043)

2025-09-26 18:34:17 -04:00

hunyuan_video.py

Cleanup and fix issues with text encoder quants. (#10872)

2025-11-25 01:48:53 -05:00

hydit_clip.json

Basic hunyuan dit implementation. (#4102)

2024-07-25 18:21:08 -04:00

hydit.py

Add a T5TokenizerOptions node to set options for the T5 tokenizer. (#7803)

2025-04-25 19:36:00 -04:00

llama.py

Z Image model. (#10892)

2025-11-25 18:41:45 -05:00

long_clipl.py

Cleanup.

2025-04-15 12:13:28 -04:00

lt.py

More flexible long clip support.

2025-04-15 10:32:21 -04:00

lumina2.py

Implement gemma 3 as a text encoder. (#10241)

2025-10-06 22:08:08 -04:00

mt5_config_xl.json

Basic hunyuan dit implementation. (#4102)

2024-07-25 18:21:08 -04:00

omnigen2.py

Omnigen2 model implementation. (#8669)

2025-06-25 19:35:57 -04:00

pixart_t5.py

Remove windows line endings. (#8866)

2025-07-11 02:37:51 -04:00

qwen_image.py

HunyuanVideo 1.5 (#10819)

2025-11-20 22:44:43 -05:00

qwen_vl.py

P2 of qwen edit model. (#9412)

2025-08-18 22:38:34 -04:00

sa_t5.py

More flexible long clip support.

2025-04-15 10:32:21 -04:00

sd2_clip_config.json

Fix potential issue with non clip text embeddings.

2024-07-30 14:41:13 -04:00

sd2_clip.py

More flexible long clip support.

2025-04-15 10:32:21 -04:00

sd3_clip.py

Add a T5TokenizerOptions node to set options for the T5 tokenizer. (#7803)

2025-04-25 19:36:00 -04:00

spiece_tokenizer.py

Fix hard crash when the spiece tokenizer path is bad.

2025-04-19 15:55:43 -04:00

t5_config_base.json

Refactor: Move some code to the comfy/text_encoders folder.

2024-07-15 17:36:24 -04:00

t5_config_xxl.json

Refactor: Move some code to the comfy/text_encoders folder.

2024-07-15 17:36:24 -04:00

t5_old_config_xxl.json

WIP support for Nvidia Cosmos 7B and 14B text to world (video) models.

2025-01-10 09:14:16 -05:00

t5_pile_config_xl.json

AuraFlow model implementation.

2024-07-11 16:52:26 -04:00

t5.py

P2 of qwen edit model. (#9412)

2025-08-18 22:38:34 -04:00

umt5_config_base.json

Initial ACE-Step model implementation. (#7972)

2025-05-07 08:33:34 -04:00

umt5_config_xxl.json

WIP support for Wan t2v model.

2025-02-25 17:20:35 -05:00

wan.py

More flexible long clip support.

2025-04-15 10:32:21 -04:00

z_image.py

Z Image model. (#10892)

2025-11-25 18:41:45 -05:00