yurekami 2843784c1c fix: handle None tokenizer in multimodal processor initialization
When skip_tokenizer_init=True is set, the tokenizer is None. Previously,
this None value was unconditionally passed to the processor, which
overrode the processor's ability to load its own tokenizer from the
model path. This caused crashes in multimodal models like gemma-3 that
require a tokenizer during processor initialization.

The fix is to only pass the tokenizer kwarg when it's not None, allowing
the processor to load its own tokenizer when skip_tokenizer_init=True.

Fixes #31123

Signed-off-by: yurekami <69337011+yurekami@users.noreply.github.com>

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
Signed-off-by: yurekami <yurekami@users.noreply.github.com>
2025-12-24 23:41:40 +09:00
..
2025-12-24 05:38:46 -08:00