Joe Runde 4db72e57f6

[Bugfix][Refactor] Unify model management in frontend (#11660) ...

Signed-off-by: Joe Runde <Joseph.Runde@ibm.com>

2025-01-01 02:21:51 +00:00

..

tool_parsers

[Model] IBM Granite 3.1 (#11307)

2024-12-19 11:27:24 +08:00

__init__.py

Change the name to vLLM (#150)

2023-06-17 03:07:40 -07:00

api_server.py

[Bugfix][Refactor] Unify model management in frontend (#11660)

2025-01-01 02:21:51 +00:00

cli_args.py

[Bugfix][Refactor] Unify model management in frontend (#11660)

2025-01-01 02:21:51 +00:00

logits_processors.py

[Bugfix] using len(tokenizer) instead of tokenizer.vocab_size in AllowedTokenIdsLogitsProcessor (#11156)

2024-12-13 15:56:19 +00:00

protocol.py

[Frontend] Online Pooling API (#11457)

2024-12-24 17:54:30 +08:00

run_batch.py

[Bugfix][Refactor] Unify model management in frontend (#11660)

2025-01-01 02:21:51 +00:00

serving_chat.py

[Bugfix][Refactor] Unify model management in frontend (#11660)

2025-01-01 02:21:51 +00:00

serving_completion.py

[Bugfix][Refactor] Unify model management in frontend (#11660)

2025-01-01 02:21:51 +00:00

serving_embedding.py

[Bugfix][Refactor] Unify model management in frontend (#11660)

2025-01-01 02:21:51 +00:00

serving_engine.py

[Bugfix][Refactor] Unify model management in frontend (#11660)

2025-01-01 02:21:51 +00:00

serving_models.py

[Bugfix][Refactor] Unify model management in frontend (#11660)

2025-01-01 02:21:51 +00:00

serving_pooling.py

[Bugfix][Refactor] Unify model management in frontend (#11660)

2025-01-01 02:21:51 +00:00

serving_score.py

[Bugfix][Refactor] Unify model management in frontend (#11660)

2025-01-01 02:21:51 +00:00

serving_tokenization.py

[Bugfix][Refactor] Unify model management in frontend (#11660)

2025-01-01 02:21:51 +00:00