陈序 218dc2ccda

Aligning top_p and top_k Sampling (#1885) ...

* Align top_p and top_k with huggingface

* remove _get_prompt_and_output_tokens

* rename _apply_top_p_top_k

* compare top_p top_k with hf

* fix test errors

2024-01-12 22:51:03 +01:00

..

async_engine

Use NCCL instead of ray for control-plane communication to remove serialization overhead (#2221)

2024-01-03 11:30:22 -08:00

distributed

[BUGFIX] Fix communication test (#2285)

2023-12-27 17:18:11 -05:00

engine

Migrate linter from pylint to ruff (#1665)

2023-11-20 11:58:01 -08:00

kernels

Revert the changes in test_cache (#2335)

2024-01-03 17:32:05 -08:00

models

Added DeciLM-7b and DeciLM-7b-instruct (#2062)

2023-12-19 02:29:33 -08:00

prompts

[BugFix] Fix input positions for long context with sliding window (#2088)

2023-12-13 12:28:13 -08:00

samplers

Aligning top_p and top_k Sampling (#1885)

2024-01-12 22:51:03 +01:00

worker

Use NCCL instead of ray for control-plane communication to remove serialization overhead (#2221)

2024-01-03 11:30:22 -08:00

__init__.py

[Small] Formatter only checks lints in changed files (#1528)

2023-10-31 15:39:38 -07:00

conftest.py

[BUGFIX] Fix the path of test prompts (#2273)

2023-12-26 10:37:21 -08:00

test_regression.py

[Minor] Fix duplication of ignored seq group in engine step (#1666)

2023-11-16 13:11:41 -08:00