clean-ups

Signed-off-by: Alexander Matveev <amatveev@redhat.com>
This commit is contained in:
Alexander Matveev 2025-01-28 22:51:31 +00:00
parent 248c5b632d
commit 1ccf100c6a

View File

@ -212,7 +212,6 @@ class Scheduler:
num_computed_tokens -= self.block_size
num_new_tokens = self.block_size
computed_blocks.pop()
num_new_tokens = min(num_new_tokens, token_budget)
assert num_new_tokens > 0