Lu Fang d8bff253d7 add il tool ...

more changes

Apply suggestions from code review

Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

fix tp

Signed-off-by: Lu Fang <fanglu@fb.com>

add comparison tool

tmp

add unit test and fix format

Signed-off-by: Lu Fang <fanglu@fb.com>

add comparison script and documentation

Signed-off-by: Lu Fang <fanglu@fb.com>

provide default intermediate logging

Signed-off-by: Lu Fang <fanglu@fb.com>

optional register il

Signed-off-by: Lu Fang <fanglu@fb.com>

add input reload and improve intermediate compare

2025-07-28 18:32:10 -07:00

..

attention

[v1][mamba] Added mamba_type into MambaSpec (#21715)

2025-07-28 08:15:55 +00:00

core

[Deprecation][2/N] Replace --task with --runner and --convert (#21470)

2025-07-27 19:42:40 -07:00

e2e

[Meta] Llama4 EAGLE Support (#20591)

2025-07-15 21:14:15 -07:00

engine

[DP] Internal Load Balancing Per Node [one-pod-per-node] (#21238)

2025-07-23 20:57:32 -07:00

entrypoints

[Tests] Add tests for headless internal DP LB (#21450)

2025-07-23 07:49:25 -07:00

kv_connector

Revert "[V1] Exception Handling when Loading KV Cache from Remote Store" (#21778)

2025-07-28 20:15:18 +00:00

metrics

Enable v1 metrics tests (#20953)

2025-07-20 03:22:02 +00:00

sample

[Sampler] Introduce logprobs mode for logging (#21398)

2025-07-23 01:39:25 -07:00

shutdown

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

spec_decode

[Deprecation][2/N] Replace --task with --runner and --convert (#21470)

2025-07-27 19:42:40 -07:00

structured_output

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

tpu

[Deprecation][2/N] Replace --task with --runner and --convert (#21470)

2025-07-27 19:42:40 -07:00

worker

[Deprecation][2/N] Replace --task with --runner and --convert (#21470)

2025-07-27 19:42:40 -07:00

__init__.py

[V1] AsyncLLM Implementation (#9826)

2024-11-11 23:05:38 +00:00

test_async_llm_dp.py

[DP] Fix Prometheus Logging (#21257)

2025-07-21 09:11:35 -07:00

test_external_lb_dp.py

[Tests] Harden DP tests (#21508)

2025-07-25 02:27:24 -07:00

test_hybrid_lb_dp.py

[Tests] Harden DP tests (#21508)

2025-07-25 02:27:24 -07:00

test_intermediates_logging.py

add il tool

2025-07-28 18:32:10 -07:00

test_internal_lb_dp.py

[Tests] Harden DP tests (#21508)

2025-07-25 02:27:24 -07:00

test_metrics_reader.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

test_oracle.py

Support encoder-only models without KV-Cache (#21270)

2025-07-26 21:09:52 +08:00

test_request.py

[Misc] Add SPDX-FileCopyrightText (#20428)

2025-07-04 07:40:42 +00:00

test_serial_utils.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

test_utils.py

Support encoder-only models without KV-Cache (#21270)

2025-07-26 21:09:52 +08:00