mirror of
https://git.datalinker.icu/vllm-project/vllm.git
synced 2026-03-25 12:14:47 +08:00
[ROCM] Reorder arguments and rename parameters for rope_cached_thd_positions_2c_fwd_inplace
The `is_nope_first` parameter is named `nope_first` in aiter. First parameter ordering is query, key, cos, sin, positions. Testing: Use `VLLM_ROCM_USE_AITER_TRITON_ROPE=1`. Previously this failed; now it runs. Signed-off-by: Tres Popp <tres.popp@amd.com>
This commit is contained in:
parent
afe9eb408e
commit
5400baf42b
@ -878,14 +878,14 @@ class rocm_aiter_ops:
|
||||
key_ = key[..., :rotary_dim]
|
||||
positions = positions.view(*query.shape[:1])
|
||||
rope_cached_thd_positions_2c_fwd_inplace(
|
||||
positions,
|
||||
sin,
|
||||
cos,
|
||||
query_,
|
||||
key_,
|
||||
sin,
|
||||
cos,
|
||||
positions,
|
||||
rotate_style,
|
||||
reuse_freqs_front_part=True,
|
||||
is_nope_first=False,
|
||||
nope_first=False,
|
||||
)
|
||||
query = query.view(query_shape)
|
||||
key = key.view(key_shape)
|
||||
|
||||
Loading…
x
Reference in New Issue
Block a user