Skip to content

Commit ed3bca9

Browse files
committed
fix broadcast
1 parent 61113ab commit ed3bca9

File tree

3 files changed

+3
-3
lines changed

3 files changed

+3
-3
lines changed

ucm/integration/vllm/ucm_connector.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -477,7 +477,7 @@ def start_load_kv(self, forward_context: "ForwardContext", **kwargs) -> None:
477477
)
478478
else:
479479
request_to_task[request_id] = None
480-
req_broadcast_addr[request_id] = tensors
480+
req_broadcast_addr[request_id] = [t for row in tensors for t in row]
481481

482482
for request_id, task in request_to_task.items():
483483
# TODO error handling

ucm/store/test/e2e/pcstore_embed.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -106,7 +106,7 @@ def store_all_hashes(hashes):
106106

107107

108108
def main():
109-
storage_backends = "/home/share/qyh-test"
109+
storage_backends = "."
110110
block_number = 4096
111111
device_id = 1
112112
block_dim = 576

ucm/store/test/e2e/pcstore_fetch.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -83,7 +83,7 @@ def fetch(
8383

8484

8585
def main():
86-
storage_backends = "/home/share/qyh-test"
86+
storage_backends = "."
8787
device_id = 1
8888
block_dim = 576
8989
block_len = 64

0 commit comments

Comments
 (0)