Skip to content

Commit 0dee5b1

Browse files
committed
TEMP: Disable everything after ssm_conv in mamba2
Branch: Mamba2SSD Signed-off-by: Gabe Goodhart <ghart@us.ibm.com>
1 parent 960bb52 commit 0dee5b1

File tree

2 files changed

+252
-242
lines changed

2 files changed

+252
-242
lines changed

src/llama-graph.cpp

Lines changed: 6 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -244,6 +244,12 @@ void llm_graph_input_rs::set_input(const llama_ubatch * ubatch) {
244244
const int64_t n_rs = mctx->get_n_rs();
245245

246246
if (s_copy) {
247+
//DEBUG
248+
if (!s_copy->buffer) {
249+
return;
250+
}
251+
//DEBUG
252+
247253
GGML_ASSERT(ggml_backend_buffer_is_host(s_copy->buffer));
248254
int32_t * data = (int32_t *) s_copy->data;
249255

0 commit comments

Comments
 (0)