Skip to content

Commit 3855734

Browse files
committed
Remove unnecessary
1 parent 340d4ed commit 3855734

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

llm_exl2_dynamic_gen.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -469,7 +469,7 @@ def process_prompts():
469469
job = ExLlamaV2DynamicJob(
470470
input_ids = ids,
471471
max_new_tokens = max_tokens,
472-
stop_conditions = get_stop_conditions() if stop_at is None else [*get_stop_conditions(), stop_at],
472+
stop_conditions = [tokenizer.eos_token_id] if stop_at is None else [tokenizer.eos_token_id, stop_at],
473473
gen_settings = ExLlamaV2Sampler.Settings(),
474474
filters = filters,
475475
token_healing = healing

0 commit comments

Comments
 (0)