Skip to content

Commit 73b127c

Browse files
committed
Update gpt-oss-120b config
1 parent cdfaf82 commit 73b127c

File tree

1 file changed

+4
-5
lines changed

1 file changed

+4
-5
lines changed

vec_inf/config/models.yaml

Lines changed: 4 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -1059,12 +1059,11 @@ models:
10591059
model_family: gpt-oss
10601060
model_variant: 120b
10611061
model_type: LLM
1062-
gpus_per_node: 4
1063-
num_nodes: 2
1062+
gpus_per_node: 2
1063+
num_nodes: 1
10641064
vocab_size: 201088
10651065
time: 08:00:00
10661066
resource_type: l40s
10671067
vllm_args:
1068-
--tensor-parallel-size: 4
1069-
--pipeline-parallel-size: 2
1070-
--max-model-len: 40960
1068+
--tensor-parallel-size: 2
1069+
--max-model-len: 32768

0 commit comments

Comments
 (0)