Skip to content

Commit ea75e00

Browse files
authored
fix: updating example files with required storage config (#176)
Updating the example files with the latest requirements from https://github.com/llamastack/llama-stack/blob/main/docs/docs/distributions/configuration.mdx. to prevent crashing on server start. The e2e tests pass again now that the upstream distribution `external_providers_dir` fix has made it into the latest `docker.io/llamastack/distribution-starter:latest` image. The `storage` parameters match documentation, and what's already in `/usr/local/lib/python3.12/site-packages/llama_stack/distributions/starter/run.yaml` Closes: RHAIENG-1655 Approved-by: nathan-weinberg Approved-by: derekhiggins
1 parent a7b71f0 commit ea75e00

File tree

2 files changed

+46
-0
lines changed

2 files changed

+46
-0
lines changed

config/samples/example-with-ca-bundle.yaml

Lines changed: 23 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -21,6 +21,29 @@ data:
2121
model_type: llm
2222
server:
2323
port: 8321
24+
storage:
25+
backends:
26+
kv_default:
27+
type: kv_sqlite
28+
db_path: ${env.SQLITE_STORE_DIR:=~/.llama/distributions/ollama}/kvstore.db
29+
sql_default:
30+
type: sql_sqlite
31+
db_path: ${env.SQLITE_STORE_DIR:=~/.llama/distributions/ollama}/sqlstore.db
32+
stores:
33+
metadata:
34+
backend: kv_default
35+
namespace: registry
36+
inference:
37+
backend: sql_default
38+
table_name: inference_store
39+
max_write_queue_size: 10000
40+
num_writers: 4
41+
conversations:
42+
backend: sql_default
43+
table_name: openai_conversations
44+
prompts:
45+
backend: kv_default
46+
namespace: prompts
2447
---
2548
apiVersion: llamastack.io/v1alpha1
2649
kind: LlamaStackDistribution

config/samples/example-with-configmap.yaml

Lines changed: 23 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -21,6 +21,29 @@ data:
2121
model_type: llm
2222
server:
2323
port: 8321
24+
storage:
25+
backends:
26+
kv_default:
27+
type: kv_sqlite
28+
db_path: ${env.SQLITE_STORE_DIR:=~/.llama/distributions/ollama}/kvstore.db
29+
sql_default:
30+
type: sql_sqlite
31+
db_path: ${env.SQLITE_STORE_DIR:=~/.llama/distributions/ollama}/sqlstore.db
32+
stores:
33+
metadata:
34+
backend: kv_default
35+
namespace: registry
36+
inference:
37+
backend: sql_default
38+
table_name: inference_store
39+
max_write_queue_size: 10000
40+
num_writers: 4
41+
conversations:
42+
backend: sql_default
43+
table_name: openai_conversations
44+
prompts:
45+
backend: kv_default
46+
namespace: prompts
2447
---
2548
apiVersion: llamastack.io/v1alpha1
2649
kind: LlamaStackDistribution

0 commit comments

Comments
 (0)