Skip to content

python main_gui.py 后卡住不动 #23

@MuuuShin

Description

@MuuuShin

本地部署LLM为chatglm3-6b
python=3.9
Ubuntu20.04

修改了部分代码尝试让模型本地加载
tokenizer = AutoTokenizer.from_pretrained("~/THUDM/chatglm3-6b", trust_remote_code=True)

model = AutoModel.from_pretrained("~/THUDM/chatglm3-6b", trust_remote_code=True).half().cuda()

已填写config.cfg

python local_database.py没问题,正常执行

调用python main_gui.py后整个console卡住不动,等了至少5分钟也没有反应
debug在这个文件的第一行打断点也没用

image

ctrl+C强停后的报错

Details
^CTraceback (most recent call last):
  File "/data/bch/LLM/forSQL/ChatSQL/main_gui.py", line 14, in <module>
    from utils import obtain_sql, retrieval_related_table, execute_sql
  File "/data/bch/LLM/forSQL/ChatSQL/utils.py", line 8, in <module>
    from prompt import embedder, corpus_embeddings, table_schema, corpus, In_context_prompt
  File "/data/bch/LLM/forSQL/ChatSQL/prompt.py", line 9, in <module>
    embedder = SentenceTransformer('paraphrase-multilingual-MiniLM-L12-v2')
  File "/data/bch/miniconda3/envs/chatsql/lib/python3.9/site-packages/sentence_transformers/SentenceTransformer.py", line 87, in __init__
    snapshot_download(model_name_or_path,
  File "/data/bch/miniconda3/envs/chatsql/lib/python3.9/site-packages/sentence_transformers/util.py", line 442, in snapshot_download
    model_info = _api.model_info(repo_id=repo_id, revision=revision, token=token)
  File "/data/bch/miniconda3/envs/chatsql/lib/python3.9/site-packages/huggingface_hub/utils/_validators.py", line 119, in _inner_fn
    return fn(*args, **kwargs)
  File "/data/bch/miniconda3/envs/chatsql/lib/python3.9/site-packages/huggingface_hub/hf_api.py", line 2227, in model_info
    r = get_session().get(path, headers=headers, timeout=timeout, params=params)
  File "/data/bch/miniconda3/envs/chatsql/lib/python3.9/site-packages/requests/sessions.py", line 602, in get
    return self.request("GET", url, **kwargs)
  File "/data/bch/miniconda3/envs/chatsql/lib/python3.9/site-packages/requests/sessions.py", line 589, in request
    resp = self.send(prep, **send_kwargs)
  File "/data/bch/miniconda3/envs/chatsql/lib/python3.9/site-packages/requests/sessions.py", line 703, in send
    r = adapter.send(request, **kwargs)
  File "/data/bch/miniconda3/envs/chatsql/lib/python3.9/site-packages/huggingface_hub/utils/_http.py", line 68, in send
    return super().send(request, *args, **kwargs)
  File "/data/bch/miniconda3/envs/chatsql/lib/python3.9/site-packages/requests/adapters.py", line 486, in send
    resp = conn.urlopen(
  File "/data/bch/miniconda3/envs/chatsql/lib/python3.9/site-packages/urllib3/connectionpool.py", line 793, in urlopen
    response = self._make_request(
  File "/data/bch/miniconda3/envs/chatsql/lib/python3.9/site-packages/urllib3/connectionpool.py", line 467, in _make_request
    self._validate_conn(conn)
  File "/data/bch/miniconda3/envs/chatsql/lib/python3.9/site-packages/urllib3/connectionpool.py", line 1099, in _validate_conn
    conn.connect()
  File "/data/bch/miniconda3/envs/chatsql/lib/python3.9/site-packages/urllib3/connection.py", line 616, in connect
    self.sock = sock = self._new_conn()
  File "/data/bch/miniconda3/envs/chatsql/lib/python3.9/site-packages/urllib3/connection.py", line 198, in _new_conn
    sock = connection.create_connection(
  File "/data/bch/miniconda3/envs/chatsql/lib/python3.9/site-packages/urllib3/util/connection.py", line 73, in create_connection
    sock.connect(sa)
KeyboardInterrupt

<\details>

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions