Skip to content

Misc. bug: in version 0.16.2, the gguf-dump CLI tool fails due to a missing PySide6 module, indicating an unintended GUI depende #13054

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
Manamama opened this issue Apr 21, 2025 · 1 comment · May be fixed by #13036
Open

Misc. bug: in version 0.16.2, the gguf-dump CLI tool fails due to a missing PySide6 module, indicating an unintended GUI depende #13054

Manamama opened this issue Apr 21, 2025 · 1 comment · May be fixed by #13036
Labels
bug Something isn't working

Comments

@Manamama
Copy link

Manamama commented Apr 21, 2025 •
edited
Loading

Name and Version

~ $ llama-cli --version
version: 5162 (2016f07)
built with clang version 20.1.3 for aarch64-unknown-linux-android24
~ $ gguf-dump --version
usage: gguf-dump [-h] [--no-tensors] [--json]
[--json-array] [--data-offset]
[--data-alignment] [--markdown]
[--verbose]
model
gguf-dump: error: the following arguments are required: model
~ $

Operating systems

Linux, Termux

Which llama.cpp modules do you know to be affected?

Other (Please specify in the next section)

Command line

Gguf

Problem description & steps to reproduce

Successfully installed gguf-0.16.2
~ $ python /data/data/com.termux/files/usr/bin/gguf-dump
Traceback (most recent call last):
File "/data/data/com.termux/files/usr/bin/gguf-dump", line 5, in
from gguf.scripts import gguf_dump_entrypoint
File "/data/data/com.termux/files/usr/lib/python3.12/site-packages/gguf/scripts/init.py", line 7, in
from .gguf_editor_gui import main as gguf_editor_gui_entrypoint
File "/data/data/com.termux/files/usr/lib/python3.12/site-packages/gguf/scripts/gguf_editor_gui.py", line 15, in
from PySide6.QtWidgets import (
ModuleNotFoundError: No module named 'PySide6'
~ $

First Bad Commit

gguf-0.16.2
See also: termux/termux-packages#21004 (comment)

Relevant log output

This solves it: 

pip install gguf[gui]
...
Installing collected packages: gguf
  Attempting uninstall: gguf
    Found existing installation: gguf 0.16.2
    Uninstalling gguf-0.16.2:
      Successfully uninstalled gguf-0.16.2
  • sic, as it downgrades it elegantly on its own to non Qt version.

Ver. 1.3
@CISC CISC linked a pull request Apr 21, 2025 that will close this issue
gguf-py : avoid requiring PySide6 for packaged scripts #13036
Open
@CISC CISC added bug Something isn't working and removed bug-unconfirmed labels Apr 21, 2025
@Manamama
Copy link
Author

FYI, I have just run at the same issue iin pure Linux, so hopefully your pull request will make it asap to the code.
Declarative versioning : pip install gguf==0.16.0 is needed, for now.

Ref:

abovetrans@cloudshell:~/.cache (test-project-2-1264)$ gguf-dump bitnet_b1_58-3B.Q4_K_M.gguf 
Traceback (most recent call last):
  File "/home/abovetrans/.local/bin/gguf-dump", line 5, in <module>
    from gguf.scripts import gguf_dump_entrypoint
  File "/home/abovetrans/.local/lib/python3.12/site-packages/gguf/scripts/__init__.py", line 7, in <module>
    from .gguf_editor_gui import main as gguf_editor_gui_entrypoint
  File "/home/abovetrans/.local/lib/python3.12/site-packages/gguf/scripts/gguf_editor_gui.py", line 15, in <module>
    from PySide6.QtWidgets import (
ModuleNotFoundError: No module named 'PySide6'
abovetrans@cloudshell:~/.cache (test-project-2-1264)$ pip install gguf[gui]
Defaulting to user installation because normal site-packages is not writeable
Requirement already satisfied: gguf[gui] in /home/abovetrans/.local/lib/python3.12/site-packages (0.16.2)
Collecting PySide6<7.0,>=6.9 (from gguf[gui])
  Downloading PySide6-6.9.0-cp39-abi3-manylinux_2_28_x86_64.whl.metadata (5.5 kB)
Requirement already satisfied: numpy>=1.17 in /home/abovetrans/.local/lib/python3.12/site-packages (from gguf[gui]) (1.26.4)
Requirement already satisfied: pyyaml>=5.1 in /usr/local/lib/python3.12/dist-packages (from gguf[gui]) (6.0.2)
Requirement already satisfied: sentencepiece<=0.2.0,>=0.1.98 in /home/abovetrans/.local/lib/python3.12/site-packages (from gguf[gui]) (0.2.0)
Requirement already satisfied: tqdm>=4.27 in /home/abovetrans/.local/lib/python3.12/site-packages (from gguf[gui]) (4.66.5)
Collecting shiboken6==6.9.0 (from PySide6<7.0,>=6.9->gguf[gui])
  Downloading shiboken6-6.9.0-cp39-abi3-manylinux_2_28_x86_64.whl.metadata (2.7 kB)
Collecting PySide6-Essentials==6.9.0 (from PySide6<7.0,>=6.9->gguf[gui])
  Downloading PySide6_Essentials-6.9.0-cp39-abi3-manylinux_2_28_x86_64.whl.metadata (3.9 kB)
Collecting PySide6-Addons==6.9.0 (from PySide6<7.0,>=6.9->gguf[gui])
  Downloading PySide6_Addons-6.9.0-cp39-abi3-manylinux_2_28_x86_64.whl.metadata (4.2 kB)
Downloading PySide6-6.9.0-cp39-abi3-manylinux_2_28_x86_64.whl (558 kB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 558.1/558.1 kB 15.1 MB/s eta 0:00:00
Downloading PySide6_Addons-6.9.0-cp39-abi3-manylinux_2_28_x86_64.whl (166.3 MB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 166.3/166.3 MB 8.0 MB/s eta 0:00:00
Downloading PySide6_Essentials-6.9.0-cp39-abi3-manylinux_2_28_x86_64.whl (94.2 MB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 94.2/94.2 MB 14.3 MB/s eta 0:00:00
Downloading shiboken6-6.9.0-cp39-abi3-manylinux_2_28_x86_64.whl (206 kB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 206.5/206.5 kB 21.8 MB/s eta 0:00:00
Installing collected packages: shiboken6, PySide6-Essentials, PySide6-Addons, PySide6
Successfully installed PySide6-6.9.0 PySide6-Addons-6.9.0 PySide6-Essentials-6.9.0 shiboken6-6.9.0
abovetrans@cloudshell:~/.cache (test-project-2-1264)$ gguf-dump bitnet_b1_58-3B.Q4_K_M.gguf 
Traceback (most recent call last):
  File "/home/abovetrans/.local/bin/gguf-dump", line 5, in <module>
    from gguf.scripts import gguf_dump_entrypoint
  File "/home/abovetrans/.local/lib/python3.12/site-packages/gguf/scripts/__init__.py", line 7, in <module>
    from .gguf_editor_gui import main as gguf_editor_gui_entrypoint
  File "/home/abovetrans/.local/lib/python3.12/site-packages/gguf/scripts/gguf_editor_gui.py", line 15, in <module>
    from PySide6.QtWidgets import (
ImportError: libEGL.so.1: cannot open shared object file: No such file or directory
abovetrans@cloudshell:~/.cache (test-project-2-1264)$ pip show gguf
Name: gguf
Version: 0.16.2
Summary: Read and write ML models in GGUF for GGML
Home-page: 
Author: GGML
Author-email: [email protected]
License: 
Location: /home/abovetrans/.local/lib/python3.12/site-packages
Requires: numpy, pyyaml, sentencepiece, tqdm
Required-by: 
abovetrans@cloudshell:~/.cache (test-project-2-1264)$ pip install gguf==0.16.0
Defaulting to user installation because normal site-packages is not writeable
Collecting gguf==0.16.0
  Downloading gguf-0.16.0-py3-none-any.whl.metadata (3.9 kB)
Requirement already satisfied: numpy>=1.17 in /home/abovetrans/.local/lib/python3.12/site-packages (from gguf==0.16.0) (1.26.4)
Requirement already satisfied: pyyaml>=5.1 in /usr/local/lib/python3.12/dist-packages (from gguf==0.16.0) (6.0.2)
Requirement already satisfied: sentencepiece<=0.2.0,>=0.1.98 in /home/abovetrans/.local/lib/python3.12/site-packages (from gguf==0.16.0) (0.2.0)
Requirement already satisfied: tqdm>=4.27 in /home/abovetrans/.local/lib/python3.12/site-packages (from gguf==0.16.0) (4.66.5)
Downloading gguf-0.16.0-py3-none-any.whl (76 kB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 76.8/76.8 kB 3.5 MB/s eta 0:00:00
Installing collected packages: gguf
  Attempting uninstall: gguf
    Found existing installation: gguf 0.16.2
    Uninstalling gguf-0.16.2:
      Successfully uninstalled gguf-0.16.2
Successfully installed gguf-0.16.0
abovetrans@cloudshell:~/.cache (test-project-2-1264)$ gguf-dump bitnet_b1_58-3B.Q4_K_M.gguf 
INFO:gguf-dump:* Loading: bitnet_b1_58-3B.Q4_K_M.gguf
* File is LITTLE endian, script is running on a LITTLE endian host.
* Dumping 40 key/value pair(s)
      1: UINT32     |        1 | GGUF.version = 3
      2: UINT64     |        1 | GGUF.tensor_count = 288
      3: UINT64     |        1 | GGUF.kv_count = 37
      4: STRING     |        1 | general.architecture = 'bitnet'
      5: STRING     |        1 | general.type = 'model'

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
bug Something isn't working
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

gguf-py : avoid requiring PySide6 for packaged scripts compilade/llama.cpp
2 participants
@CISC @Manamama