Smorty [she/her]

I’m a person who tends to program stuff in Godot and also likes to look at clouds. Sometimes they look really spicy outside.

  • 15 Posts
  • 74 Comments
Joined 1 year ago
cake
Cake day: July 5th, 2023

help-circle

  • Could you please tell me why you chose kobold.cpp over llama.cpp? I only ever used llama.cpp so I’d like to hear from the other side!

    I really like the idea of letting an LLM perform too calls into middle of the generation.

    Like, we instruct the LLM to Say what it will do, then to put the tool call into <tool></tool> tags. Then we could set </tool> as a stop keyword and insert the results into it’s message.

    I have tries this before, but it tends to not believe what is in its own message. It tends to see the output of the tool cal and go Don't believe what I just said, I made that up, even though LLMs are infamous for hallucinating…



















  • I have now fixed the apt issue. Biw I’m just stuck with the startx not working. I’ve already completely reinstalled my nvidia drivers but I still get the same errors in the Xorg logs. In case you are wondering, these are the logs

    Xorg.0.log
    [   271.351] 
    X.Org X Server 1.21.1.11
    X Protocol Version 11, Revision 0
    [   271.351] Current Operating System: Linux Marty-PC 6.9.7+bpo-amd64 #1 SMP PREEMPT_DYNAMIC Debian 6.9.7-1~bpo12+1 (2024-07-03) x86_64
    [   271.351] Kernel command line: BOOT_IMAGE=/boot/vmlinuz-6.9.7+bpo-amd64 root=UUID=d4a79dc4-42f3-4ca3-a115-9e7fede5ab33 ro quiet splash nvidia-drm.modeset=1
    [   271.351] xorg-server 2:21.1.12-1 (https://www.debian.org/support) 
    [   271.351] Current version of pixman: 0.42.2
    [   271.351] 	Before reporting problems, check http://wiki.x.org
    	to make sure that you have the latest version.
    [   271.351] Markers: (--) probed, (**) from config file, (==) default setting,
    	(++) from command line, (!!) notice, (II) informational,
    	(WW) warning, (EE) error, (NI) not implemented, (??) unknown.
    [   271.351] (==) Log file: "/var/log/Xorg.0.log", Time: Thu Jul 18 20:00:51 2024
    [   271.351] (==) Using config file: "/etc/X11/xorg.conf"
    [   271.351] (==) Using config directory: "/etc/X11/xorg.conf.d"
    [   271.351] (==) Using system config directory "/usr/share/X11/xorg.conf.d"
    [   271.352] (==) ServerLayout "Layout0"
    [   271.352] (**) |-->Screen "Screen0" (0)
    [   271.352] (**) |   |-->Monitor "Monitor0"
    [   271.352] (**) |   |-->Device "Device0"
    [   271.352] (**) |   |-->GPUDevice "Device0"
    [   271.352] (**) |-->Input Device "Keyboard0"
    [   271.352] (**) |-->Input Device "Mouse0"
    [   271.352] (**) Option "Xinerama" "0"
    [   271.352] (**) Allowing byte-swapped clients
    [   271.352] (==) Automatically adding devices
    [   271.352] (==) Automatically enabling devices
    [   271.352] (==) Automatically adding GPU devices
    [   271.352] (==) Automatically binding GPU devices
    [   271.352] (==) Max clients allowed: 256, resource mask: 0x1fffff
    [   271.352] (WW) The directory "/usr/share/fonts/X11/cyrillic" does not exist.
    [   271.352] 	Entry deleted from font path.
    [   271.352] (==) FontPath set to:
    	/usr/share/fonts/X11/misc,
    	/usr/share/fonts/X11/100dpi/:unscaled,
    	/usr/share/fonts/X11/75dpi/:unscaled,
    	/usr/share/fonts/X11/Type1,
    	/usr/share/fonts/X11/100dpi,
    	/usr/share/fonts/X11/75dpi,
    	built-ins
    [   271.352] (==) ModulePath set to "/usr/lib/xorg/modules"
    [   271.352] (WW) Hotplugging is on, devices using drivers 'kbd', 'mouse' or 'vmmouse' will be disabled.
    [   271.352] (WW) Disabling Keyboard0
    [   271.352] (WW) Disabling Mouse0
    [   271.352] (II) Loader magic: 0x559f2898ff00
    [   271.352] (II) Module ABI versions:
    [   271.352] 	X.Org ANSI C Emulation: 0.4
    [   271.352] 	X.Org Video Driver: 25.2
    [   271.352] 	X.Org XInput driver : 24.4
    [   271.352] 	X.Org Server Extension : 10.0
    [   271.353] (++) using VT number 2
    
    [   271.355] (II) systemd-logind: took control of session /org/freedesktop/login1/session/_32
    [   271.357] (--) PCI:*(1@0:0:0) 10de:1b83:10de:1b83 rev 161, Mem @ 0xd2000000/16777216, 0xc0000000/268435456, 0xd0000000/33554432, I/O @ 0x00003000/128, BIOS @ 0x????????/131072
    [   271.357] (II) LoadModule: "glx"
    [   271.357] (II) Loading /usr/lib/xorg/modules/extensions/libglx.so
    [   271.357] (II) Module glx: vendor="X.Org Foundation"
    [   271.357] 	compiled for 1.21.1.11, module version = 1.0.0
    [   271.357] 	ABI class: X.Org Server Extension, version 10.0
    [   271.357] (II) LoadModule: "nvidia"
    [   271.358] (II) Loading /usr/lib/xorg/modules/drivers/nvidia_drv.so
    [   271.358] (II) Module nvidia: vendor="NVIDIA Corporation"
    [   271.358] 	compiled for 1.6.99.901, module version = 1.0.0
    [   271.358] 	Module class: X.Org Video Driver
    [   271.358] (II) NVIDIA dlloader X Driver  535.183.01  Sun May 12 19:35:37 UTC 2024
    [   271.358] (II) NVIDIA Unified Driver for all Supported NVIDIA GPUs
    [   271.358] (II) Loading sub module "fb"
    [   271.358] (II) LoadModule: "fb"
    [   271.358] (II) Module "fb" already built-in
    [   271.358] (II) Loading sub module "wfb"
    [   271.358] (II) LoadModule: "wfb"
    [   271.358] (II) Loading /usr/lib/xorg/modules/libwfb.so
    [   271.358] (II) Module wfb: vendor="X.Org Foundation"
    [   271.358] 	compiled for 1.21.1.11, module version = 1.0.0
    [   271.358] 	ABI class: X.Org ANSI C Emulation, version 0.4
    [   271.363] (EE) NVIDIA: Failed to initialize the NVIDIA kernel module. Please see the
    [   271.363] (EE) NVIDIA:     system's kernel log for additional error messages and
    [   271.363] (EE) NVIDIA:     consult the NVIDIA README for details.
    [   271.368] (EE) NVIDIA: Failed to initialize the NVIDIA kernel module. Please see the
    [   271.368] (EE) NVIDIA:     system's kernel log for additional error messages and
    [   271.368] (EE) NVIDIA:     consult the NVIDIA README for details.
    [   271.368] (EE) No devices detected.
    [   271.369] (EE) 
    Fatal server error:
    [   271.369] (EE) no screens found(EE) 
    [   271.369] (EE) 
    Please consult the The X.Org Foundation support 
    	 at http://wiki.x.org
     for help. 
    [   271.369] (EE) Please also check the log file at "/var/log/Xorg.0.log" for additional information.
    [   271.369] (EE) 
    [   271.371] (EE) Server terminated with error (1). Closing log file.
    


  • I have now taken a look at the Xorg log files and they seem to be complaining about it not finding the nvidia kernel module, even though I just installed the nvidia-driver package. This is the complete file content

    /var/logs/Xorg.0.log
    [   271.351] 
    X.Org X Server 1.21.1.11
    X Protocol Version 11, Revision 0
    [   271.351] Current Operating System: Linux Marty-PC 6.9.7+bpo-amd64 #1 SMP PREEMPT_DYNAMIC Debian 6.9.7-1~bpo12+1 (2024-07-03) x86_64
    [   271.351] Kernel command line: BOOT_IMAGE=/boot/vmlinuz-6.9.7+bpo-amd64 root=UUID=d4a79dc4-42f3-4ca3-a115-9e7fede5ab33 ro quiet splash nvidia-drm.modeset=1
    [   271.351] xorg-server 2:21.1.12-1 (https://www.debian.org/support) 
    [   271.351] Current version of pixman: 0.42.2
    [   271.351] 	Before reporting problems, check http://wiki.x.org
    	to make sure that you have the latest version.
    [   271.351] Markers: (--) probed, (**) from config file, (==) default setting,
    	(++) from command line, (!!) notice, (II) informational,
    	(WW) warning, (EE) error, (NI) not implemented, (??) unknown.
    [   271.351] (==) Log file: "/var/log/Xorg.0.log", Time: Thu Jul 18 20:00:51 2024
    [   271.351] (==) Using config file: "/etc/X11/xorg.conf"
    [   271.351] (==) Using config directory: "/etc/X11/xorg.conf.d"
    [   271.351] (==) Using system config directory "/usr/share/X11/xorg.conf.d"
    [   271.352] (==) ServerLayout "Layout0"
    [   271.352] (**) |-->Screen "Screen0" (0)
    [   271.352] (**) |   |-->Monitor "Monitor0"
    [   271.352] (**) |   |-->Device "Device0"
    [   271.352] (**) |   |-->GPUDevice "Device0"
    [   271.352] (**) |-->Input Device "Keyboard0"
    [   271.352] (**) |-->Input Device "Mouse0"
    [   271.352] (**) Option "Xinerama" "0"
    [   271.352] (**) Allowing byte-swapped clients
    [   271.352] (==) Automatically adding devices
    [   271.352] (==) Automatically enabling devices
    [   271.352] (==) Automatically adding GPU devices
    [   271.352] (==) Automatically binding GPU devices
    [   271.352] (==) Max clients allowed: 256, resource mask: 0x1fffff
    [   271.352] (WW) The directory "/usr/share/fonts/X11/cyrillic" does not exist.
    [   271.352] 	Entry deleted from font path.
    [   271.352] (==) FontPath set to:
    	/usr/share/fonts/X11/misc,
    	/usr/share/fonts/X11/100dpi/:unscaled,
    	/usr/share/fonts/X11/75dpi/:unscaled,
    	/usr/share/fonts/X11/Type1,
    	/usr/share/fonts/X11/100dpi,
    	/usr/share/fonts/X11/75dpi,
    	built-ins
    [   271.352] (==) ModulePath set to "/usr/lib/xorg/modules"
    [   271.352] (WW) Hotplugging is on, devices using drivers 'kbd', 'mouse' or 'vmmouse' will be disabled.
    [   271.352] (WW) Disabling Keyboard0
    [   271.352] (WW) Disabling Mouse0
    [   271.352] (II) Loader magic: 0x559f2898ff00
    [   271.352] (II) Module ABI versions:
    [   271.352] 	X.Org ANSI C Emulation: 0.4
    [   271.352] 	X.Org Video Driver: 25.2
    [   271.352] 	X.Org XInput driver : 24.4
    [   271.352] 	X.Org Server Extension : 10.0
    [   271.353] (++) using VT number 2
    
    [   271.355] (II) systemd-logind: took control of session /org/freedesktop/login1/session/_32
    [   271.357] (--) PCI:*(1@0:0:0) 10de:1b83:10de:1b83 rev 161, Mem @ 0xd2000000/16777216, 0xc0000000/268435456, 0xd0000000/33554432, I/O @ 0x00003000/128, BIOS @ 0x????????/131072
    [   271.357] (II) LoadModule: "glx"
    [   271.357] (II) Loading /usr/lib/xorg/modules/extensions/libglx.so
    [   271.357] (II) Module glx: vendor="X.Org Foundation"
    [   271.357] 	compiled for 1.21.1.11, module version = 1.0.0
    [   271.357] 	ABI class: X.Org Server Extension, version 10.0
    [   271.357] (II) LoadModule: "nvidia"
    [   271.358] (II) Loading /usr/lib/xorg/modules/drivers/nvidia_drv.so
    [   271.358] (II) Module nvidia: vendor="NVIDIA Corporation"
    [   271.358] 	compiled for 1.6.99.901, module version = 1.0.0
    [   271.358] 	Module class: X.Org Video Driver
    [   271.358] (II) NVIDIA dlloader X Driver  535.183.01  Sun May 12 19:35:37 UTC 2024
    [   271.358] (II) NVIDIA Unified Driver for all Supported NVIDIA GPUs
    [   271.358] (II) Loading sub module "fb"
    [   271.358] (II) LoadModule: "fb"
    [   271.358] (II) Module "fb" already built-in
    [   271.358] (II) Loading sub module "wfb"
    [   271.358] (II) LoadModule: "wfb"
    [   271.358] (II) Loading /usr/lib/xorg/modules/libwfb.so
    [   271.358] (II) Module wfb: vendor="X.Org Foundation"
    [   271.358] 	compiled for 1.21.1.11, module version = 1.0.0
    [   271.358] 	ABI class: X.Org ANSI C Emulation, version 0.4
    [   271.363] (EE) NVIDIA: Failed to initialize the NVIDIA kernel module. Please see the
    [   271.363] (EE) NVIDIA:     system's kernel log for additional error messages and
    [   271.363] (EE) NVIDIA:     consult the NVIDIA README for details.
    [   271.368] (EE) NVIDIA: Failed to initialize the NVIDIA kernel module. Please see the
    [   271.368] (EE) NVIDIA:     system's kernel log for additional error messages and
    [   271.368] (EE) NVIDIA:     consult the NVIDIA README for details.
    [   271.368] (EE) No devices detected.
    [   271.369] (EE) 
    Fatal server error:
    [   271.369] (EE) no screens found(EE) 
    [   271.369] (EE) 
    Please consult the The X.Org Foundation support 
    	 at http://wiki.x.org
     for help. 
    [   271.369] (EE) Please also check the log file at "/var/log/Xorg.0.log" for additional information.
    [   271.369] (EE) 
    [   271.371] (EE) Server terminated with error (1). Closing log file.