Hey, I also have a Strix Halo box. Which model are you running exactly? The Q8 and BF16 are half the size of Qwen3-Coder-Next-UD-Q8 I have been running before. I tested 3.8-BF16 and UD-Q8 but both run at abysmal speed in comparison to Coder Next (around 8 t/s during chat). Which one gives you best results?
ThyTTY
- 0 Posts
- 39 Comments
ThyTTY@lemmy.worldto
LocalLLaMA@sh.itjust.works•Qwen3.8-2.4T-A95B Open Weights Released!English
2·3 months agoThanks, my knowledge on the topic of Local AI is still very barebones. I generally use my FW for coding assistance, troubleshooting Linux issues, automating stuff and doing some heavy text processing (fixing artifacts after OCRing old PDFs and formatting text). I have lots of spare RAM as I’m lucky enough to have the 128GB model I bought before the prices went crazy. I need to try this Qwen3.6 and Gemma as you recommended as it looks like they may fit my needs as well. The Coder I have has been running smoothly for a while and I didn’t really have the opportunity to tinker with other options recently. If you have any tips for my use case I’m all ears!
ThyTTY@lemmy.worldto
LocalLLaMA@sh.itjust.works•Qwen3.8-2.4T-A95B Open Weights Released!English
2·3 months agoThanks. So you’re saying Qwen 3.5-122b has more knowledge than 3.8-27B? Did I get this right?
ThyTTY@lemmy.worldto
LocalLLaMA@sh.itjust.works•Qwen3.8-2.4T-A95B Open Weights Released!English
3·3 months agoCan someone give me an ELI5 what’s the difference between 27B and this 2.4T? Is it mostly size? I have a Framework Desktop which has been running 3.5-Coder Next for a while, not sure if I should switch
Unfortunately I haven’t tested it so I cannot fully advise on that but I have seen some “repacks” on the high seas where a whole wine prefix with a game already installed was compressed to a single
dwarwhich you can mount and play with configs and saves in your ~.
ThyTTY@lemmy.worldto
Android@lemmy.world•Google’s new gradient icons for Gmail, Calendar, Drive, and other appsEnglish
11·6 months agoAndroid finally started to have a pretty unified look with everything being Material3 and people understanding how to follow the guidelines but we’re going to have another “gradually redesign everything” so it’s a mess for couple of years.
There’s an interesting project called DwarFS. I have it on my todolist to check it out but as I understand it you basically create a compressed read-only archive that is mountable and readable just like any other disk - https://github.com/mhx/dwarfs . Maybe this is something for your use case?
I use an emulator from Android SDK which uses KVM as backend AFAIK. Performance is top notch and it doesn’t use too many resources in my opinion
ThyTTY@lemmy.worldto
Android@lemdro.id•Breaking - Samsung Removes Bootloader Unlocking with One UI 8English
41·1 year agoDepends on why you would want a custom ROM in the first place. I have even more reasons now with every bundled app tracking everything I do and AI assistants being integrated in crucial comppnents of the OS.
There is Mudita Kompakt
Top is the process you are seeing the output of. By running “top” command, you spawn a process that will collect the data on all other processes.
It’s like in Windows when you launch a Task Manager and Task Manager is at the top of your CPU usage because it’s currently gathering all the data.
I use Arch with Gnome because this is something I’ve installed years ago and it just keeps working with no issues.
ThyTTY@lemmy.worldto
Linux@lemmy.ml•How to undo Firefox changes to the titlebar controls buttons?
101·1 year agoRight click on the toolbar, select “customize toolbar” and at the bottom left corner check “title bar”. Or in about:config type 0 for browser.tabs.inTitlebar
ThyTTY@lemmy.worldto
Linux@lemmy.ml•Is there a Linux version that is similar to Freedom app?
15·1 year agoI do not know any program like that but what worked for me was creating another user account that had no access to lots of stuff.
ThyTTY@lemmy.worldto
Linux@lemmy.ml•A Developer's Guide To The Top 10 AI Prompt Engineering Tools
1·2 years agoNo thanks
ThyTTY@lemmy.worldto
Android@lemmy.world•Nova Launcher faces uncertain future after the company Branch slashes its development teamEnglish
5·2 years agoThey always buy the brand or patents and that’s all.
ThyTTY@lemmy.worldto
Android@lemdro.id•It's time to stop thinking plastic phones can't be premiumEnglish
1426·2 years agoIt’s time to stop thinking a phone should be premium
MS has been using Linux on their servers for years
Where can I find beforehand which laptop supports S3? Are there any know brands that do?
Thank you, I will check this out. So what I got from this is that the speed may be slower but results should be more accurate?