

2·
3 hours agoWhat sort of setup are you rocking? Which quant? I’m running Qwen 3.6 35B A3B Q2 for speed on my 16GB T4060 Ti and Qwen 3.8 27b Q5 on my R9700 32GB for coding. Unsure if I can run a half decent QFN quant on my setup along with my 128GB of sys RAM.
Amazing, will give that a shot. Thanks!