I felt sorry for it and stopped it, 14min and the poor thing was just going around in circles.
I’m just looking at running some local llm on my m2 16GB mac and this was with the default settings for the qwen3.5 9b in LM Studio. Any pointers to get the best out of a M2?
I had already downloaded a Bonsai 27B, just not really tested it yet
You can also try https://huggingface.co/ISTA-DASLab/Qwen3.8-27B-GSQ-RCO-GGUF
It’s more demanding, but also much capable.
I ran this for a good while, quite usable, like gipity 4o or 4.5