The creator of ExLlamaV2 (turboderp) has released a lightweight web UI for running exllamav2, it’s quite nice! Missing some stuff from text-generation-webui, but makes up for it by being very streamlined and clean

I’ve made a docker image for it for anyone who may want to try it out, GitHub repo here:

https://github.com/noneabove1182/exui-docker

And for finding models to run with exllamav2 I’ve been uploading several here:

https://huggingface.co/bartowski

Enjoy!