- 2 Posts
- 2 Comments
Joined 1 year ago
Cake day: June 12th, 2023
You are not logged in. If you use a Fediverse account that is able to follow users, you can follow this user.
Compile llama.cpp, download a small GGML LLM model and you will have a quite intelligent assiatant running into your phone.
Decent enough for a model 50 times smaller than ChatGPT. I use orca_mini_3b.