From Simon Willison: “Mistral tweet a link to a 281GB magnet BitTorrent of Mixtral 8x22B—their latest openly licensed model release, significantly larger than their previous best open model Mixtral 8x7B. I’ve not seen anyone get this running yet but it’s likely to perform extremely well, given how good the original Mixtral was.”
You must log in or register to comment.
281GB
That’s huge, I’m guessing we’ll need to use a giant swap file?
It doesnt even have a license yet, or a blog post, anouncement, etc. To me it currently looks like someone just leaked their model, time will tell …
They’ve done it that way for the previous models, too. I suppose it’s to add a bit of “mystery” around it and give people some riddle to solve.