Stochastic parrots always bullshit. It can’t lie as it has no concept or care for truth and falsity, but spitting back noise that’s statistically shaped like a signal.

In practice, I noticed the answer is more likely wrong the more specific the question. General questions that have the answer widely available in the training data will more often be there correctly in the LLMs result.

Yes, beacuse that would be distribution of copyrighted materials…

Meta’s legal defense was that they limited seeding to a minimal value as a precaution when they pirated terabytes of books. Of course, I don’t expect the same ruling would be granted to an individual… Shit is fucked.

The bob cut cat:

they’ll need to use twice as many chips, which could mean doubling the bus width (one can dream) to 512 bit (ala 5900)

I misread this part, thinking you implied a bus width increase is necessary.

For a 512 bit memory bus, AMD would either have to use 1+8 dies if they follow the 7900XTX scheme or have a monolithic behemoth like GB102. The former would have increased power draw but lower manufacturing costs, while the latter is more power efficient and more prone to defects as it’s getting close to the aperture size limit.

I’d guess nvidia will soon have to switch to chiplet based GPUs. Maybe AMD stopped (for now?) because not their whole product stack was using chiplet based designs so they had way less flexibility with allocation and binning than with ryzen chiplets.

Clamshell design. RX 7900XTX 24GB | PRO W7900 48GB

Same GPU, same 384 bit bus.