

Recent comments by the new Japanese PM stating that an invasion of Taiwan may trigger an “existential crisis” for Japan that would allow them to deploy self defense forces to defend Taiwan.
It’s created a gigantic diplomatic and economic fight between Japan and China.






“Infini-attention” isn’t perfect memory, it’s highly compressed representations of the entire history. (https://arxiv.org/html/2404.07143v1).
Much like quantization. The longer the context gets the worse the compression makes recall.