• 10 Posts
  • 112 Comments
Joined 2 years ago
cake
Cake day: October 23rd, 2024

help-circle
  • someone should release something that fits in 96-128gb. Hy 3, mimo, deepseek flash are all close but 256gb (or at least more than 128gb for q4) for high context is requried. Qwen is already at 3.8, but I don’t think have updated their smaller models. I assume you’ve tried q8 version of 3.6, and prefer the larger context window?


















  • US corruption means going big on Skynet to buy datacenter time, while somehow giving Nvidia oligarchy the profits of diverting H200 supply to China, so that Skynet becomes more essential as China AI is able to be served/compete better, and Skynet is more expensive to build in US. Chinese governments may be supporting the market share gains, but models are focused on being useful/value today instead of expensive Skynet tomorrow. AI that focuses on more manufacturing is going to make a society stronger than ones that make insurance/banking/other services fire more people. The datacenter overinvestment in US can both destroy AI company valuations, while still creating mass unemployment elsewhere, and too big to fail unsustainable deficit financing of Skynet as a policy response.


  • opencode is well worth having. It has a better priced Zen gateway that is limited to top models, but priced as you go, and can point to same folder/container as your other tools. Access to openrouter is useful, if only that some models are free. Antigravity is good to have for generous use of gemini. If VsCodium can’t access open models, then other tools can work on same project, and you just reload files they change.

    Many open models at 1/10th the cost or lower, are far better than 1/10th of opus 4.6. The popularity reflects much better value. They are especially better if not doing python/js, but functional programming, even if all models are generally bad so far. agents/skills (opencode/antigravity) for models that are strong at instruction following and polyglot software (minimax pretty impressive) actually scored better than raw opus 4.6 on my benchmark, and investing in skills/agents means promise for improving whatever model is released next week.