Zos_Kia

Really interested to see this proof if you have a link handy. Do you have any idea why it doesn’t apply to human cognition ?

I think there’s a misconception about what AGI is. The point of a “smarter” model is not that it knows all the facts, that would be wasteful as it is trivial to look up facts at inference time. The point is that a “smarter” model can generalize solutions to out of distribution problems (meaning problems that are not explicitly stated in its training corpus). So AGI wouldn’t be about a model that knows everything about language and every advancement in every field, but rather a model that is better than humans at finding solutions to problems (and fetching information from outside sources when it doesn’t know enough about a field to operate a solution).

The point about context is kind of irrelevant here as training data is not part of the inference context so you “add intelligence” to a model by re-training a new one, not by cramming the context of an existing one.

In my experience I’ve mostly seen it used for a local equivalent of S3 to plop in your dev environment. It’s pretty good if your prod depends on S3 and you don’t want to deal with the cost and latency of using actual S3 buckets during development.

I’m picturing some John wick character who legitimately finds himself in tons of car chases and ticking time bomb scenarios

I see, that’s interesting. I do a lot of transcoding but offline so i don’t have usage for such a cache. I’ve tested various storage solutions but on my setup, transcoding is always CPU-bound, even on old ass HDDs the bottleneck is never I/O.

Yeah i specifically don’t do any AI workloads on my server, that would be stupid slow with my old ass hardware. But my buddy (who’s a bit impulsive with money) bought two Spark GX10s and we’re likely to get some fun out of them :)

VMs mostly

oh yeah i see how that can be hungry

What are you hosting on Minecraft that isn’t using >=4 gigs?

Just a vanilla server i play on with my son, it’s got 2G and i haven’t noticed anything out of the ordinary. Chunk gen is slow-ish but i suppose that’s CPU-bound.

BTW i exagerated in my initial comment, i looked at the machine and it’s sitting just under 8G of used RAM.

Also ZFS

Jesus christ 😅 no idea if you’re jesting

Serious question, what does RAM help with in the context of self hosting? I recently bought 32G for my server, and it’s DDR3 ecc so it’s so cheap I could have afforded 64 but I just kept wondering what will I use it for? I rarely go north of 6G usage and that’s with half a dozen services, a Minecraft server etc… I just don’t know what kind of services are RAM hungry.

Oh man believe me I’m all for it. I totally understand having an approach of engineering that is not bankable or tailored for Californian degen culture.

I’m not saying there’s anything wrong with your stance. Just saying it will become an aesthetic niche just like there’s some people who still track music on magnetic tape when it would be exponentially faster to use cubase.

I don’t have your specific axe to grind against AI but my personal angle is to only use old hardware and make software that runs on it.

Not everything has to be superlative, and self imposed constraints are great for quality of life.

Exactly. And a commit is a commit. Unless it’s 10Kloc in one go you can just read what’s in it and decide for yourself.

At my previous job we used to jokingly (?) tell our engineering manager “no commits, no opinions” well I think it’s kinda like that.

And that’s great for you but I still think you’ll be in a minority. Which is not necessarily bad of course.

Open Source devs mostly come from the industry and the penetration of agentic coding in the industry has been massive over the last six months. I don’t think I’ve ever seen anything of this scale.

I think disclosure is good and should be tackled as soon as possible because being transparent in your communication is just good practice in general.

However I feel like this will soon be rendered useless as all projects will move to agentic (or otherwise ai-assisted) coding.

Maybe there’ll be a movement of hand coded FOSS but realistically they’ll have a hard time. Resources are already tight for most projects, and rejecting productivity in favor of aesthetics is a rich guy’s strategy.

This whole debacle is showing that people fundamentally misunderstand how code works. They are trying to declare code good or code bad because of some silly heuristics like ai/not-ai, as if it wasn’t literal lines of text which you can read before you form an opinion and make a fool of yourself.