• Repple (she/her)@lemmy.world
    link
    fedilink
    English
    arrow-up
    7
    ·
    6 months ago

    I’m sitting here really hoping that models hit a plateau in capabilities soon. Continuing to get smaller/more efficient would be great, but if the capabilities of our best models would plateau for a bit and give society time to adjust to the impact I would be very happy.

    • bamboo@lemm.ee
      link
      fedilink
      English
      arrow-up
      4
      arrow-down
      1
      ·
      6 months ago

      We’re already seeing a slight leveling off compared to what we had previously. Right now there is a strong focus on optimization, getting models that can run on-device without losing too much quality. This will both help make LLMs sustainable financially and energy-wise, as well as mitigate the privacy and security concerns inherent to the first wave of cloud-based LLMs.

    • Auli@lemmy.ca
      link
      fedilink
      English
      arrow-up
      2
      ·
      6 months ago

      Hasn’t it already kind of p;plateaued, or slowed at least. They where promising the world and it seems to have kind of halted.

      • Repple (she/her)@lemmy.world
        link
        fedilink
        English
        arrow-up
        2
        ·
        6 months ago

        It’s certainly not moving as fast as their promises (what ever does), and perhaps has slowed, but for me at least it’s too early to call a plateau. Perhaps someone who works in the field or follows more closely can provide a better characterization, though.