Im on the fedi doin fedi things.

  • 325 Posts
  • 1.36K Comments
Joined vor 2 Jahren
cake
Cake day: 27. Dezember 2024

help-circle




  • You bring up some good points. Just FYI my research was specifically on ai, but a very specific branch in college. So not llm but only somewhat llm flavored.

    The are already including ai chips in consumer hardware. And your thinking of llm specific limitations. But the smaller models can absolutly be thrown into hardware. Its just the algorithms are moving so fast that the hardware needs to be flexible enough. Thars the biggest reason we dont see more hardware faster than gpus. Hooe that makes sense!



  • A while back Fedora and Nvidia had a war in my desktop. My graphics card kept needing special drivers. And Fedora would do an update, break the drivers and I would have to pop into the command line to fix the issue. It went on for a good 6 months until I just switched distros. And never had the issue again. It was something that sat in an issue tracker for a LONG time from last time I bothered to look.

    Fedora was great dont get me wrong, but debian and debian based distros make it so easy I never looked back.