• 165 Posts
  • 624 Comments
Joined 1 year ago
cake
Cake day: March 19th, 2024

help-circle




  • Efficiency still matters very much when self hosting. You need to consider power usage (do you have enough amps in your service to power a single GPU? probably. what about 10? probably not) and heat (it’s going to make you need to run more A/C in the summer, do you have enough in your service to power an A/C and your massive amount of GPUs? not likely).

    Homes are not designed for huge amounts of hardware. I think a lot of self hosters (including my past self) can forget that in their excitement of their hobby. Personally, I’m just fine not running huge models at home. I can get by with models that can run on a single GPU, and even if I had more GPUs in my server, I don’t think the results (which would still contain many hallucinations) would be worth the power cost, strain on my A/C, and possible electrical overload.















  • I lost my model A1263 in a box during a move. I’ve been looking for it over the last couple of weeks once I was notified about this, but no luck. I actually emailed Anker to ask if there’s a risk of fire even in storage or not in use, and apparently it can happen even when not under any load and completely discharged.

    I don’t even know if I still have it. Fingers crossed that my serial isn’t one of the affected ones, but I’ll keep looking and hoping that it doesn’t burn my house down.