NekuSoul-Lemmy
  • Communities
  • Create Post
  • heart
    Support Lemmy
  • search
    Search
  • Login
  • Sign Up
JOMusic@lemmy.ml to Open Source@lemmy.mlEnglish · 2 months ago

Ai2/AllenAI released a FOSS LLM which runs locally on iPhone

allenai.org

external-link
message-square
12
fedilink
41
external-link

Ai2/AllenAI released a FOSS LLM which runs locally on iPhone

allenai.org

JOMusic@lemmy.ml to Open Source@lemmy.mlEnglish · 2 months ago
message-square
12
fedilink
OLMoE, meet iOS | Ai2
allenai.org
external-link
Our state-of-the-art mixture-of-experts model is now available on the Apple app store! The OLMoE app allows anyone to test the model privately and securely on their devices.
  • dblsaiko@discuss.tchncs.de
    link
    fedilink
    arrow-up
    6
    ·
    2 months ago

    It probably uses Apple’s CoreML. Not sure if Android has an equivalent API.

    • fubarx@lemmy.ml
      link
      fedilink
      arrow-up
      3
      ·
      2 months ago

      https://developers.google.com/ml-kit/

    • foremanguy@lemmy.ml
      link
      fedilink
      arrow-up
      1
      ·
      2 months ago

      Explain it pls

      • dblsaiko@discuss.tchncs.de
        link
        fedilink
        arrow-up
        3
        ·
        2 months ago

        It’s Apple’s API for hardware-accelerated machine learning. Their new devices have specialized ML hardware so it’s actually feasible to run on mobile devices. Probably what they also use for Apple Intelligence. https://developer.apple.com/documentation/coreml

        • foremanguy@lemmy.ml
          link
          fedilink
          arrow-up
          1
          ·
          edit-2
          2 months ago

          Seems like a good project to implement on the green side (Or pinguin side)

Open Source@lemmy.ml

opensource@lemmy.ml

Subscribe from Remote Instance

Create a post
You are not logged in. However you can subscribe from another Fediverse account, for example Lemmy or Mastodon. To do this, paste the following into the search field of your instance: !opensource@lemmy.ml

All about open source! Feel free to ask questions, and share news, and interesting stuff!

Useful Links

  • Open Source Initiative
  • Free Software Foundation
  • Electronic Frontier Foundation
  • Software Freedom Conservancy
  • It’s FOSS
  • Android FOSS Apps Megathread

Rules

  • Posts must be relevant to the open source ideology
  • No NSFW content
  • No hate speech, bigotry, etc

Related Communities

  • !libre_culture@lemmy.ml
  • !libre_software@lemmy.ml
  • !libre_hardware@lemmy.ml
  • !linux@lemmy.ml
  • !technology@lemmy.ml

Community icon from opensource.org, but we are not affiliated with them.

Visibility: Public
globe

This community can be federated to other instances and be posted/commented in by their users.

  • 83 users / day
  • 1.15K users / week
  • 4.47K users / month
  • 10.4K users / 6 months
  • 1 local subscriber
  • 36.7K subscribers
  • 2.02K Posts
  • 33.6K Comments
  • Modlog
  • mods:
  • Evan@lemmy.ml
  • kevincox@lemmy.ml
  • CrypticCoffee@lemmy.ml
  • Lettuce eat lettuce@lemmy.ml
  • BE: 0.19.8
  • Modlog
  • Instances
  • Docs
  • Code
  • join-lemmy.org