• Telorand@reddthat.com
    link
    fedilink
    English
    arrow-up
    17
    arrow-down
    3
    ·
    edit-2
    2 months ago

    Except when it’s not, or else this article would have no point.

    ETA: also, it seems like a terrible idea to train science models on data you essentially invented. The reason science works is because it follows the extant evidence, not the other way around.

    • Echo Dot@feddit.uk
      link
      fedilink
      English
      arrow-up
      4
      ·
      edit-2
      2 months ago

      It’s not doing scientific discovery though it’s doing analysis of known facts. You’re just trying to get the AI to ingest that knowledge and to crystallize it.

      Think about doing flashcards when revising for an exam, it’s the same process really, the same information presented in a different way, in the hope that one of those ways, sticks.

      You need to give the AI new data for it to learn anything new (which isn’t surprising when you think about it), but for it to just get better at internalizing existing knowledge synthetic data works quite well, and since AI start off knowing nothing most of what you want them to learn is in fact already established knowledge.