stopthatgirl7@kbin.social to Technology@lemmy.world · 1 year agoEverything Made By an AI Is In the Public Domaindoctorow.medium.comexternal-linkmessage-square144fedilinkarrow-up1695arrow-down135file-text
arrow-up1660arrow-down1external-linkEverything Made By an AI Is In the Public Domaindoctorow.medium.comstopthatgirl7@kbin.social to Technology@lemmy.world · 1 year agomessage-square144fedilinkfile-text
minus-squareillusoryMechanist@lemmy.worldlinkfedilinkEnglisharrow-up3·1 year agoDoes this mean we can, indeed, train AI on ChatGPT/other AI outputs?
minus-squareNatanael@slrpnk.netlinkfedilinkEnglisharrow-up9·1 year agoFYI there’s studies showing that repeatedly training ML on ML outputs degrades quality sharply after 4-5 cycles
minus-squareNatanael@slrpnk.netlinkfedilinkEnglisharrow-up6·1 year agoMachine Learning in this context
minus-squarePrager_U@lemmy.worldlinkfedilinkEnglisharrow-up1arrow-down1·1 year agoThat is a used method for training other LLMs, I believe OpenAssistant did this.
minus-squareassassin_aragorn@lemmy.worldlinkfedilinkEnglisharrow-up1arrow-down1·1 year agoDoesn’t that break the models?
minus-squareNatanael@slrpnk.netlinkfedilinkEnglisharrow-up2·1 year agoIt does after 4-5 cycles yeah, built in algorithmic biases gets amplified to a degree that it breaks the model
Does this mean we can, indeed, train AI on ChatGPT/other AI outputs?
FYI there’s studies showing that repeatedly training ML on ML outputs degrades quality sharply after 4-5 cycles
What does ml stand for
Machine Learning in this context
That is a used method for training other LLMs, I believe OpenAssistant did this.
Doesn’t that break the models?
It does after 4-5 cycles yeah, built in algorithmic biases gets amplified to a degree that it breaks the model