General_Effort@lemmy.world to Technology@lemmy.worldEnglish · 1 year agoReddit will block the Internet Archivewww.theverge.comexternal-linkmessage-square161linkfedilinkarrow-up1914arrow-down111
arrow-up1903arrow-down1external-linkReddit will block the Internet Archivewww.theverge.comGeneral_Effort@lemmy.world to Technology@lemmy.worldEnglish · 1 year agomessage-square161linkfedilink
minus-squareNatanael@infosec.publinkfedilinkEnglisharrow-up4·1 year agoThe ability to block crawling is separate from the ability to delist old pages. The latter usually happens after domains change owners
The ability to block crawling is separate from the ability to delist old pages. The latter usually happens after domains change owners