While clicking through some random Lemmy instances, I found one that’s due to be shut down in about a week — https://dmv.social. I’m trying to archive what I can onto the Wayback Machine, but I’m not sure what the most efficient way to go about it is.
At the moment, what I’ve been doing is going through each community and archiving each sort type (except the ones under a month, since the instance was locked a month ago) with capture outlinks enabled. But is there a more efficient way to do it? I know of the Internet Archives save from spreadsheet tool, which would probably work well, but I don’t know how I’d go about crawling all the links into a sitemap or csv or something similar. I don’t have the know-how to setup a web crawler/spider.
Any suggestions?
Well since posts are numbered sequentially, you could archive all of them by generating the links. Tiny issue is, this would include every post that was federated with the server, which is almost 2 million it seems. A bit overkill for a relatively small instance.
I think if you filter by local on the main page and click next until you get to the end, there aren’t that many pages. You could save those with outlinks.
Also, I believe, the posts will live on on other instances regardless.