Somewhat complete archive of the old sub, ~22000 posts (+other WPD-related links)

submitted by [deleted] from (therealfarfetchd.dev)

sorted by:
top
newinsightfulfun
you are viewing a single comment's thread.

view the rest of the comments →

[–]Helhiem 6 insightful - 2 fun6 insightful - 1 fun7 insightful - 2 fun -  (4 children)

Damn this is impressive. The full archive is gonna be over 100 GB

[–][deleted] 8 insightful - 3 fun8 insightful - 2 fun9 insightful - 3 fun -  (3 children)

Yup, second archive is almost exactly 250 GB of videos. Too bad I lost it all because I had to restore my user partition from a 2 weeks old backup, so I gotta write all the tools I made to create that archive again and then download all that again. \o/

(and I guess I'm doing backups more often now)

[–]blind_sypher88 2 insightful - 1 fun2 insightful - 0 fun3 insightful - 1 fun -  (1 child)

Is a link going to be posted once its recovered?

[–][deleted] 2 insightful - 1 fun2 insightful - 0 fun3 insightful - 1 fun -  (0 children)

Yeah, I will post a link. Haven't gotten around to it yet, though.

[–]TheHippyDance 1 insightful - 1 fun1 insightful - 0 fun2 insightful - 1 fun -  (0 children)

Is the second archive referring to the "wpd archive #2" link on https://dblsaiko.net/wpd?

Or are you referring to something different when you say second archive? I'm guessing the wpd archive #2 is the second archive but with original content links, not downloaded and hosted like you did with the "wpd archive" link with 2000 posts, but wanted to double check because I don't remember there ever being a time without "wpd archive #2" link and I believe I was here from the very beginning.

Also, it seems like there are large chunks of time missing from the wpd archive #2. Like, there will be a 100 or so posts on one day, then no posts for 30 days. I see the same thing if I do searches through api.pushshift.io. Was just wondering if you knew what that means, did pushshift just not archive wpd during those large chunks of time?