all 15 comments

[–]Bows3633 13 insightful - 3 fun13 insightful - 2 fun14 insightful - 3 fun -  (0 children)

You deserve a medal for your dedication to us! All this AND you're helping dev our eventual forever home. What a hero

[–]unclickedlink 8 insightful - 2 fun8 insightful - 1 fun9 insightful - 2 fun -  (3 children)

I downloaded 10GB+ worth of 2000+ videos posted on WPD, thanks for this tho, it'll come in handy.

[–][deleted] 3 insightful - 1 fun3 insightful - 0 fun4 insightful - 1 fun -  (2 children)

Yeah, that's probably mine as well (third link on the page in the OP), if it was hosted on MEGA.

[–]unclickedlink 2 insightful - 1 fun2 insightful - 0 fun3 insightful - 1 fun -  (0 children)

well then, thank you, kind sir!

[–]Helhiem 6 insightful - 2 fun6 insightful - 1 fun7 insightful - 2 fun -  (4 children)

Damn this is impressive. The full archive is gonna be over 100 GB

[–][deleted] 8 insightful - 3 fun8 insightful - 2 fun9 insightful - 3 fun -  (3 children)

Yup, second archive is almost exactly 250 GB of videos. Too bad I lost it all because I had to restore my user partition from a 2 weeks old backup, so I gotta write all the tools I made to create that archive again and then download all that again. \o/

(and I guess I'm doing backups more often now)

[–]blind_sypher88 2 insightful - 1 fun2 insightful - 0 fun3 insightful - 1 fun -  (1 child)

Is a link going to be posted once its recovered?

[–][deleted] 2 insightful - 1 fun2 insightful - 0 fun3 insightful - 1 fun -  (0 children)

Yeah, I will post a link. Haven't gotten around to it yet, though.

[–]TheHippyDance 1 insightful - 1 fun1 insightful - 0 fun2 insightful - 1 fun -  (0 children)

Is the second archive referring to the "wpd archive #2" link on https://dblsaiko.net/wpd?

Or are you referring to something different when you say second archive? I'm guessing the wpd archive #2 is the second archive but with original content links, not downloaded and hosted like you did with the "wpd archive" link with 2000 posts, but wanted to double check because I don't remember there ever being a time without "wpd archive #2" link and I believe I was here from the very beginning.

Also, it seems like there are large chunks of time missing from the wpd archive #2. Like, there will be a 100 or so posts on one day, then no posts for 30 days. I see the same thing if I do searches through api.pushshift.io. Was just wondering if you knew what that means, did pushshift just not archive wpd during those large chunks of time?

[–]LiterallyCaligula 6 insightful - 2 fun6 insightful - 1 fun7 insightful - 2 fun -  (1 child)

How is this even possible? Did you archive the sub before it got nuked?

[–][deleted] 7 insightful - 2 fun7 insightful - 1 fun8 insightful - 2 fun -  (0 children)

Partially. The 2000 post one I archived myself, it's just the files from videoarchivebot, for the big one I got the data from pushshift.io (example)

[–]CoolTool 5 insightful - 1 fun5 insightful - 0 fun6 insightful - 1 fun -  (0 children)

Thanks for all the good work!

[–]ScruffyMuff 1 insightful - 1 fun1 insightful - 0 fun2 insightful - 1 fun -  (1 child)

This link is now unreachable for some reason

[–][deleted] 1 insightful - 1 fun1 insightful - 0 fun2 insightful - 1 fun -  (0 children)

Still works for me. If not, you want https://dblsaiko.net/wpd (that's what the link in the OP now redirects to)

[–]asdasdasdasdasd 1 insightful - 1 fun1 insightful - 0 fun2 insightful - 1 fun -  (0 children)

lol