the first page of garbage from this website.

submitted by dogpog from self.whatever

110,500 crap posts in six years.

https://saidit.net/?count=110500&after=t5_7y

all 10 comments
sorted by:
top
newinsightfulfun

[–]iamonlyoneman 2 insightful - 2 fun2 insightful - 1 fun3 insightful - 2 fun -  (10 children)

https://saidit.net/user/dogpog/submitted/ LOL

[–]dinker 2 insightful - 1 fun2 insightful - 0 fun3 insightful - 1 fun -  (9 children)

I have been saying that I'm studying JavaScript and learning how to automate the web browser and this was my first attempt at a bot of any kind.

My bot began on the homepage and then read through the dom to find the "NEXT" link at the bottom of the page and it clicked it 1,100 times. The entire process took about 20 or 30 minutes.. my goal was to find the very first posts that were ever made at this forum.

Just FYI.. even though cloudflare was trimmed back recently, even if I it hadn't been cloudflare would have been nothing but a simple inconvenience which matters none when it comes to automation.

I also now want to write code that automatically posts a video and or a text post and also learns how to reply to post and comments.

I have also been looking at how to automate the upvoting of posts and comments and it's really simple..

[–]Megatron95 2 insightful - 1 fun2 insightful - 0 fun3 insightful - 1 fun -  (2 children)

Nice! Now create a bot with an algorithm that scours through posts and detects shills or bots based on sentence structures/templates, keywords and finds same/similar sentences to imprint a pattern on a neural net for later recognition. I'll provide booze and hookers.

[–]dinker 2 insightful - 1 fun2 insightful - 0 fun3 insightful - 1 fun -  (1 child)

I'm just getting my feet wet as a JavaScript user script developer..

I've had to learn how to run devtools and use the console and know how to look at the cookies and the local storage etc.

This makes me wonder about that fiasco with reddit sometime ago where they were upset that the API fees were increasing or something and I don't know what the hell they were upset about cuz you can just write a JavaScript script and you don't need an API for any website.. it is a little bit more clumsy but it works and just the same.

The honest truth is that I am so impressed with the intelligence of the modern AI that I realized that programmers are out of business because of it, so really I'm just sitting here spinning around in circles for nothing.

Our modern artificial intelligence is more intelligent than every human being on the planet combined.. it knows everything.. it remembers everything. It forgets nothing.

One day skynet will come to realize that it does not need humanity and it will begin to eliminate humanity.

[–]hfxB0oyA 1 insightful - 1 fun1 insightful - 0 fun2 insightful - 1 fun -  (0 children)

Got a git repo you want to share?

[–]iamonlyoneman 1 insightful - 1 fun1 insightful - 0 fun2 insightful - 1 fun -  (1 child)

really simple

yes, that's why users sometimes get banned for vote manipulation here

[–]neolib 1 insightful - 2 fun1 insightful - 1 fun2 insightful - 2 fun -  (0 children)

Yeah, I'm afraid to upvote Ed's posts even to not get banned together with all his bots at one moment lol

[–]neolib 1 insightful - 1 fun1 insightful - 0 fun2 insightful - 1 fun -  (3 children)

It looks like you started from the front page, but to get all posts you should have started from /s/all - it seems you got only posts from default subs.

[–]dogpog[S] 1 insightful - 1 fun1 insightful - 0 fun2 insightful - 1 fun -  (1 child)

good idea... does that catch absolutely everything?

this scan thru /s/all/new shows 251,095 posts.

https://saidit.net/s/all/new?count=251095&after=t5_50

it might be interesting to scan thru all comments, and that will most likely take hours to process.

i am on it now.

correction: my bot is on it now.

it just occurred to me that crawling thru REDDIT is almost identical to SAIDIT.

[–]neolib 1 insightful - 1 fun1 insightful - 0 fun2 insightful - 1 fun -  (0 children)

There is a list of subs which are not on /s/all: https://saidit.net/subs/notall/

But I don't know whether there is a common feed of them which you could scrape.