you are viewing a single comment's thread.

view the rest of the comments →

[–]JasonCarswell 2 insightful - 1 fun2 insightful - 0 fun3 insightful - 1 fun -  (10 children)

ping /u/magnora7 /u/d3rr

I don't know if this is related or not to SEO.

I have found the default search on SaitIt only searches post titles. Google and DDG are no help either for searching the comments.

I know from almost 20 years ago you can set up your site to allow or deny their spiderbots, but is it also possible to flip it so they don't come to you?

What if after every post and comment SaidIt pinged Google and DDG to come look? Obviously that might be overkill so perhaps a script that kicks in after X days of inactivity on a post then sends an invite to be crawled by their spiders.

I don't know if that's a thing but IMHO it should be.

There is another issue, and I don't know if it really exacerbates things but I doubt it's helpful beyond the very practical search capability. And that is about SaidIt's content. If anyone were to analyse all the posts they'd certainly gain an understanding about what SaidIt is all about. But most posts are impersonal headline titles. If anyone were to analyse the content of the comments I doubt their understanding of what SaidIt is all about would be much different. But it may be. They'd know we're even more red-pilled than just some news aggregation. They'd know about us individually as participating characters with personalities. There's nothing to stop Google or the NSA from already doing this, but it's something to consider.

Especially when YouTube videos get pulled for one person in the comments mentioning "Jews" or something. Or so I've been told.

[–][deleted] 4 insightful - 1 fun4 insightful - 0 fun5 insightful - 1 fun -  (9 children)

We invite Google and whoever to come cache our site, so that's too bad if they don't have the site indexed. There's no way that I know of to tell Google hey come crawl this page.

What we need to do is work on a legit sitemap so that search engines get an idea of our organization/subs and are more encouraged to crawl the whole site.

Yes, search is post tiles only just like on Reddit. People have long complained about this. I'd be willing to put some effort into this, I think comments could be searchable too. Lots of work though.

[–]Mnemonic 3 insightful - 1 fun3 insightful - 0 fun4 insightful - 1 fun -  (8 children)

A warning (sort of): When saidit grows it might take up too much space/time to search the comments.

As I (And BEWARE, just me) see it, it;s about the posting to other sites mostly and when someone thinks 'hey that's for me' they will see he comments. For example having the ability to search the comments for 'the' is a waste of computational power(which includes time).

A sitemap for subs, a thing to consider, perhaps an update once a month (or every 2 weeks, that's the time limit right? maybe one week, every sunday).

EDIT: maybe: if you are on ones profile, serch only their comments for terms, take up a lot less time and might be just what people want.

[–][deleted] 3 insightful - 1 fun3 insightful - 0 fun4 insightful - 1 fun -  (7 children)

Yeah good warning man, you're right. At our current volume we could handle comment searching but at Reddit's volume it becomes a real technical challenge that might not be worth all of the effort. I'd rather put the effort into something like being able to save more than 1000 things, and then being able to search your saved things.

Yeah being able to search all of someone's comments would be cool too and make for a quicker search, but that still means search indexing every single comment on the site.

It's all about what people want out of their news aggregator I guess. This seems pretty low on the priority list for most.

[–]magnora7 2 insightful - 1 fun2 insightful - 0 fun3 insightful - 1 fun -  (6 children)

I agree with your assessment here.

One other random thing I noticed in regard to external crawling, I don't think our app traffic is registering on alexa, I wonder if there's a switch you can flip on the app to enable that traffic to register to our main domain name? If it's some horrible project to make that happen then don't worry about it, just a passing thought, definitely not a big deal

[–][deleted] 2 insightful - 1 fun2 insightful - 0 fun3 insightful - 1 fun -  (5 children)

flip on the app to enable that traffic to register to our main domain name?

It's very possible that this is doable and not a tech nightmare, I'll think about it.

[–]magnora7 2 insightful - 1 fun2 insightful - 0 fun3 insightful - 1 fun -  (4 children)

Okay, cool. I wouldn't put more than an hour or so in to it. If it takes longer than that, I wouldn't worry about it.

[–][deleted] 2 insightful - 1 fun2 insightful - 0 fun3 insightful - 1 fun -  (3 children)

It's definitely longer than an hour and would require an app re-release.

[–]magnora7 1 insightful - 1 fun1 insightful - 0 fun2 insightful - 1 fun -  (2 children)

Yeah I wouldn't worry about it then. It doesn't really serve us rather than to help our alexa rank, which helps our /r/redditalternative rank (although we could get an asterisk like the other site did, for uncounted app site hits).

I've stopped paying attention to the alexa rank myself, but I did mention it in saidit's most popular post ever. So I think we could probably get away with ignoring it, realistically. It just makes saidit look smaller than it is by the external metrics. Not sure how important that is to the actual growth of saidit

[–][deleted] 2 insightful - 1 fun2 insightful - 0 fun3 insightful - 1 fun -  (1 child)

Yeah I feel similarly. I left this idea on our someday/maybe list.