you are viewing a single comment's thread.

view the rest of the comments →

[–]JasonCarswell 2 insightful - 1 fun2 insightful - 0 fun3 insightful - 1 fun -  (0 children)

Right. That's what I meant.

I wouldn't know how to deal with spiders I didn't want.

Looking back I wonder if that robot.txt was a trick. "Don't look at my private folder. No. Don't do it. It's right there where I'm indicating, but don't look."

But I was not talking about blocking them. I was trying to invite them to scan SaidIt 1) so we could search them and 2) so the more content we feature the broader their set gets and the vaster SaidIt seems/is (compared to a site with 3 pages) and 3) so the diversity of content may also meet more searchers.

Maybe this is naive meat-think and the Al Gore Rhythms are nothing like my fanciful wists.