Technorati Technobabble
Has anyone else noticed changes at Technorati?
Specifically, how they seem to be handling caching and spidering?
Ok, so I subscribe to watchlists from Technorati. I “watch” certain key words and phrases like the name of my blogs, my own name, stuff I’m interested in, etc. and subscribe to the RSS feeds. That way, if someone blogs about my sites or me, I can pop by and see what they said. Very few people talk about me lately, which is a whole ‘nother story…
Anyway, I’ve been noticing over the past few weeks that I’m seeing a lot of old references to my blogs popping up - like from 4 month old posts on other sites. This leads me to believe that Technorati’s spider is either a) crawling and indexing a lot deeper and more thorough on blogs, or b) caching RSS feeds on their own servers, crawling those and adding to their index.
Another thing I’ve noticed in the past 10 days or so, is that Technorati is crawling and indexing comments on blog posts, or crawling and caching the comments RSS feed. I’ve seen my watchlist pop up with my own name and a site name for several comments I’ve made on other sites, that don’t link to me otherwise.
Now, I’m not saying this is a bad thing. In fact, I see it as a big plus since the more content Technorati crawls and indexes, the better and more complete the snapshot of the blogosphere is when someone does a search there.
Another thing I’d like to mention: The Technorati bot seems to be very friendly while crawling. Must be a well written and thought out script, unlike freakin loopy inktomi which I’ve had to ban from a couple of sites for sucking bandwidth. Not to mention numerous scraper bots…
Any other people out there geeky enough to notice these Technorati changes?
+ Del.icio.us | + Furl | + Reddit | + Digg | Email this
March 10th, 2006 at 11:30 pm
Yep, I’ve been seeing the same thing. I actually thought it was a glitch or something, but I’m happy to see that someone else is seeing the same changes…I thought I was losing it for a few days there ;D
March 11th, 2006 at 12:35 am
You guys gotta get a dog.
Kiddin’…just kiddin’.
Thanks for watching stuff like this, as I never do.
Anything we should do to take better advantage of this ?
March 11th, 2006 at 3:25 pm
Uh, guess I shoulda watched ‘em a little closer, since all my blogs have disappeared from Technorati.
March 12th, 2006 at 11:23 pm
Interesting is saw changes.. time to watch it
March 13th, 2006 at 1:18 am
I think the changes are cool.
I’ve also heard of a lot of blogs disappearing from technorati. Seems strange and I hope it’s just a glitch. I’ve seen your guys blogs and they seem perfectly legit.
March 13th, 2006 at 7:52 am
Seems to have been only Word Press based blogs. Glitches happen…it’s how fast you fix ‘em that makes you or breaks you.
They might also figure out how to keep a blog about a car from being #1 for the tag “golf” while they’re fixing stuff.
March 20th, 2006 at 10:03 pm
I have to admit, I’m not ‘up’ on Technorati at all. After I read your post, I went to check them out… and I see I have a lot of reading & learning to do, just to figure out how to best make use of their site and all they offer.
Any chance you’d be willing to do a podcast with me on this, Paul? LOL I’m sure a lot of people would be interested in Technorati and everything you can do there — if we only “got it”.
~ Lynn