Comments on: Sphere Blog Search http://elliottback.com/wp/sphere-blog-search/ Internet & Technology Sun, 22 Nov 2009 02:40:56 -0400 http://wordpress.org/?v=2.8.4 hourly 1 By: Tobias Hoellrich http://elliottback.com/wp/sphere-blog-search/#comment-259052 Tobias Hoellrich Fri, 17 Nov 2006 18:42:14 +0000 http://elliottback.com/wp/archives/2006/05/02/sphere-blog-search/#comment-259052 Almost four million for a bot that shows that kind of spidering behaviour? 64.40.115.62 - - [17/Nov/2006:11:31:36 -0700] "GET /robots.txt HTTP/1.0" 200 117 "-" "Sphere Scout&v4.0 (beta) - scout at sphere dot com" 64.40.115.62 - - [17/Nov/2006:11:31:37 -0700] "GET /feed/rdf/ HTTP/1.0" 200 23347 "-" "Sphere Scout&v4.0 (beta) - scout at sphere dot com" 64.40.115.62 - - [17/Nov/2006:11:31:40 -0700] "GET / HTTP/1.0" 200 45603 "-" "SET USER AGENT" 64.40.115.62 - - [17/Nov/2006:11:31:40 -0700] "GET / HTTP/1.0" 200 45603 "-" "SET USER AGENT" 64.40.115.62 - - [17/Nov/2006:11:31:51 -0700] "GET /robots.txt HTTP/1.0" 200 117 "-" "SET USER AGENT" 64.40.115.62 - - [17/Nov/2006:11:31:52 -0700] "GET /feed/ HTTP/1.0" 200 24898 "-" "SET USER AGENT" 64.40.115.62 - - [17/Nov/2006:11:31:53 -0700] "GET /feed/ HTTP/1.0" 200 24898 "-" "SET USER AGENT" 64.40.115.62 - - [17/Nov/2006:11:31:53 -0700] "GET / HTTP/1.0" 200 45603 "-" "Sphere Scout&v4.0 (beta) - scout at sphere dot com" Gosh - where do I sign up for my 4 million? I have a ten line perl script that does a better job than the thing above ... Sigh Almost four million for a bot that shows that kind of spidering behaviour?

64.40.115.62 – - [17/Nov/2006:11:31:36 -0700] “GET /robots.txt HTTP/1.0″ 200 117 “-” “Sphere Scout&v4.0 (beta) – scout at sphere dot com”
64.40.115.62 – - [17/Nov/2006:11:31:37 -0700] “GET /feed/rdf/ HTTP/1.0″ 200 23347 “-” “Sphere Scout&v4.0 (beta) – scout at sphere dot com”
64.40.115.62 – - [17/Nov/2006:11:31:40 -0700] “GET / HTTP/1.0″ 200 45603 “-” “SET USER AGENT”
64.40.115.62 – - [17/Nov/2006:11:31:40 -0700] “GET / HTTP/1.0″ 200 45603 “-” “SET USER AGENT”
64.40.115.62 – - [17/Nov/2006:11:31:51 -0700] “GET /robots.txt HTTP/1.0″ 200 117 “-” “SET USER AGENT”
64.40.115.62 – - [17/Nov/2006:11:31:52 -0700] “GET /feed/ HTTP/1.0″ 200 24898 “-” “SET USER AGENT”
64.40.115.62 – - [17/Nov/2006:11:31:53 -0700] “GET /feed/ HTTP/1.0″ 200 24898 “-” “SET USER AGENT”
64.40.115.62 – - [17/Nov/2006:11:31:53 -0700] “GET / HTTP/1.0″ 200 45603 “-” “Sphere Scout&v4.0 (beta) – scout at sphere dot com”

Gosh – where do I sign up for my 4 million? I have a ten line perl script that does a better job than the thing above …

Sigh

]]> By: life as usual » about those bots… http://elliottback.com/wp/sphere-blog-search/#comment-53226 life as usual » about those bots… Thu, 18 May 2006 04:43:34 +0000 http://elliottback.com/wp/archives/2006/05/02/sphere-blog-search/#comment-53226 [...] I tracked it down to these guys, but found better information from this blog. Short version is that it is a blog search service, in beta. Not very good yet. And they have all of 2 of my posts so far, even though they have indexed, well, a log of them. Of those 21 hits, 11 were for specific posts, 4 were for “/” (the main page) and 6 were for “robots.txt” (didn’t they figure out the first 5 times what an error 404 is?) I’m thinking I’m just going to block their IPs, as they are hitting me all night (so I hear the drive spin up all the time.) And geeks have a good reason I should not block them? [...] [...] I tracked it down to these guys, but found better information from this blog. Short version is that it is a blog search service, in beta. Not very good yet. And they have all of 2 of my posts so far, even though they have indexed, well, a log of them. Of those 21 hits, 11 were for specific posts, 4 were for “/” (the main page) and 6 were for “robots.txt” (didn’t they figure out the first 5 times what an error 404 is?) I’m thinking I’m just going to block their IPs, as they are hitting me all night (so I hear the drive spin up all the time.) And geeks have a good reason I should not block them? [...]

]]> By: Somewhat Frank http://elliottback.com/wp/sphere-blog-search/#comment-49451 Somewhat Frank Wed, 03 May 2006 06:38:58 +0000 http://elliottback.com/wp/archives/2006/05/02/sphere-blog-search/#comment-49451 <strong>Sphere Blog Search Engine Needs To Train Old Dogs...</strong> Sphere, a blog search engine, finally launched today (May 2, 2006) after much anticipation with a new look and logo since first hearing about Sphere in October 2005. My first impressions was that it presents a very simple interface... Sphere Blog Search Engine Needs To Train Old Dogs…

Sphere, a blog search engine, finally launched today (May 2, 2006) after much anticipation with a new look and logo since first hearing about Sphere in October 2005. My first impressions was that it presents a very simple interface…

]]> By: stickboybob http://elliottback.com/wp/sphere-blog-search/#comment-49439 stickboybob Wed, 03 May 2006 03:55:52 +0000 http://elliottback.com/wp/archives/2006/05/02/sphere-blog-search/#comment-49439 very cool, i will have to try that sometime. i like this blog alot whee very cool, i will have to try that sometime.
i like this blog alot
whee

]]>