My Photo

« How To Get from A' to B' | Main | InfoMusic »

August 09, 2007


Kevin Burton

"Robert's case for robots.txt is to prevent others from bootstrapping a news site out of your (that is to say, Google's) hard earned analysis and presentation."

This assumes that the only reason to index Google News would be to build a competitor to Google News.

The customers using Spinn3r are building things I would have NEVER thought of.


I think it's a little weird whenever Google is greedy with its data, but only because they built (and continue to build) their business off of OUR data. I'm working on a "buzz aggregator" for the Semantic Web. Basically it will be aggregating blog posts and bookmarks related to the Semantic Web and will also allow users to comment on articles. Rather than keep the comments silo'd on my blog I'm going to open up user comments with SIOC. This will allow the conversation to be combined on the with the comments on the original author's blog.

The comments to this entry are closed.

Twitter Updates

    follow me on Twitter

    March 2016

    Sun Mon Tue Wed Thu Fri Sat
        1 2 3 4 5
    6 7 8 9 10 11 12
    13 14 15 16 17 18 19
    20 21 22 23 24 25 26
    27 28 29 30 31    


    Blog powered by Typepad