My Photo

« Novelty versus Currency | Main | BlogPulse Live »

February 03, 2006


Ron Kass

Just to shed some light on the recent thread/forum count changes.
Those changes are in fact purging related.
If you notice on your graph, on mid 29th and mid 30th there were two purging actions on forums. One was on a removed board, and the other was on a dead board.
BoardTracker does not leave in it's database such removed/dead boards and their data. Also, when robots.txt directives to block a forum/board is detected, the removal is immediate (full thread data removal follows not too long after). Equally when a robot exclusion is removed, a board/forum could be re-added shortly after. Threads might need to be re-spidered if the block was in place for a long period.

Following the forum purges, after not too long a period of time the threads themselves are also purged. Very soon after in fact (compared to traditional search engines at least). Notice on your graph a drop in threads on the middle of the 30th and the middle of the 31st.

Fluctuations on forums may on other times have little effect on thread count when those are part of reorganization of an existing board's forums or a drop/addition of a board with many forums but little threads.

Putting things in perspective though, your recent reports on BoardTracker's sizes were:
October 06, 2005: 11,000 forums (if memory serves me correctly, thread count was about ~6M)
October 24, 2005: 12,563 forums (~7M threads)
November 19, 2005: 16,610 forums (~11M threads)
Numbers for Today: 23,132 forums (~13.2M threads)

Verify your Comment

Previewing your Comment

This is only a preview. Your comment has not yet been posted.

Your comment could not be posted. Error type:
Your comment has been posted. Post another comment

The letters and numbers you entered did not match the image. Please try again.

As a final step before posting your comment, enter the letters and numbers you see in the image below. This prevents automated programs from posting comments.

Having trouble reading this image? View an alternate.


Post a comment

Your Information

(Name is required. Email address will not be displayed with the comment.)

Twitter Updates

    follow me on Twitter

    March 2016

    Sun Mon Tue Wed Thu Fri Sat
        1 2 3 4 5
    6 7 8 9 10 11 12
    13 14 15 16 17 18 19
    20 21 22 23 24 25 26
    27 28 29 30 31    


    Blog powered by Typepad