Comments on: Chart Against The X Factor http://bitplane.net/2009/12/bash-for-xmas-number-one/ Rants, ramblings, free software Wed, 08 Feb 2012 21:14:59 +0000 hourly 1 http://wordpress.org/?v=3.3.1 By: Gaz Davidson http://bitplane.net/2009/12/bash-for-xmas-number-one/comment-page-1/#comment-161 Gaz Davidson Thu, 17 Dec 2009 12:36:36 +0000 http://bitplane.net/?p=342#comment-161 Yes, the raw data is currently available here: http://dump.bitplane.net/ratm/data.dat Sometime after Sunday I'll move the latest graphs back to my blog along with the results, the scripts used to generate them and maybe even a bit of analysis. Watch this space! If you can think of any cool things to do with the data then please just go ahead and use it, post me a link and I'll link back to it :) Yes, the raw data is currently available here:

http://dump.bitplane.net/ratm/data.dat

Sometime after Sunday I’ll move the latest graphs back to my blog along with the results, the scripts used to generate them and maybe even a bit of analysis. Watch this space!

If you can think of any cool things to do with the data then please just go ahead and use it, post me a link and I’ll link back to it :)

]]> By: nick rose http://bitplane.net/2009/12/bash-for-xmas-number-one/comment-page-1/#comment-160 nick rose Thu, 17 Dec 2009 12:05:48 +0000 http://bitplane.net/?p=342#comment-160 Hi, is there any plans to publish the full details once the campaign is over? Id be really interested to see all the data collated. Hi, is there any plans to publish the full details once the campaign is over? Id be really interested to see all the data collated.

]]> By: Gaz Davidson http://bitplane.net/2009/12/bash-for-xmas-number-one/comment-page-1/#comment-159 Gaz Davidson Tue, 15 Dec 2009 03:43:11 +0000 http://bitplane.net/?p=342#comment-159 It should be working again now Dimitri, it was caused by a change to the group's name, I've fixed the regexp like so: <pre lang="bash"> # extract user count from the file usercount=`sed -n -e "s/.*>[0-9]* of \(.*\) members<.*/\1/p" temp.html` </pre> It should be working again now Dimitri, it was caused by a change to the group’s name, I’ve fixed the regexp like so:

# extract user count from the file
usercount=`sed -n -e "s/.*>[0-9]* of \(.*\) members<.*/\1/p" temp.html`
]]> By: Dimitri http://bitplane.net/2009/12/bash-for-xmas-number-one/comment-page-1/#comment-158 Dimitri Mon, 14 Dec 2009 19:55:19 +0000 http://bitplane.net/?p=342#comment-158 Hey Gaz, Great work on the script, and thanks for sharing the code. Just noticed, the index page doesn't seem to load normally anymore (firefox tries to download it instead of interpreting the html). Any idea why? Thanks, Dimitri Hey Gaz,

Great work on the script, and thanks for sharing the code. Just noticed, the index page doesn’t seem to load normally anymore (firefox tries to download it instead of interpreting the html). Any idea why?

Thanks,
Dimitri

]]> By: nick rose http://bitplane.net/2009/12/bash-for-xmas-number-one/comment-page-1/#comment-157 nick rose Mon, 14 Dec 2009 11:25:42 +0000 http://bitplane.net/?p=342#comment-157 Excellent graph :D We're an internet machine!!! Excellent graph :D We’re an internet machine!!!

]]> By: Interpolated list class for Python – bitplane.net http://bitplane.net/2009/12/bash-for-xmas-number-one/comment-page-1/#comment-154 Interpolated list class for Python – bitplane.net Sat, 12 Dec 2009 03:25:31 +0000 http://bitplane.net/?p=342#comment-154 [...] messing with Python to output some better graphs for my Facebook group scraper I stumbled upon an interesting problem. What happens if you have missing samples, or want to change [...] [...] messing with Python to output some better graphs for my Facebook group scraper I stumbled upon an interesting problem. What happens if you have missing samples, or want to change [...]

]]> By: James French http://bitplane.net/2009/12/bash-for-xmas-number-one/comment-page-1/#comment-152 James French Fri, 11 Dec 2009 18:22:03 +0000 http://bitplane.net/?p=342#comment-152 This is too cool Gaz. I'm impressed. I think I'm going to learn a thing or two from these scripts - cheers! James This is too cool Gaz. I’m impressed. I think I’m going to learn a thing or two from these scripts – cheers!

James

]]> By: Dave Holden http://bitplane.net/2009/12/bash-for-xmas-number-one/comment-page-1/#comment-151 Dave Holden Fri, 11 Dec 2009 13:30:08 +0000 http://bitplane.net/?p=342#comment-151 Many thanks! Many thanks!

]]> By: Gaz Davidson http://bitplane.net/2009/12/bash-for-xmas-number-one/comment-page-1/#comment-150 Gaz Davidson Fri, 11 Dec 2009 11:57:53 +0000 http://bitplane.net/?p=342#comment-150 It assumes that there are similar volumes of users joining at the same time each day and predicts based on how many have joined so far today compared to the same time over the last three days: <pre lang="python"> secs_today = int(total_range) % 86400 # start time was 12am on Sunday, there are 86400 secs in a day for i in range( int(start), int(start) + int(day_count+1) * 86400, 86400): days.append( # tuple: day name (strftime('%b%d', gmtime(i) ), # total that day data[i+86400] - data[i], # amount at the same time on that day data[i+secs_today] - data[i]) ) # take the average values of the last three full days tot = 0.0 partial = 0.0 for i in days[-4:-1]: tot = tot + i[1] partial = partial + i[2] factor = tot / partial # make a prediction prediction = days[-1][2] * factor </pre> "data" is my InterpoList class which does linear interpolation to fill in the gaps between measurements, you can get it here: http://svn.bitplane.net/misc/trunk/py/InterpoList.py It assumes that there are similar volumes of users joining at the same time each day and predicts based on how many have joined so far today compared to the same time over the last three days:

 
secs_today = int(total_range) % 86400
 
# start time was 12am on Sunday, there are 86400 secs in a day
for i in range( int(start), int(start) + int(day_count+1) * 86400, 86400):
    days.append(
                 # tuple: day name
                 (strftime('%b%d', gmtime(i) ),
                 # total that day
                 data[i+86400] - data[i],
                 # amount at the same time on that day
                 data[i+secs_today] - data[i])
                )
 
# take the average values of the last three full days
tot     = 0.0
partial = 0.0
for i in days[-4:-1]:
    tot = tot + i[1]
    partial = partial + i[2]
 
factor = tot / partial
 
# make a prediction
prediction = days[-1][2] * factor

“data” is my InterpoList class which does linear interpolation to fill in the gaps between measurements, you can get it here:
http://svn.bitplane.net/misc/trunk/py/InterpoList.py

]]> By: Dave Holden http://bitplane.net/2009/12/bash-for-xmas-number-one/comment-page-1/#comment-149 Dave Holden Fri, 11 Dec 2009 11:48:38 +0000 http://bitplane.net/?p=342#comment-149 The new versions of your graphs are awesome! Thanks for creating them. I'm curious about the number of members being predicted today, the curve seems to go up steeply. It's predicting 70399 new members now. Where do these figures come from please? The new versions of your graphs are awesome! Thanks for creating them.

I’m curious about the number of members being predicted today, the curve seems to go up steeply. It’s predicting 70399 new members now. Where do these figures come from please?

]]>