Forum Home Forum Home > Site News, Newbies, Help and Improvements > Help us improve the site
  New Posts New Posts RSS Feed - Ratings, my new method
  FAQ FAQ  Forum Search   Events   Register Register  Login Login

Topic ClosedRatings, my new method

 Post Reply Post Reply Page  123 6>
Author
Message Reverse Sort Order
Sofagrisen View Drop Down
Forum Groupie
Forum Groupie


Joined: January 18 2007
Location: Norway
Status: Offline
Points: 45
Direct Link To This Post Topic: Ratings, my new method
    Posted: February 16 2008 at 11:02
Indeed it seems to give a satisfactory balance between votes and rating, but will it be implemented here on Prog Archives? I really want to see some discussion on that. In my view the implementation of this rating formula is of course badly needed.
Back to Top
MikeEnRegalia View Drop Down
Special Collaborator
Special Collaborator
Avatar
Honorary Collaborator

Joined: April 22 2005
Location: Sweden
Status: Offline
Points: 21806
Direct Link To This Post Posted: February 15 2008 at 02:56
Unfortunately I have been more busy than I thought ... both in the real world and with my website. A few weeks ago I decided to finally re-write the rating editor and it took much longer than I expected, but now it's nearly done.

You can all help me test the editor here:
http://ratingfreak.com/home/community/tools.xhtml?path=ratings (link works only if you're currently logged in)

It should enable you to submit ratings much faster than before, and you can also use it to complete missing entries (for example you (FightClub) submitted about 50 ratings, but they're not used in the calculation unless you also submit prog status and base genre).

BTW: Today I changed the default setting - my website now uses your ranking method as the default.Smile
Release Polls

Listened to:
Back to Top
Fight Club View Drop Down
Prog Reviewer
Prog Reviewer


Joined: May 21 2006
Location: United States
Status: Offline
Points: 572
Direct Link To This Post Posted: February 15 2008 at 00:19
erm... bump
Back to Top
MikeEnRegalia View Drop Down
Special Collaborator
Special Collaborator
Avatar
Honorary Collaborator

Joined: April 22 2005
Location: Sweden
Status: Offline
Points: 21806
Direct Link To This Post Posted: January 22 2008 at 02:48
I like it! But the current chart template isn't really suitable for comparing ranking algorithms, so I'll try to add some "display variations" later today. I'm thinking about a compact table which displays 50 albums at a time, with columns for the data used in the calculations. I'll let you know when it's available!
Release Polls

Listened to:
Back to Top
Fight Club View Drop Down
Prog Reviewer
Prog Reviewer


Joined: May 21 2006
Location: United States
Status: Offline
Points: 572
Direct Link To This Post Posted: January 22 2008 at 00:29
Awesome! So what do you think of it all?
Back to Top
MikeEnRegalia View Drop Down
Special Collaborator
Special Collaborator
Avatar
Honorary Collaborator

Joined: April 22 2005
Location: Sweden
Status: Offline
Points: 21806
Direct Link To This Post Posted: January 18 2008 at 06:08
Ok, here it is: http://ratingfreak.com/home/charts.xhtml?chart.sort_mode=fc Smile

A few comments:

- In the calculation the averages used are combinations of arithmetic mean and median.
- M is set to the average number of ratings per album of the query at hand (minimum: 5).
- R is set to the average rating of all the albums of the query at hand.
- The result of the calculation is currently only used for sorting the chart, the rating displayed is the standard average.
Release Polls

Listened to:
Back to Top
Fight Club View Drop Down
Prog Reviewer
Prog Reviewer


Joined: May 21 2006
Location: United States
Status: Offline
Points: 572
Direct Link To This Post Posted: January 17 2008 at 17:15
Cool, I like the 1-10 scale. How's the formula coming along?
Back to Top
MikeEnRegalia View Drop Down
Special Collaborator
Special Collaborator
Avatar
Honorary Collaborator

Joined: April 22 2005
Location: Sweden
Status: Offline
Points: 21806
Direct Link To This Post Posted: January 17 2008 at 11:41
^ I changed it for you. 0-10 will be the new common scale at Ratingfreak.com. But I think I'll implement a 5 star display in some situations (with partially filled stars of course). 
Release Polls

Listened to:
Back to Top
Fight Club View Drop Down
Prog Reviewer
Prog Reviewer


Joined: May 21 2006
Location: United States
Status: Offline
Points: 572
Direct Link To This Post Posted: January 17 2008 at 10:34
Hey, how do I get the ratings to a 1-10 scale rather than 1-20? 10 makes a little more sense to me and I see you seem to have that scale in your signature.
Back to Top
MikeEnRegalia View Drop Down
Special Collaborator
Special Collaborator
Avatar
Honorary Collaborator

Joined: April 22 2005
Location: Sweden
Status: Offline
Points: 21806
Direct Link To This Post Posted: January 17 2008 at 02:54
 ^ I'll simply add it to the chart page (http://ratingfreak.com/home/charts.xhtml), to the "Ranking Method" dropdown. The only problem is how to determine the fixed values of the formula automatically from the database.
Release Polls

Listened to:
Back to Top
Fight Club View Drop Down
Prog Reviewer
Prog Reviewer


Joined: May 21 2006
Location: United States
Status: Offline
Points: 572
Direct Link To This Post Posted: January 17 2008 at 01:11
Originally posted by MikeEnRegalia MikeEnRegalia wrote:

^ I've been preparing this formula on my website ... unfortunately it's not ready yet, hopefully I'll have it online tomorrow. Now all you have to do is to rate albums on my website, so that we have a lot of data for the formula.Big%20smile


AWESOME! I have no idea how it will look on your site or how you made it applicable, but we'll see.

And Sofagrisen, I am glad you approve so much of my new formula. We can only hope for the best Smile
Back to Top
MikeEnRegalia View Drop Down
Special Collaborator
Special Collaborator
Avatar
Honorary Collaborator

Joined: April 22 2005
Location: Sweden
Status: Offline
Points: 21806
Direct Link To This Post Posted: January 16 2008 at 18:51
^ I've been preparing this formula on my website ... unfortunately it's not ready yet, hopefully I'll have it online tomorrow. Now all you have to do is to rate albums on my website, so that we have a lot of data for the formula.Big%20smile
Release Polls

Listened to:
Back to Top
Sofagrisen View Drop Down
Forum Groupie
Forum Groupie


Joined: January 18 2007
Location: Norway
Status: Offline
Points: 45
Direct Link To This Post Posted: January 16 2008 at 18:42
I really think something should be done her now. There should be a forum vote about the implementation of this formula, or something. Honestly it is far superior to the one we have today, which is just awful, especially when it comes to albums with few votes. Again, because the numbers of votes on albums vary greatly, their score is not directly comparable. You can only try to make a formula that gives rather stable results, which is not biased towards any number of votes. The formula we have now does not produce stable results at all. As an example Fear of a Blank Planet has many times been pushed of the 2007 album of the year throne, by albums with much fewer votes, but it always reach the #1 spot again, as the album that passed it, gets more votes. This is just one example of the effects of how the rating formula is biased towards albums with few votes. And again, if the formula was good, it would be likely for the new #1 album at staying at the top, but it’s clearly not, because they always drop. Anyhow, the formula of Fight Club will be a great improvement in this respect.
Back to Top
Fight Club View Drop Down
Prog Reviewer
Prog Reviewer


Joined: May 21 2006
Location: United States
Status: Offline
Points: 572
Direct Link To This Post Posted: January 15 2008 at 11:50
Damn I was just typing all this out and FOR SOME REASON MY PAGE CLOSED AND I LOST IT ALL!!!!!! AngryAngryAngryAngryAngry AHHH!!! I'm going to type this out in Word so I can save it!!

But honestly Mike, I think it would be much easier if you just took a look at the Excel file I have uploaded here

Any version of Microsoft Excel from 97-08 should be able to open it.

ONLY look at the tab labeled NEW METHOD! The other tabs revolve around the my old method, which isn't as good!

The example you're seeing on that tab is King Crimson's Red. If you pan over any of the input fields, I left comment boxes that explain what each one is for. Except for the stuff in the DO NOT EDIT box. That's all the complex stuff... I'm sure you can figure out what it's all for, but it's best to be left alone.
Back to Top
Fight Club View Drop Down
Prog Reviewer
Prog Reviewer


Joined: May 21 2006
Location: United States
Status: Offline
Points: 572
Direct Link To This Post Posted: January 15 2008 at 11:04
Yes, actually it has been edited numerous times since the first post. My following posts should describe the changes in detail. Umm... I'm not exactly sure how they would "look" in a formula.... I'll see if I can come up with something to make this simpler for you, but I'm going to be out all day so it could take a little time. Unless you know how to incorporate the other stuff. We'll see
Back to Top
MikeEnRegalia View Drop Down
Special Collaborator
Special Collaborator
Avatar
Honorary Collaborator

Joined: April 22 2005
Location: Sweden
Status: Offline
Points: 21806
Direct Link To This Post Posted: January 15 2008 at 08:11
Ok, I'll add the algorithm to my website later today (in the evening). Is the code in the first post still valid, or has it been updated/improved in the meantime?
Release Polls

Listened to:
Back to Top
Easy Livin View Drop Down
Special Collaborator
Special Collaborator
Avatar
Honorary Collaborator / Retired Admin

Joined: February 21 2004
Location: Scotland
Status: Offline
Points: 15585
Direct Link To This Post Posted: January 14 2008 at 03:31
Keep it in our view FC.
 
At the moment, M@x is very busy with the routine aspects of the site anyway.
Back to Top
Fight Club View Drop Down
Prog Reviewer
Prog Reviewer


Joined: May 21 2006
Location: United States
Status: Offline
Points: 572
Direct Link To This Post Posted: January 13 2008 at 17:10
Well... eventually we might get this going somewhere...
Back to Top
MikeEnRegalia View Drop Down
Special Collaborator
Special Collaborator
Avatar
Honorary Collaborator

Joined: April 22 2005
Location: Sweden
Status: Offline
Points: 21806
Direct Link To This Post Posted: January 07 2008 at 11:16
He's currently too busy, unfortunately. EmbarrassedWink
Release Polls

Listened to:
Back to Top
Fight Club View Drop Down
Prog Reviewer
Prog Reviewer


Joined: May 21 2006
Location: United States
Status: Offline
Points: 572
Direct Link To This Post Posted: January 07 2008 at 10:57
So what's going on? Is Mike using the system or is he away?
Back to Top
 Post Reply Post Reply Page  123 6>

Forum Jump Forum Permissions View Drop Down



This page was generated in 0.357 seconds.
Donate monthly and keep PA fast-loading and ad-free forever.