Forum Home Forum Home > Site News, Newbies, Help and Improvements > Help us improve the site
  New Posts New Posts RSS Feed - Ratings, my new method
  FAQ FAQ  Forum Search   Events   Register Register  Login Login

Topic ClosedRatings, my new method

 Post Reply Post Reply Page  <1 3456>
Author
Message
Easy Livin View Drop Down
Special Collaborator
Special Collaborator
Avatar
Honorary Collaborator / Retired Admin

Joined: February 21 2004
Location: Scotland
Status: Offline
Points: 15585
Direct Link To This Post Posted: January 03 2008 at 04:36
Mike is very familiar with the PA model, so it would probably be a good idea to take up his offer and test it there. All going well, it would add to the evidence to present to M@x.
Back to Top
Fight Club View Drop Down
Prog Reviewer
Prog Reviewer


Joined: May 21 2006
Location: United States
Status: Offline
Points: 572
Direct Link To This Post Posted: January 03 2008 at 12:47
OK, I'll do whatever it takes! Go ahead with whatever you have in mind, Mike!
Back to Top
Fight Club View Drop Down
Prog Reviewer
Prog Reviewer


Joined: May 21 2006
Location: United States
Status: Offline
Points: 572
Direct Link To This Post Posted: January 07 2008 at 10:57
So what's going on? Is Mike using the system or is he away?
Back to Top
MikeEnRegalia View Drop Down
Special Collaborator
Special Collaborator
Avatar
Honorary Collaborator

Joined: April 22 2005
Location: Sweden
Status: Offline
Points: 21806
Direct Link To This Post Posted: January 07 2008 at 11:16
He's currently too busy, unfortunately. EmbarrassedWink
Release Polls

Listened to:
Back to Top
Fight Club View Drop Down
Prog Reviewer
Prog Reviewer


Joined: May 21 2006
Location: United States
Status: Offline
Points: 572
Direct Link To This Post Posted: January 13 2008 at 17:10
Well... eventually we might get this going somewhere...
Back to Top
Easy Livin View Drop Down
Special Collaborator
Special Collaborator
Avatar
Honorary Collaborator / Retired Admin

Joined: February 21 2004
Location: Scotland
Status: Offline
Points: 15585
Direct Link To This Post Posted: January 14 2008 at 03:31
Keep it in our view FC.
 
At the moment, M@x is very busy with the routine aspects of the site anyway.
Back to Top
MikeEnRegalia View Drop Down
Special Collaborator
Special Collaborator
Avatar
Honorary Collaborator

Joined: April 22 2005
Location: Sweden
Status: Offline
Points: 21806
Direct Link To This Post Posted: January 15 2008 at 08:11
Ok, I'll add the algorithm to my website later today (in the evening). Is the code in the first post still valid, or has it been updated/improved in the meantime?
Release Polls

Listened to:
Back to Top
Fight Club View Drop Down
Prog Reviewer
Prog Reviewer


Joined: May 21 2006
Location: United States
Status: Offline
Points: 572
Direct Link To This Post Posted: January 15 2008 at 11:04
Yes, actually it has been edited numerous times since the first post. My following posts should describe the changes in detail. Umm... I'm not exactly sure how they would "look" in a formula.... I'll see if I can come up with something to make this simpler for you, but I'm going to be out all day so it could take a little time. Unless you know how to incorporate the other stuff. We'll see
Back to Top
Fight Club View Drop Down
Prog Reviewer
Prog Reviewer


Joined: May 21 2006
Location: United States
Status: Offline
Points: 572
Direct Link To This Post Posted: January 15 2008 at 11:50
Damn I was just typing all this out and FOR SOME REASON MY PAGE CLOSED AND I LOST IT ALL!!!!!! AngryAngryAngryAngryAngry AHHH!!! I'm going to type this out in Word so I can save it!!

But honestly Mike, I think it would be much easier if you just took a look at the Excel file I have uploaded here

Any version of Microsoft Excel from 97-08 should be able to open it.

ONLY look at the tab labeled NEW METHOD! The other tabs revolve around the my old method, which isn't as good!

The example you're seeing on that tab is King Crimson's Red. If you pan over any of the input fields, I left comment boxes that explain what each one is for. Except for the stuff in the DO NOT EDIT box. That's all the complex stuff... I'm sure you can figure out what it's all for, but it's best to be left alone.
Back to Top
Sofagrisen View Drop Down
Forum Groupie
Forum Groupie


Joined: January 18 2007
Location: Norway
Status: Offline
Points: 45
Direct Link To This Post Posted: January 16 2008 at 18:42
I really think something should be done her now. There should be a forum vote about the implementation of this formula, or something. Honestly it is far superior to the one we have today, which is just awful, especially when it comes to albums with few votes. Again, because the numbers of votes on albums vary greatly, their score is not directly comparable. You can only try to make a formula that gives rather stable results, which is not biased towards any number of votes. The formula we have now does not produce stable results at all. As an example Fear of a Blank Planet has many times been pushed of the 2007 album of the year throne, by albums with much fewer votes, but it always reach the #1 spot again, as the album that passed it, gets more votes. This is just one example of the effects of how the rating formula is biased towards albums with few votes. And again, if the formula was good, it would be likely for the new #1 album at staying at the top, but it’s clearly not, because they always drop. Anyhow, the formula of Fight Club will be a great improvement in this respect.
Back to Top
MikeEnRegalia View Drop Down
Special Collaborator
Special Collaborator
Avatar
Honorary Collaborator

Joined: April 22 2005
Location: Sweden
Status: Offline
Points: 21806
Direct Link To This Post Posted: January 16 2008 at 18:51
^ I've been preparing this formula on my website ... unfortunately it's not ready yet, hopefully I'll have it online tomorrow. Now all you have to do is to rate albums on my website, so that we have a lot of data for the formula.Big%20smile
Release Polls

Listened to:
Back to Top
Fight Club View Drop Down
Prog Reviewer
Prog Reviewer


Joined: May 21 2006
Location: United States
Status: Offline
Points: 572
Direct Link To This Post Posted: January 17 2008 at 01:11
Originally posted by MikeEnRegalia MikeEnRegalia wrote:

^ I've been preparing this formula on my website ... unfortunately it's not ready yet, hopefully I'll have it online tomorrow. Now all you have to do is to rate albums on my website, so that we have a lot of data for the formula.Big%20smile


AWESOME! I have no idea how it will look on your site or how you made it applicable, but we'll see.

And Sofagrisen, I am glad you approve so much of my new formula. We can only hope for the best Smile
Back to Top
MikeEnRegalia View Drop Down
Special Collaborator
Special Collaborator
Avatar
Honorary Collaborator

Joined: April 22 2005
Location: Sweden
Status: Offline
Points: 21806
Direct Link To This Post Posted: January 17 2008 at 02:54
 ^ I'll simply add it to the chart page (http://ratingfreak.com/home/charts.xhtml), to the "Ranking Method" dropdown. The only problem is how to determine the fixed values of the formula automatically from the database.
Release Polls

Listened to:
Back to Top
Fight Club View Drop Down
Prog Reviewer
Prog Reviewer


Joined: May 21 2006
Location: United States
Status: Offline
Points: 572
Direct Link To This Post Posted: January 17 2008 at 10:34
Hey, how do I get the ratings to a 1-10 scale rather than 1-20? 10 makes a little more sense to me and I see you seem to have that scale in your signature.
Back to Top
MikeEnRegalia View Drop Down
Special Collaborator
Special Collaborator
Avatar
Honorary Collaborator

Joined: April 22 2005
Location: Sweden
Status: Offline
Points: 21806
Direct Link To This Post Posted: January 17 2008 at 11:41
^ I changed it for you. 0-10 will be the new common scale at Ratingfreak.com. But I think I'll implement a 5 star display in some situations (with partially filled stars of course). 
Release Polls

Listened to:
Back to Top
Fight Club View Drop Down
Prog Reviewer
Prog Reviewer


Joined: May 21 2006
Location: United States
Status: Offline
Points: 572
Direct Link To This Post Posted: January 17 2008 at 17:15
Cool, I like the 1-10 scale. How's the formula coming along?
Back to Top
MikeEnRegalia View Drop Down
Special Collaborator
Special Collaborator
Avatar
Honorary Collaborator

Joined: April 22 2005
Location: Sweden
Status: Offline
Points: 21806
Direct Link To This Post Posted: January 18 2008 at 06:08
Ok, here it is: http://ratingfreak.com/home/charts.xhtml?chart.sort_mode=fc Smile

A few comments:

- In the calculation the averages used are combinations of arithmetic mean and median.
- M is set to the average number of ratings per album of the query at hand (minimum: 5).
- R is set to the average rating of all the albums of the query at hand.
- The result of the calculation is currently only used for sorting the chart, the rating displayed is the standard average.
Release Polls

Listened to:
Back to Top
Fight Club View Drop Down
Prog Reviewer
Prog Reviewer


Joined: May 21 2006
Location: United States
Status: Offline
Points: 572
Direct Link To This Post Posted: January 22 2008 at 00:29
Awesome! So what do you think of it all?
Back to Top
MikeEnRegalia View Drop Down
Special Collaborator
Special Collaborator
Avatar
Honorary Collaborator

Joined: April 22 2005
Location: Sweden
Status: Offline
Points: 21806
Direct Link To This Post Posted: January 22 2008 at 02:48
I like it! But the current chart template isn't really suitable for comparing ranking algorithms, so I'll try to add some "display variations" later today. I'm thinking about a compact table which displays 50 albums at a time, with columns for the data used in the calculations. I'll let you know when it's available!
Release Polls

Listened to:
Back to Top
Fight Club View Drop Down
Prog Reviewer
Prog Reviewer


Joined: May 21 2006
Location: United States
Status: Offline
Points: 572
Direct Link To This Post Posted: February 15 2008 at 00:19
erm... bump
Back to Top
 Post Reply Post Reply Page  <1 3456>

Forum Jump Forum Permissions View Drop Down



This page was generated in 0.180 seconds.
Donate monthly and keep PA fast-loading and ad-free forever.