Print Page | Close Window

Rating Scale

Printed From: Progarchives.com
Category: Site News, Newbies, Help and Improvements
Forum Name: Help us improve the site
Forum Description: Help us improve the forums, and the site as a whole
URL: http://www.progarchives.com/forum/forum_posts.asp?TID=78982
Printed Date: July 18 2025 at 22:40
Software Version: Web Wiz Forums 11.01 - http://www.webwizforums.com


Topic: Rating Scale
Posted By: Earendil
Subject: Rating Scale
Date Posted: June 12 2011 at 19:23
Not to start a rebellion, but I generally prefer rating things on a 1-10 scale.  Just curious to see what other people like most.



Replies:
Posted By: catfood03
Date Posted: June 12 2011 at 20:55
My least fave would be the "school grade" method of A+, A, A-, B+... etc.  I think Entertainment Weekly magazine uses that.

I like a 1 to 10 scale, but a site like Pitchfork gets too anal about it. I mean exactly what distinguishes an 8.3 rating from an 8.4???


Posted By: The Dark Elf
Date Posted: June 12 2011 at 21:10
I usually prefer a 1 to 5 scale with .5 increments, a "5" being an essential album. A scale of ten requires too much thinking on my part.

-------------
...a vigorous circular motion hitherto unknown to the people of this area, but destined
to take the place of the mud shark in your mythology...


Posted By: Alitare
Date Posted: June 12 2011 at 22:33
I prefer a rating of 1-15. 

13-15 are different levels of masterpieces, 5 star wonders. 12's are simply your average excellent works. 10's and 11's are competent and 'decent'. 9's 8's and 7's are all mediocre and predictable and generic, but not dreadfully offensive - usually just boring. 6's 5's and 4's are all differing levels of plain awful. Anything lower than a 4 is an atrocious abomination and an effrontery to the Lord of aural elation. (as a note, I've reviewed 1,000+ albums, and only one has gotten a 15, while NONE have gotten lower than a 4 (two 4's so far)

It's all just different slices of the same pie, though. Old grade school ratings are the same as 1-15. A+ to A- is 15 to 13, B+ t B- is 12 to 10, C+ to C- is 9 to 7, D+ to D- is 6 to 4, and F+ to F- is 3 to 1. That's unless you don't use +/- on F, then it's 1-13.

If you add .5 increments to 1-5, it's basically a 1-9, unless you consider the possibility of 0.5 or 0, then it's 1-11, but most only do 1-5. 

It also depends on the weight you place to which numbers. One man's 13/15 may be another man's 4/5, which may be another man's A- which may be another man's 4.5/5 which may be another man's sperm count (in millions).




Posted By: Alitare
Date Posted: June 12 2011 at 22:34
The pitchfork scale is basically a percentage scale, which is definitely too much for me. It's not because I can't tell the difference between an 8.3 and an 8.4, it's because I'd rather yank my own teeth out than EXPLAIN the difference between an 8.3 and an 8.4 to someone else. 


Posted By: Man With Hat
Date Posted: June 12 2011 at 22:47
Originally posted by The Dark Elf The Dark Elf wrote:

I usually prefer a 1 to 5 scale with .5 increments, a "5" being an essential album. A scale of ten requires too much thinking on my part.
 
Ditto.
 
5 feels natural, 10 feels awkward.


-------------
Dig me...But don't...Bury me
I'm running still, I shall until, one day, I hope that I'll arrive
Warning: Listening to jazz excessively can cause a laxative effect.


Posted By: dreadpirateroberts
Date Posted: June 12 2011 at 22:49
I like the idea of 1, 1.5 - 4.5, 5 and so on. Though we already do it in many of our reviews informally, it might be nice for the stars to be able to reflect that in the graphical too.

Of course, 1-5 works great too.


-------------
We are men of action. Lies do not become us.
http://www.jazzmusicarchives.com/" rel="nofollow - JazzMusicArchives.


Posted By: irrelevant
Date Posted: June 13 2011 at 01:04
Second option. 

-------------
https://gabebuller.bandcamp.com/" rel="nofollow - New album!
http://www.progarchives.com/artist.asp?id=7385" rel="nofollow - http://www.progarchives.com/artist.asp?id=7385


Posted By: Queen By-Tor
Date Posted: June 13 2011 at 01:29
go for, "who gives a f**k"


Posted By: JJLehto
Date Posted: June 13 2011 at 02:55
I prefer the 1, 1.5, 2, 2.5 etc scale
Still got the simple 1-5 scale but allows a little more choice, no needing to toil between a 3 or 4!


Yeah anything using tenths is crazy. Debates are wild enough, imagine trying to decide if an album is 8.5 or 8.6LOL



OH! Also hate to be that guy, this probably should be moved since its not really about music.




Posted By: Drew
Date Posted: June 13 2011 at 03:00
1, 1.5, 2, 2.5, 3, 3.5, 4, 4.5, 5


The current system has too many gaps


-------------





Posted By: Alitare
Date Posted: June 13 2011 at 07:22
I see the way progarchives works. To me, it seems that our reviews separately don't matter to anyone on the outside, that what we've reviewed together works like a hive mind. If Close to the Edge has 4.64, it has that from us as a total being, it's only when sinking in and discerning the different reviews that you get to see each ant's antennae. Thus I can understand why we have a more trivialized and restricted approach to separate reviewing. 


Posted By: Bonnek
Date Posted: June 13 2011 at 07:41

The current 1-5 works fine for me.
Would be nice to have a special 6 star rate that you can apply to 1 album out of 100 Smile


Posted By: CPicard
Date Posted: June 13 2011 at 07:55
I suggest the scale 1-11
Why 11? Because I like to go one step beyond.


Posted By: M@X
Date Posted: June 13 2011 at 07:58
How do we handle previous ratings , we invite them to adjust ? and to maybe adjust their review because some reviewer include their ratings in the text.

-------------
Prog On !


Posted By: Earendil
Date Posted: June 13 2011 at 08:20
Originally posted by The Dark Elf The Dark Elf wrote:

I usually prefer a 1 to 5 scale with .5 increments, a "5" being an essential album. A scale of ten requires too much thinking on my part.


That's funny because I'd say the exact opposite.  It it's that scale, I rate it 1-10 then convert it.


Posted By: Warthur
Date Posted: June 13 2011 at 09:54
Honestly, I think the current system is fine. Yes, the categories are quite broad, but as has been pointed out it's the way the scores are averaged out over the community which is the most interesting part when it comes to scoring.

In general I think the actual rating you give doesn't matter so much when it comes to your review although it is important when it comes to calculating the average rating as obtained by the community as has been pointed out - which I think is what is the really interesting aspect of the scoring system. I don't personally care much whether a particular reviewer gives an album four stars or five - what they actually write about the album tells me far more about the album and their reaction to it than the rating they give. I *do* care if the album, say, has a lot of 5-star reviews and a lot of 1-star reviews but not many 3-stars (which implies an incredibly divisive disc); in general I think the shape of the bar chart of review ratings is even more informative than the averaged score.

Bottom line: I think the rating system is fine as it is; the only problem with it is that people get too hung up on it, fussing over whether a particular album should have four stars or five. And really, that's not so much a problem with the system so much as a problem with people's attitudes to it: when we review we should be reviewing with an eye to conveying what we think about an album, not reviewing with an eye to fitting our thoughts into the scoring system.


Posted By: harmonium.ro
Date Posted: June 13 2011 at 10:08
I have no idea why this poll says I've already voted. I haven't. 


Posted By: TheGazzardian
Date Posted: June 13 2011 at 10:17
I'm having a similar problem Alex, it says "You cannot vote in this poll" (with no reason given).

Personally I'm a fan of the 1-5 star system, it's simple and each rating has a clear meaning so I never have doubts about where to put an album. If there were half stars, I would probably try to avoid using them.


Posted By: harmonium.ro
Date Posted: June 13 2011 at 10:30
Oh, if it's a general problem it means the poll was created somewhere else, then moved in this section which probably does not allow polls.

The second and third options are mathematically the same, but I'd vote for the second instead of the third because it would temper the a****les who would feel the need to ask for subdivisions.


Posted By: Vompatti
Date Posted: June 13 2011 at 10:41
1, 2, 4, 7, 11, 16, 22, 29, 37, 46, 56, 67, 79.


Posted By: Epignosis
Date Posted: June 13 2011 at 12:01
I love the 5 star system as it is.

-------------
https://epignosis.bandcamp.com/album/a-month-of-sundays" rel="nofollow - https://epignosis.bandcamp.com/album/a-month-of-sundays


Posted By: lazland
Date Posted: June 13 2011 at 13:01
Originally posted by Epignosis Epignosis wrote:

I love the 5 star system as it is.

Overall, it suits us nicely. People are quite capable, as I do often, of saying that an album has been rounded up or down from a .5 rating if the narrative justifies it.


-------------
Enhance your life. Get down to www.lazland.org

Now also broadcasting on www.progzilla.com Every Saturday, 4.00 p.m. UK time!


Posted By: CPicard
Date Posted: June 13 2011 at 13:50
Originally posted by Vompatti Vompatti wrote:

1, 2, 4, 7, 11, 16, 22, 29, 37, 46, 56, 67, 79.


Wrong scale. It's: 1, 2, 3, 5, 7, 11, 13, 17...


Posted By: Vompatti
Date Posted: June 13 2011 at 14:03
Originally posted by CPicard CPicard wrote:

Originally posted by Vompatti Vompatti wrote:

1, 2, 4, 7, 11, 16, 22, 29, 37, 46, 56, 67, 79.


Wrong scale. It's: 1, 2, 3, 5, 7, 11, 13, 17...
Just because you happen to prefer a different scale doesn't make my scale "wrong". Disapprove


Posted By: Snow Dog
Date Posted: June 13 2011 at 14:03
I can not vote in this poll somehow, but option one or how it is now.

-------------
http://www.last.fm/user/Snow_Dog" rel="nofollow">


Posted By: CPicard
Date Posted: June 13 2011 at 14:11
Originally posted by Vompatti Vompatti wrote:

Originally posted by CPicard CPicard wrote:

Originally posted by Vompatti Vompatti wrote:

1, 2, 4, 7, 11, 16, 22, 29, 37, 46, 56, 67, 79.


Wrong scale. It's: 1, 2, 3, 5, 7, 11, 13, 17...
Just because you happen to prefer a different scale doesn't make my scale "wrong". Disapprove


Oh, sorry, I thought you were referencing the first numbers.


Posted By: Vompatti
Date Posted: June 13 2011 at 14:21
Originally posted by CPicard CPicard wrote:

Originally posted by Vompatti Vompatti wrote:

Originally posted by CPicard CPicard wrote:

Originally posted by Vompatti Vompatti wrote:

1, 2, 4, 7, 11, 16, 22, 29, 37, 46, 56, 67, 79.


Wrong scale. It's: 1, 2, 3, 5, 7, 11, 13, 17...
Just because you happen to prefer a different scale doesn't make my scale "wrong". Disapprove


Oh, sorry, I thought you were referencing the first numbers.
Don't you think an infinite scale would give too many ratings to choose from?


Posted By: CPicard
Date Posted: June 13 2011 at 14:28
Originally posted by Vompatti Vompatti wrote:

Originally posted by CPicard CPicard wrote:

Originally posted by Vompatti Vompatti wrote:

Originally posted by CPicard CPicard wrote:

Originally posted by Vompatti Vompatti wrote:

1, 2, 4, 7, 11, 16, 22, 29, 37, 46, 56, 67, 79.


Wrong scale. It's: 1, 2, 3, 5, 7, 11, 13, 17...
Just because you happen to prefer a different scale doesn't make my scale "wrong". Disapprove


Oh, sorry, I thought you were referencing the first numbers.
Don't you think an infinite scale would give too many ratings to choose from?


So, what? Are we on a progressive forum or not?! Angry


Posted By: Vompatti
Date Posted: June 13 2011 at 14:44
Originally posted by CPicard CPicard wrote:

Originally posted by Vompatti Vompatti wrote:

Originally posted by CPicard CPicard wrote:

Originally posted by Vompatti Vompatti wrote:

Originally posted by CPicard CPicard wrote:

Originally posted by Vompatti Vompatti wrote:

1, 2, 4, 7, 11, 16, 22, 29, 37, 46, 56, 67, 79.


Wrong scale. It's: 1, 2, 3, 5, 7, 11, 13, 17...
Just because you happen to prefer a different scale doesn't make my scale "wrong". Disapprove


Oh, sorry, I thought you were referencing the first numbers.
Don't you think an infinite scale would give too many ratings to choose from?


So, what? Are we on a progressive forum or not?! Angry
Shocked Bowdown Embarrassed


Posted By: Earendil
Date Posted: June 13 2011 at 15:57
Originally posted by harmonium.ro harmonium.ro wrote:

Oh, if it's a general problem it means the poll was created somewhere else, then moved in this section which probably does not allow polls.

The second and third options are mathematically the same, but I'd vote for the second instead of the third because it would temper the a****les who would feel the need to ask for subdivisions.


That must be it.  It was under the general music poll category then got moved to site improvements.  Nothing really needs changed though...


Posted By: richardh
Date Posted: June 13 2011 at 17:10
Happy with it as it is. More important to post a review than to worry about the exact rating.


Posted By: JJLehto
Date Posted: June 13 2011 at 20:02
Originally posted by harmonium.ro harmonium.ro wrote:

I have no idea why this poll says I've already voted. I haven't. 


The higher ups are trying to keep us down. They know a rating rebellion is brewing and are suppressing votes.

LOL J/K

(especially since this thread has been made like 15 timesLOL)


Posted By: Formentera Lady
Date Posted: June 14 2011 at 01:45
Now that I actually started rating and reviewing albums I have the feeling that I need half stars...


-------------
http://theprogressiveweb.blogspot.de" rel="nofollow - Visit me in Second Life to talk about music.


Posted By: ExittheLemming
Date Posted: June 14 2011 at 06:47
The current rating system has many detractors, and I can empathise to a certain degree with some of their objections with regards gradation of appraisal e.g. it's better than what I think a 4 is, but not a bona fide 5 etc

The good thing about the current rating system is that if nothing else, it forces you to choose or make a clear cut decision without any blurry ambivalence and that's gotta be a good thang y'all

The only reason many of you hanker for half stars or decimal subdivisions is because you don't have the faintest idea how to articulate or qualify what you like or dislike about any given music.


-------------


Posted By: Epignosis
Date Posted: June 14 2011 at 07:05
Originally posted by ExittheLemming ExittheLemming wrote:

The current rating system has many detractors, and I can empathise to a certain degree with some of their objections with regards gradation of appraisal e.g. it's better than what I think a 4 is, but not a bona fide 5 etc

The good thing about the current rating system is that if nothing else, it forces you to choose or make a clear cut decision without any blurry ambivalence and that's gotta be a good thang y'all

The only reason many of you hanker for half stars or decimal subdivisions is because you don't have the faintest idea how to articulate or qualify what you like or dislike about any given music.


Clap


-------------
https://epignosis.bandcamp.com/album/a-month-of-sundays" rel="nofollow - https://epignosis.bandcamp.com/album/a-month-of-sundays


Posted By: Sean Trane
Date Posted: June 14 2011 at 07:22
Originally posted by Alitare Alitare wrote:

I prefer a rating of 1-15. 

13-15 are different levels of masterpieces, 5 star wonders. 12's are simply your average excellent works. 10's and 11's are competent and 'decent'. 9's 8's and 7's are all mediocre and predictable and generic, but not dreadfully offensive - usually just boring. 6's 5's and 4's are all differing levels of plain awful. Anything lower than a 4 is an atrocious abomination and an effrontery to the Lord of aural elation. (as a note, I've reviewed 1,000+ albums, and only one has gotten a 15, while NONE have gotten lower than a 4 (two 4's so far)


 
Yoiu describe Gnosis2000's scaleClap
 
http://gnosis2000.net/" rel="nofollow - http://gnosis2000.net/
 
I'd be content with halfstars, really!!!


-------------
let's just stay above the moral melee
prefer the sink to the gutter
keep our sand-castle virtues
content to be a doer
as well as a thinker,
prefer lifting our pen
rather than un-sheath our sword


Posted By: someone_else
Date Posted: June 14 2011 at 07:26
Originally posted by Vompatti Vompatti wrote:

Originally posted by CPicard CPicard wrote:

Originally posted by Vompatti Vompatti wrote:

1, 2, 4, 7, 11, 16, 22, 29, 37, 46, 56, 67, 79.


Wrong scale. It's: 1, 2, 3, 5, 7, 11, 13, 17...
Just because you happen to prefer a different scale doesn't make my scale "wrong". Disapprove
 
None of these make sense Disapprove. I have two other suggestions (both are better) to choose from:
 
2, 3, 5, 7, 11, 13, 17, 19, 23, 29, ...
1, 2, 3, 5, 8, 13, 21, 34, 55, 89, ...
 
 
Edit:
 
By the way: how can it be that I cannot vote in this poll, even though I am logged in? Is this a bug, some unconventional authorization issue or is it because this thread is moved?


-------------


Posted By: Vompatti
Date Posted: June 14 2011 at 07:42
Originally posted by someone_else someone_else wrote:

Originally posted by Vompatti Vompatti wrote:

Originally posted by CPicard CPicard wrote:

Originally posted by Vompatti Vompatti wrote:

1, 2, 4, 7, 11, 16, 22, 29, 37, 46, 56, 67, 79.


Wrong scale. It's: 1, 2, 3, 5, 7, 11, 13, 17...
Just because you happen to prefer a different scale doesn't make my scale "wrong". Disapprove
 
None of these make sense Disapprove. I have two other suggestions (both are better) to choose from:
 
2, 3, 5, 7, 11, 13, 17, 19, 23, 29, ...
1, 2, 3, 5, 8, 13, 21, 34, 55, 89, ...
 
 
Edit:
 
By the way: how can it be that I cannot vote in this poll, even though I am logged in? Is this a bug, some unconventional authorization issue or is it because this thread is moved?
I think it's because the thread is moved k


Posted By: Warthur
Date Posted: June 14 2011 at 08:39
Originally posted by ExittheLemming ExittheLemming wrote:

The current rating system has many detractors, and I can empathise to a certain degree with some of their objections with regards gradation of appraisal e.g. it's better than what I think a 4 is, but not a bona fide 5 etc

The good thing about the current rating system is that if nothing else, it forces you to choose or make a clear cut decision without any blurry ambivalence and that's gotta be a good thang y'all
Agreed.

I think the best way to look at the current rating system is that the stars aren't points on a scale going up to 5, they're broad ranges. So, for example, "four stars" is a broad range covering everything from albums which just about scrape into the definition of four star but only barely right up to those albums which are reaching for a fifth star but just don't *quite* make it.

This is obviously going to vary for everyone (hence why I think the average rating is more meaningful than people's individual ratings - when you average it everyone's different biases end up getting smoothed out), but for me I find that the five-star bucket is a bit narrower than 2, three or four, because only the absolute essential picks get into that club - I might find fine distinctions between different five star albums, but they're small enough to be negligible when looking at the overall scale. And, personally, I consider the 1-star range to be extremely narrow; I basically reserve one-star reviews for albums which go beyond simply being mediocre, uninspiring efforts and end up in the realm of actual full-blown incompetence.


Posted By: Epignosis
Date Posted: June 14 2011 at 08:44
Originally posted by Warthur Warthur wrote:



I think the best way to look at the current rating system is that the stars aren't points on a scale going up to 5, they're broad ranges. So, for example, "four stars" is a broad range covering everything from albums which just about scrape into the definition of four star but only barely right up to those albums which are reaching for a fifth star but just don't *quite* make it.




Well said!

And the review explains where in that range the album falls.


-------------
https://epignosis.bandcamp.com/album/a-month-of-sundays" rel="nofollow - https://epignosis.bandcamp.com/album/a-month-of-sundays


Posted By: Andy Webb
Date Posted: June 16 2011 at 10:51
I would say "1.5, 2.5, etc," but asking EVERY rater on the site to adjust their ratings if needed would be a bit tedious. 

Also, would someone move this to general polls or something? It's not letting me vote.


-------------
http://ow.ly/8ymqg" rel="nofollow">



Print Page | Close Window

Forum Software by Web Wiz Forums® version 11.01 - http://www.webwizforums.com
Copyright ©2001-2014 Web Wiz Ltd. - http://www.webwiz.co.uk