Progarchives.com Homepage
Forum Home Forum Home > Progressive Music Lounges > Prog Music Lounge
  New Posts New Posts
  FAQ FAQ  Forum Search Search  Calendar   Register Register  Login Login

Defining the value of "5 star" ratings?

 Post Reply Post Reply Page  <1234>
Author
Message
  Topic Search Topic Search  Topic Options Topic Options Bookmark and Share
kingfriso View Drop Down
Senior Member
Senior Member
Avatar

Joined: October 24 2007
Location: Netherlands
Online Status: Offline
Posts: 423
  Quote kingfriso Quote  Post ReplyReply Direct Link To This Post Topic: Defining the value of "5 star" ratings?
    Posted: November 06 2009 at 06:45
Originally posted by progrules

Originally posted by Atavachron

Originally posted by Moogtron III

Originally posted by Atavachron

simple; the rating is objective, the review subjective
It's not that simple, because in your standards of what is, for instance, an excellent addition to any prog collection, there is some subjectivity involved. It isn't a complete exact science like math.
no but it's close, as you say --
Originally posted by Moogtron III

I'm very strict in it, actually. Often giving albums that I absolutely love but not think that they are an excellent addition etc. a 3 - star, while giving albums that I don't love that much but still think that they stand out within prog a 4 - star etc.If I would rake on the grounds of what I would like, I would give almost all of my Allan Holdsworth - albums 5 stars, Close To The Edge 3 stars. But I don't... Because of the description of the star rating.
-- that's my point about ratings being a platform for a dispassionate & balanced assessment, while reviews can be for details, commentary and opinion.

 

Even if you are right here, I'm sure the community is divided about this. I'm pretty sure 90% of all guest raters and reviewers rate subjectively and also many prog reviewers and collabs. On the other hand I've been reading opinions like Moogtrons and yours (and also Mickey) more often and that puzzles me.

Shouldn't we do something about this and mention it in our groundrules about rating and reviewing ??

It's a big difference between rating objectively and subjectively and so it's a big deal I feel.

My problem with rating objectively (see my earlier post): who decides what the objective rating is for each album ?? And why should everybody stick to that ? And even if that is possible and reasonable: wouldn't it lead to monotous ratings and is that really what we want ?


This is not a valid discussion. Objective means without human emotions and opinions involved. One could objectively say that the moon is bigger than a tennis ball, but a piece of art can not be viewed at in an objective way. Art is representative, so there's a gap.
Back to Top
Slartibartfast View Drop Down
Collaborator
Collaborator
Avatar
Crossover Team

Joined: April 29 2006
Location: Atlantais, GA
Online Status: Offline
Posts: 9483
  Quote Slartibartfast Quote  Post ReplyReply Direct Link To This Post Posted: November 06 2009 at 07:03
Originally posted by Epignosis

Originally posted by Slartibartfast


why bother even reviewing 1 star albums?  If you buy an album that you consider 1 star even if someone gave it a 5, it's your own damn fault for not sampling it first.



I write hefty one star reviews to maintain my street cred.  Cool


Are you sure this isn't a case of musical masochism?  I mean to write a good review of a 1 star album, you're going to actually have to listen to it. LOL
A penny for my thoughts and yet I have to put my two cents in. What the hell is wrong with this equation?

Back to Top
Epignosis View Drop Down
Collaborator
Collaborator
Avatar
Eclectic Prog Team

Joined: December 30 2007
Location: Orlando, FL
Online Status: Offline
Posts: 11849
  Quote Epignosis Quote  Post ReplyReply Direct Link To This Post Posted: November 06 2009 at 07:09
Originally posted by Slartibartfast

Originally posted by Epignosis

Originally posted by Slartibartfast


why bother even reviewing 1 star albums?  If you buy an album that you consider 1 star even if someone gave it a 5, it's your own damn fault for not sampling it first.



I write hefty one star reviews to maintain my street cred.  Cool


Are you sure this isn't a case of musical masochism?  I mean to write a good review of a 1 star album, you're going to actually have to listen to it. LOL


I do listen to it, and for more than one reason.  For instance, as a musician and songwriter, it helps me to expose myself to "bad" music and try to understand why it's awful.  Writing reviews serves me well in this regard.
Back to Top
ExittheLemming View Drop Down
Prog Reviewer
Prog Reviewer
Avatar

Joined: October 19 2007
Location: Brisbane
Online Status: Offline
Posts: 686
  Quote ExittheLemming Quote  Post ReplyReply Direct Link To This Post Posted: November 06 2009 at 07:55
Lots of very well reasoned posts here certainly and some, less so. I think we might all agree that one critters 5 heavenly bodies is another's 1 dwarf star and no amount of objective posturing will ever change this. Having said that, it still leaves the ticklish dilemma of the dichotomy between an albums historical importance for any given PA genre and that of its erm..aesthetic merit for the reviewer. Perhaps it's the word essential here that causes much of the ambivalence ? eg I rated In the Court and Close to the Edge as 3 stars because I feel they're both good albums but for me, contain sufficient flaws to preclude them from either excellent or masterpiece status.
It's only from a 3rd party journalistic perspective that such albums could be deemed essential i.e. for a full and historical appreciation of the genre and its pivotal developments such albums would certainly be considered compulsory listening. (It stands to reason that the caveman who invented the wheel will never receive as many design awards as Michelin)

Sorry to ramble, but it does beg the question, were the ratings ever designed to make allowance for an albums historical importance to the genre ? (Me ? I don't believe so after all, that's what the body of the text is for ain't it ? and we're fans, not museum curators)
Back to Top
Epignosis View Drop Down
Collaborator
Collaborator
Avatar
Eclectic Prog Team

Joined: December 30 2007
Location: Orlando, FL
Online Status: Offline
Posts: 11849
  Quote Epignosis Quote  Post ReplyReply Direct Link To This Post Posted: November 06 2009 at 07:58
Originally posted by ExittheLemming

Lots of very well reasoned posts here certainly and some, less so. I think we might all agree that one critters 5 heavenly bodies is another's 1 dwarf star and no amount of objective posturing will ever change this. Having said that, it still leaves the ticklish dilemma of the dichotomy between an albums historical importance for any given PA genre and that of its erm..aesthetic merit for the reviewer. Perhaps it's the word essential here that causes much of the ambivalence ? eg I rated In the Court and Close to the Edge as 3 stars because I feel they're both good albums but for me, contain sufficient flaws to preclude them from either excellent or masterpiece status.
It's only from a 3rd party journalistic perspective that such albums could be deemed essential i.e. for a full and historical appreciation of the genre and its pivotal developments such albums would certainly be considered compulsory listening. (It stands to reason that the caveman who invented the wheel will never receive as many design awards as Michelin)

Sorry to ramble, but it does beg the question, were the ratings ever designed to make allowance for an albums historical importance to the genre ? (Me ? I don't believe so after all, that's what the body of the text is for ain't it ? and we're fans, not museum curators)


This post has more sense than all of America's politicians.

Okay, so that's not saying much, but still.
Back to Top
jampa17 View Drop Down
Senior Member
Senior Member
Avatar

Joined: July 04 2009
Location: Guatemala
Online Status: Offline
Posts: 762
  Quote jampa17 Quote  Post ReplyReply Direct Link To This Post Posted: November 06 2009 at 08:44
Originally posted by Epignosis

Originally posted by ExittheLemming

Lots of very well reasoned posts here certainly and some, less so. I think we might all agree that one critters 5 heavenly bodies is another's 1 dwarf star and no amount of objective posturing will ever change this. Having said that, it still leaves the ticklish dilemma of the dichotomy between an albums historical importance for any given PA genre and that of its erm..aesthetic merit for the reviewer. Perhaps it's the word essential here that causes much of the ambivalence ? eg I rated In the Court and Close to the Edge as 3 stars because I feel they're both good albums but for me, contain sufficient flaws to preclude them from either excellent or masterpiece status.
It's only from a 3rd party journalistic perspective that such albums could be deemed essential i.e. for a full and historical appreciation of the genre and its pivotal developments such albums would certainly be considered compulsory listening. (It stands to reason that the caveman who invented the wheel will never receive as many design awards as Michelin)

Sorry to ramble, but it does beg the question, were the ratings ever designed to make allowance for an albums historical importance to the genre ? (Me ? I don't believe so after all, that's what the body of the text is for ain't it ? and we're fans, not museum curators)


This post has more sense than all of America's politicians.

Okay, so that's not saying much, but still.
 
Include all the Central and South American politicians there also... Totally agree... I feel sad about the caveman who invented the wheel... his sons deserve a payment... jejeje... not, really, I feel the word Essential is what makes all this complicated for sure...
"Pero aquí tenemos grande el corazón
Y nos brillan más los ojos que una estrella..."
     "Alux Nahual"
Back to Top
infandous View Drop Down
Senior Member
Senior Member
Avatar

Joined: March 23 2006
Location: United States
Online Status: Offline
Posts: 508
  Quote infandous Quote  Post ReplyReply Direct Link To This Post Posted: November 06 2009 at 10:11
Well, I generally go by the rating descriptions.  BUT, I only apply them to myself.  After all, how can any one of us possibly decide whether something is "essential" to the prog community as a whole?  This is simply impossible.  Now, whether it is essential to understanding the genre is perhaps another story.  But honestly, if someone unfamiliar with prog comes here looking to understand it, they can pretty much look at the top 100 and start working through it and get a pretty reasonable picture of prog (a broad overview,  but enough to get a good start and an idea of what they like and dislike, etc.).  How many of us started our prog journey with In The Court?  I certainly didn't.  To me, it's only essential for a prog fan to hear it, not to have it in their collection.

So, I just write the reviews I feel like writing and try to give as much detail and explanation about an album as I can.  Then I rate it based solely on how much I like it (there have been a couple exceptions to this, but this is how it usually works for me).  It is possible to be somewhat objective about music, if you understand music theory, technique, and composition and arrangement.  But how many listeners really understand that stuff (or even prog musicians, for that matter)?  Not very many, I'd bet.  So I just try to express my experience with the album in words and hope it helps someone else decide whether or not they want to try the album (or at least gives them some entertainment value).

 
Back to Top
sinkadotentree View Drop Down
Prog Reviewer
Prog Reviewer
Avatar

Joined: August 27 2006
Location: Canada
Online Status: Offline
Posts: 1557
  Quote sinkadotentree Quote  Post ReplyReply Direct Link To This Post Posted: November 06 2009 at 15:06
I agree with infandous that evaluating an album is a very personal thing.It's my opinion. Having said that i'm sure "popular opinion" has to have some sort of an affect on how i feel about an album.I'd like to think it doesn't but it has to sometimes. For me it's more of a subjective thing.A musician could tell me that a certain album is flawless but if i don't like it it's 3 stars.That's subjective right? I have a hard time with "objectivity" when it comes to music.What's the difference between opinions about music and opinions about someone's looks.We all have different tastes,where does objectivity come into it?
I really don't belive 5 star means perfect.I've never heard the perfect album yet.Even my top three have passages and even songs i'd omit or change. A masterpiece can have flaws, at least in my world it does.
"The storms gone away-so come my kingdom come-come today" Anekdoten
Back to Top
Atavachron View Drop Down
Special Collaborator
Special Collaborator
Avatar
Art Rock Specialist

Joined: September 30 2006
Online Status: Online
Posts: 24891
  Quote Atavachron Quote  Post ReplyReply Direct Link To This Post Posted: November 06 2009 at 15:10
^ yes and in some cultures imperfections are crucial to a piece of art
Back to Top
TheCaptain View Drop Down
Senior Member
Senior Member
Avatar

Joined: January 04 2009
Location: Ohio, USA
Online Status: Offline
Posts: 1256
  Quote TheCaptain Quote  Post ReplyReply Direct Link To This Post Posted: November 06 2009 at 15:51
Originally posted by ExittheLemming

Lots of very well reasoned posts here certainly and some, less so. I think we might all agree that one critters 5 heavenly bodies is another's 1 dwarf star and no amount of objective posturing will ever change this. Having said that, it still leaves the ticklish dilemma of the dichotomy between an albums historical importance for any given PA genre and that of its erm..aesthetic merit for the reviewer. Perhaps it's the word essential here that causes much of the ambivalence ? eg I rated In the Court and Close to the Edge as 3 stars because I feel they're both good albums but for me, contain sufficient flaws to preclude them from either excellent or masterpiece status.
It's only from a 3rd party journalistic perspective that such albums could be deemed essential i.e. for a full and historical appreciation of the genre and its pivotal developments such albums would certainly be considered compulsory listening. (It stands to reason that the caveman who invented the wheel will never receive as many design awards as Michelin)

Sorry to ramble, but it does beg the question, were the ratings ever designed to make allowance for an albums historical importance to the genre ? (Me ? I don't believe so after all, that's what the body of the text is for ain't it ? and we're fans, not museum curators)


I would agree with you about the ambiguity regarding historical context if the text accompanying the 5-star rating were slightly different.
Essential: a masterpiece of progressive rock music

If the colon was replaced with "and/or" then yes, I would undoubtedly give ITCOTCK 5 stars even though on a scale of 1-5 with no text qualifiers the music is roughly a 4-bordering-3 for me because I feel that ITCOTCK is a must-have for any prog fan. However, the colon indicates that the album is essential BECAUSE it is "a masterpiece of progressive rock music" which leaves historical importance wholly irrelevant. The argument of historical significance, however, can be made for the 4-star rating. Historically important albums would be an "excellent addition to any prog rock music collection" in much the same way an original copy of "Pong" (admittedly not the best game out there) would be an excellent addition to a video game collection.
Curse your sudden but inevitable betrayal.
Back to Top
Evolver View Drop Down
Senior Member
Senior Member
Avatar

Joined: October 22 2005
Location: United States
Online Status: Offline
Posts: 467
  Quote Evolver Quote  Post ReplyReply Direct Link To This Post Posted: November 06 2009 at 15:52
I used to managed a record/CD store.  Since I could get just about any new release from the vendors, I have plenty of albums that I requested just for who played on it.  Because of that, I have plenty of one star albums. 
 
And I do listen to each one at least once just before I write a review, in case my recollected impression has changed.
 
As for five star reviews, there are a large number of albums that I listen to when I want to feel good.  They get 5 stars.  If I listen to an album and it makes me feel good, but I feel the need to skip over some songs, it gets 4 stars.
 
Some new albums give me that buzz immediately.  I'll play them over a few times and see if the feeling continues...
I don't have a sig.
Back to Top
tdfloyd View Drop Down
Senior Member
Senior Member
Avatar

Joined: April 06 2008
Location: USA
Online Status: Offline
Posts: 134
  Quote tdfloyd Quote  Post ReplyReply Direct Link To This Post Posted: November 06 2009 at 22:31
Defining a 5? Easy.   Do I like it alot?  Does it have staying power with me or did I tire of it after a couple of listens.  Are all of the songs very good with a good part of them being exceptional songs?  What I don't do is rate the "progginess" of an album.  I don't give an album 4 stars as an album but actually rate it a 2 because its not that "progressive".   There would be a lot less albums on this site if we only rated progressive albums.  I don't rate historical value.  Thats like saying "Sally Dick and Jane" books are great because they are what most of us read first.  If you like them, great, but not because they are first.   
 
 
Examples DSOTM is a 5.  It has great songs, production has never been better, sounds that I never heard anything like it before or since that are meaningful to the album, unbelievable guitar parts, thought provoking lyrics,  emotion for me music, and most importantly, I love it and can (and do) still listen to it today.  
 
ITCOTCK 4 stars.  2 outstanding songs which are some of the finest that I ever heard.  I Talk to the Wind is OK.  21st Century, while I know its a favorite for many is not outstanding for me.  I like the ELP version better. And finally Moonchild, while I like long instrumental passages, goes nowhere and its more than 25% of the album.  There are no bad songs, 2 great, 1 very good and 2 OK.  4 stars     
 
Back to Top
karneviljay View Drop Down
Newbie
Newbie
Avatar

Joined: November 03 2009
Location: Wasilla, AK
Online Status: Offline
Posts: 6
  Quote karneviljay Quote  Post ReplyReply Direct Link To This Post Posted: November 07 2009 at 00:34
Originally posted by Atavachron

simple; the rating is objective, the review subjective
 
I could not agree more.
Back to Top
sealchan View Drop Down
Groupie
Groupie
Avatar

Joined: March 12 2009
Online Status: Offline
Posts: 96
  Quote sealchan Quote  Post ReplyReply Direct Link To This Post Posted: November 07 2009 at 04:36
I'd be personally satisfied to know that the bulk of the reviews and ratings were sincere and personally as consistent as a person can reasonably be. 
 
I take the text that describes the meaning of the number of stars as a guide rather than a rule.  So what is "essential" is meant to be subjectively interpreted and not a matter of whether one has done one's homework and researched until the answer has been found (the supposed right one for everyone).  Otherwise, if it's only about being objective, then rating an album is more like a test than an expression of personal opinion. 
 
There is, in the end, no separation of objective and subjective without definition of context.  In an online community one can only hope to shape the form of opinion, but the law of averages will rule and those that look at ratings accumulated in an online community need to consider the nature (benefits and hazards) of virtual culture before drawing strong conclusions.
Back to Top
earlyprog View Drop Down
Senior Member
Senior Member
Avatar

Joined: March 05 2006
Location: Denmark
Online Status: Offline
Posts: 402
  Quote earlyprog Quote  Post ReplyReply Direct Link To This Post Posted: November 07 2009 at 06:32
Well I haven't reviewed many albums. Yet. One reason being that I'm not sure how to rate the albums.
 
But as of now, my starting point is always to ask myself if the album is above or below average, average being 3 star rating.
 
I'm in that fortunate state (comes with experience/age) that I rarely buy below-average albums. I did that alot when I started my album collection.
 
For a long time I thought that 5 star ratings were only for the perfect album, that is every segment of every song on the album being perfect (and the album being consistent). Well only very few albums attain that status in my opinion (King Crimson, Gentle Giant). I have found that I need to moderate this requirement  so that nearly-perfect albums get 5 star (Genesis, Pink Floyd). These albums are the ones that usually give me the goose bumps.


Edited by earlyprog - November 07 2009 at 06:34
Love is the answer
Back to Top
ExittheLemming View Drop Down
Prog Reviewer
Prog Reviewer
Avatar

Joined: October 19 2007
Location: Brisbane
Online Status: Offline
Posts: 686
  Quote ExittheLemming Quote  Post ReplyReply Direct Link To This Post Posted: November 07 2009 at 06:57
Originally posted by earlyprog

Well I haven't reviewed many albums. Yet. One reason being that I'm not sure how to rate the albums.
 
But as of now, my starting point is always to ask myself if the album is above or below average, average being 3 star rating.
 
I'm in that fortunate state (comes with experience/age) that I rarely buy below-average albums. I did that alot when I started my album collection.
 
For a long time I thought that 5 star ratings were only for the perfect album, that is every segment of every song on the album being perfect (and the album being consistent). Well only very few albums attain that status in my opinion (King Crimson, Gentle Giant). I have found that I need to moderate this requirement  so that nearly-perfect albums get 5 star (Genesis, Pink Floyd). These albums are the ones that usually give me the goose bumps.


Not much wrong with this rationale, but it should be borne in mind that three stars is a GOOD album and not necessarily by inference a mediocre one.
Back to Top
Isa View Drop Down
Groupie
Groupie
Avatar

Joined: February 26 2009
Location: California
Online Status: Offline
Posts: 79
  Quote Isa Quote  Post ReplyReply Direct Link To This Post Posted: November 08 2009 at 13:24
My mentality with this is simple.

A masterpiece album is an album that I can come back to and enjoy just about every moment no matter how many times I listen to it that I come to have a very close personal love and respect for the album overall. When I think of Crime of the Century or Close to the Edge, this what goes through my mind.

Of about two thousand or more albums I've heard, only about twenty or so fall into this category. That's a five star rating to me.

And the reverse for 1 star albums, where I grow a near personal hatred for the album overall.

Just my two cents.
Smile
"Let the truth of love be lighted, let the love of truth shine clear."
Back to Top
A Person View Drop Down
Senior Member
Senior Member
Avatar

Joined: November 10 2008
Location: MI, USA
Online Status: Online
Posts: 2106
  Quote A Person Quote  Post ReplyReply Direct Link To This Post Posted: November 08 2009 at 13:39
I think that it would be interesting to factor in significance of an album outside of the 1-5 star rating, for example, a separate 1-5 stars for rating an album based on significance and impact. Comus' First Utterance will most likely not get a five star review from most people, but it is, IMO, a significant enough album to warrant highly recommending that people listen to it anyway, knowing that they may not like it.

Back to Top
Atavachron View Drop Down
Special Collaborator
Special Collaborator
Avatar
Art Rock Specialist

Joined: September 30 2006
Online Status: Online
Posts: 24891
  Quote Atavachron Quote  Post ReplyReply Direct Link To This Post Posted: November 08 2009 at 13:44
Originally posted by ExittheLemming


it should be borne in mind that three stars is a GOOD album and not necessarily by inference a mediocre one.


yes the dreaded 'pretty good' rating, never has there been such a wide gulf between a 3 star rating meaning '"fine" and meaning "disappointing"



Back to Top
The Block View Drop Down
Senior Member
Senior Member
Avatar

Joined: September 01 2009
Location: There
Online Status: Offline
Posts: 639
  Quote The Block Quote  Post ReplyReply Direct Link To This Post Posted: November 08 2009 at 18:31
Originally posted by J-Man

Usually if I have any doubt in my mind whether an album's a masterpiece or not, I give it a four.
Very good principle.

Edited by The Block - November 08 2009 at 18:31
Life only counts when you are awesome
    
Back to Top
 Post Reply Post Reply Page  <1234>

Forum Jump Forum Permissions View Drop Down

Bulletin Board Software by Web Wiz Forums® version 9.53
Copyright ©2001-2008 Web Wiz

This page was generated in 0.047 seconds.