Print Page | Close Window

Are We Too Generous?

Printed From: Progarchives.com
Category: Site News, Newbies, Help and Improvements
Forum Name: Help us improve the site
Forum Description: Help us improve the forums, and the site as a whole
URL: http://www.progarchives.com/forum/forum_posts.asp?TID=78618
Printed Date: June 10 2025 at 15:44
Software Version: Web Wiz Forums 11.01 - http://www.webwizforums.com


Topic: Are We Too Generous?
Posted By: cannon
Subject: Are We Too Generous?
Date Posted: May 27 2011 at 12:08
I've noticed that when a new album comes out by a relatively well known prog artist that we(the community) seem to give the new release very high ratings within a relative short time though the ratings seem to "come down to earth" after certain amount of duration and/or with more ratings. Do you see the same trend? Are we being too generous with our ratings with a new release? Is it the anticipation, hype, hope, desire for a new release to be a "classic"? Is a new release like getting a new toy? WOW! This is fantastic! But like so many new things we acquire, does it lose it's appeal after a certain amount of time(number of listens)?
 
When you rate a new album here on the progarchives, do you go back after a certain number of listens to adjust your first rating when you listened to the album within a short time after it's release? For example; say after three listens to the new release you rate it 5 stars, but after numerous listens you realise it's not worthy of 5 stars and you adjust your rating to 4 stars, 3 stars, ...? Or do you tend to rate a new release with a conservative rating after a relative few listens and find yourself giving that album a higher rating after numerous listens?
 
For me, listening to a new release after 3 or 4 listens I tend to give it a conservative rating and usually adjust the rating higher after many listens. Of course, some albums I have rated lower than my first rating.
 
Your thoughts? Your trends on rating albums here on progarchives? Do you see the same trend as I do with the ratings with a new release?



Replies:
Posted By: Queen By-Tor
Date Posted: May 27 2011 at 12:30
You are correct, good sir. Which is why any reviewer worth his salt will wait a good 10 or so listens before passing judgement.

This is not always the case though. I still have the same feelings about Snakes & Arrows as when it was released. One of my favorite Rush albums!

I do find that the opposite is true as well. Some people will throw a band into the fire and then admit years later that, "it's actually a pretty good album, I just didn't 'get' it at the time"


Posted By: harmonium.ro
Date Posted: May 27 2011 at 12:31
Yes. 


Posted By: Tapfret
Date Posted: May 27 2011 at 12:40
The real question is: is it legitimate to go back and change your rating? That's why I have always been a proponent of a "cooling" period where new releases are not rateable. Text reviews should always be welcome, but quantitative ratings are, as the premise of your post, skewed by the (won't use the 'f' word that ends with 'boy') people who are predisposed to grab their favorite band's new album the minute its released.

Everybody's taste changes and like it or not, albums sometimes don't stand the test of time. There was a time when there was an extremely limited number of progmetal bands. I regarded Dream Theater very highly for the first 2 albums. Now that i know what was really out there, and what has been subsequently created that is light years better than DT, they bore me, and in some cases, completely annoy. The Wall, used to seem so profound. In its case, its not just other music, but reading and life experience that really exposes The Wall as a 90 minute transferal whine by a self-absorbed masochist.

So I guess, yes, we (meaning everybody elseTongue) are too generous. But really, the ratings say more about the rater than the album.  That's why its a good idea to look at member profiles and get an idea of what they like and how the give ratings to really determine if what you are seeing is indicative of quality, or just personal taste. 


-------------
https://www.last.fm/user/Tapfret" rel="nofollow">
https://bandcamp.com/tapfret" rel="nofollow - Bandcamp


Posted By: Negoba
Date Posted: May 27 2011 at 12:40
Absolutely. I've down rated a bunch of newly acquired 5 stars to 4 over the years. I don't think ever to 3, and I've always listened many times before I review. But 3 months later, sometimes things change.
 
I've been more cautious about giving 5 star ratings lately, but it still happens.


-------------
You are quite a fine person, and I am very fond of you. But you are only quite a little fellow, in a wide world, after all.


Posted By: The Truth
Date Posted: May 27 2011 at 12:51

I don't do that personally, I normally up the rating with more listens. But I give a lot of four and five stars so you could say I'm kind of a music fanboy in general.



-------------
http://blindpoetrecords.bandcamp.com/" rel="nofollow">


Posted By: zravkapt
Date Posted: May 27 2011 at 12:53
I refuse to give ***** to any album that is not at least 5 years old, it doesn't matter how much I like it. One of my criteria for a ***** release is for it to have 'stood the test of time.' Some people rate an album ***** before it's even released!


Posted By: lazland
Date Posted: May 27 2011 at 13:07
I gave only one five star review last year, that being David Minasian, a rating I stand by. I haven't been as busy in 2011, but out of the seven (I think) 2011 albums i have bought and reviewed, only Pendragon's new release got five stars, again a rating I stand by.

The answer to the question is absolutely yes. I do think some are far too free with their masterpiece ratings. Masterpieces are a rare commodity, and looking at my almost 200 ratings, about 18% have a five star rating. Even this is probably too high, but nowhere as near as high as many others.

Members need to realise that three and four star albums are what they say they are, good and excellent, and that there is no shame as an artist in getting this rating.

As for a "cooling off period", I really sympathise with the sentiment, but it would be impossible to enforce, I think. I thought of having some sort of "review/rating moderating panel", who could objectively look at these things and mark down or up as they saw fit, but, again, too much work, and, of course, people would get extremely upset at having their marking changed.

Having said all this, it is a fact that many people reading reviews are able to identify the reviewer who fits in best with their taste and is "sound of judgement".


-------------
Enhance your life. Get down to www.lazland.org

Now also broadcasting on www.progzilla.com Every Saturday, 4.00 p.m. UK time!


Posted By: tupan
Date Posted: May 27 2011 at 13:17
Originally posted by Tapfret Tapfret wrote:

The real question is: is it legitimate to go back and change your rating?


Yes, it is


-------------
"Prog is Not Dead and never has been." (Will Sergeant, from Echo And The Bunnymen)


Posted By: cannon
Date Posted: May 27 2011 at 13:19
I have given only two five star ratings from any release in the last 20 years. One of those five star ratings is from this year. Deep Politics from the Grails. The other is In Absentia by PT. There is a handful I would rate as 4 1/2 stars. As for prog in the 80's, Moving Pictures by Rush I have given 5 stars with KC's Discilpine coming in at 4 1/2 stars. The 70's is another story.


Posted By: Tapfret
Date Posted: May 27 2011 at 13:30
Originally posted by cannon cannon wrote:

...The other is In Absentia by PT...


This speaks to my point of rating saying more about the rater than the album. You have only given two 5's, and one is to an album that bores me to death. No PT album exceeds 3 stars to me. But that's ok. Were I rating PT albums, someone would look at those ratings and say, "this guy does like Porky Tree". The choice is, read the review to see why (maybe this guys tastes match mine and I can check albums from his profile that he fancies), or move on and find out what someone with similar tastes thinks.

I also believe there is a rather limited view we can take away from a 5 star system. There is considerable polarity built in. I give 5 stars here to what would be nines in a ten star system. Again, what I really, really like says more about me than the album.


-------------
https://www.last.fm/user/Tapfret" rel="nofollow">
https://bandcamp.com/tapfret" rel="nofollow - Bandcamp


Posted By: cannon
Date Posted: May 27 2011 at 14:17
Originally posted by Tapfret Tapfret wrote:

Originally posted by cannon cannon wrote:

...The other is In Absentia by PT...


This speaks to my point of rating saying more about the rater than the album. You have only given two 5's, and one is to an album that bores me to death. No PT album exceeds 3 stars to me. But that's ok. Were I rating PT albums, someone would look at those ratings and say, "this guy does like Porky Tree". The choice is, read the review to see why (maybe this guys tastes match mine and I can check albums from his profile that he fancies), or move on and find out what someone with similar tastes thinks.

I also believe there is a rather limited view we can take away from a 5 star system. There is considerable polarity built in. I give 5 stars here to what would be nines in a ten star system. Again, what I really, really like says more about me than the album.
 
All good points. I can't disagree with what you say.
 
For me, I give four stars here to an album that would be a nine on a ten star system. For me, 5 stars=10 stars.
 
We all have different criteria for rating albums. In regards to the question, it is more of a general observation I have seen with ratings here at PA. I'm not saying that anybody's ratings are right or wrong or that I agree or disagree with how people rate albums. I have respect for others ratings. If you give In Absentia only a 1 star rating that wouldn't bother me in the least. If anything, I'd have admiration for you stating the fact that you think the album is only worth 1 star.


Posted By: Easy Livin
Date Posted: May 27 2011 at 14:57
I notice that Classic Rock, prog magazine reviews do not do ratings at all. While I can see the logic in this, I think they are a misguided omission.


Posted By: notesworth
Date Posted: May 27 2011 at 15:39
IMDb is the same way. Movie ratings shoot up when people first see them and then drop. Rate Your Music is the exact opposite: people rate new albums lower and it can take years for their ratings to go up.


Posted By: Alitare
Date Posted: May 27 2011 at 15:48
For me, it depends on the album. If an album punches me hard with styles I gravitate toward (depressing, seemingly sincere, psychologically brutal, dark but catchy) I may be inclined to rate a tad higher than normal. On the other hand, it might take a long time for me to filter my personal bias against heavy metal to see just how great an album is. This isn't always the case, though. Originally, I rated Antony and the Johnsons' 'I Am a Bird Now' 3/5, even though it's dark, sincere, and all that rot. Finally, I ended up giving it a strong 4/5. And yes, this is a band far removed from prog rock. I review albums as a hobby. :P


Posted By: Man With Hat
Date Posted: May 30 2011 at 17:58
I imagine that in the beginning most people who seek out the album as soon as it is released (or even sooner) or really really big fans of the band, and they will probably be more forgiving for lesser tracks or things that are terrible about it, and thus rate it higher. After time, when the general listening community gets around to hearing it, things will probably level out to something lower. Not saying that fans can't be objective, it's just I imagine that fans could be less objective (compared to people who just like a band, or don't know them, or whatever) when it comes to one of their "favorite bands".
 
But, yes, I have noticed that trend happneing. I try to give new albums a little longer before I stop taking reviews/ratings with a grain of salt.


-------------
Dig me...But don't...Bury me
I'm running still, I shall until, one day, I hope that I'll arrive
Warning: Listening to jazz excessively can cause a laxative effect.


Posted By: Sean Trane
Date Posted: June 06 2011 at 10:17
Originally posted by Tapfret Tapfret wrote:

The real question is: is it legitimate to go back and change your rating? That's why I have always been a proponent of a "cooling" period where new releases are not rateable. Text reviews should always be welcome, but quantitative ratings are, as the premise of your post, skewed by the (won't use the 'f' word that ends with 'boy') people who are predisposed to grab their favorite band's new album the minute its released.

Everybody's taste changes and like it or not, albums sometimes don't stand the test of time. There was a time when there was an extremely limited number of progmetal bands. I regarded Dream Theater very highly for the first 2 albums. Now that i know what was really out there, and what has been subsequently created that is light years better than DT, they bore me, and in some cases, completely annoy. The Wall, used to seem so profound. In its case, its not just other music, but reading and life experience that really exposes The Wall as a 90 minute transferal whine by a self-absorbed masochist.

So I guess, yes, we (meaning everybody elseTongue) are too generous. But really, the ratings say more about the rater than the album.  That's why its a good idea to look at member profiles and get an idea of what they like and how the give ratings to really determine if what you are seeing is indicative of quality, or just personal taste. 
µ
 
 
I'm generally one to rate from the middle of the scale: making three stars as a normal likeable album, and 5 stars as exceptional...  I start from the assumption that exceptionally good albums are the exception, so they're rather rare.... which means that even 5% of the total albums should be less than 5Star... most people are way tooooooo generous, IMHO
 
Yes I agree that there should a self-imposed moratorium on reviews on new releases (last time I looked the latest VdGG album still had no collab reviews Clap)
 
 
 
And of course one should be able to update their reviews and ratingsClap: I can't see one reason to forbid it.Confused
 
 
I rate on Gnosis2000 and it's recommended not to rate higher than 11 (out of a piossible 15) before a few months after discovering the album, just to avoid the novelty factor ... you can always go back to change your rating later if you feel you've evolved in your appreciation.
 
 
 
 
 
 


-------------
let's just stay above the moral melee
prefer the sink to the gutter
keep our sand-castle virtues
content to be a doer
as well as a thinker,
prefer lifting our pen
rather than un-sheath our sword


Posted By: Bonnek
Date Posted: June 06 2011 at 10:44

Yep to the OP, too many generous fanboy and over-hurried ratings when albums come out.

I don't always listen 10 times before I review, but I do usually take a couple of months, listening to the music in various moods, places and under various circumstances and multiple devices...

5 stars is only for albums that get me totally hooked for an extensive period of time.


Posted By: Vompatti
Date Posted: June 06 2011 at 14:06
I could give my opinion on this, but I want something in return.


Posted By: dreadpirateroberts
Date Posted: June 07 2011 at 08:55
Too generous, possibly, yeah. I've only reviewed a few albums, but the ideal situation for me is that I don't review anything that I haven't owned for at least over a year. Or 6 months perhaps.

So with that tough time frame, it's basically impossible for me to review a new release or anything that arrived in the mail between Feb & Now. So I will have to figure something out there.  The cooling off period is a great idea.


-------------
We are men of action. Lies do not become us.
http://www.jazzmusicarchives.com/" rel="nofollow - JazzMusicArchives.


Posted By: Mr ProgFreak
Date Posted: June 07 2011 at 13:00
Originally posted by Sean Trane Sean Trane wrote:


 
I rate on Gnosis2000 and it's recommended not to rate higher than 11 (out of a piossible 15) before a few months after discovering the album, just to avoid the novelty factor ... you can always go back to change your rating later if you feel you've evolved in your appreciation.


[shameless_plug]You can also rate at Progfreak.com - there you can, in addition to the rating, specify how familiar you are with the album.[/shameless_plug]


I don't think that this is a good idea. If everyone did that - give the album a lower rating if for example they only listened to it once - you could never be sure of what the ratings mean. Obviously many people will fail to return to correct their rating later on.

I think that even without an elaborate system of correction mechanisms and instructions it doesn't hurt if people, when blown away by an album at first listen, give it a 5/5, 10/10 or 15/15. If they had that kind of experience, that's what the rating should reflect. If they change their mind a few months later - who is to say that that rating will be more accurate? I'm sure that it often is, but sometimes people also grow tired of stuff, or lose interest in styles. There are obviously many factors here, and IMO the best strategy is to simply take every rating with a grain of salt.


-------------
https://tagyourmusic.org/users/Mike" rel="nofollow - https://tagyourmusic.org/users/Mike



Posted By: cannon
Date Posted: June 07 2011 at 16:43
Originally posted by Vompatti Vompatti wrote:

I could give my opinion on this, but I want something in return.
 
 How about a kick in the azz?LOL


Posted By: Warthur
Date Posted: June 08 2011 at 09:03
Personally, I think there's two factors at work here.

1: Motivation to buy new. If you think about it, who are the people most likely to rush out and grab a band's latest release as soon as it comes out? The people who are already fans of that particular group, of course! And so it's only natural that their reviews will tend towards the higher ratings - well, unless a band tries out a different approach with a new album which alienates a large proportion of their existing fanbase, which does happen, but I don't think it happens so often as to throw the trend off.

2: Motivation to review. It's always easier to push yourself to write glowing praise of an album you really, really love - the urge to share the joy with people is a powerful one. (Likewise, if you seriously dislike an album that could also be a good motivator to warn the world about it...) It's a bit harder to motivate yourself to review an album you're only lukewarm about or which you consider to be OK but not especially praiseworthy or horrible. So in general people are a bit more likely to review albums they want to rave or curse about than albums they don't particularly care about.

When you take those two factors and put them together, the people reviewing albums when they are newly released are disproportionately likely to be folk who a) like the band in question and were looking forward to the release and b) formed a fairly immediate opinion about the album rather than being unsure and wanting to give it a few more listens before reviewing. So it's only natural that new releases get good reviews and then get harsher criticism later on.

Personally, I think my 5-star ratings are a bit high at the moment, but they're skewed a bit because at the moment I'm doing a project of going through my music collection in chronological order and reviewing *everything* - which means that the albums I'm reviewing now will tend to be the 1960s-early 1970s albums which have well and truly stood the test of time. I anticipate my proportion of 5-stars will go down over time as I get to more recent albums which perhaps are a bit more imitative and a bit less innovative.

What I think might help is a rule that an album can't appear on the top 100 lists until at least 6 months after its release date; I think that's a fair amount of time to let the initial wave of enthusiasm die down and get some input from cooler heads.


Posted By: Sean Trane
Date Posted: June 09 2011 at 05:23
Originally posted by Mr ProgFreak Mr ProgFreak wrote:

 
Originally posted by Sean Trane Sean Trane wrote:


 
I rate on Gnosis2000 and it's recommended not to rate higher than 11 (out of a piossible 15) before a few months after discovering the album, just to avoid the novelty factor ... you can always go back to change your rating later if you feel you've evolved in your appreciation.


[shameless_plug]You can also rate at Progfreak.com - there you can, in addition to the rating, specify how familiar you are with the album.[/shameless_plug]

 
I'd expected no less from you, actuallyLOL
 
good ol'MikeWink
 
 
Originally posted by Mr ProgFreak Mr ProgFreak wrote:

I don't think that this is a good idea. If everyone did that - give the album a lower rating if for example they only listened to it once - you could never be sure of what the ratings mean. Obviously many people will fail to return to correct their rating later on.

I think that even without an elaborate system of correction mechanisms and instructions it doesn't hurt if people, when blown away by an album at first listen, give it a 5/5, 10/10 or 15/15. If they had that kind of experience, that's what the rating should reflect. If they change their mind a few months later - who is to say that that rating will be more accurate? I'm sure that it often is, but sometimes people also grow tired of stuff, or lose interest in styles. There are obviously many factors here, and IMO the best strategy is to simply take every rating with a grain of salt.
 
actually the Gnosis project is counting very much on actualization of ratings : it's a fairly closed circle (roughly 100  highly-committed slightly RIO-slanted raters able to rate at least 2500 albums) that go back to re-rate once they done explorations on a given artiste
 
despite the closed amount of raters, the ovrall ratings (three types of averages available - including a standard deviation - and very recently a tagging featured added) constantly change, and that's actually interesting - despite the site not having a memory to keep track of the evolution of the ratings (it might be quite interesting to monitor the rating updates, especially with new releases!!).
 
 
Well, I've been blown away at first listen on some albums in a given context (at friends or in a store), but NEVER managed to recapture the feelings afterwards. It's precisely the repeated listens that will give a more accurate feeling and rating... But it's also the motivation or wear & tear of time that ensures the "perenity"  (all things considered, uh??) of the rating
 
Obviously!!! never take a rating of a review for more than just indication


-------------
let's just stay above the moral melee
prefer the sink to the gutter
keep our sand-castle virtues
content to be a doer
as well as a thinker,
prefer lifting our pen
rather than un-sheath our sword



Print Page | Close Window

Forum Software by Web Wiz Forums® version 11.01 - http://www.webwizforums.com
Copyright ©2001-2014 Web Wiz Ltd. - http://www.webwiz.co.uk