Forum Home Forum Home > Topics not related to music > I Have A Question For You......?
  New Posts New Posts RSS Feed - Applying ratings
  FAQ FAQ  Forum Search   Events   Register Register  Login Login

Applying ratings

 Post Reply Post Reply Page  12>
Author
Message Reverse Sort Order
Hrychu View Drop Down
Forum Senior Member
Forum Senior Member
Avatar

Joined: November 03 2013
Location: poland?
Status: Offline
Points: 6070
Post Options Post Options   Thanks (0) Thanks(0)   Quote Hrychu Quote  Post ReplyReply Direct Link To This Post Topic: Applying ratings
    Posted: 2 hours 47 minutes ago at 10:33
Originally posted by Grumpyprogfan Grumpyprogfan wrote:

There are plenty of modern releases that sound stellar...
The latest Karmakanic record (mixed by Chris Lord Alge) sounds excellent. The attention to detail, especially in the drum department, is quite remarkable, I'd say.

Also, I think Roine Stolt is a very underappreciated mix engineer. Yes, he writes songs, sings and plays guitar, but don't forget that he did the mixing on most if not all of The Flower Kings albums. I think those mixes sound super crisp and are very nicely balanced.
Back to Top
Grumpyprogfan View Drop Down
Forum Senior Member
Forum Senior Member
Avatar

Joined: July 09 2019
Location: KC
Status: Offline
Points: 12983
Post Options Post Options   Thanks (0) Thanks(0)   Quote Grumpyprogfan Quote  Post ReplyReply Direct Link To This Post Posted: 3 hours 1 minutes ago at 10:19
^You're talking about the difference in analog vs. digital recordings.

There are plenty of modern releases that sound stellar... Here's some artists off the top of my head

Helmet of Gnats
Thieves' Kitchen
Big Big Train
Mike Keneally
Antoine Fafard
French TV
IZZ

Back to Top
Proggle View Drop Down
Forum Newbie
Forum Newbie
Avatar

Joined: July 01 2025
Location: USA
Status: Offline
Points: 23
Post Options Post Options   Thanks (0) Thanks(0)   Quote Proggle Quote  Post ReplyReply Direct Link To This Post Posted: 3 hours 12 minutes ago at 10:08
Originally posted by moshkito moshkito wrote:

tastes change with every generation, and folks today that like metal (example!) are not likely to vote favorably for the KC's first or ELP's first, for example, thus bringing down the numbers.


It can sometimes go the other way. I was born a little late to be a music fan in the 70s, but over the years I started to get tired of the production values of more recent music (which are sometimes maximum sound all the time) and started to really appreciate the sound palette of older material. Part of the appeal is that it doesn't sound like now. I don't know how common that is, but I can't be the only one.
Back to Top
Proggle View Drop Down
Forum Newbie
Forum Newbie
Avatar

Joined: July 01 2025
Location: USA
Status: Offline
Points: 23
Post Options Post Options   Thanks (0) Thanks(0)   Quote Proggle Quote  Post ReplyReply Direct Link To This Post Posted: 3 hours 19 minutes ago at 10:01
Reviewing anything after one listen seems wrong. That's, among other things, when I am most susceptible to hearing the shadow of whatever I listened to last and consciously or unconsciously comparing it to that. It's also when I am least likely to understand what is going on the release - all I can really go on at that point is how it is tickling my senses, and that has a maximal chance of being temporary subjective reaction.

Edited by Proggle - 3 hours 18 minutes ago at 10:02
Back to Top
Valdez View Drop Down
Forum Senior Member
Forum Senior Member
Avatar

Joined: September 17 2005
Location: United States
Status: Offline
Points: 1332
Post Options Post Options   Thanks (0) Thanks(0)   Quote Valdez Quote  Post ReplyReply Direct Link To This Post Posted: 4 hours 23 minutes ago at 08:57
Originally posted by MikeEnRegalia MikeEnRegalia wrote:

^ If you really LOVE it, of course you can give it five stars. You said it yourself, it doesn't happen often. Five stars (or S-tier at AP) is exactly for those releases. The only thing I would do in these cases: Follow up on them a few weeks after and see whether that loving feeling was a fluke or whether it is persistent. If it was a fluke, the rating should be adjusted.

Sometimes the situation we're in when listening to music has a big effect on how we perceive it. Especially for first listen impressions, I've found that my opinion sometimes drastically changes on repeated listens, and I suspect that this is mostly due to changed circumstances.


This is good advice. I once said I wouldn’t change ratings but I am re-thinking that statement lately.

I never rate on headphones
I never rate at low volumes
I never rate on cheap speakers
I always give a minimum of 2 listens ( which may not be enough, I know )

Sound quality and volume really can (drastically) change the way an album plays for me.

Also, if an album is a painfully obvious 1 star for me, I have a good laugh and I don’t rate it at all. Others may love it!! You just never know.
Should I freeze my eggs

Edited by Valdez - 3 hours 28 minutes ago at 09:52
https://bakullama1.bandcamp.com/album/maxwells-submarine
Back to Top
moshkito View Drop Down
Forum Senior Member
Forum Senior Member
Avatar

Joined: January 04 2007
Location: Grok City
Status: Offline
Points: 18884
Post Options Post Options   Thanks (0) Thanks(0)   Quote moshkito Quote  Post ReplyReply Direct Link To This Post Posted: 4 hours 40 minutes ago at 08:40
Originally posted by Valdez Valdez wrote:


...
After a year or two it will rise or drop into its proper place, or thereabouts. Some of the worlds greatest records are sitting at 3.75 - 4.00 after 50 years


Hi,

That's cheating ... mainly because tastes change with every generation, and folks today that like metal (example!) are not likely to vote favorably for the KC's first or ELP's first, for example, thus bringing down the numbers.

In general, I would like to suggest that an album be available to rate for so many years, and then the rating ability closes, which would leave the albums with a much better rating than what has happened to many things since the 1970's and how their ratings have dropped.

It's something that I'm not sure we can fix, unless we create some kind of a tool that adjusts for the WHEN an album is reviewed, with some kind of scale that won't allow a low rating to be accepted that is not normal, in the history of the film. Ex: Voting down Bela Lugosi's Dracula because it has no "action" and flying body parts!

The same thing happens in film ... where many folks on the toma'toe thing have voted down David Lean and voted up the antics of that impossible clown finding more ways to give us a thrill!! I suppose their work will be remembered for the clever antics, and the other for its color and visual design. BUT, at least David Lean is discussed in Film Schools. I'm not sure that those other films will get that much recognition beyond the amount of money made! And, generally, that is not a theme for a class in most Film Studies schools.
Music is not just for listening ... it is for LIVING ... you got to feel it to know what's it about! Not being told!
www.pedrosena.com
Back to Top
MikeEnRegalia View Drop Down
Special Collaborator
Special Collaborator
Avatar
Honorary Collaborator

Joined: April 22 2005
Location: Sweden
Status: Offline
Points: 21833
Post Options Post Options   Thanks (0) Thanks(0)   Quote MikeEnRegalia Quote  Post ReplyReply Direct Link To This Post Posted: 4 hours 51 minutes ago at 08:29
^ If you really LOVE it, of course you can give it five stars. You said it yourself, it doesn't happen often. Five stars (or S-tier at AP) is exactly for those releases. The only thing I would do in these cases: Follow up on them a few weeks after and see whether that loving feeling was a fluke or whether it is persistent. If it was a fluke, the rating should be adjusted.

Sometimes the situation we're in when listening to music has a big effect on how we perceive it. Especially for first listen impressions, I've found that my opinion sometimes drastically changes on repeated listens, and I suspect that this is mostly due to changed circumstances.
Release Polls

Listened to:
Back to Top
Valdez View Drop Down
Forum Senior Member
Forum Senior Member
Avatar

Joined: September 17 2005
Location: United States
Status: Offline
Points: 1332
Post Options Post Options   Thanks (0) Thanks(0)   Quote Valdez Quote  Post ReplyReply Direct Link To This Post Posted: 5 hours 5 minutes ago at 08:15
Recently I listened to a new release that I loved ( which doesn’t happen very often ) and I gave it a 5 star rating. My opinion is that if YOU love it, why not give it a 5 or at least a 4.   Someone else will come along and give it a 1 or 2…. You can count on it.   After a year or two it will rise or drop into its proper place, or thereabouts. Some of the worlds greatest records are sitting at 3.75 - 4.00 after 50 years
https://bakullama1.bandcamp.com/album/maxwells-submarine
Back to Top
Finnforest View Drop Down
Special Collaborator
Special Collaborator
Avatar
Honorary Collaborator

Joined: February 03 2007
Location: The Heartland
Status: Offline
Points: 17613
Post Options Post Options   Thanks (0) Thanks(0)   Quote Finnforest Quote  Post ReplyReply Direct Link To This Post Posted: 5 hours 46 minutes ago at 07:34
Originally posted by MikeEnRegalia MikeEnRegalia wrote:

^ As far as rating distribution goes, it depends a lot on which releases one chooses to rate.

I guess that if one were to choose random releases, the result of a really "balanced" rater with no extreme biases would produce a bell curve like distribution with the peak at 30-50/100. This is simply because so much music is being released, and a lot of it is mediocre. It follows from the fact that it is now so easy to produce and release music.

But most of us are not choosing albums randomly. We tend to focus on releases we love first and foremost, and then maybe also on popular releases we dislike and consider to be "overrated". As a result, most users skip those releases which would otherwise be at the peak of the bell curve.

My guess for the most typical distribution of the "perfect" rater/review would be for it to peak in the four stars range, with very few five stars releases and fewer three star than four star releases and a few two stars ratings and again very few one star ratings.



Yes, this is a great point also and does affect things. In the past, I was buying and reviewing large swaths of stuff blindly, so I had much more 1-3 star reviews. Now, I have far less time for PA, and so I tend to just review the stuff which speaks to me in a positive way, thus almost everything I review is 3-4 stars. I'm still very stingy with that 5th star though. An album has to be basically offer me a cigarette afterwards in order to get the 5 from me.

Back to Top
moshkito View Drop Down
Forum Senior Member
Forum Senior Member
Avatar

Joined: January 04 2007
Location: Grok City
Status: Offline
Points: 18884
Post Options Post Options   Thanks (0) Thanks(0)   Quote moshkito Quote  Post ReplyReply Direct Link To This Post Posted: 8 hours 28 minutes ago at 04:52
Hi,

Now I'm not sure ... I only rate "reviews" of mine, and never have rated another album at all ... which I would think is an area (if wide open) will be abused senselessly.

Most of my reviews, these days, are on the Jazz Music Archives, where I am working on reviewing the large bunch of ECM stuff I have and other jazz/fusion related stuff. In general, on the rock side, there are so many reviews on some albums, that I do not feel that we need to add another review. I mean ... c'mon ... who's going to bother even checking 5 or 10 reviews of ITCOTCK or any other album?

After a bit, I think it gets ridiculous, and honestly, I would prefer that someone could audit the reviews as some of them should not be there and considered "reviews" at all. But I'm a reviewer (over 600 art/foreign films), so saying that makes sense, but you're not gonna get me to review another Marvel Comic Book Review or another of those impossible bruhahas!

Edited by moshkito - 8 hours 22 minutes ago at 04:58
Music is not just for listening ... it is for LIVING ... you got to feel it to know what's it about! Not being told!
www.pedrosena.com
Back to Top
MikeEnRegalia View Drop Down
Special Collaborator
Special Collaborator
Avatar
Honorary Collaborator

Joined: April 22 2005
Location: Sweden
Status: Offline
Points: 21833
Post Options Post Options   Thanks (0) Thanks(0)   Quote MikeEnRegalia Quote  Post ReplyReply Direct Link To This Post Posted: 9 hours 33 minutes ago at 03:47
^ As far as rating distribution goes, it depends a lot on which releases one chooses to rate.

I guess that if one were to choose random releases, the result of a really "balanced" rater with no extreme biases would produce a bell curve like distribution with the peak at 30-50/100. This is simply because so much music is being released, and a lot of it is mediocre. It follows from the fact that it is now so easy to produce and release music.

But most of us are not choosing albums randomly. We tend to focus on releases we love first and foremost, and then maybe also on popular releases we dislike and consider to be "overrated". As a result, most users skip those releases which would otherwise be at the peak of the bell curve.

My guess for the most typical distribution of the "perfect" rater/review would be for it to peak in the four stars range, with very few five stars releases and fewer three star than four star releases and a few two stars ratings and again very few one star ratings.

Edited by MikeEnRegalia - 9 hours 21 minutes ago at 03:59
Release Polls

Listened to:
Back to Top
MikeEnRegalia View Drop Down
Special Collaborator
Special Collaborator
Avatar
Honorary Collaborator

Joined: April 22 2005
Location: Sweden
Status: Offline
Points: 21833
Post Options Post Options   Thanks (0) Thanks(0)   Quote MikeEnRegalia Quote  Post ReplyReply Direct Link To This Post Posted: 10 hours 22 minutes ago at 02:58
At AP we have a 0-100 scale, and 90-100 are labelled the "S-tier". When converting this to a five star rating only the S-tier results in five stars, whereas numerically you might expect 80-100 (one fifth). Then 80-89 maps to four stars. Then a comparatively large section (50-79) is mapped to three stars, 30-49 results in two stars, and anything less than 30 maps to one star. This non-linear mapping tries to reflect the significance we intuitively attribute to the stars:

5 stars: truly exceptional
4 stars: awesome
3 stars: decent/good, but not really great
2 stars: mediocre
1 star: bad
Release Polls

Listened to:
Back to Top
A Crimson Mellotron View Drop Down
Prog Reviewer
Prog Reviewer
Avatar

Joined: September 10 2020
Location: Sofia, Bulgaria
Status: Offline
Points: 5947
Post Options Post Options   Thanks (0) Thanks(0)   Quote A Crimson Mellotron Quote  Post ReplyReply Direct Link To This Post Posted: 11 hours 11 minutes ago at 02:09
Originally posted by Finnforest Finnforest wrote:

In my mind and intentions, a 5-star "masterpiece" is top 5 percent. Not if I like the album, which 3-4 stars do a great job of handling, but it also has to be something I consider absolutely essential/universal/iconic to sit on the "top five percent shelf" of my collection.

I am attempting to follow in the shoes of Hugues, who I've long considered the PA reviewer who rates albums in the best, optimal way, closest to the actual spirit of the stars definitions intent. If my math is correct, looking at Hugues 3000-plus reviews to date, 4.5 percent of them are 5-star. That's awesome and useful to me. I know when he rates something 5, it means something special and well beyond excellent.

Four stars is "excellent," which comfortably handles most of the great albums. That extra star needs to mean something well beyond excellent.
I have to say that this is probably the most accurate breakdown of the rating system on PA. That degree of moderation and trying to be a bit more "universal" when assigning three, four of five stars to an album is really valuable and what draws my attention is the often-unhinged use of the five-star rating. Not that there is anything inherently bad in it, but one should really think about the fact that very few albums are "essential masterpieces", so a bit of an objective overview doesn't hurt.
Back to Top
Finnforest View Drop Down
Special Collaborator
Special Collaborator
Avatar
Honorary Collaborator

Joined: February 03 2007
Location: The Heartland
Status: Offline
Points: 17613
Post Options Post Options   Thanks (1) Thanks(1)   Quote Finnforest Quote  Post ReplyReply Direct Link To This Post Posted: 22 hours 46 minutes ago at 14:34
^

It's really very cool that you're taking the site serious enough to be concerned with rating in the manner the founders intended, as opposed to what you see in some corners of the ratings universe, which is:
I like it = 5 stars.

Much of the internet seems to struggle with the idea of the middle ground, moderate ratings. Not so much here, but other places that rate.

Kudos to you for caring.
Back to Top
Proggle View Drop Down
Forum Newbie
Forum Newbie
Avatar

Joined: July 01 2025
Location: USA
Status: Offline
Points: 23
Post Options Post Options   Thanks (0) Thanks(0)   Quote Proggle Quote  Post ReplyReply Direct Link To This Post Posted: Yesterday at 13:43
Still following this with interest - thanks for the suggestive discussion. FWIW, as a would-be newbie reviewer, the writing is more interesting to me than the ratings, and delaying the ability to rate would not scare me off at all, but if there are ratings I do welcome there being a scale that is not just "I like this right now," even though personal judgements will inevitably vary. I tend to agree that "essential" is not that common in the larger scheme of things (@Valdez) and is necessarily relative to subgenre (@wiz_d_kidd). One of the albums I want to review is essential to me and currently has no ratings or reviews :-) - I am under no illusion that my enthusiasm confers cosmic significance. I do want to recognize all the work that has gone into this site and at least try to use the system in a way that aligns with the hopes already invested concerning how it is all supposed to work.

If you really wanted to narrow the spread of review types I guess another way to turn the screws would be to have a forum thread for newbie reviews and require, say, 3 reviews deemed sentient by the mods before being cleared to add a review on the main site. It might take some tracking though.

Regardless, I'm glad for the insights into how folk are thinking.
Back to Top
Valdez View Drop Down
Forum Senior Member
Forum Senior Member
Avatar

Joined: September 17 2005
Location: United States
Status: Offline
Points: 1332
Post Options Post Options   Thanks (0) Thanks(0)   Quote Valdez Quote  Post ReplyReply Direct Link To This Post Posted: Yesterday at 09:04
In reality there are very few "Essential" albums over the long haul. Many albums deemed essential by a few raters have been long forgotten over the years. Unfortunately an album only truly becomes essential after never-ending Sales and long term interest.

I have many albums I call Essential that no one else has probably ever heard of. I've given 5 stars to many albums. It's more of a 'personal taste' rating.
https://bakullama1.bandcamp.com/album/maxwells-submarine
Back to Top
Valdez View Drop Down
Forum Senior Member
Forum Senior Member
Avatar

Joined: September 17 2005
Location: United States
Status: Offline
Points: 1332
Post Options Post Options   Thanks (0) Thanks(0)   Quote Valdez Quote  Post ReplyReply Direct Link To This Post Posted: Yesterday at 08:55
Originally posted by moshkito moshkito wrote:

Hi,

I was wondering what would happen if the "ratings" were completely removed ... it would force the "review" to be better worded and applied, instead of some sort of album plug, that happens with the ratings much too often.



DPRP has just done away with album ratings. They will review only from now on.
https://bakullama1.bandcamp.com/album/maxwells-submarine
Back to Top
moshkito View Drop Down
Forum Senior Member
Forum Senior Member
Avatar

Joined: January 04 2007
Location: Grok City
Status: Offline
Points: 18884
Post Options Post Options   Thanks (0) Thanks(0)   Quote moshkito Quote  Post ReplyReply Direct Link To This Post Posted: Yesterday at 08:31
Hi,

I was wondering what would happen if the "ratings" were completely removed ... it would force the "review" to be better worded and applied, instead of some sort of album plug, that happens with the ratings much too often.

Maybe we should enforce a completely different idea ... a new user/reviewer can not do "ratings" until after their 5th or 6th review ... and that might give some of those folks something to think about ... 5 reviews under the same name for the same album and band? Not likely to get very far!

Preventing any newbie to add reviews simply to advertise the band, would help in one way ... make the reviews more important all around, and likely flush out a lot of stuff that is over rated and just spam for a band, or a listing. It might also help the Admins, in not having to check 17/18 reviews every day that border on the spam side of things.

As wide open as things are at this time, the invitation is to do whatever anyone can, and I'm not sure that we need to have things that wide open at all ... in order to be able to maintain the quality of the work ... even though some might think that it is too stuck up ... in essence it is protecting the work of hundreds of others from being left behind.

A year ago I went over the reviews of one album and read over 50 of them ... and honestly? At least 10 of those should have been removed as they are not reviews! I'm not sure that we should be allowing what amounts to a bit of garbage onto the incredible amount of work it takes to make this board work ... we're adding more work that does not need to be there and can easily be addressed with some special needs ... and reviewers not able to rate anything until after their 5th review is a fair idea, even if some folks are not gonna like it ... let them go try and post somewhere else, where there are rules for the spamming of an album review as some listings on PA obviously are!

I wish there was a way to have folks at PA actually take a look at the suggestions, but when it comes to Mosh, I think most collaborators probably look at something else. It's ok ... I don't mind being the ugly duckling ... remembering that the bass in the lake don't care when momma and all the ducklings go for their first swim!
Music is not just for listening ... it is for LIVING ... you got to feel it to know what's it about! Not being told!
www.pedrosena.com
Back to Top
wiz_d_kidd View Drop Down
Forum Senior Member
Forum Senior Member
Avatar

Joined: January 13 2018
Location: EllicottCityMD
Status: Offline
Points: 1521
Post Options Post Options   Thanks (0) Thanks(0)   Quote wiz_d_kidd Quote  Post ReplyReply Direct Link To This Post Posted: Yesterday at 06:31
Originally posted by Proggle Proggle wrote:

...So I think there's a difference between "essential to a progressive rock collection" and "a masterpiece of a very specific subgenre" (like ambient).


I agree. I don't think you can call an album "essential" outside of it's subgenre, as many people simply don't like that genre, and it would be ludicrous to suggest to them that they should own or listen to that album because it is universally "essential". It may be deemed essential only within the subgenre.
"Instrumental music is an expression that words can never capture." -- Peter Baumann
Back to Top
Finnforest View Drop Down
Special Collaborator
Special Collaborator
Avatar
Honorary Collaborator

Joined: February 03 2007
Location: The Heartland
Status: Offline
Points: 17613
Post Options Post Options   Thanks (0) Thanks(0)   Quote Finnforest Quote  Post ReplyReply Direct Link To This Post Posted: Yesterday at 05:45
In my mind and intentions, a 5-star "masterpiece" is top 5 percent. Not if I like the album, which 3-4 stars do a great job of handling, but it also has to be something I consider absolutely essential/universal/iconic to sit on the "top five percent shelf" of my collection.

I am attempting to follow in the shoes of Hugues, who I've long considered the PA reviewer who rates albums in the best, optimal way, closest to the actual spirit of the stars definitions intent. If my math is correct, looking at Hugues 3000-plus reviews to date, 4.5 percent of them are 5-star. That's awesome and useful to me. I know when he rates something 5, it means something special and well beyond excellent.

Four stars is "excellent," which comfortably handles most of the great albums. That extra star needs to mean something well beyond excellent.

Edited by Finnforest - Yesterday at 05:57
Back to Top
 Post Reply Post Reply Page  12>

Forum Jump Forum Permissions View Drop Down



This page was generated in 0.152 seconds.
Donate monthly and keep PA fast-loading and ad-free forever.