Forum Home Forum Home > Site News, Newbies, Help and Improvements > Help us improve the site
  New Posts New Posts RSS Feed - Dropping the Rating System
  FAQ FAQ  Forum Search   Events   Register Register  Login Login

Dropping the Rating System

 Post Reply Post Reply Page  <12
Author
Message
Cristi View Drop Down
Special Collaborator
Special Collaborator
Avatar
Crossover / Prog Metal Teams

Joined: July 27 2006
Location: wonderland
Status: Offline
Points: 47121
Post Options Post Options   Thanks (0) Thanks(0)   Quote Cristi Quote  Post ReplyReply Direct Link To This Post Posted: Yesterday at 00:01
Originally posted by TSoP2018 TSoP2018 wrote:

In my opinion, a rating should be combined with a review or a short comment. Allowing compulsive rating without any rules or limits makes the rating system itself worthless.
For example, if I'm not a fan of Primus, then I can give 1 to all their releases without explanation, and that's ok?


Who says there aren't any rules?!

Compulsive rating?! I don't know what it means.

Rating an entire discography a 1 star is rating abuse. Same for rating it 5 stars. Because both things do not make sense.
Back to Top
TSoP2018 View Drop Down
Forum Newbie
Forum Newbie
Avatar

Joined: June 22 2018
Location: Finland
Status: Offline
Points: 32
Post Options Post Options   Thanks (0) Thanks(0)   Quote TSoP2018 Quote  Post ReplyReply Direct Link To This Post Posted: Yesterday at 00:59
Originally posted by Cristi Cristi wrote:

Originally posted by TSoP2018 TSoP2018 wrote:

In my opinion, a rating should be combined with a review or a short comment. Allowing compulsive rating without any rules or limits makes the rating system itself worthless.
For example, if I'm not a fan of Primus, then I can give 1 to all their releases without explanation, and that's ok?


Who says there aren't any rules?!

Compulsive rating?! I don't know what it means.

Rating an entire discography a 1 star is rating abuse. Same for rating it 5 stars. Because both things do not make sense.


with "compulsive" I meant in bursts... a lot of ratings during the same day, too many to be objective.
In any case, if you are happy, I'm happy.

Back to Top
Cristi View Drop Down
Special Collaborator
Special Collaborator
Avatar
Crossover / Prog Metal Teams

Joined: July 27 2006
Location: wonderland
Status: Offline
Points: 47121
Post Options Post Options   Thanks (0) Thanks(0)   Quote Cristi Quote  Post ReplyReply Direct Link To This Post Posted: Yesterday at 01:05
Originally posted by TSoP2018 TSoP2018 wrote:

Originally posted by Cristi Cristi wrote:

Originally posted by TSoP2018 TSoP2018 wrote:

In my opinion, a rating should be combined with a review or a short comment. Allowing compulsive rating without any rules or limits makes the rating system itself worthless.
For example, if I'm not a fan of Primus, then I can give 1 to all their releases without explanation, and that's ok?


Who says there aren't any rules?!

Compulsive rating?! I don't know what it means.

Rating an entire discography a 1 star is rating abuse. Same for rating it 5 stars. Because both things do not make sense.


with "compulsive" I meant in bursts... a lot of ratings during the same day, too many to be objective.
In any case, if you are happy, I'm happy.



ok, thanks for explaining.
Back to Top
TSoP2018 View Drop Down
Forum Newbie
Forum Newbie
Avatar

Joined: June 22 2018
Location: Finland
Status: Offline
Points: 32
Post Options Post Options   Thanks (0) Thanks(0)   Quote TSoP2018 Quote  Post ReplyReply Direct Link To This Post Posted: Yesterday at 01:11
Just a suggestion:

only rating a maximum of 3/day
rating and review no limit

Simple, no?
Back to Top
Sean Trane View Drop Down
Special Collaborator
Special Collaborator

Prog Folk

Joined: April 29 2004
Location: Heart of Europe
Status: Online
Points: 20735
Post Options Post Options   Thanks (0) Thanks(0)   Quote Sean Trane Quote  Post ReplyReply Direct Link To This Post Posted: Yesterday at 01:47
Originally posted by Grumpyprogfan Grumpyprogfan wrote:


DPRP reviewers usually rated everything 9 or 10 out of 10, so it makes no difference that they no longer do it.


Yup, their way to have a bad rating was to ignore it and not review/rate it at all.

Originally posted by Valdez Valdez wrote:

How about only rating if you write a review as well?


PA takes care of that in a way. Reviews count 10x more than a review-less rating.

Originally posted by Hrychu Hrychu wrote:


I think that Progarchives wouldn't lose anything valuable without a few ordinary/uneducated people (or bots?) leaving a vague numeric-based quasi-opinion. If anything, it will gain from it, getting rid of the fluff.


This is tooooooo tempting, but I will resist

Originally posted by Floydoid Floydoid wrote:

For a long time now I've been of the opinion that the ratings/reviews system should be restricted to members with a status of at least Forum Senior Member. This could help prevent potential abuse of the ratings system, and make the ability to award ratings an earned privilege and not an automatic right.

I do believe however that you should be able to rate albums without necessarily writing a review.


Again, PA takes care of this issue, with the weighing factor. Registered or PA-accredited Collabs reviews are worth three times the outsider reviews.

At first, it can seem a little unfair, but generally good reviewers are noticed and invited to "join up".

Originally posted by Guldbamsen Guldbamsen wrote:

I find it verging on the absurd having to assign a numerical value to art…which incidentally was the hardest thing for me to do back when I wrote reviews; slapping a rating on X album. Feels so weird to me.


Again PA took care of this by not making it a strict quality rating: our 5 stars system is about the album being of a usefulness (or "essentialness") to include it in your collection.
Hardly perfect, because the 197th album of TFK, Buckethead or King Gizzard will simply not be "essential" to a good prog collection - unless that's the only album of theirs you/they own.... in which case, one can wonder just how qualified the reviewer is.




Edited by Sean Trane - 23 hours 14 minutes ago at 03:32
let's just stay above the moral melee
prefer the sink to the gutter
keep our sand-castle virtues
content to be a doer
as well as a thinker,
prefer lifting our pen
rather than un-sheath our sword
Back to Top
Sean Trane View Drop Down
Special Collaborator
Special Collaborator

Prog Folk

Joined: April 29 2004
Location: Heart of Europe
Status: Online
Points: 20735
Post Options Post Options   Thanks (0) Thanks(0)   Quote Sean Trane Quote  Post ReplyReply Direct Link To This Post Posted: Yesterday at 02:31
Originally posted by lazland lazland wrote:

I understand why Max & others like the rating system on a site such as PA. For those albums where a significant number have reviewed/rated, it is a pretty good guide to how they are perceived or thought about in the community.

I took a decision not to have scores on my website from the off. DPRP are simply playing catchup!

Of more concern to me is allowing all and sundry to post reviews. IMO, the first ten reviews submitted by a new member should be vetted before being published.


In the halcyon days of PA, much debate went on behind the curtains about the rating system. Including not only the rating scale, but worthiness of the reviews as well and we came up with this weighing scheme (10/3/1)

We even implemented a 0 stars rating (which either meant avoid at all casts or simply n/a (not applicable) or n/o (no object)), which lasted one year.
We also implemented that the rating space should come below the review space (still the case nowadays)
For years, we also asked M@X to implement the half-star ratings, but he claimed it was not possible under the software used for the database.

AFAIAC, while not really looking at the ratings, it has the merits to set apart the good/excellent albums from the bad/cruddy ones very quickly and therefore saves much time, effort and money.

==================

For me, outside colours & tastes, the main problem is that we don't rate the same way.

Personally I rate upwards or downwards from an average album (which should be 5/10 or 2.5/5 or 7/15 in the Gnosis scale >> in any case, it should be the middle value).

Most of our personal and collective ratings should be espousing the Gauss bell (look it up) and extreme ratings (5 stars or 1 star) be almost exceptionnal. Now of course, most of us will not be taking time to rate average albums (I try/tried to do so in Gnosis) and only concentrate on what we love or loathe. That trend alone is skewing the stats rules foundations.
The majority are average or medium releases, and should be ranked as such. 5 albums ratings should be - if not rare - carefully used, simply because "masterpieces" are not to be found around every street corner
Of course, in terms of arts, can normal statisticians maths rules applicable? Obviously no... but our top lists systems is based on this statistics bible. Which is why I simply don't even look at these top lists (though I do have an idea of what's on it), but I'm in the clear minority in this isue.

===============

The odd contradiction on my part is/was that my fave "prog" site is/was a ratings-only site, but there it was the pannel of raters that interested me most, because the members were somehow carefully selected on their seriousness and general or specific tastes (neo and metal fans were not part of the pannel). So yes, in a way, it was a closed circle and the older members' updating visits were getting rare (still alive?).

Gnosis' main attractiveness was (IMHO) its collective force, though the individual raters' rates were easily consulted. But the site's rating side is down (for one year now), and the chances of its 20/25 years-old software being transferred to someting more actual are dwindling (only one person left to administer it) every month or so.



.

Edited by Sean Trane - 23 hours 11 minutes ago at 03:35
let's just stay above the moral melee
prefer the sink to the gutter
keep our sand-castle virtues
content to be a doer
as well as a thinker,
prefer lifting our pen
rather than un-sheath our sword
Back to Top
Mellotron Storm View Drop Down
Prog Reviewer
Prog Reviewer
Avatar

Joined: August 27 2006
Location: The Beach
Status: Offline
Points: 14907
Post Options Post Options   Thanks (0) Thanks(0)   Quote Mellotron Storm Quote  Post ReplyReply Direct Link To This Post Posted: 3 hours 30 minutes ago at 23:16
Originally posted by Nogbad_The_Bad Nogbad_The_Bad wrote:

You can all talk about this as much as you want but it's extremely unlikely Max is going to change anything so I'd suggest we all learn to live with it.


I remember the discussions about having half star ratings back in the day, which I liked the idea of, but to start that years after this site has been established didn't seem like it would work to me, unless you started over.
I love PA worts and all.
"The wind is slowly tearing her apart"

"Sad Rain" ANEKDOTEN
Back to Top
 Post Reply Post Reply Page  <12

Forum Jump Forum Permissions View Drop Down



This page was generated in 0.102 seconds.
Donate monthly and keep PA fast-loading and ad-free forever.