*GOOFYRAT!*
The goofiest of investigators.
Eh, fair.His posted implied that if the topic he was referining to was still about star ratings, the argument I made wouldn't be a good one for it
Eh, fair.His posted implied that if the topic he was referining to was still about star ratings, the argument I made wouldn't be a good one for it
Cool!
is now enabled on addon pages.", doesn't feel great to me.Downloads
and Views
, making a third one rather pointless to have.Cool!
s just tell you how many players interacted with your work, and that's it. Low Cool!
s only serve to tell players that some players liked it. What about those that didn't? Did they try it even?Cool!
is practically just as vague as before. You're simply rating a thing as "Cool", and it doesn't pair itself with any review in particular. It's just "Cool". That feels like on the same level as a post with the contents being "Cool", or a "i like, 5 stars" review.+1
, and "Not Recommended" -1
.HOO BOY, LOTS to unpack here.After sorta talking about it over Discord and giving it a big thought, I figured I'd leave my two cents as well.
My feelings with the current changes are mixed, and to get over why, I have to first go over about the XenForo's review system that's available by default and why it sucks.
I want to emphasize that being able to rate something, even negatively, is useful. I enjoy being able to leave a positive rating on something I like, alongside a review as for why I think this way. Conversely, I want to be able to leave a negative rating on something that I did not like, and be able to defend this with a why.
While it can be abused, being able to rate something with stars provides immediate feedback about a review - think of it as a summary. This rating affects the rating meter provided in the overview and in the addon list.
Addons seen as great by the community will have plenty of stars, while flawed addons or those that don't fit properly will have lower scores. This is natural.
Both positive and negative ratings help users see what's the most liked and disliked things in a list of addons at a glance, and (ideally) you can learn why if you go to the addon page and read the reviews. This all helps the author of said addons too, providing them with valuable information to better their craft and make something better next time around.
Even though I like them ratings and reviews, XenForo's default system is pretty ass.
The reason for this are because ratings are vague and reviews are not engageable.
Ratings... While they are par for the course, they're stupid vague.
Think about it a little: What are you measuring with stars? How much you like the addon? How well it plays? How SRB2y it is?
And note that you have five of these to give. If you know what 5 of them means as well as 1, what do 2, 3 and 4 mean? Why would you choose 3 even? Why would you decide to pick 2 or 4?
This sounds quite vague to me, and only the extremes tend to be most meaningful anyways.
Even so, with these stars you are given a quick summary to glance at, offering a rough idea of the "quality" (or whatever your assumption of this metric is) of the work as perceived by the community at large.
This not only helps a prospective player understand what to expect from the addon without having to start by digging through text (I get games from Steam, I'm sure you can understand why I don't wish to read reviews all the time), but also get the author to think "Hmm, maybe I did something weird?" on low ratings and encourage them to read reviews then try to open up avenues of change to make it more interesting for a better rating. Or get ecstatic at having all the meaningless shiny little stars.
(Ideally, you would always navigate to the addon page and check the reviews, provided thanks to the community.)
Now, reviews are also par - but definitely not great. They do their job decently though: You can leave a review with a rating... and that's it.
As a player looking at the review, sometimes you'd expect the reviewer to go over something that they may have summarized, or perhaps you've got other questions that you want to discuss. How do you go about it? You can open a conversation with them and point out the review they left, or you can @ping them in the Discussions tab, but both options are mechanically awkward. And the last one just brings the person into the thread, which might be socially awkward (but you can do, nothing stops you lol).
A better option is if you replied to it- Oh wait, you can't. Only the addon author can reply to the review, and only once. That's as much engagement as there can be with a review as-is, other than the previous options.
Besides, and by experience, discussion threads are easy to derail with random junk, and god forbid a conversation line lasts for several pages, making reading the many pages a massive chore from there on out.
On top of that, reviews are pretty abusable, intentionally or otherwise - While useless reviews can be reported, they can still be made. Prying information from a lazy player is then hard to impossible, either because the player doesn't want to navigate to the addon page anymore to discuss it, or because @pinging them in the thread to get information might be weird.
The way both concepts were implemented in XenForo are most useful with a community that can enunciate what they like and what they don't on a particular work in an hyper constructive manner, but... we're not really that kind of community, so we're bound to have a few bumps here and there that need to be tweaked.
With this in mind, my feelings with the current changes are mixed.
Increasing the review character minimum to 100 forces the reviewer to actually put their mind into their review instead of "lol good 5 star" or "lol bad 1 star", bringing down the rate of bad reviews even lower.
This should, in turn, open the door to more detailed reviews that actually go over the points they liked and over the ones they didn't.
That is prettyCool!
to me, honestly!
But the other part of the current change, which amounts to "Star ratings are hidden (except when using a filter).Cool!
is now enabled on addon pages.", doesn't feel great to me.
The little star based summary, which averages rating scores for something moderately useful, is now replaced by a counter going from zero to infinity.
You'll notice that we already have two of these, namelyDownloads
andViews
, making a third one rather pointless to have.
It also doesn't provide the same information than a metric with a potential negative position can provide -Cool!
s just tell you how many players interacted with your work, and that's it. LowCool!
s only serve to tell players that some players liked it. What about those that didn't? Did they try it even?
Besides, aCool!
is practically just as vague as before. You're simply rating a thing as "Cool", and it doesn't pair itself with any review in particular. It's just "Cool". That feels like on the same level as a post with the contents being "Cool", or a "i like, 5 stars" review.
These changes are wholeheartedly mediocre, if not worse than what we had before.
I can understand these changes are coming from, mind you. Clueless actors tend to misuse systems in place for whatever reason, usually because they don't get how it works. Maybe they rate things 1 star because "i didn't like", but they don't really know any better than that. Bad actors will abuse these same systems for whatever reason, sometimes tiptoeing what's allowed.
But both these types of actors can easily be corrected with the help of the community and the powers of a staff member: The report button there is not for show, and moderators have the means to quickly navigate to a particular post to excise it if need be.
ANY sort of review system will be abused in novel ways when given the chance, and that's why the dynamic of the community and its staff helps to keep this at bay. Simply removing an ability that has proven to be useful helps nobody, it just disables an area of interaction from the community while not actually providing a better solution.
Overall, XenForo reviews are flawed, and the newer changes (except for 100-char) aren't particularly useful.
I believe the actual solution to the overarching issue is to address the actual problems:
Reviews are not engageable, and ratings are vague.
Perhaps, different ways to manage reviews and ratings should be considered?
I want to preface this by mentioning that I know changing the layout drastically to allow more features is basically XenForo addon territory, but figured I'd lay them down in the chance that anybody wishes to expand upon them to think of what would be an optimal solution.
Originally, I thought that simply revamping them by doing exactly what Steam does for apps would be a great idea:
It's pretty good if I do say so myself... but for a game platform. This is overkill for an addon aggregator like this message board.Reviews have their own section, and each have a rating and a block of text associated to them.
The rating number in the sidebar is a summary of all ratings given, denoting how recommended the addon is.
Each review is a block of text, with a rating right above it.
Each rating is either "Recommended" or "Not Recommended". The site aggregates all ratings, averages it, and displays the result of recommendations as a percentage on the sidebar.
Works that don't have a particular amount of ratings do not get a score percentage. Hiding the score helps curb players that follow the rating of the player before them.
Each review has its own comments section where you are able to engage with the review author about it. This allows other players or even the developers to interact with the players to get more information or other things.
(Reviews can also have a "Developer response", which is basically a highlighted comment displayed right on the store page side of the review.)
Each review can also be given a rating itself, marking how "helpful" it is. There's also a "Funny" rating.
But there are still some good parts to it. To highlight a few, renaming the rating system is a good method to remove ambiguity of what a rating is.
As written above, why 5 stars? And what are you rating, anyways? Wouldn't it be better if this was more streamlined?
Therefore, instead of it being just a rating with no other nickname, it's now a "recommendation rating" (or some other better nickname): a metric that holds how recommended the addon is.
And instead of having that many stupid stars, they get coalesced into two contrasting options: You can choose between "Recommended"+1
, and "Not Recommended"-1
.
Turning ratings into recommendations dispel ambiguity, letting the reviewer stop thinking about "how many stars am I rating this" by simply having them answer "Would you recommend this to other players? Yes or no?", with a review for the "Why?". Very straightforward.
This way, you don't have to stay in the edge thinking "ooohh, I don't really like the mod because this and this", now that you have to think about other players as well.
"Woah, is that CHARACTER!? Does it play good? Holy SHIT this is amazing, I absolutely recomend it!"
"Oh, this Kaizo map pack is really damn hard. I completed it, but I wouldn't recommend it to you normies."
Or something more advanced like "This niche character plays really well and I had fun, but I wouldn't recommend it because X" or "This music pack, I didn't like. But if you are a fan of Y, why not give it a go?".
Even better, "recommendations" help remove that notion that a rating has to correlate with the quality of a work. Yes, more polished works have higher recommendations as is natural, but the implication that "more score very polished" is no longer a thing, with more simplistic works being able to get just as many recommendations because they're amazing.
Works with a lower recommendation score doesn't necessarily mean such a work is bad - it's just not recommended. Could be too difficult, could be flawed in some way. This should not be seen as a discouraging moment, but one of learning: read reviews, figure out the main problematic points, and do something about it. Or it could be a badge of honor if you're insane enough?
In addition, reviews get turned into something like mini threads. Each review can now be engaged individually by anyone, be it to get information, be all like "yes bestie i agree", or... whatever you would want to do. With this, you don't have to do much work to be able to ask and discuss why the review is like that.
This might be the most optimal way to engage with reviews, but also a bit too much, both for the backend (LOL A NEW THREAD PER REVIEW that'd kill storage i think) and for you, the viewer.
A little bit of talking lead me to something a bit more simplified, at least review-side:
In my opinion, this one is slightly more optimal for the board.Each addon has a Discussions tab. Why not turn it into a place for reviews as well?
Instead of reviews being a separate concept that exists in the overview/review tab, being able to make a post should also allow you to add a "rating" for the addon.
Writing a new post in the discussions thread should give you an option to "update your rating". (How? Where?)
In here, you can pick between "No change", "Recommended" and "Not Recommended".
Except for "No change", changing your rating and creating the post will highlight it then give it a badge with the chosen rating. (previous posts with ratings from the same user should be marked as "outdated", with a link to the newest rating)
Through this, the Reviews tab can simply aggregate and showcase all non-outdated highlighted posts with a rating (or at least a summary of them, imagine long ass 10+ sentence posts here lol), followed by a link to navigate to the post itself.
(Perhaps, the link should also activate a filter that shows the review post, followed by all posts that quote it. This way you can also check how many commented on it!)
The "Leave a rating!" button should be removed, or lead you to make a new post. Or hint you to it with a message somewhere else.
This encourages players and authors to visit the discussions tab to read discussions and reviews, and engage with them in a more organic fashion. You can quote them, discuss individual points, and get more information - stuff that would be slightly more awkward to do with reviews being somewhere else.
Of note, this doesn't unspaghettify the discussions thread (in fact, it has the potential to get worse) but at least you are forced to engage with them if you want to leave a rating - and it must be paired with a review. And seeing everyone speak like a player would probably force you to make the review socially acceptable, lol.
Changing how reviews operate, and renaming then reworking the stars to something less vague, would turn the current feedback system into something more useful and less XenForo-y dogwater.
Plus, it should be easier to read for both players and staff, and simpler to moderate for staff.
I believe it was very transparently a dig at Pika for calling out his bad attitude. Not gonna let people get away with that after all the legwork staff put in to support modders in this community.Hey Xavier, I think Platter is being hypothetical. (If not, then wtf, Platter. That's just fucking asshat talk.)
I just wanna clarify that their answer wouldn't apply here, because the staff in this place are pretty laid back and cool (Especially Pikaspoop, thanks man.), but I've been in a community or two where the moderators weren't very great, so their answer would apply there.
Tatsuru said "changes to prevent bullying towards creators is tantamount to censorship" is a bad argument, which it absolutely is.Uh, how exactly is that a bad argument?
Mkay.I believe it was very transparently a dig at Pika for calling out his bad attitude. Not gonna let people get away with that after all the legwork staff put in to support modders in this community.
Very big fan of this idea, actually. Might not be absolutely perfect, but I think it's the best way to keep reviews here. It also feels like this would allow people to write more varied thoughts on a mod instead of just going "this is good because so and so," because even if you don't like something, that doesn't mean there's not a chance you'll think other people will enjoy it.But there are still some good parts to it to take from it. To highlight a few, renaming and reworking the rating system is a good method to remove ambiguity of what a rating is.
As written a section ago, why 5 stars? And what are you rating, anyways? Wouldn't it be better if this was more streamlined?
Therefore, instead of "rating" being just a rating with no nickname, it should be a "recommendation rating" (or some other better name): a metric that holds how recommended the addon is.
And instead of having that many stupid stars to choose for in your review, they get coalesced into two contrasting options: You choose between "Recommended"+1
, and "Not Recommended"-1
.
All removing stars does is make the getting feedback part harder, I don't want to scroll through multiple reviews to find one that helps. I want to easily be able to distinguish between good and bad reviews, not just with some arbitrary like button.a none of that is happening! your fears of people not getting the feedback they need are unfounded!! people who want to improve will seek out the means to improve!!! i implore you to believe that criticism is not equally helpful for everyone sharing artwork with others.
Ya'll...really didn't get the message, did you?All removing stars does is make the getting feedback part harder, I don't want to scroll through multiple reviews to find one that helps. I want to easily be able to distinguish between good and bad reviews, not just with some arbitrary like button.
I was only replying to the part of the message that I found eager to reply to.Ya'll...really didn't get the message, did you?
Alright, now saying this is going quite a good bit far. I'm sure their intentions are good. They don't wanna force you into anything, and just because you don't get what you want doesn't justify how you call it "being a slave" to people on the internet. It's just decent respect, get that through your skull.I don't feel like this is a good reason to justify removing star ratings, when the simple solution to this problem is to... Not be a slave to people on the internet.
I think you are misunderstanding the idea of the message.Alright, now saying this is going quite a good bit far. I'm sure their intentions are good. They don't wanna force you into anything, and just because you don't get what you want doesn't justify how you call it "being a slave" to people on the internet. It's just decent respect, get that through your skull.
is making reference to the fact that in some communities, feedback is considered king and something that you should really really really listen to, but an incorrect assumption made by people not in the know on these kind of communities that promote feedback is that you MUST listen to it and do something with it. This is not true! At least, not here in this board lolwhen the simple solution to this problem is to... Not be a slave to people on the internet.
Ah, that explains it. Sorry @Bartz and Amper.This is making reference to the fact that in some communities, feedback is considered king and something that you should really really really listen to, but an incorrect assumption made by people not in the know on these kind of communities that promote feedback is that you MUST listen to it and do something with it. This is not true! At least, not here in this board lol
You are encouraged to do so, so you can find out weak points to reinforce or figure out what's that thing people like the most that you could tack onto a future update or something else, but if you don't want to read reviews and ratings, then lol that is always allowed
(exceptions where its due: If you complain about how people don't like something you made but you don't do anything to remedy it despite having the means to do so... that's not a good look!)
In fact, making something you love often involves ignoring the people around you trying to curve your intentions towards a particular goal. For example, I dislike fast paced characters with a quadrillion buttons and I know a few labors of love here that meet this criteria. I could be rating then low scores with long walls of text for a review explaining why and detailing what would make me like it, but the authors don't have to listen to my boring fast-hating non-button-mashing ass
Now THAT I can get behind.I'm sorry about that "incompetent" comment I made earlier, that was definitely a bridge too far. What I meant to say was, modders really do need to learn from feedback. Not one modder-- not you nor I-- have made the best mod ever first crack out the gate, and we should stop acting like that can happen. Mods can't be completely perfect, but with time, they can get closer to perfection, like any creation. This change makes it harder for that to happen.
Basically "Review Bombing" for you, one of the reasons of removing these stars.My 2¢: Stars were always useless to authors, because they flatten complex feelings into a context-free number with zero actionable feedback.
You cannot design a mechanism that differentiates a "needs improvement" 1-star, an "I am outside of target audience" 1-star, and a "you're mom gay" 1-star, regardless of how clear you make the criteria—but who cares? Even if you could, none of them give me any information on what I should be doing to resolve it.
I don't see any reason to frame pro-stars discussion in terms of critique. They've always been for players and no one else.