More concerning than Bethesda’s decision to withhold early review codes from certain outlets is how heavily some sites are relying on the game to drive their business.

  • It’s been probably 10 years or so since I was writing reviews, and I have to say, I never felt pressure to skew a review one way or another.

    The biggest heat I got was from fanboys when I had a sneak peek at PAX of Duke Nukem Forever and had to report how shitty it was. “YOU DON’T KNOW!!! YOU DIDN’T PLAY THE WHOLE GAME!!! YOU HACK!!!”

    And I was like “Yeah, you’re right, I didn’t play the whole game, I played what their marketing team WANTED me to play and it sucked, you think the parts they DIDN’T want me to play are going to be better?”

    Surprise… the game stunk up the joint.

    But when it came to reviewing games, I approached every review as if the game were a 10/10, and then as I played I looked for reasons to subtract or add points. The plusses and minuses would balance out and I’d have a final score.

    As a former teacher, I used school grades, which is why I think most sites are on a 7-10 scale.

    A - 90%+
    B - 80%+
    C - 70%+
    D - 60%+
    F - 59% and down.

    A game can be bad because it’s a bad game or it can be bad because it’s functionally broken. D is generally the Ralph Wiggum of games, possible to like, but you have to admit it’s pretty bad.

    I had to give a failing review to Assassin’s Creed Liberty on the Playstation Vita even though I really liked how it looked and it played, because it had a game breaking bug that made your save file unloadable. Ubi took 2 months to fix it, rendering it unplayable for the first two months after launch.

    Once it was fixed, I amended the review, but it was plainly unacceptable to release it in a broken state like that.

    • What was the worst game that comes to mind from your time writing? I used to write album reviews for a metal site years ago and one of our writers got HIM’s latest album at the time. They really just didn’t like the album and I shit you not, the review garnered 1,000+ comments from pissed off fans. It got so out of hand, we had to close comments.

      • Had to be Duke Nukem Forever. I was talking with one of the devs and I was legit curious as to how their process worked because it had been in hell for so long…

        “Were you able to use any of the original assets?”

        “Oh, all of them!” He seemed super excited.

        To use 14 year old assets and be incredibly proud of that? Eesh.

        Oh, and Brink! Brink was so incredibly disappointing. They had this well developed world and a fantastic movement system, solid class based shooter… but then it all fell apart in the actual implementation of it.

        I really, really, wanted to like Brink, but it was unplayable.

        Say you have a level where the enemy is escorting a VIP and your goal is to eliminate the VIP before they get to the destination.

        You roll in, wipe the team, wipe the VIP, then someone respawns, revives the VIP, and you keep going back and forth until the clock runs out.

        It didn’t matter how many times you killed the VIP, all that mattered was if they were alive or dead when the clock ran out. Win/lose. Just crap design.

        •  Kill_joy   ( @Kill_joy@kbin.social ) 
          link
          fedilink
          13
          edit-2
          10 months ago

          Brink… Sigh. I remember that trailer coming out and I watched it like every day for years waiting for it to come. I watched every dev vlog, read every update. For years I was hyped on that. At time of release my buddy and I took the week off of work. We played it for like 3 hours one night and finished it. I remember thinking “there must be a mistake. This can’t be it. This isn’t the game I’ve been dreaming about.” I never booted it up again after that first night.

          Brink was my CP2077.

          • It’s a shame, because if someone licensed the IP for, just spitballin’ here… A Fallout/Outer Worlds style game, the bones are there for a REALLY good game.

            The assets, art, backstory, it’s all done, it just deserved a better developer. :(

            • I really should go back to playing CP, I already enjoyed my time with the release Version.

              But I also had a great PC and managed to not hit many Bugs during my playthrough, so I understand that my experience was not a common one.

              • That happened for me too. Great 2077 experience through and through on good hardware with RT+DLSS. Had a couple bugs but nothing unsolvable like a puzzle with some saving involved, and they were things like scanning one thing early stops a scan later. Which is an unintended pretty cool mechanic lol, if only we’d been told it was a mechanic at the time.

                Game got even crazier looking in recent updates and with better hardware, but I 100%ed it early and I haven’t done another playthrough since so I’ve been at the endgame through all the updates lol

        • I think Brink was game that killed my naive trust in the hype machine. So much anticipation, so much desperation to enjoy it, so much disappointment. From there on I only believed the hyperbole from proven developers but eventually Destiny killed even that. Now I’m a bitter shell of a gamer who lives by the creed, “never pre-order!”

          • I actually enjoyed the hell out of Destiny, then Destiny 2 fucked everything up, got patched, got better, and then Bungie turned around and went “LOL - story missions? What’s that?” and cut 1/2 the content out of the game. Content I paid for.

            No more money for Bungie after that, I’m surprised it’s somehow still going.

        • Man, DN4E sat in limbo forever. I remember waiting patiently for it knowing full well it would be a mess, but I didn’t care because I was such a massive Duke Nukem fan. Definitely on my list of bad games but I managed to complete it. It was so dated and clunky.

          I vaguely remember Brink and all of the hype absolutely vanishing when it came out. I think I ended up skipping it because of the feedback people had.

          Thanks for sharing!

  • “Decay”

    What’s left to decay? It’s dust now. Remember when Eidos used a PR firm to strongarm websites into not publishing reviews of Tomb Raider: Underworld if they were less than an 8/10 till after launch?

    “That’s right. We’re trying to manage the review scores at the request of Eidos.” When asked why, the spokesperson said: “Just that we’re trying to get the Metacritic rating to be high, and the brand manager in the US that’s handling all of Tomb Raider has asked that we just manage the scores before the game is out, really, just to ensure that we don’t put people off buying the game, basically.”

    That was 15 years ago, and despite the fact that Barrington Harvey went on to lie and pretend they never said that, everybody knew that kind of thing was old hat back then too. Mainstream gaming journalism is a captured industry.

    •  Nilz   ( @Nilz@sopuli.xyz ) 
      link
      fedilink
      2110 months ago

      The only conclusion to make is that the video game industry has matured to a point where only masterpieces are released. Bad games just don’t exist anymore.

      Right??

      • I think you can explain much of the lack of lower scores by the fact that the games that would get lower scores are also likely to be ignored by just about any established reviewer.

        There are thousands of games released every year that a site like IGN will never review. Would you find it valuable for IGN to scour Steam or the Switch eShop for terrible games just to use more of the score scale?

    •  Mkengine   ( @Mkengine@feddit.de ) 
      link
      fedilink
      10
      edit-2
      10 months ago

      Exactly, it feels like 50/100 is the baseline and 75/100 is mediocre. 75/100 tells me I have to be a fan of the genre to enjoy it. This rating inflation really shows how dependent reviewers are. This is one of the reasons I like organisations like Stiftung Warentest instead of depending on some biased product comparison blogs.

      • You may notice that this parallels the american school grading system to a T. Most major gaming review sites and such are done by americans that spent anywhere between 4-10+ years with that being the what grading/reviewing/scoring was done in almost every interaction they ever had past childhood, there’s no wonder it’s the standard here even if it’s changed the scoring paradigm.

        • Exactly this. 50/100 looks like an F, because that’s what it would be on a school paper. Often we’d even be given points out of a hundred just like that. So giving a 50 to a middling/okay game feels really harsh, vs 70 (aka a C) or 80 (B).

      • Find an independent critic you respect and listen to the tenor of why they say a game is good. Or ignore critics and develop your own taste and sense of which studios, directors, artists, composers, or otherwise will compel you to buy a game.

  • Stuff like this is why I never buy new games. Not only can you not trust the critics, but players get so blinded by hype and buyers remorse that they’ll ignore everything bad about the games they love.

    It’s always wiser to wait for the hype to die down and see what the retrospective consensus is

    •  regul   ( @regul@lemm.ee ) 
      link
      fedilink
      1510 months ago

      yeah but now he’s just a guy in a spare bedroom with 4.5k patrons and under 40k youtube subscribers (of which I am one)

      it’s not that hard to blame game studios for not really thinking he’s worth it anymore

      • More likely that they know he’s probably not going to give it a glowing review, especially after Fallout 4, so he didn’t get one. This is something many publishers have historically done. It keeps reviews higher at launch so that people looking at reviews or metacritic scores see more positive information than after the dust settles.

      • I mean, if you phrase it that way, sure. Just a dude in his spare room. But then again, aside from the fact that he makes probably 20 000 dollar a month alone from his Patreon, almost everyone who is interested in video games knows this man’s name for way over a decade. More like two decades, actually. And while he certainly hasn’t anywhere near the same visibility as he had at Gamespot or Giantbomb, way more of the people who do follow him, actually pay him money directly. Reach alone isn’t what’s important these days. And yet, Jeff still has the potential to influence a lot of people who do not directly give him money. He also has a podcast, he streams and has 170k follower on Twitter. And if he has a very contrarian take on something, it will get noticed. Maybe not as much as 15 years ago but still noticed.

        A bit of a ramble, sorry! I guess it triggered some memories of me listening to Giantbomb with him, Ryan, Vinnie, Alex and Brad while going to work or cleaning the house. Bombcast was pretty much the first podcast I regularly listened to.

      • Yeah, Ive followed Jeff for a long time and he’s absolutely not afraid to say a game isn’t good, and his tastes can be fickle and particular, if I were a publisher cynically selecting who to send advance codes to to manufacture a good score he would not be one of them.

        As a consumer, I love him because he has integrity, likes what he likes, and says what he means, and I even can tell sometimes when he dislikes a game that I’d still like.

    • Commercial media has always been collaborative with whatever power structures or industries it’s associated with. Only good media is independent, and even then you get some really shitty journalists, and sometimes entire rotten publications.

  • Is there any reason to follow game journalism outlets anymore? Reading some positive/negative Steam reviews and watching some gameplay footage on its own gives a really good impression of what a game is like IMO.

    • I haven’t followed professional outlets for a long time. It’s pretty obvious most of them do not have enough time to give a proper review to these massive, 120+ hour long games. I used to read Computer Gaming World. Their reviewers would often mention that their rules required them to complete the game. Most of the reviews I see today, they don’t even necessarily get the whole fuckin’ game in their review copy. Just look at BG3.

      Phenomenal game, with a solid story, incredible characters, fun game play, and just… Bugs. Lotta bugs. Especially after the first act. You might not even realize you are getting them because so many are that things that should happen, don’t. The reviews for it clearly only covered the first, most polished act. And even then, they didn’t actually mention bugs there and while it’s the most polished, it is still far from perfect. As time goes on and more people push further into the game, now those same review outlets put out editorials reporting on players bitching about the bugs on social media. Things that should have been covered in their own official reviews in the first damn place.

      If all they’re going to do is write a bunch of bullshit they were likely paid to say, and then rely on users to generate more “news” content for them, I’m just going to stick with going straight to other players. There are still plenty that think for themselves and give honest, detailed descriptions of the game while trying to limit their personal opinions and bias. I want to be told how the thing actually is and make my own mind up based on my opinions; reviews can be objective.

      • Sounds like the real problem is publishers not actually finishing their games before release, so even if reviewers did try to play the whole thing, they couldn’t. The switch to digital downloads (over pressed media) has created an opportunity to do more with a game, but the reality is that it’s simply made games more expensive (since there is no resale market) and, worse, created an entire generation of game developers and managers who think that the launch date product is like a rough draft copy of their book report for Freshman English.

  • Ratings. Are. Stupid.

    When it comes to movies and audience scores, sure, look at the rotten tomatoes score or whatever. But everyone should realize that the average score of EVERY CRITIC is just going to be a useless number.

    Not only that but reviewers who represent entire companies like the people at IGN and elsewhere aren’t giving an honest opinion. I know this because a few of them have given their honest opinion before. They got fired for low scores.

    This is the reason that I enjoy watching reviews from people like ACG or SkillUp. They don’t need to give a score because their opinion isn’t a number. Enjoyability isn’t a number. Both of those reviewers enjoy games slightly different than I do, but when I watch their reviews I get a sense of if I will enjoy them.

    Seriously if you go to outlets who give scores on games commonly, stop. Very little time is put into choosing these numbers and they reflect nothing about enjoying a game for you personally. Go watch a review from ACG or SkillUp. Outlets like IGN or PCGamer can’t hold a candle to these guys.

    • They could easily all be giving their honest opinion at IGN: if the reviewers who tend to like everything are the ones who don’t get fired, the output of mostly positive (or sometimes groupthink negative) reviews would be the same, even if individual reviewers never lied.

      • Take a read of this summary (by IGN) of their Madden 22 review:

        “ Madden NFL 22 is a grab bag of decent – if frequently underwhelming – ideas hurt by poor execution. Face of the Franchise, to put it mildly, is a mess. Homefield advantage is a solid addition, but it doesn’t quite capture the true extent of real on-field momentum swings. The new interface is an eyesore, and the new presentation is cast in a strange and unflattering shade of sickly green. It’s smoother and marginally more refined, but in so many ways it’s the same old Madden. In short, if you’re hoping for a massive leap forward for the series on the new generation of consoles (or on the old ones), you’re apt to be disappointed”

        Now, I want you to read that and ask what you’d rate it based on this info (or the whole review).

        IGN has a scale approximately this: 10. Masterpiece 9. Excellent 8. Great 7. Good 6. Okay 5. Mediocre

        I don’t think I need to tell you that the user reviews for this game don’t even reach mediocre. Not to mention the gambling inclusion that IGN doesn’t take seriously in any sports game it reviews. But IGN still called Madden 22 a 6 or an “okay” game.

        I’m not saying they’re lying necessarily but the result is the same. The honest critiques are ignored to keep receiving review codes. That score should be left out entirely but they refuse because it drives clicks. It’s a joke.

        • This is just one example of how boiling down a review to a number is flawed. My favorite reviewers of games in general have been Matthewmatosis and Mandalore Gaming. IIRC neither of them provides a final score of any sort. Even whether a game is “recommended” or not may come with some caveats depending on what you’re looking for in a game.

  •  saigot   ( @saigot@lemmy.ca ) 
    link
    fedilink
    17
    edit-2
    10 months ago

    I don’t understand the purpose of big company reviewers (for subjective stuff like media at least). If I’m watching a smaller reviewer my goal is figure out their tastes so I can ignore the criticisms that I know don’t bother me, and pay very close attention to where their tastes align with mine. Like if dunky calls a game buggy or slow paced, that’s probably more a positive than a negative, but if he says the controls are clunky, I’ll probably agree. ACG tends to like games that are less mechanically adventious and easy compared to what I like, and we have evry different tastes in storylines, but he’s a really good barometer for sound and graphics.

    If kotaku or whatever releases a review it’s really hard for me to understand whose voice I’m getting, so the review is pretty useless, how do I know if the guy calling the game a challenge is that infamous cuphead reviewer or a guy that has been beating dark souls since he was 4.

    • I have a hard time when people complain about loading screens. I’ve been gaming since the 70s guys, let me tell you about load times:

      https://en.m.wikipedia.org/wiki/Commodore_Datasette

      https://en.m.wikipedia.org/wiki/Starpath_Supercharger

      You’d start loading a game from tape and then you might as well go have dinner with your family because it would be 30 to 60 minutes before you could play.

      Or, it could hit a loading error 5 minutes after you walked away and now you have to start all over again…

    • Same here,

      Unfortunately most of the folks in gaming media that I follow don’t write or produce proper “reviews” anymore. Reading a review from IGN or Gamespot… I don’t know anything about the reviewer so I take it with a grain of salt. Like with Starfield, I give the same weight to IGN giving it a 7 as I do with some no-name whatever tiny website I never heard of giving it a 9.5

      Just have to read through the reviews. If someone docks the game for not letting you fly manually between solar systems like you do in Elite Dangerous then I just have to write-off the negativity because… of-course fucking not, did anyone expect that? With something like, the repeated knocks against the barren nature of the procedural generation leading to repetitive tedious travel - I take that more seriously, because it was something I was hoping they would have addressed when moving that direction. Something like the story sucking or the NPCs having cringey dialogue is completely subjective and means nothing without knowing the reviewer’s tilt.

      • If someone docks the game for not letting you fly manually between solar systems like you do in Elite Dangerous then I just have to write-off the negativity because… of-course fucking not, did anyone expect that?

        I think a lot of people expected that. This is the see-that-mountain-you-can-go-there studio.

        • That surprises me… each BGS game is extraordinary iteritive over the previous one ever since Morriwind. They’re like 20 years into iteritive design and arguably each iteration, while doing some interesting new things also takes a step or two back. Very obvious looking back over their history. They’re really a one-note-studio.

          To all of a sudden expect Starfield would manage to be that revolutionary (to their formula) seems shortsighted. Even the concept of having a fully-realized BGS RPG with a near infinitely open space exploration system seems like an impossible feat. On a technical level, sure, but the space between planets would be empty and desolate… and even expecting an interesting procedurally generated continent is a big ask today, let alone a planet, let alone a solar system, let alone a quarter of a galaxy.

          • I wasn’t expecting it to be revolutionary. I expect Bioware RPGs to be on dozens of finite maps, and I expect BGS games, other than interiors, to be seamless maps. I was expecting procedural generation to cover the difference, and I expected that if No Man’s Sky could do it with maybe two dozen employees, BGS probably could too, especially given when the game went into full production. I was not, and still am not, expecting the vast majority of their planets to have something interesting on them just due to how many there are.

            • I can understand the link between seamless exteriors and the equivalent of what that would mean in the context of a space game for Bethesda, but the technological implications of having a galactic system flight mode and seamless planet to space transitions are both completely new ideas to Bethesda and are also technically complex to implement in a game already knee deep in new tech and systems only from what we’d been shown.

              There’s a reason things like seamless planet transitions are only something you might be able to expect in recent years. While Bethesda could totally make that happen, it’s not where I’d expect them to put their money, or they’d have probably dropped a line showing it off in the pre release footage.

              At once, I understand why you might’ve expected that, but expecting anything not explicitly shown is never a good idea when it comes to tempering expectations.

              • They showed so much of the game that I was bored before I could sift through anywhere near all of it (not to say I wouldn’t enjoy the game, but I know what I’m getting with a Bethesda RPG). I’m not knocking it for having a load screen between space and landing on the planet, but because we’ve seen that done a handful of times in recent years, as well as expectations set up from their previous games’ maps, it makes perfect sense to me to expect that to be in the game.

                • I think it does make sense to expect that up until you realize how much of a technical undertaking it’d be to do so and whether that payoff seems worth it to them. Seamless transitions seem to me to still be in a category to show off if you have it, so that they didn’t should be a red flag, but if you didn’t watch all the footage then you wouldn’t realize that, which I get, and I dont expect everybody to watch both the showcases like I did, thats probably over an hour of footage.

                  I can see why you’d expect a similar seamless experience due to their previous maps, but implementing that is completely different due to the style of game and requires new engine features to do so unlike their previous games which were already capable of it since Morrowind. You could expect them to consider doing it, but it wouldn’t be a given

            • I see what you’re getting at, I could see how someone might assume an seamless outer space based on that. As soon as you realize how much of a technical undertaking that is though, it’s easy to assume they wouldn’t go that route and not have blown that horn 2+ years ago as a huge feature. Something like that combined with a BGS RPG would be massive and I can’t imagine a world where a company like BGS or Microsoft would be wanting to keep that a secret until release.

    • PC Gamer shows clearly who wrote the article, and generally they’ll be clear about what subjective reasons they had for their final verdict.

      Personally, I feel they are prone to buying into marketing hype, but at least you can tell when that is the case.

  • This article made a damn good point about how much gaming websites depend on guides now. It hasn’t really clicked until now with me. I follow a bot on Mastodon that posts new articles from a bunch of different gaming sites, and it seems like half of them are for guides and walkthroughs. That’s where they get their ad bucks from, so that and SEO are the big focus.

  •  PenguinTD   ( @PenguinTD@lemmy.ca ) 
    link
    fedilink
    English
    410 months ago

    I wrote reviews(early 2000) during the late magazine era and even back then there were taboos about local influential company’s releases.(they only sign import deal and sell/distribute games locally.) Cause they survive on the ad money instead of subscription or individual purchases. Modern website sucks even more cause you made pennies for each view and if you don’t have something that covers enough contents to drive views, you will be at the mercy of promotion partners, same for the youtuber/streamer/influencer.

    I mostly write review/walk through for import games, as there was usually a couple months delay for localization, even had contacts with local publisher that consult with group of writers about maybe which game to sign and import. The US/Japan publisher aren’t exactly nice guys you know, they will ask you to sign multiple games, including the games you know might not sell well as part of the deal. It’s a risky business and if companies that import games will try to influence review scores, you know how desperate the publisher will try to defend their “investment”.

  • Gaming journalism is in a sorry state. I am thankful that we live in an age where I can just watch someone play something for a while. Seeing how they react and how the game flows can be a far better gauge of quality than a published review.

    Of course, it also makes you run the risk of spoilers, which sucks. There are a few YouTubers out there making what I would say are fair reviews, but that could change in an instant.