Variety Game Writer Troubled by "Exclusive" Reviews (including GTA IV's)

April 28, 2008 -
Ben Fritz (left), who writes The Cut Scene blog for Variety, questions the journalistic ethics underlying exclusive game reviews.

At the center of Fritz's concern is IGN's recent perfect score for Grand Theft Auto IV. Fritz writes:
I'm not at all accusing IGN of being dishonest in this particular case... HOWEVER... what the hell is with the concept of an "exclusive review?" Is anyone else as troubled by this entire concept as I am?

...being the first outlet to review a highly anticipated new videogame is a big deal. It means a major boost in Web traffic or magazine sales. ...But how can we trust a videogame review when the outlet running it has been given a major commercial favor -- one that's worth money -- from the publisher of the game?

You never see a paper or TV station getting special access from a movie studio or TV network or book publisher to run an "exclusive review." Imagine the L.A. Times or Roger Ebert touting their "exclusive review of 'Iron Man.'" Absurd, right? So why do we tolerate it for a videogame?

Via: That Videogame Blog

UPDATE: IGN responds in an interview on Game Daily. Xbox Editor Hilary Goldstein said:
My problem with online journalism in general is that nobody does their due diligence. Nobody from Variety called us and said, "Hey, would you like to comment about this?" ...A lot of people didn't get the game early. So if Variety didn't get the game early then you're looking at somebody, I don't know, who had a grudge on his shoulder because he didn't even have the game yet and we'd already put out the review.

I just wish people would call. We had so many people writing comments about us and not a single person contacted us. Not Kotaku. Not Variety. Nobody called. They just all made assumptions. And of course we gave it a 10. But so did everyone else.

Comments

hfHxZObvnSABi

Well, if Gamespot gives the 360 version a 10, and the PS3 version an 8.5, then I'll know something is fishy.

To be frank, I never quite trusted IGN's reviews in the first place. Too wordy, and it often felt more like some PR piece than an honest critique.

There are better reviewers out there - ZeroPunctuation comes to mind.

@ GoodRobotUs Says:

It’s not really a question of being right or wrong in their reviews to be honest, it’s being objective when it is what you do for a living.


EXACTLY!

That is 100% perfect what i was trying to say :)

the whole point of this article isnt so ppl can go 'oh well GTa MAY be that good duh!'. Yes it may, but there are far too many games that receive reviews not based on teh quality of the game but based on the quality of te freebiews / ad revenue they get. Its a sad but true fact that myself (as a game dev) know only too well about.

A game should earn its review PURELY on its gameplay, not even 1% due to ad money or whatever. ITs just wrong.

If it wasn't for the fact that virtually every other review has been giving it the same score, then ign would have been in serious trouble.

I don't know why but after reading this article, I though about Kane and Lynch. A review, a favor from a game company...

But what I am sure is that GTA IV deserve this score.

Forget GTA IV man...his point in general makes sense. Does anyone here actually trust reviews...especially "exclusive first" ones? Even if most magazines and review sites are honest, the very idea is cause for concern.

[...] wrote an interesting post today onHere’s a quick excerptBen Fritz (left), who writes The Cut Scene blog for Variety, questions the journalistic ethics underlying exclusive game reviews. At the center of Fritz’s concern is IGN’s recent perfect score for Grand Theft Auto IV. Fritz writes: I’m not at all accusing IGN of being dishonest in this particular case… HOWEVER… what the hell is with the concept of an “exclusive review?” Is anyone else as troubled by this entire concept as I am? [...]

He's perfectly correct, but his conclusion misses a vital point. In IGN's case, we're talking about a website. Do gamers who check websites for score base their decision PURELY on that site? No. For God's sake someone direct this guy to metacritic.com.

@Tristam

I trust some reviews. For print magazines, it's important to get games to review early so that they can have content for their magazine. IGN, however, doesn't have that excuse.

As far as this specific case goes, I don't think there is much to worry about. In general, however, it does sound a bit suspicious.

Hmm.... unethical. I agree 100% sir. Remember the Kaine and Lynch reviews?

I can understand Exclusive screen shots, videos, demo and anything else that is similar. But Reviews, not really. Its like reading book reviews, movies reviews, music reviews, critiques and etc there opinion pieces. I dont trust majority of the sources. I do find myself trust some places more than others because I found they have similar taste.

This sounds some what similar to what the Source did with Benzino. Or FOX news not having any problems with 20 century Fox new release and so forth.

This is easy.

It's because IGN's target market is the internet where the amount of content is not limited by time and space thus putting up words like "Exclusive" just makes the story more interesting.

Then again, he forget to mention all the celeb tv shows like "Entertainment Tonight" and "Access Hollywood" who have "Exclusive" interviews with celebs and reviews of movies and events involving well known celebs.

I think I kinda agree with him.

When it comes to "exclusive first" reviews I am not really looking for the rating. I don't care if they are 10/10 or whatever. I am just looking for the information on the game so I can compare it to what I know I like. If the game is deemed, in my mind, worthy of my attention then I am going to wait for more info as the release date comes closer.

However, I do agree that, in practice, this "exclusive review" system is rotten and can (and probably has) cause problems with unfair rating.

I usualy just read the review and ignore the number in the corner.

I am beginning to wonder if this writer person complaining is not unlike the same people that complain about violent video games.

I really did not know why IGN said Exclusive Review of the game because a week earlier there was a Leaked copy of the OXM giving GTA IV the same score.

actually tv shows do get exclusive trailers promoted to run at some point during specific shows. happens all the time. you just need to watch more tv...

So I did a search on Vareity's website and they had an exclusive interview with Morgan Spurlock on March 10'th of this year.

I find it a little ironic.

Hope Fritz doesn't read his employer's website.

Damn, that is a really good point, I never thought of it. But nobody informed is going to look at one review and decide whether to buy a game or not. There are multiple review sources, too many to be bought so to average them all together would be fair.

P.S. I don't know if that was a comment or a rant but you all caught my drift.

@tallika

That is paid advertising though, not supposed neutral-source reviews of the product in question. I think that the article writer is correct... Roger Ebert doesn't get exclusive reviews of movies... why? Because it makes no sense from multiple standpoints. The whole exclusive thing just means that the video game company can "sweeten the deal" to make the review be biased a bit more favorably to them... not saying it necessarily will happen, just that it can happen, while if multiple different sources can review the item in question, then the consumer is better informed about the product. "Exclusivity" is basically another word for propaganda.

Exclusive means nothing when it comes to reviews. They weren't the first ones to get their hands on it, they just got to post it first. Their exclusive lasted only, what, a few hours?

While in general exclusive reviews may seem bad they're a moot point. Five minutes after the exclusivity period is up everybody has posted their reviews. Not to mention the fact that these "exclusive firsts" are usually only done for highly anticipated titles, which makes their reviews not all that surprising when they do come out.

In the end, they're really no different than reporters getting exclusive interviews for a story.

It's only a problem if IGN purports to have journalistic integrity. Every journalist should have the phrase, "The appearance of impropriety is itself impropriety" seared somewhere deep into their brain. Do IGN writers claim to be either journalists or legitimate critics, or are they instead solely an enthusiast site?

@Arlen

I believe they've defended themselves as legitimate critics.

Arlen is right...journalism requires something a bit more above board then "look, everyone else gave a good review too". Also, to clarify, there is a HUGE difference between exclusive interviews, previews smf promotional trailers even in something as seemingly mindless as entertainment journalism. These are meant to peak interest and to serve the public's desire for information about a production or product. A review is provided as a guidance by the reviewer for consumers whether or not this is something that may be worth their time and/or money.

It's not a moot point that someone gets an exclusive review if you realize that a few hours is enough to drive additiional traffic to the site enough to enhance its normal figures for advertising sales. In essence, these 'exclusive' official rights given to a website or magazine publication for review comes with strings attached. If a publication receives exclusive rights and then torpedoes the game...this can happen:

http://gamepolitics.com/2008/01/09/editor-upset-with-coverage-gamecos-cu...

So, I would say that IGN has been indiscreet, and it is a concern for anyone who gives a crap about standards and integrity anymore in whatever venue.

Don't forget folks, this is coming from the writer that brought the pathetic Mario Galaxy review...sponsored by Sony...

http://nsidernews.com/mario-galaxy-review-is-the-worse-experience/

What gamers take Variety reviews seriously anyways?

its a well known fact amongst game developers that most reviews are in a round about way 'paid for' (wether that be direct or promises for more advertising revenue)

a sad fact i learned when becoming a dev.. :(

I'm glad to see people finally addressing this fact. It's extremely troubling and is something every gamer should be concerned with. I remember picking up a game magazine because they had a big preview of Mass Effect. At the beginning of the article they basically said something to the effect of, well we figured what better way to let you, the reader, learn about Mass Effect than to have the developers themselves tell you. The entire article was written by someone representing the Mass Effect development team. Worse, I didn't realize how screwed up that was until about halfway through the article. I basically paid money to see one big advertisement. Not good.

@Velvet_Llama

Welcome to the internet where you can find pretty much anything for free from numerous resources.

Sounds like someone is upset that they didn't get the exclusive that they went for...so they are throwing the dirt and pointing fingers to make everyone else look bad. Exclusive first looks are common for a LOT of things...home electronics, cars, clothes, music, etc. Why are we looking at this any different honestly? I base my trust of their integrity on the people that are doing the writing. I have not seen anything in regards to what I see that leads me to believe that they are "dirty" in any way. If I do find something that troubles me, then I will change my opinion at that point. Plus, these are people's opinions on something...no matter WHAT they say, someone will be able to say it's "twisted" in one direction or the other.

EGM is well known for doing this. They had a "World exclusive" of a few reviews. Some of their content, like talking to Capcom about Street Fighter 4, is great enough to be exclusive. But I agree that calling something "exclusive" when there are near-simultaneous occurrences of the same thing is false and misleading.

I think he has a very good point. Gamespot's recent troubles come to mind. Game reviewing in general has gotten pretty developer friendly. They give exclusives to top reviewers as long as they get good scores. If they don't give good scores, then they don't get exclusives, and soon lose their "top reviewer" status.

The ratings scale seems to be from 7 to 10 rather than 0 to 10, largely because of developers driving it with ad money on review sites and giving exclusive reviews to only favorable reviewers.

Considering past performance, I would believe GTA Rockstar is capable of making a 10 game, and I would not expect GTA to drop below 80% on any scale, so this may not be the example to use. There are plenty of others out there though.

Nowhere in the IGN review does it say "exclusive". This guy is making stuff up.

@Tristram

I totally agree. It's shady. But then, so is IGN. As a reader, as soon as you hear "exclusive review" you should be thinking "not going to read it".

While I agree with the intent of the article--should we trust exclusive reviews, especially when there's obviously money involved--I disagree with the comparison to film. The film industry uses exclusives...it's just that sometimes they aren't as overt as the gaming industry. Red Carpet Premieres involving a select group of journalists, websites like Aint It Cool receiving their exclusive reviews, etc.

It's always about money and site traffic/readership. The only difference is that a lot of times the film industry doesn't use the moniker "exclusive."

I just went on ign.com, but where is the "exclusive" review. Instead, it is just like any ordinary review for the game.

Yellow journalism plagues the video game world. This is just another example.

One should be wary of any pre-release review not only due to the publishers and developers controlling who gets the reviews, but also because content changes.

Variety is just as bad with their movie reviews though. It is sad when a comedic newspaper like The Onion is actually a better source of media reviews than a movie specific source.

I think he's taking "Exclusive Review" (or anything with the "exclusion" label) little too literally. Traffic is the name of the game when it comes to websites and what better way to get that traffic then to claim something as being exclusive. While I don't necessarily agree with IGN most of the time (the GTA4 review was the first time in a long time that I've been there), I think he's jumping the gun a bit here.

Did fansites like GTAGaming, GTA Planet and others pay or give favors to gain exclusive screenshots? I would argue no.

Can someone tell me how long Variety has kept a gaming section? I'd suggest that maybe this guy is new, but I down want to put him down in such a way if he's been there a while...

Another comment I wanted to add:

To me, this whole thing is similar to seeing three movie trailers in a row that claim to be the "Best Movie of the Year" by critics. They've gotta have a hook, and the phrase "exclusive" is one of them.

Kinda screams the "Kane and Lynch" incident.

Addendum

I was just thinking about someone saying 7-10 scale. Not true, if they pay for ad space it's more like 8-10, if they don't it's more like 1-7.

Since the retail game isn't out yet, the "reviews" and "scores" that have been published so far, and will be published tomorrow, are all subject to extremely large doses of salt. Any review of a game before its official release (and any review published on release day falls into this category) should be viewed with extreme skepticism. The code the reviewers received may not (and probably doesn't) reflect the code that you, the game buying public, will receive when you plunk down your hard-earned greenbacks for the retail box. In fact, I would be shocked if the two sets of code were even remotely similar.

@ Idonyo

Companies that review games do get advanced copies. Granted a lot of the reviews these days are very slanted.

@Barly
No, they will just cut and paste the same review and score, substituting PS3 for Xbox 360 (or vice versa).

Because games these days are made for poeple with attention spans too short to care (see:oblviion)

First off, I never trust an "perfect score." That means the game is perfect, and I have yet to see one. 9.9, 99%, yeah, but not a solid 100.

Second of all, that was the major warning that the authors of "Paid to Play" mentioned in their Journalism chapter. Game companies know you'd love that trip to the Bahamas to try out the latest FPS. They know you may need a new 360 in order to review Halo 3, so they send that Special Limited Edition.

Rockstar knew that IGN would love to boost their traffic (which has been dwindling lately). Nuff Said.

As a video game journalist, I have to agree. These practices cut out us in the smaller media outlets, especially.

----
Papa Midnight

I don't use reviews to decide my game purchasing decision anyway.

For those who are saying it's a good thing other review sites are also giving it the same score, remember these sites where also allowed to play the game in advance so that they could release the review before the game comes out.

You think Take 2 would lock them in a hotel to play the game just for these folks to give them a bad score?

I'm still buying it at midnight.
 
Forgot your password?
Username :
Password :

Shout box

You're not permitted to post shouts.
Montetrolls are just at their absolute worst when it comes to women and feminist. You could bet good money that if the developer were male the trolls would be silent and the conversation would actually focus on the journalism.10/18/2014 - 9:18pm
MontePapa: Not the first time we've had a journalism scandals before, but the harassment never got close to this level; the difference with this scandal is that feminists are involved. Without the feminist angle, their would be A LOT less harrassment10/18/2014 - 9:15pm
Papa MidnightMonte: That's honestly rather short-sighted. As has been proven with other persons who have been targeted, if it wasn't Quinn, it would be someone else.10/18/2014 - 6:26pm
AvalongodI think that's part of what gives an esoteric news story like this real life...it taps into a larger narrative about misogyny in society outside of games.10/18/2014 - 3:29pm
Avalongod@Monte, well the trolls made death threats that came to police (and media attention). I think this is tapping into a larger issue outside of games about how women are treated in society (like all the "real rape" stuff during the last election)10/18/2014 - 3:28pm
WonderkarpZippy : Havent tried the PS4 controller. might later.10/18/2014 - 2:37pm
MonteSeirously, If Quinn was not involved and GG was instead about something like the Mordor Marketing contracts, the trolling would have never grown so vile and disgusting. There have been plenty of movements in the past that never sufferred from behavior..10/18/2014 - 1:57pm
MonteWe have seen scandel's before but the trolling has never been as vile as what we see with GG. Trolls usually have such a tiny voice you can barely notice them, but its like moths to a flame whenever femistist are involved.10/18/2014 - 1:53pm
ZippyDSMleeWonderkarp: You might be able to if you had a PS4 controller.10/18/2014 - 1:00pm
MaskedPixelantehttp://store.steampowered.com/app/327940/ Night Dive starts charging for freeware.10/18/2014 - 12:21pm
Matthew Wilsonthe sad thing is there are trolls on both sides of this. people need to stop acting like their side is so pure.10/18/2014 - 12:19pm
MechaTama31So, only speak out on a scandal that hasn't attracted trolls? I wouldn't hold my breath...10/18/2014 - 10:49am
MonteI feel like GG just needs to die. The movement is FAR to tainted by hatred and BS for it to be useful for any conversation. Let GG die, and then rally behind the NEXT gaming journalism scandal, and start the conversation fresh.10/18/2014 - 10:33am
quiknkoldand we dont have a Dovakin to call a cease fire10/17/2014 - 7:37pm
quiknkoldThe whole thing is Futile. Both sides are so buried deep in their trenchs that there isnt a conversation. Its just Finger Pointing, Name Calling, Doxxing, Threats. there needs to be a serious conversation, and GG isnt it.10/17/2014 - 7:37pm
quiknkoldI thought it was a good article. Jeff is right. I feel like GamerGate did destroy its message. I am for Ethics in game journalism, but man. so much hate. and its on both sides. I've seen some awful stuff spewed on twitter. Its a big reason why I exited..10/17/2014 - 7:34pm
Matthew Wilsonwhile he focused on gg, he did call out both sides crap.10/17/2014 - 7:18pm
Papa MidnightThat was a damn good read offered by Jeff Gertsmann.10/17/2014 - 7:17pm
Matthew Wilsonhttp://www.giantbomb.com/articles/letter-from-the-editor-10-17-2014/1100-5049/ deferentially a nice write up.10/17/2014 - 6:44pm
james_fudgeI think Evan killed it. He's a great guy and super smart.10/17/2014 - 6:38pm
 

Be Heard - Contact Your Politician