Saturday, September 23, 2017

Little Correlation Between Box Office and Film Quality

[Added later: this post was prophetic. The Blade Runner sequel (2049) came out two weeks later and as I'm adding this comment, has been out for a few days. There couldn't be a better illustration of this principle. Reviews from critics and moviegoers alike are extremely positive (including my own here - major spoilers) yet it's underperforming even its modest first-weekend projections. Whether or not word of mouth will increase revenues, it's certainly following in the footsteps of its predecessor, a classic which was initially written off as a box office failure. Movie studio stocks have plummeted as investors realized: even if you make a movie this good, in this day and age, you can't make back your initial investment, and maybe movies are dead as a commercial project, especially relative to video games (see end of linked post).]

I'd been wanting to do an analysis like this for some time. Fortunately a professional (Yves Bergquust at USC) has beaten me to it. It's worth reading the whole article because it's loaded with quantitative analysis of the American film industry, but the upshot for our purpose is that there is no correlation between quality (Rotten Tomatoes rating) and box office.

This reinforces the studios' disinterest, judging by their output and stated explicitly when they're speaking honestly, in making "critically-acclaimed award bait." As with most entertainment, Hollywood doesn't know much about what results in success, but they DO know that spending effort or money on making a good movie has no connection to financial success. Given the medium, that's critically important. A failed experimental painting or short story wastes a few days and dollars of a single person's resources. But movies are intense, multi-million dollar temporary startups. You MUST consider ROI.

To that end, I was also interested to see if budget or ROI are related to quality, and it turns out they are - but of course based on the non-relationship discussed above, that doesn't mean big budget equals big box office. And, bad news for Hollywood, what budget-box office relationship DOES exist is getting weaker over time - which is disastrous, because that means they can't predict ROI anymore.

I'd also like to see if total take (not just box office, also including back-end, ie video) has any better relationship to quality. Cult films that develop a following long after they leave theaters suggest that if there is a profit-quality signal, it would be more likely to emerge using the total take. I would also assume that as distribution channels have multiplied, that box office is less important as a fraction and predictor of overall revenue.

2 comments:

Anonymous said...

"there is no correlation between quality (Rotten Tomatoes rating) and box office"
what if the problem is that there is no correlation between quality and media-rating (Rotten Tomatoes rating)?

I ask this because it was not specified if the rating from Rotten Tomatoes was taken from critics or viewers. Since in recent years what is clear is that there is a divergence between what critic claims to be a good movie and what viewers actually think (too much politics inside critics and movies??).

As examples of the previous idea: Ghostbusters (the new one), last two Star Wars movies. The critics were charmed by those movies and said that they were going to break new records. The viewers were disappointed and the box office numbers were horrible (in some of them compared with expected sales and compared to to previous movies of the sagas).

Michael Caton said...

Your point is a good one, how do we know what the "true" quality is? We don't, we only know what different groups of people like. Like you I find the divergence between the broader public and paid critics to be interesting. So yes, it's possible for there to be a correlation between box office and broad audience perception of quality, as long as there isn't much correlation between broad audience and Rotten Tomatoes. My suspicion is there still won't be much correlation in either case, because box office is more about strength and intensity of marketing.