Academic journal article Journal of Electronic Commerce Research

The Reliability of Online Review Helpfulness

Academic journal article Journal of Electronic Commerce Research

The Reliability of Online Review Helpfulness

Article excerpt

1. Introduction

User-generated online reviews (online reviews hereafter) are becoming an essential component of B2C ecommerce. Online reviews mainly serve two functions in electronic commerce. One is to help online shoppers evaluate products and services before making purchase decisions [Park, Lee et al. 2007]. The other is informant [Clemons, Gao et al. 2006], which allows consumers to become familiar with a product or service even though they do not have an immediate intent to purchase [Chen and Xie 2008]. Online reviews can offer important value to customers [Mudambi and Schuff 2010]. Empirical studies done in the past ten years report that popular reviews have strong influences not only on commodities [Zhu and Zhang 2010] and new products [Cui, Lui et al. 2012] but also on services [Ye, Law et al. 2011].

Amazon.com revolutionized many online review features to enhance consumers' shopping experiences. For example, once a new online review has been posted and read by a registered shopper, the shopper can vote on its helpfulness by simply clicking the Yes or No button under the review content. The aggregated number of Yes vote and total votes a review received are then updated and displayed at the top of the review content as an indicator of helpfulness.

Based on the aggregated helpfulness votes a review receives, amazon.com could use its proprietary computer algorithms to automatically rank and sort out those most helpful reviews and feature them at the top of the review section. This simple feature seems very helpful when the number of reviews keeps increasing and consumers feel difficult to go through even a small percentage of them. Shoppers could then spend their limited product-research time on the most helpful ones to avoid information overload [Maes 1994]. Gradually, because of the market share and influence of amazon.com, this voting-for-helpfulness feature was not only being adopted by many other online retailers, but also being utilized by many researchers as a de facto review quality standard [Mudambi and Schuff 2010, Ghose and Ipeirotis 2011, Korfiatis, García-Bariocanal et al. 2012].

Helpfulness votes are important to help consumers on product research and making purchase decisions. It also serves as a benchmark for academic studies on online review. So understanding their reliability and resistance to manipulation could help us better utilize this feature. Several studies already identified bias in online reviews [Li and Hitt 2008, Kapoor and Piramuthu 2009, Cui, Lui et al. 2012, Purnawirawan, Dens et al. 2012]. The voting for helpfulness of reviews may also suffer from similar or related biases. We need to explore the impact of such bias on the helpfulness rating outcomes.

In addition to bias, there are increasing concerns about the review manipulation by interested parties like product manufacturers. Ordinary consumers may not be aware of online review manipulation but such practices were observed by both small businesses owners, like those listed on Yelp.com [Banks 2013], and researchers as reflected in recent studies [Mukherjee, Liu et al. 2012]. In September 2013, a few online review-rigging firms have been persecuted by the Court of New York State [Chappell 2013], which became the first law punishment on such practice. Since online review manipulations have strong financial incentive and were being systematically conducted, it is reasonable to suspect those firms to boost or bust certain reviews or to manipulate the helpfulness vote, which makes the helpfulness ratings unreliable. On the other hand, voting for helpfulness is a crowdsourcing continuous process. An online review-rigging firm may be able to manipulate the helpfulness votes for a product temporarily but it may not be economically viable to do so in the long term, especially for those products receiving votes continuously. So a helpfulness rating may self-correct such manipulation gradually.

In whichever case, the most helpful reviews featured for popular products on amazon. …

Search by... Author
Show... All Results Primary Sources Peer-reviewed

Oops!

An unknown error has occurred. Please click the button below to reload the page. If the problem persists, please try again in a little while.