Finding the Wise and the Wisdom in a Crowd: Estimating Underlying Qualities of Reviewers and Items
dc.rights.license | open | en_US |
dc.contributor.author | CARAYOL, Nicolas
IDREF: 059775874 | |
dc.contributor.author | JACKSON, Matthew O. | |
dc.date.accessioned | 2024-07-02T14:59:53Z | |
dc.date.available | 2024-07-02T14:59:53Z | |
dc.date.issued | 2024-05-24 | |
dc.identifier.issn | 0013-0133 | en_US |
dc.identifier.uri | oai:crossref.org:10.1093/ej/ueae045 | |
dc.identifier.uri | https://oskar-bordeaux.fr/handle/20.500.12278/200710 | |
dc.description.abstractEn | Abstract Consumers, businesses, and organizations rely on others’ ratings of items when making choices. However, individual reviewers vary in their accuracy and some are biased – either systematically over- or under-rating items relative to others’ tastes, or even deliberately distorting a rating. We describe how to process ratings by a group of reviewers over a set of items and evaluate the individual reviewers’ accuracies and biases, in a way that yields unbiased and consistent estimates of the items’ true qualities. We provide Monte Carlo simulations that showcase the added value of our technique even with small data sets, and we show that this improvement increases as the number of items increases. Revisiting the famous 1976 wine tasting that compared Californian and Bordeaux wines, accounting for the substantial variation in reviewers’ biases and accuracies results in a ranking that differs from the original average rating. We also illustrate the power of this methodology with an application to more than forty-five thousand ratings of “en primeur” Bordeaux fine wines by expert critics. Those data show that our estimated wine qualities significantly predict prices when controlling for prominent experts’ ratings and numerous fixed effects. We also find that the elasticity of a wine price in an expert’s ratings increases with that expert’s accuracy. | |
dc.language.iso | EN | en_US |
dc.source | crossref | |
dc.subject | Ratings | |
dc.subject | Reviews | |
dc.subject | Qualities | |
dc.subject | Scoring | |
dc.subject | Aggregating Ratings | |
dc.subject | Wine Ratings | |
dc.title.en | Finding the Wise and the Wisdom in a Crowd: Estimating Underlying Qualities of Reviewers and Items | |
dc.type | Article de revue | en_US |
dc.identifier.doi | 10.1093/ej/ueae045 | en_US |
dc.subject.hal | Sciences de l'Homme et Société/Economies et finances | en_US |
dc.subject.jel | D - Microeconomics | en_US |
bordeaux.journal | The Economic Journal | en_US |
bordeaux.hal.laboratories | Bordeaux Sciences Economiques / Bordeaux School of Economics (BSE) - UMR 6060 | en_US |
bordeaux.institution | Université de Bordeaux | en_US |
bordeaux.institution | CNRS | en_US |
bordeaux.institution | INRAE | en_US |
bordeaux.peerReviewed | oui | en_US |
bordeaux.inpress | non | en_US |
bordeaux.import.source | dissemin | |
hal.description.error | <?xml version="1.0" encoding="utf-8"?> <sword:error xmlns:sword="http://purl.org/net/sword/error/" xmlns="http://www.w3.org/2005/Atom" href="http://purl.org/net/sword/error/ErrorBadRequest"> <title>ERROR</title> <updated>2024-07-03T01:04:08+02:00</updated> <author> <name>HAL SWORD API Server</name> </author> <source> <generator uri="https://api.archives-ouvertes.fr/sword" version="1.0">hal@ccsd.cnrs.fr</generator> </source> <summary>Some parameters sent with the request were not understood</summary> <sword:treatment>processing failed</sword:treatment> <sword:verboseDescription>{"author":["Au moins 1 auteur doit \u00eatre affili\u00e9"]}</sword:verboseDescription> <link rel="alternate" href="https://api.archives-ouvertes.fr" type="text/html"/> </sword:error> | |
hal.popular | non | en_US |
hal.audience | Internationale | en_US |
hal.export | true | |
workflow.import.source | dissemin | |
dc.rights.cc | Pas de Licence CC | en_US |
bordeaux.COinS | ctx_ver=Z39.88-2004&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.jtitle=The%20Economic%20Journal&rft.date=2024-05-24&rft.eissn=0013-0133&rft.issn=0013-0133&rft.au=CARAYOL,%20Nicolas&JACKSON,%20Matthew%20O.&rft.genre=article |
Files in this item
Files | Size | Format | View |
---|---|---|---|
There are no files associated with this item. |