Mining the Geek

Discussion about methods for gathering data from BGG, ideas of what you might look for, and interesting results found. There's an amazing wealth of data here on BGG, and a lot of really interesting ways to look at it.
 Thumb up

Games with bogus/stacked/fake ratings

Alex Wilson
flag msg tools
Generally speaking, things have gone about as far as they can possibly go, when things have gotten about as bad as they can reasonably get.
I was going to post a list of games with the highest percentage of their ratings being a user's top rating, but found the list rather contaminated. This calculation was really simple: Go through each user's ratings (in this case, all the ratings of the top 7500 games), and if the game was the user's top rating given, then give that game a point. In the case of a user having more than one game with the same top score, each game gets a fraction. The points awarded are divided by the number of total ratings (of any value), so you get an idea of which games have the higher proportion of getting someone's top score.

First run of the data, and the number one game is:
Have a look at the ratings, and I think it pretty obvious things are off - lot of users giving it a 10, and if you check their profile you find they only have that one game rated.

Next on the list is:
Good Help
There's a few users rating it 10 that seem much more legitimate, but still a number of single-rating users.

Number 3:
At least they seemed to put effort into comment the ratings, but there's still a bunch of single-rating users -- comments made in clumps on the same day seem fishy, too.

Sigh... okay, let's filter the ratings set so it only contains users with 10 or more ratings and see what we get. The new number one:

My Little Pony Hide & Seek

Okay, at least this one makes sense given the pony shenanigans -- a lot of users with real rating sets.

War of the Ring Collector's Edition
This makes sense.

Puerto Rico: Limited Anniversary Edition

Champions of the Galaxy
Huh? It's got some suspect single ratings, but 19 of them get filtered out with the 10 minimum. But it's got 3 people with large sets that rate it their sole 10, and 7 others who rate it highest along with others. Alrighty.

Strike of the Eagle
Cool. This is the sort of thing I was hoping I would see -- things I haven't heard of, but looking at the ratings and reviews, seem genuinely loved.

RPGQuest: Greek Mythology
Another potential problem. All 4 of the RPGQuest items are ranked really high in this list. There's a number of users that get filtered out, but still enough with other ratings. Is it bogus? Or is there a limited selection of of Brazilian games and this one deserves the score from its fans? Some of the collection look rather random, but I just skimmed them.

Now I'm trying to figure out if filtering on a minimum rating count (like 100, after the <10 ratings users are removed) might give more useful results. There are some really interesting games that seem to be coming up -- like Doctor Who: Solitaire Story Game, and I don't want to filter out less popular (but deserving) titles as a side-effect of purging the bogus ratings.


Geeklist up now! I ended up just filtering the single-vote users and kept it to games with more than 50 ratings -- check it out and see the top 100 most-loved games!
Twitter Facebook
Subscribe sub options Wed Nov 30, 2011 6:31 pm
Post Rolls
  • [+] Dice rolls
Loading... | Locked Hide Show Unlock Lock Comment     View Previous {{limitCount(numprevitems_calculated,commentParams.showcount)}} 1 « Pg. {{commentParams.pageid}} » {{data.config.endpage}}
    View More Comments {{limitCount(numnextitems_calculated,commentParams.showcount)}} / {{numnextitems_calculated}} 1 « Pg. {{commentParams.pageid}} » {{data.config.endpage}}




Front Page | Welcome | Contact | Privacy Policy | Terms of Service | Advertise | Support BGG | Feeds RSS
Geekdo, BoardGameGeek, the Geekdo logo, and the BoardGameGeek logo are trademarks of BoardGameGeek, LLC.