The Hotness
Games|People|Company
Dominion: Dark Ages
Total War
Mage Knight: Board Game
Fantastiqa
Libertalia
The Lord of the Rings: Nazgul
Descent: Journeys in the Dark (Second Edition)
Eclipse
Mice and Mystics
Doctor Who: The Card Game
Lords of Waterdeep
Star Wars: X-Wing Miniatures Game
Agricola: All Creatures Big and Small
Dungeon Fighter
Android: Netrunner
Virgin Queen
A Game of Thrones: The Board Game (Second Edition)
Glory to Rome
Infiltration
Collapsible D: The Final Minutes of the Titanic
Dominion
The Lord of the Rings: The Card Game
Twilight Struggle
City of Horror
Snowdonia
1989: Dawn of Freedom
Goa
Sherlock Holmes Consulting Detective
Agricola
Among the Stars
7 Wonders: Cities
7 Wonders
The Swarm
Through the Ages: A Story of Civilization
Arkham Horror
Village
Ora et Labora
Battles of Westeros: House Baratheon Army Expansion
Race for the Galaxy
War of the Ring
Trajan
Kingdom Builder
The Castles of Burgundy
Zombicide
Twilight Imperium (third edition)
Space Alert
Dungeon Command: Sting of Lolth
Hacienda
Battlestar Galactica
Ground Floor

Mining the Geek

Discussion about methods for gathering data from BGG, ideas of what you might look for, and interesting results found. There's an amazing wealth of data here on BGG, and a lot of really interesting ways to look at it.
Recommend
57 
 Thumb up
 tip
 Thumb up

Games with bogus/stacked/fake ratings

Alex Wilson
Canada
Waterloo
Ontario
Generally speaking, things have gone about as far as they can possibly go, when things have gotten about as bad as they can reasonably get.
Avatar
mbmbmbmbmb
I was going to post a list of games with the highest percentage of their ratings being a user's top rating, but found the list rather contaminated. This calculation was really simple: Go through each user's ratings (in this case, all the ratings of the top 7500 games), and if the game was the user's top rating given, then give that game a point. In the case of a user having more than one game with the same top score, each game gets a fraction. The points awarded are divided by the number of total ratings (of any value), so you get an idea of which games have the higher proportion of getting someone's top score.

First run of the data, and the number one game is:
90°
Have a look at the ratings, and I think it pretty obvious things are off - lot of users giving it a 10, and if you check their profile you find they only have that one game rated.

Next on the list is:
Good Help
There's a few users rating it 10 that seem much more legitimate, but still a number of single-rating users.

Number 3:
Orbit: Rocket Race 5000
At least they seemed to put effort into comment the ratings, but there's still a bunch of single-rating users -- comments made in clumps on the same day seem fishy, too.

Sigh... okay, let's filter the ratings set so it only contains users with 10 or more ratings and see what we get. The new number one:

My Little Pony Hide & Seek

Okay, at least this one makes sense given the pony shenanigans -- a lot of users with real rating sets.

Next:
War of the Ring Collector's Edition
This makes sense.

Third:
Puerto Rico: Limited Anniversary Edition
Okay.

Fourth:
Champions of the Galaxy
Huh? It's got some suspect single ratings, but 19 of them get filtered out with the 10 minimum. But it's got 3 people with large sets that rate it their sole 10, and 7 others who rate it highest along with others. Alrighty.

Fifth:
Strike of the Eagle
Cool. This is the sort of thing I was hoping I would see -- things I haven't heard of, but looking at the ratings and reviews, seem genuinely loved.

Sixth:
RPGQuest: Greek Mythology
Another potential problem. All 4 of the RPGQuest items are ranked really high in this list. There's a number of users that get filtered out, but still enough with other ratings. Is it bogus? Or is there a limited selection of of Brazilian games and this one deserves the score from its fans? Some of the collection look rather random, but I just skimmed them.

Now I'm trying to figure out if filtering on a minimum rating count (like 100, after the <10 ratings users are removed) might give more useful results. There are some really interesting games that seem to be coming up -- like Doctor Who: Solitaire Story Game, and I don't want to filter out less popular (but deserving) titles as a side-effect of purging the bogus ratings.

--edit

Geeklist up now! I ended up just filtering the single-vote users and kept it to games with more than 50 ratings -- check it out and see the top 100 most-loved games!
Twitter Facebook
17 Comments
Subscribe sub options Wed Nov 30, 2011 6:31 pm
Post Comment
Dany Majard
United States
Manhattan
Kansas
Avatar
mbmbmbmbmb
I really enjoy reading your work !
1 
 Thumb up
 tip
 Thumb up
  • Posted Wed Nov 30, 2011 6:41 pm
    • Choose your Dice
      • Roll
      • Comment (Optional)
    • Reply
    •  
    • Quote
Rob Rob
United States
La Mesa
California
Avatar
mbmbmbmbmb
You probably could also try and filter out those all to frequent perfect 10 ratings for games that haven't even been released yet! shake
3 
 Thumb up
 tip
 Thumb up
  • Posted Wed Nov 30, 2011 6:45 pm
    • Choose your Dice
      • Roll
      • Comment (Optional)
    • Reply
    •  
    • Quote
Alex Wilson
Canada
Waterloo
Ontario
Generally speaking, things have gone about as far as they can possibly go, when things have gotten about as bad as they can reasonably get.
Avatar
mbmbmbmbmb
Robrob wrote:
You probably could also try and filter out those all to frequent perfect 10 ratings for games that haven't even been released yet! shake


Most of those don't make the "BGG top 7500" list, I think, so they aren't an issue.

Right now filtering out single-rating users and games with less than 50 ratings total seems to be giving some good results -- more "hidden gems"!
1 
 Thumb up
 tip
 Thumb up
  • Posted Wed Nov 30, 2011 7:05 pm
    • Choose your Dice
      • Roll
      • Comment (Optional)
    • Reply
    •  
    • Quote
simon cogan
United Kingdom

designer
Avatar
mbmbmbmbmb
Glad you think my Doctor Who game is interesting.

You could always rate it for me!

Simon
Designer - DWSSG
9 
 Thumb up
 tip
 Thumb up
  • Posted Wed Nov 30, 2011 7:40 pm
    • Choose your Dice
      • Roll
      • Comment (Optional)
    • Reply
    •  
    • Quote
Steve Mackenzie
United Kingdom

Avatar
mbmbmbmbmb
angramainyu wrote:

Right now filtering out single-rating users and games with less than 50 ratings total seems to be giving some good results -- more "hidden gems"!


I will vouch for Doctor Who: Solitaire Story Game being a gem! As a legit rater of the game (I have plenty of other ratings) I'm happy to say it is one of my two most favourite games. Like Strike of the Eagle you mention above, DWSSG has an active and loyal fan base and the game is genuinely loved and enjoyed. The work and passion that goes into improving it and releasing expansions is incredible.

A fantastic idea for a blog, Alex! Let's hope your work draws attention to even more 'hidden gems' with a rightful place high up the BGG rankings!
2 
 Thumb up
 tip
 Thumb up
  • Posted Wed Nov 30, 2011 9:14 pm
    • Choose your Dice
      • Roll
      • Comment (Optional)
    • Reply
    •  
    • Quote
Alex Wilson
Canada
Waterloo
Ontario
Generally speaking, things have gone about as far as they can possibly go, when things have gotten about as bad as they can reasonably get.
Avatar
mbmbmbmbmb
dragoncymru wrote:
Glad you think my Doctor Who game is interesting.

You could always rate it for me!

Simon
Designer - DWSSG


I'd heard good things about it before -- so it was nice to be reminded of it by the list! I certainly plan on checking it out. When I did the first run while debugging on the set of 2500 games, DWSSG came out number one
3 
 Thumb up
 tip
 Thumb up
  • Edited Wed Nov 30, 2011 10:00 pm
  • Posted Wed Nov 30, 2011 9:59 pm
    • Choose your Dice
      • Roll
      • Comment (Optional)
    • Reply
    •  
    • Quote
Dominic Crapuchettes
United States
Bethesda
MD
designer
publisher
This overtext is brought to you by the abstract strategy game Battle of LITS and the number 20.
badge
Avatar
mbmbmbmbmb
Please don't bring up ponygeddon again. Thanks for your consideration.
9 
 Thumb up
 tip
 Thumb up
  • Posted Thu Dec 1, 2011 5:26 am
    • Choose your Dice
      • Roll
      • Comment (Optional)
    • Reply
    •  
    • Quote
Fenômeno
United States
Fitchburg
Wisconsin
Button Soccer
Avatar
mbmbmbmbmb
Cool work. I don't think it can be fixed this way. The miners could just rate as many games as necessary to overcome the threshold and then rate their target a 10.
 
 Thumb up
 tip
 Thumb up
  • Posted Mon Dec 5, 2011 11:58 am
    • Choose your Dice
      • Roll
      • Comment (Optional)
    • Reply
    •  
    • Quote
Alex Wilson
Canada
Waterloo
Ontario
Generally speaking, things have gone about as far as they can possibly go, when things have gotten about as bad as they can reasonably get.
Avatar
mbmbmbmbmb
Ronaldo wrote:
Cool work. I don't think it can be fixed this way. The miners could just rate as many games as necessary to overcome the threshold and then rate their target a 10.


Detecting cheaters (whether is fake game ratings here, spambots on blogs, or whatever) is always an arms race. It's much more a matter of defining what level of fraud is acceptable (in this case, one that doesn't give too many skewed results vs. how many "real" results you are getting false positives on), and how costly (in terms of time and/or effort) you make it for cheaters to get around the system.
2 
 Thumb up
 tip
 Thumb up
  • Posted Mon Dec 5, 2011 2:14 pm
    • Choose your Dice
      • Roll
      • Comment (Optional)
    • Reply
    •  
    • Quote
Luke Morris
United States
Eugene
Missouri
mbmbmbmbmb
What's wrong with Champions of the Galaxy? I love that game and I probably have conversed with most of the guys that had given ratings here at BGG.
 
 Thumb up
 tip
 Thumb up
  • Posted Fri Dec 16, 2011 4:15 am
    • Choose your Dice
      • Roll
      • Comment (Optional)
    • Reply
    •  
    • Quote
Yoki Erdtman
Sweden
Södertälje
flag msg tools
Handsome devil huh?
Avatar
mbmbmbmbmb
In regards to Champions of the Galaxy it is a highly popular game with a lot of people playing it almost exclusively, and has developed into a sort of hobby on its own. I think a lot of those 10 ratings are due to a link from the publisher's web site and game forum to register on BGG and rate that game.
 
 Thumb up
 tip
 Thumb up
  • Posted Tue Dec 20, 2011 2:48 am
    • Choose your Dice
      • Roll
      • Comment (Optional)
    • Reply
    •  
    • Quote
Alex Wilson
Canada
Waterloo
Ontario
Generally speaking, things have gone about as far as they can possibly go, when things have gotten about as bad as they can reasonably get.
Avatar
mbmbmbmbmb
Yokiboy wrote:
In regards to Champions of the Galaxy it is a highly popular game with a lot of people playing it almost exclusively, and has developed into a sort of hobby on its own. I think a lot of those 10 ratings are due to a link from the publisher's web site and game forum to register on BGG and rate that game.


That sort of thing certainly adds to the confusion and difficulty of sorting the real from bogus ratings. It might be a great game, but seems like it might not deserve such high scores if fairly compared to other games -- it's hard to put much stock in the one-rating raters.
2 
 Thumb up
 tip
 Thumb up
  • Posted Tue Dec 20, 2011 2:55 am
    • Choose your Dice
      • Roll
      • Comment (Optional)
    • Reply
    •  
    • Quote
Rob Rob
United States
La Mesa
California
Avatar
mbmbmbmbmb
Yokiboy wrote:
I think a lot of those 10 ratings are due to a link from the publisher's web site and game forum to register on BGG and rate that game.

We've seen that before. It tends to produce lots of (probably genuine) "10" ratings from people with new accounts and no other ratings. In the short run it will skew the ratings but I suspect in the long run it will all even out.
1 
 Thumb up
 tip
 Thumb up
  • Posted Tue Dec 20, 2011 3:13 am
    • Choose your Dice
      • Roll
      • Comment (Optional)
    • Reply
    •  
    • Quote
John McD
Scotland

Avatar
mbmbmbmbmb
I found this Geeklist because I was reading up on Strike of the Eagle. I saw it was on a list with this title and was worried that there was something fishy behind the score, but it seems there isn't.

Maybe the list could be titled differently. Right now, it looks like being on the list means the game has shill votes but I don't think that's really the intent.
1 
 Thumb up
 tip
 Thumb up
  • Posted Sun Jan 22, 2012 9:42 pm
    • Choose your Dice
      • Roll
      • Comment (Optional)
    • Reply
    •  
    • Quote
Luke Morris
United States
Eugene
Missouri
mbmbmbmbmb
angramainyu wrote:
Yokiboy wrote:
In regards to Champions of the Galaxy it is a highly popular game with a lot of people playing it almost exclusively, and has developed into a sort of hobby on its own. I think a lot of those 10 ratings are due to a link from the publisher's web site and game forum to register on BGG and rate that game.


That sort of thing certainly adds to the confusion and difficulty of sorting the real from bogus ratings. It might be a great game, but seems like it might not deserve such high scores if fairly compared to other games -- it's hard to put much stock in the one-rating raters.


Well I think it is hard to discredit those single ratings as well. Maybe out of all the games they've played it has been the only one that has appealed to them. I know I haven't rated many games and really only rate games I care about. Just another possibility.
 
 Thumb up
 tip
 Thumb up
  • Posted Tue Jan 24, 2012 6:59 am
    • Choose your Dice
      • Roll
      • Comment (Optional)
    • Reply
    •  
    • Quote
Rob Rob
United States
La Mesa
California
Avatar
mbmbmbmbmb
MrBeefy84 wrote:
Well I think it is hard to discredit those single ratings as well. Maybe out of all the games they've played it has been the only one that has appealed to them. I know I haven't rated many games and really only rate games I care about. Just another possibility.

I suspect it's something that will even out as more ratings are added.
 
 Thumb up
 tip
 Thumb up
  • Posted Tue Jan 24, 2012 6:49 pm
    • Choose your Dice
      • Roll
      • Comment (Optional)
    • Reply
    •  
    • Quote
Todd Davis
United States

New Mexico
You should also filter out the ratings posted by the designers, publishers, and artists on their own games.

A lot of designers rate their own game - imagine that!! They rate their game a '10'.
 
 Thumb up
 tip
 Thumb up
  • Edited Wed Jan 25, 2012 3:38 pm
  • Posted Wed Jan 25, 2012 3:37 pm
    • Choose your Dice
      • Roll
      • Comment (Optional)
    • Reply
    •  
    • Quote

Subscribe

Categories

Contributors

Front Page | Welcome | Contact | Privacy Policy | Terms of Service | Advertise | Support BGG | Feeds RSS
Geekdo, BoardGameGeek, the Geekdo logo, and the BoardGameGeek logo are trademarks of BoardGameGeek, LLC.