The Skinner Box – How Games Condition People to Play More – Extra Credits

Published by Jan Heaney on

The Skinner Box – How Games Condition People to Play More – Extra Credits


In the early 1930s a man named Burrhus Frederic Skinner began to study psychology in a radical new way. See, before him we only knew how to condition reactions; we could condition a person to be terrified of pumpkins or hungry at the sight of office supplies. But Skinner theorized that you could go
one further. He theorized that you could condition volition—that you could change the way that people make choices So why are we talking about it? Because a vast number of today’s games are built upon Skinner’s discoveries, and it’s starting to become a bad habit. But, before I get ahead of myself, let’s take a closer look at what Skinner did. Skinner created a machine: a simple box with a button in it that he would put pigeons in. When the pigeons pecked at the button the machine would give them food. He then hooked the box up to a recording device so he could tell how often the pigeons pecked the button. Seems simple enough, so: why was this so groundbreaking? Because pecking the button is active. This wasn’t just an automatic reaction to stimuli, it involved making a decision. So if Skinner could show that he could consistently change how often the pigeons peck the button, he could show that he could condition them to make a specific choice. This is called operant conditioning. Now there were two amazing parts to his findings. One, operant conditioning works on humans. Two, simply rewarding someone every time they do an action isn’t the best way to keep them continually doing that action. Rather, if you provide a reward to a person after they perform the action a random number of times, or only give a reward once every so many minutes, these methods are far more effective at conditioning someone to repeat an action. Skinner often talked about operant conditioning in terms of gambling. Most gambling games are not rigged in the gambler’s favor and, oddly enough, most gamblers are well aware of this, and yet they continue to gamble rather than perform an equally strenuous job that has a regular pay out with a higher net profit. Consider which activity people will tell you is more fun: spending eight hours in a casino playing the slots and ending up with a hundred bucks, or pushing a button in a factory for eight hours and getting a paycheck for a hundred bucks at the end. This is all compounded by another discovery of Skinner’s research: he demonstrated that primary conditioners, or rewards that are fundamental biological needs— you know: food water sex etc.—have a diminishing effect once a person reaches “satiation,” or the biological limit of their needs. But then there are secondary reinforcers: things outside the biological realm, like money or social approbation. These things generally don’t hit a satiation point. You can probably see where we’re going with this. Many of you have played Farmville or World of Warcraft well past the point where it was fun. Why? Because those games are very clearly built around reward schedules. The entire design of both of those games is to condition you to continue to repeat an action that has long since lost its
novelty— that has long since become tedious. Actually, before we continue: quick
disclaimer. Being conditioned to do an action and being addicted to something are very different. We’re not gonna go into the addiction thing today but I just wanted to acknowledge the difference. All we’re going to talk about today is
how games can condition us. Okay, disclaimer over. So why is it a problem if games do this? For now let’s ignore the questionable morality of using Skinner’s theories to create games. The problem is that it’s a lazy and cheap way to get someone to believe they’re enjoying your product. Have you ever finished a game and then
looked back a few weeks later and thought, “What the hell was I doing putting 80 hours of my life into that? That usually happens because the game
used Skinner’s techniques to create the illusion of engagement and extend playtime. RPGs, especially poorly-made ones, are a great example of this. Everything from loot drops to leveling is a very clear reward schedule that reinforces the behavior that gets you the
reward. ever been playing late and getting sleepy but then decide that you’re going to get just one more level before you go to bed Yep. But this isn’t just an RPG problem,
it’s endemic. Almost anything with points uses this system. Ask your grandmother sometime why she plays so much Bejeweled. But it goes beyond points, too. It works with anything that has a clear and manifest reward. Solitaire the most played game in the
world sets up the infrequent win as a clear reward Many action games use the same system to convince players to mash the same buttons for 12 hours straight. Even elements like the voiceovers in shooters that tell the player how awesome they are can be used as conditioning tools. It’s also one of the main reasons every game is getting RPG elements these days. Now don’t get me wrong, there’s nothing
wrong with adding RPG elements if it’s being used to create deep immersive
systems for the game. I’m actually a huge fan of this trend
when it’s used to combine mental challenges and execution challenges like in Call of Duty or Dungeon Fighter. But too many games are using RPG elements as a crutch. Bland uninspired games will include reward systems simply to delay your realization of how terrible they are. My point is there are other better ways of fostering engagement, and those are the methods we should be demanding from our games, not simple Skinner box satisfaction. Here are a few examples. 1. Mystery. Human curiosity is a powerful thing. We like unraveling mysteries. We’ve all played a game that made us ask “what the hell’s going on?” immediately followed by “I want to keep going to find out.” 2. Mastery. The player can be engaged by giving him the opportunity to master a skill, and then utilize that mastery. You see this sort of thing in rhythm games fighting games sometimes even RPGs. This one’s a little tougher to execute
in traditional games but we already kind of talked about this in our easy games episode, so: moving on! 3. Mental Challenge. Oddly enough most of us don’t actually get enough mental stimulation in a day. From the thought problems in Professor Layton or Myst to the logic stomping of a Civ game. Giving players a way to work their brains is a great way to keep people interested. 4. Narrative. You ever get lost in a world? Continued playing a game just because it was a place you wanted to be? This, as well as linear story narrative, is a great way to engage players. 5. Novelty. This one’s hard to maintain but: human
beings like new things. We’re engaged by novelty. This is why brown shooters may wear thin but Planescape doesn’t. 6. Flow. Games like “everyday shooter,” N₂O or even a really good session of the original Alien vs Predator can bring a player to a sort of Zen trance. We’ve all been there at one point or
another. Your eyes enter soft focus, your blinking slows, your breathing becomes incredibly regular, and you’re just doing. There is no controller; you and the screen are one. You’ve stopped thinking in the ordinary sense of cognition and instead are working on some much deeper level. This is very hard to design for. It basically involves creating rhythm within play, and then slowly demanding the player to start performing actions faster, and faster, building momentum until they’re performing the actions faster than they could possibly think through them. It’s hard to pull this off as a designer but achieving this experience is deeply compelling in a game. Now this is just a small set of non-conditioning ways to make games fun, and no good game relies strictly on one; most of your favorites combine many of these elements. So to all designers and future designers out there: we have to get away from this increased reliance on Skinner box methods of compelling gamers to play our games. Engagement and compulsion are different things. Just because you can make an experience compelling doesn’t make it a good game. Well, thanks for watching! See you next
week.


100 Comments

Cat? I Think Not! · July 6, 2017 at 5:33 pm

Cookie Clicker.

Uncommon Virus · July 11, 2017 at 10:50 pm

me and assassin's creed are=

Lord Inquisitor Shadowlord · July 14, 2017 at 6:45 pm

Richard Garfield calls this type of game "Skinner Ware".

TheBlindVirus · September 1, 2017 at 10:38 am

Well fuck me, I guess I enjoy skinner games. I actually enjoy the majority of game mechanics described here as skinner game mechanics. Though that may literally just be the reward system in my brain fucking up, but seriously I do find them fun.

Gabriel Lewis · September 6, 2017 at 11:27 pm

some games have some Skinner box mechanics but some parts are different and i play them anyway.. i like playing these building games but I've got to win in a combat mode which i do enjoy to get currency to unlock new items with improved stats which takes the game off of the skill base and puts it on level systems and stats which i don't like and i think attracts people that are stuck up materialistic and egotistical which i don't like

Jonathan Walmsley · September 7, 2017 at 4:08 pm

Alas, this problem has only gotten worse these last 5 years through the increase of 'optional rewards' with the prevalence of micro-transactions, loot-boxes, card systems and all that crock of sh*t which preys on the same psychological impulses that the gambling industry is built around. This whole approach to design threatens to become the dominant strand within Triple-A games.

Menno Astfalck · September 16, 2017 at 11:11 am

Infinity Loop was designed to be a zen game

Radimkiller · September 16, 2017 at 2:23 pm

"Many of you played games well past the point it was fun." Do you have any statistics on this? Because I'm pretty sure crushing majority of people stop playing after they no longer enjoy the game.

Ken B · September 28, 2017 at 3:59 pm

Fallout 3, do a quest to take the reward, and then go to a quest to take another reward.

Ad Ici De · October 6, 2017 at 7:23 pm

amazingly intelligent video. actually helps me understand why and how i dislike so many current games.

Azrial · October 15, 2017 at 5:15 am

Destiny 2 feels like a giant skinner's box

Stephen Sundberg · October 16, 2017 at 12:30 am

World of Warcraft in its finest

Eric Taylor · October 18, 2017 at 1:08 am

So skinner just had a bunch of peckers in the end?

olahfeji · October 18, 2017 at 1:17 pm

shoes

Name Here · October 18, 2017 at 10:32 pm

This is one of EC's most useful episodes, only becoming more relevant as game publishers invest more and more in design choices and economies designed to isolate and prey on these kinds of psychological weaknesses.

_deviled_eggs_ · October 24, 2017 at 7:36 pm

Fuck, Animal Crossing fits into this category, but I still love it.

First Name and Last Name ples · October 27, 2017 at 6:23 am

Like when I played Tap Titan on my phone for hooourrrs. WTF was I doing

lionblooze · October 28, 2017 at 10:28 pm

Food/Water/Sex etc.

RinShin / リンシン · October 31, 2017 at 3:48 am

You seem to sort of mention rhythm gaming as a small example for the Flow part. That makes me wonder, have you covered something regarding that particular genre in the past?

BCPowerhouse · November 5, 2017 at 4:11 pm

Elite Dangerous anyone?

Spike Spiegel · November 18, 2017 at 11:28 pm

With the very lackluster single player on Star Wars Battlefront 2, and their clearly designed pay to win model, especially with Mobile Games, this shit needs to be regulated. Very easy games that have very repetitive gameplay, people have to constantly grind time to get the rewards, not from winning, but from spending money and time to work for a reward that doesn't have a payout that is worth it, but these gambling mobile and AAA games are out there, and they rank in millions.

PotatoesAreSucculentVegetables · November 20, 2017 at 2:23 pm

FYI: Rumors about his daughter, Deborah Skinner, is not true. She even debunks all of those rumors in an article she wrote. Prof Skinner was a cool dad.

(._. I don't know why. I just felt like saying it.)

Cagatay Ulubay · November 22, 2017 at 3:34 pm

2017 – It's getting worse :OO

the fastest link · November 25, 2017 at 11:50 pm

now that you mention it, the event dungeons in FFRK kinda stopped being fun a while ago, and that's your big source of mythril… OH GOD MY FAVORITE MOBILE GAME HAS A SKINNER BOX!

Trustin Neo · November 27, 2017 at 6:23 am

This video now makes more sense to starwars battlefront 2 lootboxes issue!

Cameron Gallagher · November 30, 2017 at 4:08 pm

Would you say a game like stardew valley is a skinner box system?

metalgeartrusty · December 1, 2017 at 12:49 pm

5 years later and this is more relevant. it sucks how slowly the gaming community (not just industry, but the players themselves) pick up on these things. only now these practices are finally getting some sort of negative feedback, better late than never i suppose

frumpis bumba · December 3, 2017 at 1:03 am

Shit, I wish I made a hundred bucks a day for pushing a button in a factory for 8 hours

Christopher Hall · December 6, 2017 at 2:42 pm

It has been awhile since I played it, but how is call of doody not the prime example of a skinner box in fps games? It sacrifices game balance with play time incentives.

FuckNuggectMegee · December 21, 2017 at 1:23 am

Only issue I have is labeling sex as a basic human need

Gaming Kick · January 1, 2018 at 11:18 am

Alien Vs Predator Zen Sessions are my fav!!!!

the genius · January 4, 2018 at 6:49 pm

Thank you for this veluable information.

I benefited really of you, I learned that developers games just thieves.

Thay are Stealing my time and my Live.

Jonsse · January 12, 2018 at 3:01 pm

They used World of Warcraft Cataclysm as a reference here. Considering what World of Warcraft is today 7 years later it seems Blizzard watched this video and did the exact opposite. They just piled on the Skinner Box methods on top of each other for 3 straight expansions to create the monstrosity of today.

J.R. Boyett · January 17, 2018 at 1:55 am

I truly do like your work and insight.

I feel exceedingly fortunate that I have recently been presented with an opportunity to return to game development, this time by working on the office side of a AAA game… with some potential for input on creative content. I say this not to lift myself up, but to give you the context of what comes next.

I fully intend to use what voice I have to speak THIS truth to the lead designers.

While this may not be a universally true statement for all developers, I want for any project that I work on to be the best that it can possibly be, and I do not consider profitability to be a measurement of quality. The points that you have made in this (and other) video(s) resonates strongly with me. I only hope that I can keep them in mind as I my tiny voice is added to the process.

Thank you.

ilikeceral3 · January 21, 2018 at 6:34 am

This is my biggest issue with Japanese mobile games.

Major General Bunk · January 22, 2018 at 2:00 am

World of Tanks is definitely a skinner-box game.

Andrew Danis · January 23, 2018 at 8:02 pm

shadow of mordor is one of the few games that can regularly get me in that zen mode, slaughtering waves of uruk until my zen is half broken by the captain that just showed up

Daniel Wellington · January 31, 2018 at 10:27 pm

You have some abnormal gamers who rip through the highest diffuculty level in any game in just a few hours, how?

darter9000 · February 3, 2018 at 2:17 am

Skinner Box games seem to get you to play the game while hating the company that made it as well

Jennifer H. · February 20, 2018 at 7:21 am

I think some people just aren't into it. One round of a game & I think, when can I return to real life?

Liekki Animaatio · February 21, 2018 at 8:20 am

Chalmers: Skinner!

Philip Henderson · February 28, 2018 at 8:51 am

Perhaps dumb question, but… what is the difference between being conditioned to do something and being addicted to it?

A Jolly Nurgle Prick · March 20, 2018 at 2:58 pm

Rhythm within play: DOOM. I've never felt so in synch with a game before this one i think.

Gambit Ben · April 4, 2018 at 6:38 pm

Do MOBAs (like LoL or DotA) or team-based FPS (like overwatch or teamfortress) can be considered Skinner Boxes?

Zaffre Verinius · April 19, 2018 at 8:40 am

I agree with your point here. But the thing is a lot of successful games use a Skinner Box feature in some way. Dota 2 and League of Legends use those voiceovers when you get multiple kills. Heck they even have items that make your screen flashier when you get those kills!

Borderlands 2 capitalize on getting the perfect gun all from loot drops and they even flaunt it in their trailers!

My point is that banking on a Skinner Box feature alone is a cheap and crappy way to make a game. But you should not totally avoid it either if you want to keep players hooked when they reach the end-game.

Awesomeness101 · April 25, 2018 at 11:11 pm

5:50 My playing Geometry Dash

anonimoalfin · April 26, 2018 at 10:40 pm

Wonderful vis, thanks for sharing! I have a request: would you please consider making a vid about more *Psychological Tricks in Game Design*, explaining more of this evil strategies besides Skinner Boxes, like Daily Rewards, Resource Decay, Loss Aversion and others, giving examples of games that do this? I'd like a complete video explaning ALL the addiction strategies used by devs. Thanks! ^_^

Tokuijin · April 29, 2018 at 1:18 pm

Actually, Skinner most used rats, not pigeons. Most of the the info we know about Skinner box conditioning comes from usage with rats

Sharky Overlord · May 8, 2018 at 6:42 pm

Honestly, I don't usually go into that trance state when playing games that I don't need to think about, but rather games I care about thinking about. I totally zen out when making a house in Sims 4 or when fighting a tough boss in Undertale (namely Papyrus is one of the hardest for me tbh as pathetic as that is ^^' But hey I beat Undyne on my very first try so give me a little credit!) I zen out when I'm intensely focused, if that makes any sense?

This is exactly why I can't hear anything that's happening around me when I play 2048. I get a little too into that game for my own good if I'm being real

Kreiser_VII · May 18, 2018 at 12:33 am

I think this is why I got tired of MMOs at my teen years… I hope there's a way I can love them as much as I did, they were so magical when I was a young dummy clueless about the genre

nevo light · May 18, 2018 at 10:53 pm

2:04, d-did I just hear sex?

ClickToPreview · May 20, 2018 at 7:51 am

It's like the difference between Asteroids and Fallout 3, for me anyway. Asteroids was a total Skinner Box (POINTS! I actually flipped the score back to zero after 999,999 points when I was idk 13 years old on my Atari 2600). Fallout 3 offers me engagement and immersion, but disengaging is fairly easy after big quests are finished.

Kevin Queen · May 21, 2018 at 9:41 pm

This in economics is utility maximization

CaptainKizer · June 1, 2018 at 9:04 pm

Old Family Recipe

HelloDolly · June 27, 2018 at 8:21 am

from reddit

Rubber Band Republic · July 8, 2018 at 11:00 am

This channel.

Isaivoid · July 16, 2018 at 10:29 pm

For a while, I’ve been researching what makes a game good… I decided that one way of satisfaction is revenge, maybe I can use this technique with the satisfaction of revenge and make a system that’s rewarding but not in a useless way… maybe I can throw some Easter eggs into the mix…

ExtremeTacticalBlaster · August 1, 2018 at 1:02 am

Honestly, when they ban lootboxes, I think there should be a bill for companies that do the practice, in the exact amount of cash that they gained from the scummy business practice, even if they can't afford it, just as a "You really think you can get away that easily?" And I know this was made in 2012, but I'm just writing it in case I forget it.

Ralsei · August 13, 2018 at 12:20 am

5:59 so basically WarioWare and Rhythm Heaven?

mariocobos2001 · August 18, 2018 at 3:42 am

Ark of War and War Robots… Tens of thousands of dollars..

darbukaman · August 19, 2018 at 6:49 pm

Fucking Hearthstone man. I can't believe how did I play it everyday for one year straight.

Damo Revo · August 20, 2018 at 7:29 pm

facebook = ultimate skinner box

daniel umana · August 22, 2018 at 1:47 am

Pokemon tries not to have people grinding forever and breezing through with the gym badge obedience system. It makes it so that people are discouraged from over leveling because their pokemon may lose because it doesn't want to battle.

Dos Dosru · September 21, 2018 at 1:38 am

put it at .25 speed at 4:30

Courtney SugarAntQueen · September 24, 2018 at 4:28 pm

I love this video!!! haha great job.

lateralsx7 · September 30, 2018 at 11:54 am

Garbage MMos are 100% relying on skinner box, even the all mighty WoW is not worth anything, people play it for the shiny rewards even if gameplay sucks, content is boring, everything is complacent but the carrot on a stick makes wonders just like with f2p games

broccolidood · October 2, 2018 at 2:11 pm

This is why I have 600 hours in GTA Online. I regret 500 hundred of it. The other hundred I had cheated money.

brandon grey · October 23, 2018 at 3:21 am

80 hours?!?
The most I ever put in a game is 60, and that's that's a lot for me lol

macsnafu · November 9, 2018 at 3:01 am

I love a good mystery. We need more mystery games, not puzzle games pretending to be mystery games!

Yoshi -TheOreo · November 11, 2018 at 12:26 pm

I know this video is old, but researchers and studies do need an update on studying if gaming is becoming addictive because I've noticed one factor that could unravel something: what games are consistently being played in these studies to come to these conclusions? There's a difference in results if games like: Mario Party, Final Fantasy 4, Pokemon, Metal Gear Solid 2, Kingdom Hearts, and Tetris were played for hours yielding no results to addiction. Yet you'll most likely see a vast result in studies if the subjects only played Skinner Box games or games built around this mechanic only: Borderlands, Diablo, World of Warcraft, Warframe, Call of Duty, Destiny, Monster Hunter World, Battlefront 2; while also segmenting these games studies with a group playing Skinner Games without microtransactions built in vs with them in mind. Because people are using studies from back in 2014 and such where these types of games were not as prominent within the industry at the time, which is like saying cigarettes are not as addicting today because if you look back where they made quality cigarettes focusing on flavor and quality ingredients with a moderate amount of nicotine, it furthers my point versus if you did a study on today's nicotine products is what would yield a way different result than from back then.

William L. · November 23, 2018 at 11:22 am

Specifically went and bought a large projector TV and sound system upgrade for the release of Nitrous Oxide!

mamertvonn · December 21, 2018 at 7:49 am

gacha gacha gacha gacha

Matthew Mazzetti · December 26, 2018 at 3:50 pm

Does anyone else like the Professor Layton games? I love them, but nobody I talk to has even heard of them.

Lee JungWoo · January 10, 2019 at 4:56 pm

오래된 영상이지만 좋은 영상이네요

Caston Young · January 17, 2019 at 2:42 am

I'm not sure every instance of operant conditioning in games is a bad thing. Given that it is rewarding, I don't see the problem unless there is a net negative amount of fun had (as was often the case playing Xenoblade).

iiSeyFX / IseyFzShooT · January 19, 2019 at 2:58 pm

All of his demands on games, literally, ALL of them are present in one game :
– League of Legends

Prog Fr · February 23, 2019 at 3:25 am

https://blue-rabbit.itch.io/the-button-game the skinner box game !

Jeff Doe · February 23, 2019 at 9:59 am

Click the Like button to receive a randomly scheduled reward.

info mus · February 28, 2019 at 11:30 pm

The problem is publishers are running gaming studios now instead of what would make sense and it being the other way around.

abdullah9734 · March 7, 2019 at 2:29 am

That's why i got Fortnite Season 8 Battle Pass for free !!

Alexander Rodriguez y Gibson · March 26, 2019 at 3:37 pm

3:37 Wait, other people than my grandma play bejeweled?

Gaurab Chatterjee · April 15, 2019 at 2:58 pm

Thanks for inspiring me. Now I fully intend to go full throttle on the Skinnerian Operant Conditioning for my studies.

bilal kara · April 20, 2019 at 7:35 am

dude you talking too fast

Dgblin · April 26, 2019 at 7:51 am

press f to pay respect

Banter 2.0 · May 24, 2019 at 2:54 pm

If only we knew…

Louis Lambros · June 22, 2019 at 1:11 pm

Sekiro mastered this flow state game play

Empyreal Denizen · July 10, 2019 at 5:06 am

Golly.

Amaroq64 · July 13, 2019 at 1:03 am

The only game I really had that "in the zone" thing for was the original Unreal Tournament.

Time would like go fast and slow at the same time and I would juggle a bot around a room with a rocket launcher and then giggle maniacally when it reduced to giblets.

Enias K. · July 22, 2019 at 8:42 am

thats how lol works nowadays … its not even fun anymore and they kept the people playing only because of the divisions in a lower degree but mainly because of capsules from leveling up, the missions and the free skins… feels bad

Shilvio D. Linton · August 15, 2019 at 3:11 am

This clashes with some of the more recent videos on lootboxes that Extra credits has put out.

baabaa9000 · August 22, 2019 at 3:02 am

This is kinda random, but I wonder of this sort of conditioning works on somebody with a disorder like ADHD? people like that tend to struggle with performing a repetitive task for long periods of time; I wonder if the intermittent rewards would end up frustrating and driving them away, rather than conditioning them to continue?

Informia · August 25, 2019 at 7:02 pm

Just made a better video explaining Skinner Box in a more fun way 😀

Jordan Fink · September 1, 2019 at 2:48 am

Idiot

D-land Arrese Valle · September 11, 2019 at 1:26 am

Great video thx Vechs for sending me

Stephen Widger · September 11, 2019 at 2:28 am

OMG SHOES!

Dougy Dozier · September 18, 2019 at 11:07 pm

Why do you think Minecraft is so popular?

plsegott · September 19, 2019 at 9:09 pm

Godfather the game is NOT bad.

Scotty · September 20, 2019 at 10:49 pm

Osu- Skinner box flow mastery heaven

MildlyMad yt · September 22, 2019 at 12:13 pm

S K I N E R

PhantomTissue · September 24, 2019 at 7:37 pm

Its 2019 today, and literally nobody trusts companies to not heavy rely on P2W mechanics in literally any game. So much for moving away from this philosophy

Leave a Reply

Your email address will not be published. Required fields are marked *