In the 1930s, B.F. Skinner invented the "operant conditioning chamber" — universally known as the Skinner box — to study how consequences shape behavior in rats and pigeons.

How It Worked

An animal in the box could press a lever (or peck a disc) to receive food pellets. Skinner varied the schedule of reinforcement to study how different reward patterns shaped behavior.

Key Findings on Reinforcement Schedules

• Fixed ratio: Reward every Nth press — produces high, steady response rates
• Variable ratio: Reward after an unpredictable number of presses — produces the highest, most persistent response rates. This is the slot machine schedule.
• Fixed interval: Reward after a fixed time — produces scalloping (low activity, then burst near reward time)
• Variable interval: Reward after unpredictable time — produces steady, moderate response

Modern Applications

Variable ratio reinforcement is the engine behind slot machines, social media notifications, email checking, and most addictive digital behaviors. Skinner's pigeons and Silicon Valley's engagement engineers arrived at the same formula independently.

Reference:

Wikipedia: Operant Conditioning Chamber

https://en.wikipedia.org/wiki/Operant_conditioning_chamber