Operant conditioning

1. Operant conditioning Learning from our behavior’s consequences

2. Operant conditioning • How the consequences of our behavior affects our future behavior • Edward Thorndike started this concept by studying cats in “puzzle boxes” • He graphed how their learning progressed over many trials to reveal the learning curve

3. reinforcement • An event which increases the future probability of the most recent response • First explored by Thorndike • Taken from another perspective, if the delivery of something makes the action or behavior which preceded it more likely to occur, it is a reinforcer • A reinforcer “stamps in” a response

4. Thorndike labeled this “The Law of Effect” • We are more likely to repeat responses that lead to (what we view as) favorable consequences or outcomes

5. In operant conditioning, we change behavior by following a desired action/response with reinforcement • And the sooner, the better • We label it “operant” because the subject operates on the environment to obtain reinforcement

6. Cc contrast • Some call it instrumental conditioning because the subject’s behavior is instrumental in producing the outcome • Stark distinction from classical conditioning when the subject’s behavior was meaningless • Operant – subject acts with muscles • Classical – subject reacts through internal organs

7. b. F. skinner • The “Father” of Operant Conditioning • Zealous advocate • Laid out theoretical framework • Used only the simplest of assumptions • Pioneered precise operational definitions • Invented The Skinner Box • Rats pressed levers, pigeons pecked Os

8. Setting the table for desired behaviors • How do we get the rat to pull the lever in the first place? • Shaping – establishing a new behavior by reinforcing successive approximations to it

9. Shaping ii • Works with rats, pigeons, children, everyone • Skinner’s lectures • Pigeon’s dropping bombs? • “Catch them while they’re being good” • Token economies

10. Complex behaviors • How do we get an animal to perform a sequence of behaviors? • Chaining – reinforce each desired behavior by giving the animal the chance to engage in a previously reinforced behavior

11. Reinforcement & punishment • These two events drive operant conditioning, and as a result, much of our behavior • Reinforcement increases the odds that the behavior which preceded it will re-occur • Punishment decreases the odds that the behavior which preceded it will reoccur

12. Reinforcement can result from removing pain or by helping us avoid it • Going to the dentist • Taking Tylenol/aspirin • Finding an excuse not to ask her out • Settling the big trial

13. SUPERSTITIONS • We think that our good luck charm prevents us from screwing up • Same with “pre-game” rituals

14. More punishment • Punishment can result from removing pleasure • “If you do that one more time. I’ll …” • Fouls in a basketball game • Grounded! • Time-outs

15. Does reinforcement simply equal pleasure or pain equal punishment? • No, reinforcement must increase thefrequency of the behavior. • And, punishment must decrease it.

16. Punishment iii • Very hard to administer successfully • Works best if it is: 1) consistent, 2) immediate, 3) moderate, and 4) alternatives are available. Does torture work? Spanking?

17. Finding the right reinforcer • How can we pick reinforcers that will prompt more desirable behaviors? • Harder than you might think, great variability between individuals. • Remember, Skinner virtually starved his pigeons and rats.

18. Two principles • Permack – the chance to engage in frequent behaviors can be a reinforcer for less common behaviors • If that fails,

19. Disequilibrium – disrupting someone’s typical routine will make a return to the routine reinforcing