SPATIOTEMPORAL PATTERNS OF BEHAVIOR PRODUCED BY VARIABLE-INTERVAL SCHEDULES OF REINFORCEMENT

The spatiotemporal patterns of behavior exhibited by two pigeons during a variable‐interval 15‐second schedule of food reinforcement, a variable‐interval 5‐minute schedule, and then extinction of key pecking were recorded using an apparatus that continuously tracked the position of the bird in the experimental chamber. The variable‐interval 15‐second schedule produced a close‐to‐key pattern between reinforcements with two types of regular excursions from the region of the key frequently occurring after reinforcement. Subsequent exposure to the variable‐interval 5‐minute schedule produced more extended and extremely regular patterns between responses. Reinstatement of the variable‐interval 15‐second schedule reestablished the close‐to‐key pattern with regular excursions frequently occurring after reinforcement. During extinction the spatiotemporal patterns that had developed during the variable‐interval 5‐minute schedule reappeared and gradually dissipated. These patterns may have been a form of superstitious behavior.