In this episode, it is revealed that Bruce's great-grandfather attended Yale University and founded the Skull and Bones society.
The first two criminal photographs Batman shows Alfred are of producers William Dozier and Howie Horwitz.
After Alfred is kidnapped, The Penguin threatens him by saying, "I'll teach you how to waddle like The Penguin do." This is a line from Burgess Meredith's song "The Escape", performed in character as The Penguin.
While Penguin's hench-fish are Octopus, Shark and Swordfish, his female companion is named Finella. Although it's likely a nod to the title of the episode, it is also a Celtic girl's name meaning fair one.
Alfred mentions dealing with the Iranian embassy to purchase the caviar. The Caspian Sea, which Iran borders, is home to the caviar sturgeon. At the time of this episode, most fine caviar was exported by Iran and the former USSR.