Here are a couple of interesting details to add to the story of olive oil's back-of-the-throat, peppery pungency.
In 2003, a research group at Unilever reported on the sensory effects of several of the phenolic compounds found in olive oil, including the cough-inducing substance later named oleocanthal. Oleuropein, the phenolic compound that makes the fruit of the olive bitter, is water-soluble rather than fat-soluble, so it doesn't get transferred into the oil when the fruit is pressed. But a number of oleuropein relatives do end up in the oil, and the Unilever researchers tasted them in pure form. They found these compounds to contribute mainly bitterness and drying astringency, along with some numbing, cooling, sour, salty, and tingling sensations. Relatives of pungent oleocanthal also taste somewhat astringent and bitter. So an oil rich in phenolics can have a very complex taste and mouthfeel indeed.
Other studies have found that heating olive oil reduces the levels of most phenolic compounds. And pepperiness gradually fades as an oil ages. The balance of flavors in an excellent olive oil is thus temporary and so especially worth savoring when you find it. The deterioration of olive oil is slowed by keeping it cool and protected from light.