[MINI] Entropy

Data Skeptic

Episode | Podcast

Date: Fri, 16 Dec 2016 08:23:50 +0000

<p>Classically, entropy is a measure of disorder in a system. From a statistical perspective, it is more useful to say it's a measure of the unpredictability of the system. In this episode we discuss how information reduces the entropy in deciding whether or not Yoshi the parrot will like a new chew toy. A few other everyday examples help us examine why entropy is a nice metric for constructing a decision tree.</p>