Abstract
Entropies must correspond to mean values for them to be measurable. The Shannon entropy corresponds to the weighted arithmetic mean, whereas the Renyi entropy corresponds to the exponential mean. These means refer to code lengths, which are converted into entropies by replacing the length of a sequence by the negative logarithm of the probability of its occurrence. Only affine and exponential generating functions of means preserve the property of additivity and invariance under translations, and hence are Kolmogorov-Nagumo functions, resulting in the Shannon and Renyi entropies, respectively. Pseudo-additive entropies are generating functions of means of order 0\le\tau<1, which is the exponential Renyi entropy, or, in the \tau=0 limit, the Shannon entropy. Means of any order cannot be expressed as escort averages because such averages contradict the fact that the means are monotonically increasing functions of their order. Exponential mean error functions of Renyi, in general, and Shannon, in particular, are shown to be measures of the extent of a distribution.
本页仅发布可检索的书目信息与作者摘要。HTML 正文、PDF 和 LaTeX 源文件是独立阅读资源，不作为搜索引擎落地内容。打开页面后会按浏览器语言自动翻译标题与摘要，并写入缓存。