On variational definition of quantum entropy

Belavkin, Roman V. ORCID logoORCID: https://orcid.org/0000-0002-2356-1447 (2014) On variational definition of quantum entropy. Volume 1641: Bayesian Inference and Maximum Entropy Methods in Science and Engineering (MaxEnt 2014). In: 34th International Workshop on Bayesian Inference and Maximum Entropy Methods in Science and Engineering (MaxEnt 2014), 21–26 Sep 2014, Clos Lucé, Amboise, France. ISBN 9780735412804. ISSN 0094-243X [Conference or Workshop Item] (doi:10.1063/1.4905979)


Entropy of distribution $P$ can be defined in at least three different ways: 1) as the expectation of the Kullback-Leibler (KL) divergence of $P$ from elementary $\delta$-measures (in this case, it is interpreted as expected surprise); 2) as a negative KL-divergence of some reference measure $\nu$ from the probability measure $P$; 3) as the supremum of Shannon's mutual information taken over all channels such that $P$ is the output probability, in which case it is dual of some transportation problem. In classical (i.e. commutative) probability, all three definitions lead to the same quantity, providing only different interpretations of entropy. In non-commutative (i.e. quantum) probability, however, these definitions are not equivalent. In particular, the third definition, where the supremum is taken over all entanglements of two quantum systems with $P$ being the output state, leads to the quantity that can be twice the von~Neumann entropy. It was proposed originally by V.~Belavkin and Ohya \cite{Belavkin-Ohya02:_entan} and called the \emph{proper} quantum entropy, because it allows one to define quantum conditional entropy that is always non-negative. Here we extend these ideas to define also quantum counterpart of proper cross-entropy and cross-information. We also show inequality for the values of classical and quantum information.

Item Type: Conference or Workshop Item (Paper)
Additional Information: Published in: AIP Conference Proceedings, 1641, 197-204 (2015)
Keywords (uncontrolled): Quantum information; Quantum entropy
Research Areas: A. > School of Science and Technology > Computer Science
A. > School of Science and Technology > Computer Science > Artificial Intelligence group
Item ID: 15349
Useful Links:
Depositing User: Roman Belavkin
Date Deposited: 27 Apr 2015 11:23
Last Modified: 13 Oct 2016 14:33
URI: https://eprints.mdx.ac.uk/id/eprint/15349

Actions (login required)

View Item View Item


Activity Overview
6 month trend
6 month trend

Additional statistics are available via IRStats2.