PhyslibSearch

QuantumInfo.Finite.Entropy.Relative

55 declarations

theorem

Weighted Jensen Inequality for Power Functions xqx^q with q1q \ge 1

#weighted_jensen_rpow

Let wjw_j be a set of non-negative weights such that jwj=1\sum_j w_j = 1, and let bjb_j be non-negative real numbers. For any real number q1q \geq 1, the following weighted Jensen inequality holds: (jwjbj)qjwjbjq\left( \sum_j w_j b_j \right)^q \le \sum_j w_j b_j^q

theorem

Doubly Stochastic Hölder Inequality

#doubly_stochastic_holder

Let aia_i and bjb_j be non-negative real numbers for i,j{1,,d}i, j \in \{1, \dots, d\}. Let wijw_{ij} be a doubly stochastic matrix, such that wij0w_{ij} \geq 0 for all i,ji, j, and its rows and columns sum to 1 (jwij=1\sum_{j} w_{ij} = 1 for all ii, and iwij=1\sum_{i} w_{ij} = 1 for all jj). For any conjugate exponents p,q>1p, q > 1 satisfying 1p+1q=1\frac{1}{p} + \frac{1}{q} = 1, the following inequality holds: i,jaibjwij(iaip)1/p(jbjq)1/q\sum_{i,j} a_i b_j w_{ij} \le \left( \sum_{i} a_i^p \right)^{1/p} \left( \sum_{j} b_j^q \right)^{1/q}

theorem

Hermitian Trace Hölder Inequality: A,BTr[Ap]1/pTr[Bq]1/q\langle A, B \rangle \le \text{Tr}[A^p]^{1/p} \text{Tr}[B^q]^{1/q}

#inner_le_trace_rpow_mul

Let AA and BB be complex Hermitian matrices of dimension dd that are positive semi-definite (A0,B0A \ge 0, B \ge 0). Let pp and qq be real conjugate exponents such that p>1p > 1 and 1p+1q=1\frac{1}{p} + \frac{1}{q} = 1. Then the real-valued Hilbert-Schmidt inner product of AA and BB, denoted A,BR\langle A, B \rangle_{\mathbb{R}}, satisfies: A,BR(Tr[Ap])1/p(Tr[Bq])1/q\langle A, B \rangle_{\mathbb{R}} \le (\text{Tr}[A^p])^{1/p} (\text{Tr}[B^q])^{1/q}

theorem

Mr1M^r \le 1 for Mixed State MM and r>0r > 0

#rpow_le_one'

Let σ\sigma be a quantum mixed state with associated matrix MM. For any real number r>0r > 0, the rr-th power of the matrix MM satisfies MrIM^r \le \mathbb{I}, where I\mathbb{I} denotes the identity matrix.

theorem

If AIA \le I, then its eigenvalues satisfy λi1\lambda_i \le 1

#eigenvalues_le_one_of_le_one

Let AA be a Hermitian matrix in Cd×d\mathbb{C}^{d \times d}. If AIA \le I (where II is the identity matrix), then for every index ii in the dimension type dd, the ii-th eigenvalue of AA satisfies λi(A)1\lambda_i(A) \le 1. Combined with the condition A0A \ge 0, this implies that all eigenvalues of AA lie in the interval [0,1][0, 1].

theorem

Tr(Ap)Tr(A)\text{Tr}(A^p) \le \text{Tr}(A) for 0AI0 \le A \le I and p1p \ge 1

#trace_rpow_le_trace_of_le_one

Let AA be a complex Hermitian matrix of dimension dd such that 0AI0 \le A \le I, where II is the identity matrix. For any real number p1p \ge 1, the trace of the pp-th power of AA is less than or equal to the trace of AA, i.e., Tr(Ap)Tr(A)\text{Tr}(A^p) \le \text{Tr}(A).

theorem

ApAp=Psupp(A)A^{-p} A^p = P_{\text{supp}(A)} for PSD AA and p0p \neq 0

#rpow_neg_mul_rpow_eq_supportProj

Let AA be a positive semi-definite (PSD) Hermitian matrix of dimension d×dd \times d over the complex numbers C\mathbb{C}. For any non-zero real number pp, the product of the matrix power ApA^{-p} and ApA^p is equal to the orthogonal projection onto the support of AA, denoted as Psupp(A)P_{\text{supp}(A)}.

theorem

Left multiplication of a Hermitian matrix by its support projection PAA=AP_A A = A

#supportProj_mul_self

For any complex Hermitian matrix ACd×dA \in \mathbb{C}^{d \times d}, the product of its support projection PAP_A and the matrix itself is equal to AA, i.e., PAA=AP_A A = A.

theorem

A,PA=Tr(A)\langle A, P_A \rangle = \text{Tr}(A)

#inner_supportProj_self

For any complex Hermitian matrix AA, the inner product of AA with its support projection PAP_A is equal to the trace of AA. Here, A,PA\langle A, P_A \rangle denotes the Frobenius inner product (or Hilbert-Schmidt inner product), and A.traceA.trace denotes the sum of the diagonal elements of AA.

theorem

kerBkerA    AΠB=A\ker B \subseteq \ker A \implies A \Pi_B = A

#mul_supportProj_of_ker_le

Let AA and BB be Hermitian matrices of dimension dd over the complex numbers C\mathbb{C}. If the kernel of the linear map associated with BB is a subspace of the kernel of the linear map associated with AA (i.e., kerBkerA\ker B \subseteq \ker A), then the product of AA and the support projection of BB (denoted ΠB\Pi_B) satisfies AΠB=AA \Pi_B = A.

theorem

kerBkerA    A,ΠB=Tr(A)\ker B \subseteq \ker A \implies \langle A, \Pi_B \rangle = \text{Tr}(A)

#inner_supportProj_of_ker_le

Let AA and BB be complex Hermitian matrices of dimension dd. If the kernel of BB is contained in the kernel of AA (i.e., kerBkerA\ker B \subseteq \ker A), then the Frobenius inner product of AA and the support projection of BB (denoted ΠB\Pi_B) is equal to the trace of AA, such that A,ΠB=Tr(A)\langle A, \Pi_B \rangle = \text{Tr}(A).

theorem

kerσkerρ    Πσ,ρR=1\ker \sigma \subseteq \ker \rho \implies \langle \Pi_{\sigma}, \rho \rangle_{\mathbb{R}} = 1

#supportProj_inner_density

Let ρ\rho and σ\sigma be density matrices. If the kernel of the linear map associated with σ\sigma is contained within the kernel of the linear map associated with ρ\rho (denoted kerσkerρ\ker \sigma \subseteq \ker \rho), then the real inner product of the support projection of σ\sigma and the density matrix ρ\rho is equal to 1, i.e., Πσ,ρR=1\langle \Pi_{\sigma}, \rho \rangle_{\mathbb{R}} = 1.

theorem

Non-negativity of Quantum Relative Entropy D(ρσ)0D(\rho \| \sigma) \geq 0

#inner_log_sub_log_nonneg

Let ρ\rho and σ\sigma be density operators (represented by their matrices ρ.M\rho.M and σ.M\sigma.M). If the kernel of σ.M\sigma.M is contained in the kernel of ρ.M\rho.M (ker(σ.M)ker(ρ.M)\ker(\sigma.M) \subseteq \ker(\rho.M)), then the quantity ρ.M,log(ρ.M)log(σ.M)\langle \rho.M, \log(\rho.M) - \log(\sigma.M) \rangle is non-negative, i.e., 0ρ.M,logρ.Mlogσ.M0 \leq \langle \rho.M, \log \rho.M - \log \sigma.M \rangle. Here A,B\langle A, B \rangle denotes the Hilbert-Schmidt inner product Tr(AB)\text{Tr}(A^\dagger B).

theorem

Non-negativity of Sandwiched Rényi Relative Entropy Dα(ρσ)0D_{\alpha}(\rho \| \sigma) \ge 0

#sandwichedRelRentropy_nonneg

Let ρ\rho and σ\sigma be density states with associated matrices ρ.M\rho.M and σ.M\sigma.M. Suppose the kernel of σ.M\sigma.M is contained in the kernel of ρ.M\rho.M (kerσ.Mkerρ.M\ker \sigma.M \subseteq \ker \rho.M). For any αR\alpha \in \mathbb{R} such that α>0\alpha > 0, the sandwiched Rényi relative entropy Dα(ρσ)D_{\alpha}(\rho \| \sigma) is non-negative (0Dα(ρσ)0 \le D_{\alpha}(\rho \| \sigma)), where Dα(ρσ)D_{\alpha}(\rho \| \sigma) is defined as: - If α=1\alpha = 1, the relative entropy is given by the inner product ρ.M,logρ.Mlogσ.M\langle \rho.M, \log \rho.M - \log \sigma.M \rangle. - If α1\alpha \neq 1, it is given by 1α1logTr[(σ.M1α2αρ.Mσ.M1α2α)α]\frac{1}{\alpha - 1} \log \text{Tr}\left[ \left( \sigma.M^{\frac{1-\alpha}{2\alpha}} \rho.M \sigma.M^{\frac{1-\alpha}{2\alpha}} \right)^\alpha \right].

theorem

kerAkerC\ker A \subseteq \ker C and kerBkerD\ker B \subseteq \ker D implies ker(AB)ker(CD)\ker(A \otimes B) \subseteq \ker(C \otimes D)

#ker_kron_le_of_le

Let A,CA, C be square matrices of size d1×d1d_1 \times d_1 over C\mathbb{C}, and let B,DB, D be square matrices of size d2×d2d_2 \times d_2 over C\mathbb{C}. If the kernel of AA is contained in the kernel of CC (kerAkerC\ker A \subseteq \ker C) and the kernel of BB is contained in the kernel of DD (kerBkerD\ker B \subseteq \ker D), then the kernel of the Kronecker product ABA \otimes B is contained in the kernel of the Kronecker product CDC \otimes D (ker(AB)ker(CD)\ker(A \otimes B) \subseteq \ker(C \otimes D)). Here, kerM\ker M refers to the kernel of the linear map associated with a matrix MM.

theorem

ker(σ1σ2)ker(ρ1ρ2)\ker(\sigma_1 \otimes \sigma_2) \subseteq \ker(\rho_1 \otimes \rho_2) implies kerσ1kerρ1\ker \sigma_1 \subseteq \ker \rho_1

#ker_le_of_ker_kron_le_left

Let ρ1,σ1\rho_1, \sigma_1 be quantum mixed states of dimension d1d_1, and ρ2,σ2\rho_2, \sigma_2 be quantum mixed states of dimension d2d_2. If the kernel of the Hermitian operator associated with the product state σ1σ2\sigma_1 \otimes \sigma_2 is contained in the kernel of the Hermitian operator associated with the product state ρ1ρ2\rho_1 \otimes \rho_2 (i.e., ker(σ1σ2).Mker(ρ1ρ2).M\ker(\sigma_1 \otimes \sigma_2).M \subseteq \ker(\rho_1 \otimes \rho_2).M), then the kernel of σ1\sigma_1 is contained in the kernel of ρ1\rho_1 (kerσ1.Mkerρ1.M\ker \sigma_1.M \subseteq \ker \rho_1.M).

theorem

ker(Mσ1σ2)ker(Mρ1ρ2)    kerMσ2kerMρ2\ker(M_{\sigma_1 \otimes \sigma_2}) \subseteq \ker(M_{\rho_1 \otimes \rho_2}) \implies \ker M_{\sigma_2} \subseteq \ker M_{\rho_2}

#ker_le_of_ker_kron_le_right

Let ρ1,σ1\rho_1, \sigma_1 be quantum mixed states of dimension d1d_1 and ρ2,σ2\rho_2, \sigma_2 be quantum mixed states of dimension d2d_2. If the kernel of the Hermitian operator of the product state σ1σ2\sigma_1 \otimes \sigma_2 is contained in the kernel of the Hermitian operator of the product state ρ1ρ2\rho_1 \otimes \rho_2 (i.e., ker(Mσ1σ2)ker(Mρ1ρ2)\ker(M_{\sigma_1 \otimes \sigma_2}) \subseteq \ker(M_{\rho_1 \otimes \rho_2})), then the kernel of the Hermitian operator of σ2\sigma_2 is contained in the kernel of the Hermitian operator of ρ2\rho_2 (i.e., kerMσ2kerMρ2\ker M_{\sigma_2} \subseteq \ker M_{\rho_2}).

theorem

ker(σ1σ2)ker(ρ1ρ2)    kerσ1kerρ1kerσ2kerρ2\ker(\sigma_1 \otimes \sigma_2) \subseteq \ker(\rho_1 \otimes \rho_2) \iff \ker \sigma_1 \subseteq \ker \rho_1 \land \ker \sigma_2 \subseteq \ker \rho_2

#ker_prod_le_iff

Let ρ1,σ1\rho_1, \sigma_1 be mixed states on a Hilbert space of dimension d1d_1, and let ρ2,σ2\rho_2, \sigma_2 be mixed states on a Hilbert space of dimension d2d_2. The kernel of the density matrix of the product state σ1σ2\sigma_1 \otimes \sigma_2 is contained in the kernel of the density matrix of the product state ρ1ρ2\rho_1 \otimes \rho_2 (i.e., ker(σ1σ2)ker(ρ1ρ2)\ker(\sigma_1 \otimes \sigma_2) \subseteq \ker(\rho_1 \otimes \rho_2)) if and only if kerσ1kerρ1\ker \sigma_1 \subseteq \ker \rho_1 and kerσ2kerρ2\ker \sigma_2 \subseteq \ker \rho_2.

theorem

AB,CD=A,CB,D\langle A \otimes B, C \otimes D \rangle = \langle A, C \rangle \langle B, D \rangle

#inner_kron

Let AA and CC be complex Hermitian matrices of dimension d1d_1, and let BB and DD be complex Hermitian matrices of dimension d2d_2. Then the Frobenius inner product of the Kronecker products ABA \otimes B and CDC \otimes D is equal to the product of the individual inner products, namely: AB,CD=A,CB,D\langle A \otimes B, C \otimes D \rangle = \langle A, C \rangle \langle B, D \rangle

theorem

Continuity of rtrr \mapsto t^r in the topology of uniform convergence on compact sets for r>0r > 0

#continuousOn_rpow_uniform

Let KRK \subset \mathbb{R} be a compact set. The function that maps a real exponent rr to the power function ttrt \mapsto t^r (viewed as an element of the space of functions on KK endowed with the topology of uniform convergence) is continuous on the interval (0,)(0, \infty).

theorem

Additivity of ρ,logρlogσ\langle \rho, \log \rho - \log \sigma \rangle under tensor products of mixed states

#sandwichedRelRentropy_additive_alpha_one_aux

Let ρ1,σ1\rho_1, \sigma_1 be mixed states of dimension d1d_1 and ρ2,σ2\rho_2, \sigma_2 be mixed states of dimension d2d_2. Let Mρ1,Mσ1,Mρ2,Mσ2M_{\rho_1}, M_{\sigma_1}, M_{\rho_2}, M_{\sigma_2} denote their respective density matrices, and let M\otimes^M denote the tensor product of mixed states. Suppose that the kernel of Mσ1M_{\sigma_1} is a subspace of the kernel of Mρ1M_{\rho_1} (kerMσ1kerMρ1\ker M_{\sigma_1} \subseteq \ker M_{\rho_1}) and the kernel of Mσ2M_{\sigma_2} is a subspace of the kernel of Mρ2M_{\rho_2} (kerMσ2kerMρ2\ker M_{\sigma_2} \subseteq \ker M_{\rho_2}). Then the following additivity property for the Frobenius inner product of the logarithm of the states holds: Mρ1Mρ2,log(Mρ1Mρ2)log(Mσ1Mσ2)=Mρ1,logMρ1logMσ1R+Mρ2,logMρ2logMσ2\langle M_{\rho_1 \otimes^M \rho_2}, \log(M_{\rho_1 \otimes^M \rho_2}) - \log(M_{\sigma_1 \otimes^M \sigma_2}) \rangle = \langle M_{\rho_1}, \log M_{\rho_1} - \log M_{\sigma_1} \rangle_{\mathbb{R}} + \langle M_{\rho_2}, \log M_{\rho_2} - \log M_{\sigma_2} \rangle where log\log denotes the functional calculus for Hermitian matrices.

definition

Sandwiched Rényi Relative Entropy Dα(ρσ)D_\alpha(\rho \| \sigma)

#SandwichedRelRentropy

Let ρ\rho and σ\sigma be quantum states (represented by the type `MState d`) with associated density matrices MρM_\rho and MσM_\sigma. Given a parameter αR\alpha \in \mathbb{R}, the Sandwiched Rényi Relative Entropy Dα(ρσ)D_\alpha(\rho \| \sigma) is defined as an extended non-negative real number as follows: 1. If α0\alpha \le 0, the value is 00. 2. If α>0\alpha > 0 and the kernel condition kerMσkerMρ\ker M_\sigma \le \ker M_\rho is not satisfied, the value is \infty. 3. If α=1\alpha = 1 and kerMσkerMρ\ker M_\sigma \le \ker M_\rho, it returns the standard relative entropy (Kullback-Leibler divergence) calculated using the natural logarithm: D1(ρσ)=Tr(Mρ(logMρlogMσ))D_1(\rho \| \sigma) = \text{Tr}(M_\rho (\log M_\rho - \log M_\sigma)) 4. If α(0,1)(1,)\alpha \in (0, 1) \cup (1, \infty) and kerMσkerMρ\ker M_\sigma \le \ker M_\rho, it is given by: Dα(ρσ)=1α1logTr[(Mσ1α2αMρMσ1α2α)α]D_\alpha(\rho \| \sigma) = \frac{1}{\alpha - 1} \log \text{Tr} \left[ \left( M_\sigma^{\frac{1-\alpha}{2\alpha}} M_\rho M_\sigma^{\frac{1-\alpha}{2\alpha}} \right)^\alpha \right] where Tr\text{Tr} denotes the trace and the power of the matrices is defined via functional calculus.

definition

Sandwiched Rényi relative entropy D~α(ρσ)\tilde{D}_\alpha(\rho \| \sigma)

#termD̃__(_‖_)

This notation defines the sandwiched Rényi relative entropy of order α\alpha between two mixed states ρ\rho and σ\sigma, denoted as D~α(ρσ)\tilde{D}_\alpha(\rho \| \sigma). It is defined for αR\alpha \in \mathbb{R} and maps a pair of mixed states ρ,σ\rho, \sigma to an extended non-negative real number [0,][0, \infty].

definition

Quantum Relative Entropy D(ρσ)D(\rho \parallel \sigma)

#qRelativeEnt

The quantum relative entropy, also known as the Umegaki relative entropy, is defined for two quantum states ρ\rho and σ\sigma (elements of the space of mixed states MState d\text{MState } d) as: D(ρσ)=Tr[ρ(logρlogσ)]D(\rho \parallel \sigma) = \text{Tr}[\rho (\log \rho - \log \sigma)] The value is represented as an extended non-negative real number (ENNReal\text{ENNReal}). In this library, it is implemented as a special case of the sandwiched Rényi relative entropy D~α(ρσ)\tilde{D}_\alpha(\rho \parallel \sigma) evaluated at the limit α1\alpha \to 1.

definition

Notation for Quantum Relative Entropy D(ρσ)\mathbf{D}(\rho \parallel \sigma)

#term𝐃(_‖_)

This represents the mathematical notation D(ρσ)\mathbf{D}(\rho \parallel \sigma), which denotes the quantum relative entropy between two quantum states ρ\rho and σ\sigma. It is defined formally as the value of the function `qRelativeEnt ρ σ`, which calculates the Umegaki relative entropy D(ρσ)=Tr[ρ(logρlogσ)]D(\rho \parallel \sigma) = \text{Tr}[\rho (\log \rho - \log \sigma)].

theorem

Factorization of the trace of the sandwiched term over tensor products

#sandwiched_term_product

Let ρ1,σ1\rho_1, \sigma_1 be mixed states of dimension d1d_1 and ρ2,σ2\rho_2, \sigma_2 be mixed states of dimension d2d_2. For any real numbers α\alpha and β\beta, the trace of the sandwiched term of the combined states satisfies the following factorization property: Tr[((ρ1ρ2)(σ1σ2)β(ρ1ρ2))α]=Tr[(ρ1σ1βρ1)α]Tr[(ρ2σ2βρ2)α] \operatorname{Tr}\left[ \left( (\rho_1 \otimes \rho_2) \cdot (\sigma_1 \otimes \sigma_2)^\beta \cdot (\rho_1 \otimes \rho_2)^\dagger \right)^\alpha \right] = \operatorname{Tr}\left[ \left( \rho_1 \cdot \sigma_1^\beta \cdot \rho_1^\dagger \right)^\alpha \right] \cdot \operatorname{Tr}\left[ \left( \rho_2 \cdot \sigma_2^\beta \cdot \rho_2^\dagger \right)^\alpha \right] where M.conjM.conj denotes the conjugation operation ABAA \cdot B \cdot A^\dagger, \otimes is the tensor product of mixed states, and MM is the density matrix associated with a mixed state.

theorem

Additivity of Sandwiched Rényi Relative Entropy for α1\alpha \neq 1

#sandwichedRelRentropy_additive_alpha_ne_one

For any real parameter α1\alpha \neq 1 and any quantum mixed states ρ1,σ1\rho_1, \sigma_1 on a Hilbert space of dimension d1d_1 and ρ2,σ2\rho_2, \sigma_2 on a Hilbert space of dimension d2d_2, the sandwiched Rényi relative entropy D~α\tilde{D}_\alpha is additive under the tensor product. That is, D~α(ρ1ρ2σ1σ2)=D~α(ρ1σ1)+D~α(ρ2σ2),\tilde{D}_\alpha(\rho_1 \otimes \rho_2 \parallel \sigma_1 \otimes \sigma_2) = \tilde{D}_\alpha(\rho_1 \parallel \sigma_1) + \tilde{D}_\alpha(\rho_2 \parallel \sigma_2), where \otimes denotes the tensor product of the mixed states.

theorem

Additivity of Sandwiched Rényi Relative Entropy for Product States

#sandwichedRelRentropy_additive

For any Renyi parameter α\alpha and mixed states ρ1,σ1\rho_1, \sigma_1 on a system of dimension d1d_1 and ρ2,σ2\rho_2, \sigma_2 on a system of dimension d2d_2, the sandwiched Rényi relative entropy D~α\tilde{D}_\alpha is additive under the tensor product of states: D~α(ρ1ρ2σ1σ2)=D~α(ρ1σ1)+D~α(ρ2σ2)\tilde{D}_\alpha(\rho_1 \otimes \rho_2 \,\|\, \sigma_1 \otimes \sigma_2) = \tilde{D}_\alpha(\rho_1 \,\|\, \sigma_1) + \tilde{D}_\alpha(\rho_2 \,\|\, \sigma_2) where \otimes denotes the tensor product of mixed states.

theorem

Additivity of Quantum Relative Entropy for Product States D(ρ1ρ2σ1σ2)=D(ρ1σ1)+D(ρ2σ2)D(\rho_1 \otimes \rho_2 \parallel \sigma_1 \otimes \sigma_2) = D(\rho_1 \parallel \sigma_1) + D(\rho_2 \parallel \sigma_2)

#qRelativeEnt_additive

For any quantum mixed states ρ1,σ1\rho_1, \sigma_1 on a Hilbert space of dimension d1d_1, and any quantum mixed states ρ2,σ2\rho_2, \sigma_2 on a Hilbert space of dimension d2d_2, the quantum relative entropy DD is additive under the tensor product of states. Specifically, D(ρ1ρ2σ1σ2)=D(ρ1σ1)+D(ρ2σ2)D(\rho_1 \otimes \rho_2 \parallel \sigma_1 \otimes \sigma_2) = D(\rho_1 \parallel \sigma_1) + D(\rho_2 \parallel \sigma_2) where \otimes denotes the tensor product of the mixed states.

theorem

Invariance of Sandwiched Rényi Relative Entropy under basis relabeling

#sandwichedRelRentropy_relabel

For any quantum mixed states ρ,σ\rho, \sigma defined on a finite-dimensional Hilbert space with basis dd, and for any bijection e:d2de: d_2 \simeq d between basis sets, the sandwiched Rényi relative entropy of order α\alpha is invariant under relabeling, such that D~α(ρσ)=D~α(ρσ)\tilde{D}_\alpha(\rho' \| \sigma') = \tilde{D}_\alpha(\rho \| \sigma), where ρ\rho' and σ\sigma' are the states relabeled by ee.

theorem

D~α(ρρ)=0\tilde{D}_{\alpha}(\rho \parallel \rho) = 0 for α>0\alpha > 0

#sandwichedRelRentropy_self

For any quantum state ρ\rho and any real parameter α>0\alpha > 0, the sandwiched Rényi relative entropy of the state with itself, denoted as D~α(ρρ)\tilde{D}_{\alpha}(\rho \parallel \rho), is equal to 0.

theorem

D~α(ρσ)\tilde{D}_{\alpha}(\rho \| \sigma) \neq \infty for non-singular σ\sigma

#sandwichedRelEntropy_ne_top

Let ρ\rho and σ\sigma be quantum mixed states on a finite-dimensional Hilbert space. If the density matrix of σ\sigma (denoted σ.M\sigma.M) is non-singular (invertible), then for any real order α\alpha, the sandwiched Rényi relative entropy D~α(ρσ)\tilde{D}_{\alpha}(\rho \| \sigma) is not equal to positive infinity (\infty).

theorem

The function α1α2α\alpha \mapsto \frac{1-\alpha}{2\alpha} is continuous on (0,)(0, \infty)

#continuousOn_exponent

The function f:RRf: \mathbb{R} \to \mathbb{R} defined by f(α)=1α2αf(\alpha) = \frac{1 - \alpha}{2\alpha} is continuous on the interval (0,)(0, \infty).

theorem

Continuity of rzrr \mapsto z^r on (0,)(0, \infty)

#continuousOn_cpow_const_Ioi

For any complex number zCz \in \mathbb{C}, the function f:RCf: \mathbb{R} \to \mathbb{C} defined by f(r)=zrf(r) = z^r is continuous on the interval (0,)(0, \infty). Here, zrz^r denotes the complex power function, and (0,)(0, \infty) is the set of positive real numbers.

theorem

α1α2α\alpha \mapsto \frac{1-\alpha}{2\alpha} maps (1,)(1, \infty) to (,0)(-\infty, 0)

#maps_to_Iio_of_Ioi_1

The function f:RRf: \mathbb{R} \to \mathbb{R} defined by α1α2α\alpha \mapsto \frac{1 - \alpha}{2\alpha} maps the interval (1,)(1, \infty) into the interval (,0)(-\infty, 0).

theorem

The frontier of a singleton {p}\{p\} in a perfect T1T_1 space is {p}\{p\}

#frontier_singleton

Let XX be a topological space that satisfies the T1T_1 separation axiom and is a perfect space (meaning it has no isolated points). For any point pXp \in X, the frontier (boundary) of the singleton set {p}\{p\} is equal to the set {p}\{p\} itself.

theorem

Continuity of D~α(ρσ)\tilde{D}_\alpha(\rho\|\sigma) for α>0\alpha > 0

#continuousOn

Let ρ\rho and σ\sigma be mixed states of a dd-dimensional Hilbert space (MStatedMState\, d). The sandwiched Rényi relative entropy D~α(ρσ)\tilde{D}_\alpha(\rho\|\sigma), considered as a function of the order parameter α\alpha, is continuous on the interval (0,)(0, \infty).

theorem

Quantum Relative Entropy Formula for kerσkerρ\ker \sigma \subseteq \ker \rho

#qRelativeEnt_ker

For any two quantum states ρ\rho and σ\sigma in a dd-dimensional Hilbert space, if the kernel of the density operator σ.M\sigma.M is contained within the kernel of the density operator ρ.M\rho.M (denoted kerσkerρ\ker \sigma \subseteq \ker \rho), then the quantum relative entropy D(ρσ)D(\rho \parallel \sigma) is given by the inner product ρ,logρlogσ\langle \rho, \log \rho - \log \sigma \rangle. In the context of operators, this corresponds to the trace formula Tr[ρ(logρlogσ)]\text{Tr}[\rho(\log \rho - \log \sigma)].

theorem

D(ρσ)=Svn(ρ)ρ,logσD(\rho \parallel \sigma) = -S_{vn}(\rho) - \langle \rho, \log \sigma \rangle if kerσkerρ\ker \sigma \subseteq \ker \rho else \infty

#qRelativeEnt_eq_neg_Sᵥₙ_add

For any two quantum mixed states ρ\rho and σ\sigma of dimension dd, the quantum relative entropy D(ρσ)D(\rho \parallel \sigma) relates to the von Neumann entropy Svn(ρ)S_{vn}(\rho) as follows: D(ρσ)=Svn(ρ)+{ρ,logσHSif kerσkerρotherwiseD(\rho \parallel \sigma) = -S_{vn}(\rho) + \begin{cases} -\langle \rho, \log \sigma \rangle_{HS} & \text{if } \ker \sigma \subseteq \ker \rho \\ \infty & \text{otherwise} \end{cases} where ,HS\langle \cdot, \cdot \rangle_{HS} denotes the Hilbert-Schmidt inner product and kerσkerρ\ker \sigma \subseteq \ker \rho indicates that the kernel of the density operator σ\sigma is contained within the kernel of ρ\rho.

theorem

Quantum Relative Entropy is Invariant Under Relabeling

#qRelativeEnt_relabel

Let ρ\rho and σ\sigma be quantum mixed states on a system with basis dd. For any bijection (equivalence) e:d2de : d_2 \simeq d, let ρ.relabel e\rho.\text{relabel } e and σ.relabel e\sigma.\text{relabel } e be the mixed states on the system with basis d2d_2 obtained by reindexing the density matrices. Then the quantum relative entropy D(ρσ)D(\rho \parallel \sigma) is invariant under such relabeling, i.e., D(ρ.relabel eσ.relabel e)=D(ρσ)D(\rho.\text{relabel } e \parallel \sigma.\text{relabel } e) = D(\rho \parallel \sigma).

theorem

D~α(ρσ)=0D̃_{\alpha}(\rho‖\sigma) = 0 for unique states on a 1D system

#sandwichedRelRentropy_of_unique

Let dd be a type with exactly one element (representing a 1-dimensional Hilbert space). For any two mixed states ρ\rho and σ\sigma in MState d\text{MState } d, the sandwiched Rényi relative entropy of order α\alpha, denoted D~α(ρσ)D̃_{\alpha}(\rho‖\sigma), is equal to 0.

theorem

Quantum Relative Entropy of States on a Unique Type is 0

#qRelEntropy_of_unique

Let dd be a type with a unique element (i.e., a singleton type). For any two mixed states ρ\rho and σ\sigma defined over dd, the quantum relative entropy D(ρσ)\mathbf{D}(\rho\|\sigma) is equal to 00.

theorem

D~α(ρ1σ1)=D~α(ρ2σ2)\tilde{D}_\alpha(\rho_1 \| \sigma_1) = \tilde{D}_\alpha(\rho_2 \| \sigma_2) for heterogeneously equal states and types

#sandwichedRelRentropy_heq_congr

Let d1d_1 and d2d_2 be finite types with decidable equality, representing the index sets of two quantum systems. Let ρ1,σ1\rho_1, \sigma_1 be mixed states on the system indexed by d1d_1, and ρ2,σ2\rho_2, \sigma_2 be mixed states on the system indexed by d2d_2. If the index sets are equal (d1=d2d_1 = d_2) and the states are heterogeneously equal (denoted by ρ1ρ2\rho_1 \cong \rho_2 and σ1σ2\sigma_1 \cong \sigma_2), then their sandwiched Rényi relative entropies of order α\alpha are equal, i.e., D~α(ρ1σ1)=D~α(ρ2σ2)\tilde{D}_\alpha(\rho_1 \| \sigma_1) = \tilde{D}_\alpha(\rho_2 \| \sigma_2).

theorem

Invariance of Sandwiched Rényi Relative Entropy under Basis Relabeling (D~α(ρ1σ1)=D~α(ρ2σ2)\tilde{D}_\alpha(\rho_1 \| \sigma_1) = \tilde{D}_\alpha(\rho_2 \| \sigma_2))

#sandwichedRelRentropy_congr

Given two finite dimensional quantum systems with basis types d1d_1 and d2d_2 and states ρ1,σ1\rho_1, \sigma_1 on d1d_1 and ρ2,σ2\rho_2, \sigma_2 on d2d_2, if there is an equality between the basis types d1=d2d_1 = d_2 such that the states are related by the corresponding relabeling (ρ1=relabel(ρ2)\rho_1 = \text{relabel}(\rho_2) and σ1=relabel(σ2)\sigma_1 = \text{relabel}(\sigma_2)), then the sandwiched Rényi relative entropies are equal: D~α(ρ1σ1)=D~α(ρ2σ2)\tilde{D}_\alpha(\rho_1 \| \sigma_1) = \tilde{D}_\alpha(\rho_2 \| \sigma_2).

theorem

Quantum Relative Entropy is Invariant under Heterogeneous Equality of States

#qRelEntropy_heq_congr

Let d1d_1 and d2d_2 be finite types. Let ρ1,σ1\rho_1, \sigma_1 be mixed states (of type `MState`) acting on a Hilbert space indexed by d1d_1, and ρ2,σ2\rho_2, \sigma_2 be mixed states acting on a Hilbert space indexed by d2d_2. If the underlying types are equal (d1=d2d_1 = d_2) and the states are heterogeneous equal (denoted by ρ1ρ2\rho_1 \cong \rho_2 and σ1σ2\sigma_1 \cong \sigma_2), then the quantum relative entropies are equal: D(ρ1σ1)=D(ρ2σ2)D(\rho_1 \Vert \sigma_1) = D(\rho_2 \Vert \sigma_2).

theorem

Quantum Relative Entropy for Full Rank σ\sigma acts as ρ,logρlogσ\langle \rho, \log \rho - \log \sigma \rangle

#qRelativeEnt_rank

Let ρ\rho and σ\sigma be quantum states (represented as density matrices in MState dMState \ d). If σ\sigma is non-singular (i.e., it has full rank), then the quantum relative entropy D(ρσ)D(\rho \| \sigma) is given by the inner product ρ,logρlogσ\langle \rho, \log \rho - \log \sigma \rangle where log\log denotes the matrix logarithm and A,B=Tr(AB)\langle A, B \rangle = \text{Tr}(A^* B) is the Hilbert-Schmidt inner product.

theorem

Upper Semicontinuity of ρ,logσ\langle \rho, \log \sigma \rangle under Kernel Constraint

#inner_log_bounded_near

Let ρ\rho and σ\sigma be mixed states in MState d\text{MState } d, where MM denotes the underlying density matrix. Suppose the kernel of σ\sigma is contained in the kernel of ρ\rho (kerσkerρ\ker \sigma \subseteq \ker \rho). If the Hilbert-Schmidt inner product of ρ\rho and the matrix logarithm of σ\sigma is strictly less than some real value yy (i.e., ρ,logσ<y\langle \rho, \log \sigma \rangle < y), then for all mixed states xx in a sufficiently small neighborhood of σ\sigma, if kerxkerρ\ker x \subseteq \ker \rho, then ρ,logx<y\langle \rho, \log x \rangle < y.

theorem

Lower Semicontinuity of Quantum Relative Entropy at States with Mismatched Kernels

#qRelativeEnt_lowerSemicontinuous_2

Let ρ\rho and xx be mixed states in MState d\text{MState } d such that the kernel of the matrix xx is not contained in the kernel of the matrix ρ\rho (kerx≰kerρ\ker x \not\le \ker \rho). For any value y[0,]y \in [0, \infty], if y<y < \infty, then there exists a neighborhood of xx such that for all mixed states xx' in that neighborhood, the value yy is strictly less than the quantity defined by: {ρ,logρlogxif kerxkerρotherwise \begin{cases} \langle \rho, \log \rho - \log x' \rangle & \text{if } \ker x' \le \ker \rho \\ \infty & \text{otherwise} \end{cases} where the expression is treated as an element of the extended real numbers R\overline{\mathbb{R}}.

theorem

Lower Semicontinuity of Quantum Relative Entropy D(ρσ)\mathbf{D}(\rho \| \sigma) in its Second Argument

#lowerSemicontinuous

For any fixed mixed state ρ\rho of dimension dd, the quantum relative entropy D(ρσ)\mathbf{D}(\rho \| \sigma) is lower semicontinuous as a function of the mixed state σ\sigma. That is, for every σMState d\sigma \in \text{MState } d, and for any y<D(ρσ)y < \mathbf{D}(\rho \| \sigma), there exists a neighborhood of σ\sigma such that for all σ\sigma' in that neighborhood, y<D(ρσ)y < \mathbf{D}(\rho \| \sigma').

theorem

Joint Convexity of Quantum Relative Entropy D(ρσ)D(\rho \| \sigma)

#qRelativeEnt_joint_convexity

For any quantum states ρ1,ρ2,σ1,σ2\rho_1, \rho_2, \sigma_1, \sigma_2 in the state space MStated\text{MState}_d and any probability p[0,1]p \in [0, 1], the quantum relative entropy D()D(\cdot \| \cdot) satisfies joint convexity: D(pρ1+(1p)ρ2pσ1+(1p)σ2)pD(ρ1σ1)+(1p)D(ρ2σ2)D(p\rho_1 + (1-p)\rho_2 \| p\sigma_1 + (1-p)\sigma_2) \le p D(\rho_1 \| \sigma_1) + (1-p) D(\rho_2 \| \sigma_2) where p[ρ1ρ2]p [\rho_1 \leftrightarrow \rho_2] denotes the convex mixture (or "mix") of the states ρ1\rho_1 and ρ2\rho_2 with weights pp and 1p1-p respectively.

theorem

D(ρρ)=0D(\rho \Vert \rho) = 0

#qRelEntropy_self

For any mixed state ρ\rho in a dd-dimensional Hilbert space, the quantum relative entropy of ρ\rho with respect to itself is zero, denoted as D(ρρ)=0D(\rho \Vert \rho) = 0.

theorem

Quantum Relative Entropy with Non-Singular σ\sigma is Finite

#qRelativeEnt_ne_top

Let ρ\rho and σ\sigma be mixed states of dimension dd. If σ\sigma is non-singular (i.e., its density matrix is invertible), then the quantum relative entropy D(ρσ)D(\rho\|\sigma) is not equal to \infty (it is finite in the extended non-negative real numbers R0\overline{\mathbb{R}}_{\ge 0}).

theorem

I(A:B)=D(ρρAρB)I(A:B) = D(\rho \parallel \rho^A \otimes \rho^B)

#qMutualInfo_as_qRelativeEnt

For a bipartite quantum mixed state ρ\rho on a composite system with dimensions dA×dBd_A \times d_B, the quantum mutual information I(A:B)I(A:B) is equal to the quantum relative entropy between ρ\rho and the tensor product of its reduced density matrices, ρAρB\rho^A \otimes \rho^B. That is, I(A:B)=D(ρρAρB)I(A:B) = D(\rho \parallel \rho^A \otimes \rho^B) where ρA=TrB(ρ)\rho^A = \text{Tr}_B(\rho) and ρB=TrA(ρ)\rho^B = \text{Tr}_A(\rho) are the partial traces over the right and left subsystems, respectively.

theorem

D(ρσ1)D(ρσ2)+logαD(\rho \parallel \sigma_1) \le D(\rho \parallel \sigma_2) + \log \alpha if σ2ασ1\sigma_2 \le \alpha \sigma_1

#qRelEntropy_le_add_of_le_smul

Let ρ\rho, σ1\sigma_1, and σ2\sigma_2 be quantum mixed states in a dd-dimensional Hilbert space. Let Mσ1M_{\sigma_1} and Mσ2M_{\sigma_2} denote the density operators of σ1\sigma_1 and σ2\sigma_2, respectively. If Mσ2M_{\sigma_2} is bounded by a scaling of Mσ1M_{\sigma_1} such that Mσ2αMσ1M_{\sigma_2} \le \alpha \cdot M_{\sigma_1} for some scalar αR\alpha \in \mathbb{R}, then the quantum relative entropy satisfies the inequality D(ρσ1)D(ρσ2)+logαD(\rho \parallel \sigma_1) \le D(\rho \parallel \sigma_2) + \log \alpha.

theorem

Quantum Relative Entropy is bounded by the Logarithm of the Dominance Ratio α\alpha

#qRelativeEnt_op_le

Let ρ\rho and σ\sigma be mixed states of dimension dd, and let MρM_\rho and MσM_\sigma denote their respective density matrices. If MραMσM_\rho \le \alpha \cdot M_\sigma for some scalar αR\alpha \in \mathbb{R}, then the quantum relative entropy D(ρσ)D(\rho \| \sigma) is bounded by logα\log \alpha, specifically D(ρσ)ENNReal.ofReal(logα)D(\rho \| \sigma) \le \text{ENNReal.ofReal}(\log \alpha).