中国物理B ›› 2025, Vol. 34 ›› Issue (8): 80201-080201.doi: 10.1088/1674-1056/adbed7
所属专题: SPECIAL TOPIC — A celebration of the 90th Anniversary of the Birth of Bolin Hao
• • 下一篇
Jeffrey Commons1, Ying-Jen Yang(杨颖任)2,3, and Hong Qian(钱纮)2,†
Jeffrey Commons1, Ying-Jen Yang(杨颖任)2,3, and Hong Qian(钱纮)2,†
摘要: We generalize the convex duality symmetry in Gibbs' statistical ensemble formulation, between the Gibbs entropy $\varphi_{V,N}(E)$ as a function of mean internal energy $E$ and Massieu's free entropy $\varPsi_{V,N}(\beta)$ as a function of inverse temperature $\beta$. The duality in terms of Legendre-Fenchel transform tells us that Gibbs' thermodynamic entropy is to the law of large numbers (LLN) for arithmetic sample mean values what Shannon's information entropy is to the LLN for empirical counting frequencies in independent and identically distributed data. Proceeding with the same mathematical logic, we identify the energy of the state $\{u_i\}$ as the conjugate variable to the counting of statistical occurrence $\{m_i\}$ and find a Hamilton-Jacobi equation for the Shannon entropy analogous to an equation of state in thermodynamics. An eigenvalue problem that is reminiscent of certain features in quantum mechanics arises in the entropy theory of statistical counting frequencies of Markov correlated data.
中图分类号: (Probability theory)