|
Special Issue:
|
| SPECIAL TOPIC — A celebration of the 90th Anniversary of the Birth of Bolin Hao |
Next
|
|
|
Duality symmetry, two entropy functions, and an eigenvalue problem in generalized Gibbs' theory |
| Jeffrey Commons1, Ying-Jen Yang(杨颖任)2,3, and Hong Qian(钱纮)2,† |
1 Department of Physics, University of Washington, Seattle, WA 98195-1560, USA;
2 Department of Applied Mathematics, University of Washington, Seattle, WA 98195-3925, USA;
3 Laufer Center for Physical and Quantitative Biology, Stony Brook University, New York 11794, USA |
|
|
|
|
Abstract We generalize the convex duality symmetry in Gibbs' statistical ensemble formulation, between the Gibbs entropy $\varphi_{V,N}(E)$ as a function of mean internal energy $E$ and Massieu's free entropy $\varPsi_{V,N}(\beta)$ as a function of inverse temperature $\beta$. The duality in terms of Legendre-Fenchel transform tells us that Gibbs' thermodynamic entropy is to the law of large numbers (LLN) for arithmetic sample mean values what Shannon's information entropy is to the LLN for empirical counting frequencies in independent and identically distributed data. Proceeding with the same mathematical logic, we identify the energy of the state $\{u_i\}$ as the conjugate variable to the counting of statistical occurrence $\{m_i\}$ and find a Hamilton-Jacobi equation for the Shannon entropy analogous to an equation of state in thermodynamics. An eigenvalue problem that is reminiscent of certain features in quantum mechanics arises in the entropy theory of statistical counting frequencies of Markov correlated data.
|
Received: 30 June 2024
Revised: 02 March 2025
Accepted manuscript online: 11 March 2025
|
|
PACS:
|
02.50.Cw
|
(Probability theory)
|
| |
05.70.-a
|
(Thermodynamics)
|
| |
82.60.-s
|
(Chemical thermodynamics)
|
| |
89.70.-a
|
(Information and communication theory)
|
|
Corresponding Authors:
Hong Qian
E-mail: hqian@uw.edu
|
Cite this article:
Jeffrey Commons, Ying-Jen Yang(杨颖任), and Hong Qian(钱纮) Duality symmetry, two entropy functions, and an eigenvalue problem in generalized Gibbs' theory 2025 Chin. Phys. B 34 080201
|
[1] Smith E 2020 Entropy 22 1137
[2] Qian H 2022 J. Chem. Theory Comput. 18 6421
[3] Qian H 2024 Entropy 26 1091
[4] Ge H and Qian H 2016 Phys. Rev. E 94 052150
[5] Ge H and Qian H 2017 J. Stat. Phys. 166 190
[6] Hill T L 1963 Thermodynamics of Small Systems (New York: Dover)
[7] Lu Z and Qian H 2022 Phys. Rev. Lett. 128 150603
[8] Oono Y 1989 Progr. Theor. Phys. Supp. 99 165
[9] Dembo A and Zeitouni O 1998 Large Deviations Techniques and Applications, 2nd Ed. (New York: Springer)
[10] Chibbaro S, Rondoni L and Vulpiani A 2014 Reductionism, Emergence and Levels of Reality (New York: Springer)
[11] Angelini E and Qian H 2023 J. Phys. Chem. B 127 2552
[12] Rockafellar R T 1996 Convex Analysis (NJ: Princeton Univ. Press)
[13] Miao B, Qian H and Wu Y S 2024 arXiv:2406.02405
[14] Shannon C E and Weaver W 1949 The Mathematical Theory of Communication (Champaign: Univ. Ill. Press)
[15] Hobson A 1969 J. Stat. Phys. 1 383
[16] Shore J E and Johnson R W 1980 IEEE Trans. Inf. Th. 26 26
[17] Guggenheim E A 1933 Modern Thermodynamics by the Methods of Willard Gibbs (New York: Methuen & Co.)
[18] Callen H B 1991 Thermodynamics and an Introduction to Thermostatistics, 2nd Ed. (New York: John Wiley & Sons)
[19] Huang K 1963 Statistical Mechanics (New York: John Wiley & Sons)
[20] Kirkwood J G 1935 J. Chem. Phys. 3 300
[21] Yang Y J and Qian H 2020 Phys. Rev. E 101 022129
[22] Barato A C and Chetrite R 2015 J. Stat. Phys. 160 1154
[23] Baldi P and Piccioni M 1999 Stat. Probab. Lett. 41 107
[24] Cohen J 1981 Proc. Amer. Math. Soc. 81 657
[25] Yang C N and Lee T D 1952 Phys. Rev. 87 404
[26] Anderson P W 1972 Science 177 393
[27] Jaynes E T 2003 Probability Theory: The Logic of Science (Cambridge: Cambridge Univ. Press)
[28] Ghosh K, Dixit P D, Agozzino L and Dill K A 2020 Annu. Rev. Phys. Chem. 71 213
[29] Dill K A 2021 The maximum caliber principle for modeling stochastic dynamic processes
[30] Salmon W C 1990 Four Decades of Scientific Explanation (Pittsburgh: Univ. Pittsburgh Press)
[31] Laughlin R B 2006 A Different Universe: Reinventing Physics from the Bottom Down (New York: Basic Books)
[32] Schellman J A 1997 Biophys. Chem. 64 7
[33] Hoffmann B 2011 The Strange Story of the Quantum (New York: Dover) |
| No Suggested Reading articles found! |
|
|
Viewed |
|
|
|
Full text
|
|
|
|
|
Abstract
|
|
|
|
|
Cited |
|
|
|
|
Altmetric
|
|
blogs
Facebook pages
Wikipedia page
Google+ users
|
Online attention
Altmetric calculates a score based on the online attention an article receives. Each coloured thread in the circle represents a different type of online attention. The number in the centre is the Altmetric score. Social media and mainstream news media are the main sources that calculate the score. Reference managers such as Mendeley are also tracked but do not contribute to the score. Older articles often score higher because they have had more time to get noticed. To account for this, Altmetric has included the context data for other articles of a similar age.
View more on Altmetrics
|
|
|
