### Tsallis Entropy

October 29, 2014 Thermodynamics has developed from contributions from scientists of many nationalities. As just a few examples, we have Sadi Carno (1796-1832) from France; Robert Boyle (1627-1691) and William Thomson, Lord Kelvin (1824-1907) from Ireland; James Prescott Joule (1818-1889) from England; Rudolf Clausius (1822-1888) from Germany; James Clerk Maxwell (1831-1879) from Scotland; Josiah Willard Gibbs (1839-1903) from the United States; and Ludwig Boltzmann (1844-1906) from Austria).*Some founders of thermodynamics. Clockwise from the upper left, **Carno, Boyle, Kelvin, Joule, Boltzmann, Gibbs, Maxwell, and Clausius. Images, via Wikimedia Commons, Carnot, Boyle, Kelvin, Joule, Clausius, Maxwell, Gibbs, Boltzmann. (Click for larger image)*

It's only fitting that Greece, the origin of the Western intellectual tradition of philosophy and science, should also have been the birthplace of some prominent thermodynamicists. One of these is Constantin Carathéodory (1873-1950), whose profession was primarily mathematics. In 1909, Carathéodory ventured into applied mathematics by working to formulate thermodynamics axiomatically. His book, "Investigations on the Foundations of Thermodynamics," sought to derive thermodynamics from mechanics. The importance of this approach is that he was able address irreversibility. Classical thermodynamics is accurately applied only to reversible processes, although bending of this rule still leads to acceptable results.

*Constantin Carathéodory shown in military dress in his youth. This is apparently from his time at the Royal Military Academy in Belgium.Carathéodory's doctoral advisor was Hermann Minkowski, known for his work on special relativity.(Via Wikimedia Commons.)*

Carathéodory's work is somewhat inaccessible because of all the mathematics, but another Greek thermodynamicist developed a modification of the classical Boltzmann entropy that's easy to understand. Constantino Tsallis (b. 1943) is a physicist who's a naturalized citizen of Brazil, but he was born in Athens, Greece, lived in Argentina, and he was awarded his doctotal degree in physics from the University of Paris-Orsay. Everyone who has taken a few physics or chemistry courses is familiar with Boltzmann's entropy formula,

in which

**S**is the entropy,

**K**is the Boltzmann constant (1.38062 x 10

_{B}^{-23}joule/kelvin), and

**Ω**is the number of states accessible to the system. This equation is actually a simplification of the Boltzmann-Gibbs entropy when every state has the same probability

**p**; viz,

_{i}These equations define a maximum entropy, since the equal probability means that you can stuff an atom or molecule into any accessible state. At this point, we might wonder what will happen when some states are correlated with each other, a condition for which the entropy will be less than the maximum. That's what Tsallis did in a 1988 paper[1] in which he defined what's now known as the Tsallis entropy,

**S**, given by the following equation:

_{q}in which the parameter,

**q**, is called the entropic-index. This equation becomes the Boltzmann-Gibbs entropy equation when we take the limit as q approaches one. It's been a while since I did limits in Calculus, so I'll just take this on faith. There are presently 69 papers posted on arXiv having "Tsallis entropy" in their titles. What's so important about Tsallis entropy? Boltzmann entropy applies only to systems in equilibrium, and the Boltzmann entropy is an extensive function; that is, it depends on how much matter we have in our system. In non-equilibrium systems we need another way to look at entropy, and now we have Tsallis entropy, which is non-extensive. As can be imagined, a lot of people have a problem with a non-extensive entropy.

*Constantino Tsallis in February, 2010Tsallis is at the Centro Brasileiro de Pesquisas Físicas (Brazilian Physics Research Center)(Photograph by Maria Aparecida, via Wikimedia Commons.)*

Tsallis entropy has been shown to produce better results than Boltzmann entropy for the analysis of some systems in biology, nuclear physics, finance, music, and linguistics; and the correlations in DNA sequences.[2] Despite these successes, there's been criticism that the entropic-index

**q**acts merely as a fitting parameter. There's also an argument that Tsallis entropy violates the zeroth law of thermodynamics. That's the law that states that systems in thermal equilibrium with another system are in equilibrium with each other.[3] In the end, it appears that physicists just need to know whether to apply one entropy or another to a given system. It's not unlike knowing that you should use classical mechanics for bowling balls and quantum mechanics for atoms.[3]

### References:

- Constantino Tsallis, "Possible generalization of Boltzmann-Gibbs statistics," Journal of Statistical Physics, vol. 52, nos. 1-2 (July, 1988), pp. 479-487.
- H. V. Ribeiro, E. K. Lenzi, R. S. Mendes, G. A. Mendes, and L. R. da Silva, "Symbolic Sequences and Tsallis Entropy," arXiv Preprint Server, January 16, 2014.
- Jon Cartwright, "Roll over, Boltzmann," Physics World, May, 2014, pp. 31-35.

*Permanent Link to this article*

Linked Keywords: Thermodynamics; scientist; nationality; Sadi Carno (1796-1832); Robert Boyle (1627-1691); William Thomson, Lord Kelvin (1824-1907); James Prescott Joule (1818-1889); Rudolf Clausius (1822-1888); James Clerk Maxwell (1831-1879); Josiah Willard Gibbs (1839-1903); Ludwig Boltzmann (1844-1906); Founders of Thermodynamics; Greece; Western intellectual tradition; philosophy; science; thermodynamics; thermodynamicist; Constantin Carathéodory (1873-1950); profession; mathematics; applied mathematics; axiom; axiomatic; classical mechanics; reversible process; irreversibility; uiform; military dress; youth; Royal Military Academy; Belgium; doctoral advisor; Hermann Minkowski; special relativity; Wikimedia Commons; Boltzmann's entropy formula; Boltzmann entropy; Constantino Tsallis (b. 1943); physicist; naturalization; naturalized citizen; Brazil; Athens; Argentina; doctorate; doctotal degree; physics; University of Paris-Sud; University of Paris-Orsay; chemistry; course; entropy; Boltzmann constant; joule; kelvin; Boltzmann-Gibbs entropy; probability; atom; molecule; correlation; correlated; Tsallis entropy; parameter; limit; Calculus; scientific literature; paper; arXiv; thermodynamic equilibrium; intensive and extensive properties; extensive function; matter; Centro Brasileiro de Pesquisas Físicas; biology; nuclear physics; finance; music; linguistics; nucleic acid sequence; DNA sequence; curve fit; fitting; zeroth law of thermodynamics; physicist; bowling ball; quantum mechanics.

### Google Search

Latest Books by Dev Gualtieri

**Previews Availableat Tikalon Press**

*STEM-themed novel for middle-school students*

*Mathematics-themed novel for middle-school students*

*Complete texts of LGM, Mother Wode, and The Alchemists of Mars*

Other Books

- A.I., Wine, and Beer, June 10, 2024

- Bergmann's rule, June 3, 2024

- 60 Hertz Standard, May 27, 2024

- Droplets, May 20, 2024

- Levitation, May 13, 2024

- 100 Years of IBM, May 6, 2024

- Cicada Apocalypse, April 29, 2024

- Critical Materials, April 22, 2024

- Eclipse 2024, April 15, 2024

- Reverse Sprinkler, April 8, 2024

- T Coronae Borealis, April 1, 2024

- Coffee and Tea, March 25, 2024

- Arno Penzias (1933-2024), March 18, 2024

- Wave-Particle Duality, March 11, 2024

- Offshore Wind, March 4, 2024

- High Entropy Ceramics, February 26, 2024

- Methane Emissions, February 19, 2024

- Thales, Heron, and Experimental Mathematics, February 12, 2024

- Mica, February 5, 2024

- Disk Packing, January 29, 2024

- Is e
^{π}> π^{e}?, January 22, 2024

- Brownian Motion Energy Harvesting, January 15, 2024

- Coin Flip, January 8, 2024

- Holidays 2023, December 18, 2023

- Fast Radio Bursts, December 11, 2023

- Adhesives, December 4, 2023

- MOND and Planet Nine, November 27, 2023

- Earthquake Light, November 20, 2023

- Antimatter Gravitation, November 13, 2023

- Koch Snowflake, November 6, 2023

### Deep Archive

Deep Archive 2006-2008

**Blog Article Directory on a Single Page**