### Tsallis Entropy

October 29, 2014 Thermodynamics has developed from contributions from scientists of many nationalities. As just a few examples, we have Sadi Carno (1796-1832) from France; Robert Boyle (1627-1691) and William Thomson, Lord Kelvin (1824-1907) from Ireland; James Prescott Joule (1818-1889) from England; Rudolf Clausius (1822-1888) from Germany; James Clerk Maxwell (1831-1879) from Scotland; Josiah Willard Gibbs (1839-1903) from the United States; and Ludwig Boltzmann (1844-1906) from Austria).*Some founders of thermodynamics. Clockwise from the upper left, **Carno, Boyle, Kelvin, Joule, Boltzmann, Gibbs, Maxwell, and Clausius. Images, via Wikimedia Commons, Carnot, Boyle, Kelvin, Joule, Clausius, Maxwell, Gibbs, Boltzmann. (Click for larger image)*

It's only fitting that Greece, the origin of the Western intellectual tradition of philosophy and science, should also have been the birthplace of some prominent thermodynamicists. One of these is Constantin Carathéodory (1873-1950), whose profession was primarily mathematics. In 1909, Carathéodory ventured into applied mathematics by working to formulate thermodynamics axiomatically. His book, "Investigations on the Foundations of Thermodynamics," sought to derive thermodynamics from mechanics. The importance of this approach is that he was able address irreversibility. Classical thermodynamics is accurately applied only to reversible processes, although bending of this rule still leads to acceptable results.

*Constantin Carathéodory shown in military dress in his youth. This is apparently from his time at the Royal Military Academy in Belgium.Carathéodory's doctoral advisor was Hermann Minkowski, known for his work on special relativity.(Via Wikimedia Commons.)*

Carathéodory's work is somewhat inaccessible because of all the mathematics, but another Greek thermodynamicist developed a modification of the classical Boltzmann entropy that's easy to understand. Constantino Tsallis (b. 1943) is a physicist who's a naturalized citizen of Brazil, but he was born in Athens, Greece, lived in Argentina, and he was awarded his doctotal degree in physics from the University of Paris-Orsay. Everyone who has taken a few physics or chemistry courses is familiar with Boltzmann's entropy formula,

in which

**S**is the entropy,

**K**is the Boltzmann constant (1.38062 x 10

_{B}^{-23}joule/kelvin), and

**Ω**is the number of states accessible to the system. This equation is actually a simplification of the Boltzmann-Gibbs entropy when every state has the same probability

**p**; viz,

_{i}These equations define a maximum entropy, since the equal probability means that you can stuff an atom or molecule into any accessible state. At this point, we might wonder what will happen when some states are correlated with each other, a condition for which the entropy will be less than the maximum. That's what Tsallis did in a 1988 paper[1] in which he defined what's now known as the Tsallis entropy,

**S**, given by the following equation:

_{q}in which the parameter,

**q**, is called the entropic-index. This equation becomes the Boltzmann-Gibbs entropy equation when we take the limit as q approaches one. It's been a while since I did limits in Calculus, so I'll just take this on faith. There are presently 69 papers posted on arXiv having "Tsallis entropy" in their titles. What's so important about Tsallis entropy? Boltzmann entropy applies only to systems in equilibrium, and the Boltzmann entropy is an extensive function; that is, it depends on how much matter we have in our system. In non-equilibrium systems we need another way to look at entropy, and now we have Tsallis entropy, which is non-extensive. As can be imagined, a lot of people have a problem with a non-extensive entropy.

*Constantino Tsallis in February, 2010Tsallis is at the Centro Brasileiro de Pesquisas Físicas (Brazilian Physics Research Center)(Photograph by Maria Aparecida, via Wikimedia Commons.)*

Tsallis entropy has been shown to produce better results than Boltzmann entropy for the analysis of some systems in biology, nuclear physics, finance, music, and linguistics; and the correlations in DNA sequences.[2] Despite these successes, there's been criticism that the entropic-index

**q**acts merely as a fitting parameter. There's also an argument that Tsallis entropy violates the zeroth law of thermodynamics. That's the law that states that systems in thermal equilibrium with another system are in equilibrium with each other.[3] In the end, it appears that physicists just need to know whether to apply one entropy or another to a given system. It's not unlike knowing that you should use classical mechanics for bowling balls and quantum mechanics for atoms.[3]

### References:

- Constantino Tsallis, "Possible generalization of Boltzmann-Gibbs statistics," Journal of Statistical Physics, vol. 52, nos. 1-2 (July, 1988), pp. 479-487.
- H. V. Ribeiro, E. K. Lenzi, R. S. Mendes, G. A. Mendes, and L. R. da Silva, "Symbolic Sequences and Tsallis Entropy," arXiv Preprint Server, January 16, 2014.
- Jon Cartwright, "Roll over, Boltzmann," Physics World, May, 2014, pp. 31-35.

*Permanent Link to this article*

Linked Keywords: Thermodynamics; scientist; nationality; Sadi Carno (1796-1832); Robert Boyle (1627-1691); William Thomson, Lord Kelvin (1824-1907); James Prescott Joule (1818-1889); Rudolf Clausius (1822-1888); James Clerk Maxwell (1831-1879); Josiah Willard Gibbs (1839-1903); Ludwig Boltzmann (1844-1906); Founders of Thermodynamics; Greece; Western intellectual tradition; philosophy; science; thermodynamics; thermodynamicist; Constantin Carathéodory (1873-1950); profession; mathematics; applied mathematics; axiom; axiomatic; classical mechanics; reversible process; irreversibility; uiform; military dress; youth; Royal Military Academy; Belgium; doctoral advisor; Hermann Minkowski; special relativity; Wikimedia Commons; Boltzmann's entropy formula; Boltzmann entropy; Constantino Tsallis (b. 1943); physicist; naturalization; naturalized citizen; Brazil; Athens; Argentina; doctorate; doctotal degree; physics; University of Paris-Sud; University of Paris-Orsay; chemistry; course; entropy; Boltzmann constant; joule; kelvin; Boltzmann-Gibbs entropy; probability; atom; molecule; correlation; correlated; Tsallis entropy; parameter; limit; Calculus; scientific literature; paper; arXiv; thermodynamic equilibrium; intensive and extensive properties; extensive function; matter; Centro Brasileiro de Pesquisas Físicas; biology; nuclear physics; finance; music; linguistics; nucleic acid sequence; DNA sequence; curve fit; fitting; zeroth law of thermodynamics; physicist; bowling ball; quantum mechanics.

### Google Search

Latest Books by Dev Gualtieri

Thanks to Cory Doctorow of BoingBoing for his favorable review of Secret Codes!

Other Books

- Torqued Light - August 19, 2019

- The Dragonfly of Titan - August 12, 2019

- Optical Ruler - August 5, 2019

- Bolometry - July 29, 2019

- Too Many Commercials - July 22, 2019

- Lost Moons - July 15, 2019

- Go with the Flow - July 8, 2019

- Ion-Gated Transistors - July 1, 2019

- Ice XVIII - June 24, 2019

- Threshold Earthquakes - June 17, 2019

- Aurora Exascale Computer - June 10, 2019

- Flawed Science - June 3, 2019

- Very Low Frequencies - May 27, 2019

- Boiling Crisis - May 20, 2019

- Weighing the Milky Way - May 13, 2019

- Tanis - May 6, 2019

- Grey/Gray Goo - April 29, 2019

- Anti-Laser Blackness - April 22, 2019

- The Zwicky Transient Facility - April 15, 2019

- Weather Forecasting - April 8, 2019

- Boron Nitride Aerogels - April 1, 2019

- John Archibald Wheeler - March 25, 2019

- The Year 536 - March 18, 2019

- 150 Years of the Periodic Table - March 11, 2019

- Sloan Digital Sky Survey MaNGA - March 4, 2019

- Ductile High-Entropy Alloys - February 25, 2019

- Cooling with Aerosols - February 18, 2019

- Magnetic North - February 11, 2019

- Metal-Air Transistor - February 4, 2019

- Crazy Number Sequences - January 28, 2019

- Thermal Filtering - January 21, 2019

- Strong Wood - January 14, 2019

- Ultima Thule - January 7, 2019

### Deep Archive

Deep Archive 2006-2008

**Blog Article Directory on a Single Page**