What is Entropy: Definition and 1000 Discussions

Entropy is a scientific concept, as well as a measurable physical property that is most commonly associated with a state of disorder, randomness, or uncertainty. The term and the concept are used in diverse fields, from classical thermodynamics, where it was first recognized, to the microscopic description of nature in statistical physics, and to the principles of information theory. It has found far-ranging applications in chemistry and physics, in biological systems and their relation to life, in cosmology, economics, sociology, weather science, climate change, and information systems including the transmission of information in telecommunication.The thermodynamic concept was referred to by Scottish scientist and engineer Macquorn Rankine in 1850 with the names thermodynamic function and heat-potential. In 1865, German physicist Rudolph Clausius, one of the leading founders of the field of thermodynamics, defined it as the quotient of an infinitesimal amount of heat to the instantaneous temperature. He initially described it as transformation-content, in German Verwandlungsinhalt, and later coined the term entropy from a Greek word for transformation. Referring to microscopic constitution and structure, in 1862, Clausius interpreted the concept as meaning disgregation.A consequence of entropy is that certain processes are irreversible or impossible, aside from the requirement of not violating the conservation of energy, the latter being expressed in the first law of thermodynamics. Entropy is central to the second law of thermodynamics, which states that the entropy of isolated systems left to spontaneous evolution cannot decrease with time, as they always arrive at a state of thermodynamic equilibrium, where the entropy is highest.
Austrian physicist Ludwig Boltzmann explained entropy as the measure of the number of possible microscopic arrangements or states of individual atoms and molecules of a system that comply with the macroscopic condition of the system. He thereby introduced the concept of statistical disorder and probability distributions into a new field of thermodynamics, called statistical mechanics, and found the link between the microscopic interactions, which fluctuate about an average configuration, to the macroscopically observable behavior, in form of a simple logarithmic law, with a proportionality constant, the Boltzmann constant, that has become one of the defining universal constants for the modern International System of Units (SI).
In 1948, Bell Labs scientist Claude Shannon developed similar statistical concepts of measuring microscopic uncertainty and multiplicity to the problem of random losses of information in telecommunication signals. Upon John von Neumann's suggestion, Shannon named this entity of missing information in analogous manner to its use in statistical mechanics as entropy, and gave birth to the field of information theory. This description has been proposed as a universal definition of the concept of entropy.

View More On Wikipedia.org
  1. Y

    Entropy change in an RC circuit

    Hello,I would like some help for a problem Homework Statement Initially:At t=0 [/B]the cylindrical capacitor of capacitance c=\frac{\epsilon s}{d} (d the distance between the 2 electrodes and s their surface; \epsilon = \epsilon(T) is the dielectric permittivity) is discharged and we close the...
  2. S

    Entropy Contradiction for a Single Harmonic Oscillator

    Making use of the partition function, it is straight forward to show that the entropy of a single quantum harmonic oscillator is: $$\sigma_{1} = \frac{\hbar\omega/\tau}{\exp(\hbar\omega/\tau) - 1} - \log[1 - \exp(-\hbar\omega/\tau)]$$However, if we look at the partition function for a single...
  3. J

    Vibrational entropy and the partition function

    Homework Statement I'm asked to compute the molar entropy of oxygen gas @ 298.15 K & 1 bar given: molecular mass of 5.312×10−26 kg, Θvib = 2256 K, Θrot = 2.07 K, σ = 2, and ge1 = 3. I'm currently stuck on the vibrational entropy calculation. Homework Equations [/B]S = NkT ∂/∂T {ln q} + Nk...
  4. Benhur

    The entropy of a Carnot cycle and the efficiency equation

    I have my first question. It's about entropy in the Carnot cycle and I'll try to be direct. The equal sign in the Carnot cycle efficiency equation is related to the fact that the total entropy doesn't change at the end of the whole cycle (being related to the fact that the heat exchanges occur...
  5. A

    Thermodynamic Entropy Change Upon Partition Removal

    Homework Statement Box divided by a partition into two equal compartments containing ideal gas. Each compartment is having volume V ,temp T and pressure P 1.entropy of the system when the partition is given? 2.entropy of the system when the partition is removed. [/B]Homework EquationsThe...
  6. L

    Piece of iron put into container with ice

    Homework Statement We put 1kg iron of temperature 100 Celsius into container with 1kg of ice, temperature 0 Celsius. What is state of the system after reaching equilibrium? Calculate change of entropy. Coefficient of melting of ice (c_L) is 330 kJ/kg, coefficient of heat transfer of iron (c_I)...
  7. S

    Change in molar entropy of steam

    Homework Statement Calculate the change in molar entropy of steam heated from 100 to 120 °C at constant volume in units J/K/mol (assume ideal gas behaviour). Homework Equations dS = n Cv ln(T1/T0) T: absolute temperature The Attempt at a Solution 100 C = 373.15 K 120 C = 393.15 K dS = nCvln...
  8. A

    Is there an Entropy difference between a cold and hot body

    Hello, If two bodies, who say start with ##T_{cold}=T_c## and ##T_{hot}=T_h## and then they are brought in contact with one another and then after some time they both have the same temperature. What would be the entropy of the entire system? Also another quick question, I've looked at some...
  9. UMath1

    Heat Engine Efficiency and Entropy

    In deriving the Carnot Efficiency, the assumption is made that theoretically most efficient engine will generate no net entropy, meaning that the entropy that enters the system during heat absorption must equal the entropy that leaves the engine during heat rejection. Why is the case? Why would...
  10. A

    Conditional Entropy and Kullback–Leibler divergence

    Homework Statement To find relation between conditional (Shanon) entropy and KL divergence. Homework Equations Conditional Entropy: H[X | Y] = H[X,Y] - H[Y] KL Divergenece: H[X || Y] = -H[X] - Σx ln(y) The Attempt at a Solution H[p(x,y) || p(x)p(y)] = -H[p(x,y)] + H[p(x)] + H[p(y)]
  11. F

    I Does measuring an atom collapse the wavefunction of its parts?

    Suppose you have an experiment that measures the property of an atom as a whole, maybe you can put it through a double-slit or measure its spin, whatever. Presumably that will collapse the wavefunction that you used to describe the atom in that experiment. Would this entail that in the process...
  12. X

    A Comoving distance, causality volume and entropy

    Hello everyone ! I try to find the expression of the time derivative of the entropy for the CMB (photon gas) but I am stuck with the calculations. We are in the matter-domination area and at the present time (Ro=1). No radiation and no vacuum, only the curvature. The different equations are...
  13. E

    What is the entropy for an irreversible adiabatic process?

    Homework Statement The change in entropy is zero for: A. reversible adiabatic processes B. reversible isothermal processes C. reversible processes during which no work is done D. reversible isobaric processes E. all adiabatic processes Homework Equations ## dS = \frac{dQ}{T} ## The Attempt...
  14. Ron Burgundypants

    Classical Book recommendation; magnetism/magnetic entropy related

    I'm looking for a book to help me understand a project I'm working on measuring the magnetocaloric effect. I'd like to understand a bit more about the link between magnetism and entropy. I'm a third year bachelor student so I've studied no quantum mechanics (yet), but I'm not against doing so if...
  15. S

    I Entropy and contracting universe

    My somewhat ropey understanding of entropy is that it is a measure of order/disorder and that in a closed system entropy always increases. Was discussing it with my teenage daughter. Whilst trying to convey my limited understanding it struck me that if the universe is contracting (we had also...
  16. barcodeIIIII

    Proof: Time independence of the entropy under unitary time evolution

    Homework Statement The unitary time evolution of the density operator is given by $$\rho(t)=\textrm{exp}(-\frac{i}{\hbar}Ht)\,\rho_0 \,\textrm{exp}(\frac{i}{\hbar}Ht)$$ General definition of entropy is $$S=-k_B\,Tr\,\{\rho(t) ln \rho(t)\}$$ Proof: $$\frac{dS}{dt}=0$$ Homework Equations I am not...
  17. R

    I Heat death of the universe and the 3rd law of thermodynamics

    If the universe keeps expanding and eventually ends in a "big freeze" or heat death, does this contradict the third law of thermodynamics? The third law of thermodynamics states that a crystal at absolute zero has zero entropy. Since the entropy of the universe can never decrease, as the age...
  18. E

    Confusion about relation of entropy with temperature.

    Why can sometimes entropy remain constant with increase of temperature and vice versa?Entropy implies transfer of heat and heat must increase with temperature.I am unable to intuitively understand.
  19. E

    Why does entropy increase when hot water is mixed with cold?

    Why is entropy lost by hot water less than the entropy gained by the cold water?From perspective of energy,why is it better to take water and heat it to a temperature than it is to mix hot water and cold water to get a particular temperature.
  20. dRic2

    Entropy and heat bath/reservoir

    If I have and object at a different temperature than the thermal/heat reservoir (whatever it's called) an heat flow will take place. If I write the entropy balance for the thermal reservoir it will be: ##\frac {dS} {dt} = \frac {\dot Q} T + \dot S_{gen}## Now I remember something my professor...
  21. C

    Measurable consequences of entropy of mixing

    Most textbooks include an example of entropy of mixing that involves removing a partition between two (in principle) distinguishable gases, and compare this to the case where the two gases are indistinguishable. What I’ve not yet been able to figure out is what the consequences of this...
  22. B

    Trying to reconcile two definitions of Entropy

    My question is regarding a few descriptions of Entropy. I'm actually unsure if my understanding of each version of entropy is correct, so I'm looking for a two birds in one stone answer of fixing my misunderstanding of each and then hopefully linking them together. 1) A measure of the tendency...
  23. Danny Boy

    A Von Neumann Entropy of a joint state

    Definition 1 The von Neumann entropy of a density matrix is given by $$S(\rho) := - Tr[\rho ln \rho] = H[\lambda (\rho)] $$ where ##H[\lambda (\rho)]## is the Shannon entropy of the set of probabilities ##\lambda (\rho)## (which are eigenvalues of the density operator ##\rho##). Definition 2 If...
  24. MeneMestre

    Does entropy increase with improbability?

    Well, maybe that's a simple question, but it has been pissing me off for some time ... Does entropy increase with improbability?
  25. N

    A Entropy and derivations - is my logic faulty?

    It is assumed that entropy increases in the universe. However, the fluid and acceleration equations are derived assuming that. TdS=dE+pdV where dQ = TdS. But dQ is usually set equal to zero to derive these equations. Hence since T is non zero, dS should be zero and so there would be no...
  26. maajdl

    Surprise? Entropy changes for systems in a canonical state

    Every year since the 90's I come back to some of my pet topics in physics, like statistical physics. This time it was the reading of a Wikipedia article on entropy that surprised me. The derivation of the second law from the Gibbs entropy was unknown to me. I didn't know how heat, how change of...
  27. Luke Strand

    Finding Initial Temperature Entropy and Heat Exchange

    Homework Statement A 2.45 kg aluminium pan at 155 C is plunged into 3.58 kg of water. If the entropy change of the system is 162 J/k, what is the initial temperature of the water? Homework Equations Q = mcΔT ΔS=mcln(T_2/T_1) Q_water + Q_Aluminium = 0 c water = 4184 J/kg*K c aluminium = 900...
  28. Upupumiau

    How do I find the entropy variation?

    Homework Statement Find the ∆S per mol between liquid water at -5 ºC and ice at -5ºC at 1020hPa Data: ∆CP,m fusion = 37,3 J K-1 mol-1 ∆fusH = 6,01 kJ mol-1 The answer is 21.3 J/K mol Homework Equations Usually I solve these problems by steps when they are at P=1 atm but since its at P=1020...
  29. A

    I Entropy of the last scattering surface and today's universe?

    Hi, I am quite confused about followed question, I think scientist think the last scattering surface was dense plasma at the temperature of 3000K. If the today's universe much cooler and less dense then "the last scattering surface" how can anyone says entropy increased by time? Isn't universe...
  30. Pushoam

    Change in entropy per mole for an isothermal process

    Homework Statement Homework EquationsThe Attempt at a Solution ## dS = \frac { dQ_{rev} } { T } ## Assuming that isothermal process is a reversible processes, ## dU = dQ – pdV## For isothermal process, dU = 0. ## dQ = pdV ## ## pV = nRT##, where n is number of moles. For one mole, ##...
  31. M

    Change in temperature for a system with entropy change

    Homework Statement I am Pretty Lost with this problem...[/B] A 2.45-kg aluminum pan at 155∘C is plunged into 3.58 kg of water. If the entropy change of the system is 162 J/K, what was the initial temperature of the water? NOTE:We did not receive a Tf for the system. Homework Equations...
  32. K

    Correct statement of 2nd law of thermodynamics?

    Thermodynamics is stated in different ways. E.g. In isolated systems entropy never decreases Heat never spontaneously pass from colder to warmer body Total energy quality decreases in all processes. Energy disperses But what is it exactly? What is the correct description of the 2nd law of...
  33. VSayantan

    Entropy of a System of Spin-half Non-interacting Particles

    Homework Statement A system having ##N## non-degenerate energy eigenstates populated by##N## identical spin-zero particles and ##2N## identical spin-half particles. There are no interaction between any of these particles. If ##N=1000## what is the entropy of the system? Homework Equations...
  34. W

    Understanding the Derivation of the Latent Heat and Entropy Equation

    Homework Statement I came across this equation ##L / T = \Delta S## and am not too sure about its derivation. From what I know, ##L = Q/m## and ##Q = TdS ##. Substitution gives me ##\Delta S = mL / T## which isn't correct. Could someone assist me in understanding the derivation? Thanks...
  35. A

    Determining entropy as function of pressure

    I read this discussion but I am interested in how the entropy is obtained as a function of pressure. Namely, how can you determine a following integral for an ideal gas: $$S(p) = -\int_{0}^{p} \frac{nR}{p}dp $$ when you need to start from 0 pressure?
  36. F

    I Does entropy change on horizons

    As I understand it, horizons, such as black hole or cosmological event horizons is a place where time seems to stop. So if nothing changes at the horizon, then can there be entropy there? Does entropy require things to change with time? If not energy dissipates because nothing moves, then what...
  37. H

    Calculating entropy for an adiabatic system

    Homework Statement A container of 1.5 Kg of gas is at a temperature and pressure of 293 K and 1 bar respectively. The gas is adiabatically compressed until its temperature and pressure are 450 K, 4.49 bars. Adiabatic processes are processes with no heat transfer. The properties of this...
  38. S

    Heat, Work, Change in Entropy and Energy

    Homework Statement Calculate q, w, ∆E, and ∆H for the process in which 93.0 g of nitrous oxide gas (N2O) is cooled from 179°C to 55°C at a constant pressure of 4.00 atm. Cp(N2O) = 38.70 J K-1 mol-1 Homework Equations q= mCΔT ΔH=n(Cp)=n(qv)ΔT ΔE=q+w w= -pΔV *Probably something else too but I'm...
  39. durant35

    I Equilibrium of Universe: Earth vs. Black Hole

    I have a question regarding the process of getting towards equilibrium in our universe. If we imagine a causal patch with our planet at the centre, every planet will redshift away from us an after a while the planet itself will disintegrate, let's call this process the decay of Earth. Eventually...
  40. patrickmoloney

    Molar latent heat of phosphine

    Homework Statement [/B] Phospine exist in three forms. known as the \alpha, \beta and \gamma forms. The \alpha and \beta forms are in equilibrium with each other at 49.43 \, K, and the \alpha and \gamma forms are in equilibrium at 30.29 \, K. Obtain the molar heat of transformation for the...
  41. patrickmoloney

    Show that the entropy is non-negative

    Homework Statement Two vessels A and B each contain N molecules of the same perfect monatomic gas. Initially, the two vessels are thermally isolated from each other, with the two gases at the same pressure P and at temperatures T_A and T_B. The two vessels are now brought into thermal contact...
  42. TristanJones

    Entropy - show positive net entropy change....

    Homework Statement Two systems that have the same heat capacity Cv but different initial temperatures T1 and T2 (with T2 > T1) are placed in thermal contact with each other for a brief time, so that some heat flows but the temperature of neither system changes appreciably. Show that there is a...
  43. WeiShan Ng

    Find the maximum of E_a when the entropy is at its maximum

    Homework Statement Show that \Gamma_T is maximum at E_a = \frac{N_aE}{N_a+N_b} Homework Equations The expression for \Gamma(E) when N\gg 1 \Gamma_T = C_aC_b exp \left( -\frac{E_a^2}{2N_a\mu_B^2h^2} \right) exp \left[ - \frac{(E-E_a)^2}{2N_b\mu_B^2H^2} \right] where C_a and C_b are...
  44. T

    Maximum entropy principle from minimum energy principle

    Homework Statement Formulate a proof that the energy minimum principle implies the entropy maximum principle. That is, show that if the entropy were not maximum at constant energy then the enrgy could not be minimum at constant entropy. HINT: First show that the permissible increase in entropy...
  45. Pushoam

    Entropy- change & the condition when a system reaches equilibrium

    Homework Statement Homework EquationsThe Attempt at a Solution I didn't understand the last part. At eqbm. ##\Delta S = 0##. This means that the RHS of the eqnn. 14.25 is 0. This doesn't mean that the following eqns. must hold true. ##(\frac 1 T_1 - \frac 1 T_2) =0,.............(1) \\...
  46. N

    Thermodynamics equivalence between entropy in two ensembles

    So while practicing statistical mechanics problems I was faced with the following problem : calculate the entropy as function of energy for an ensemble of harmonic oscillators ( the Hamiltonian is ##\sum_{i=1}^N \frac {p_i^2} {2m} + \frac {m\cdot\omega\cdot q_i^2} 2##) ). Now the official...
  47. F

    Is there a PF section specifically for classical and quantum entropy?

    I'm interested in classical and quantum entropy. Is there a section on PF devoted exclusively to this topic? I searched a few forum discussions but couldn't find anything. I'm new here. Thank you.
  48. D

    Is the Entropy in a Free Expansion Affected by the Gas Type?

    Homework Statement The question is: What happened with the entropy in a free expansion? The system is isolated and the state equation is: $$p=AT/V+B/V^2$$ Homework Equations $$dU=TdS-pdV$$ The Attempt at a Solution My attempt is: Because the system is isolated and corresponding to an free...
  49. Z

    How do I solve this problem involving the Helmholtz and Gibbs Energy?

    1. Robert Dehoff 4.12 A system is designed that permits continuous programmed control of the pressure and volume of the gas that it contains. The system is filled with 1 g atom of helium and brought to an initial condition of one atmosphere and 18 liters. It is then reversibly compressed to 12...
  50. T

    Analysis of the entropy S of an arbritary system can be written as a power series?

    Is it ok to assume that the entropy ##S## of an arbritary system can be written as a power series as a function of the system's internal energy ##U##? Like $$S(U) = \sum_{i=1}^{\infty}a_iU^i = a_1 U + a_2 U^2 + \ ...$$ with ##a_i \in \mathbb{R}##. What results could be obtained from such...
Back
Top