What is Entropy: Definition and 1000 Discussions

Entropy is a scientific concept, as well as a measurable physical property that is most commonly associated with a state of disorder, randomness, or uncertainty. The term and the concept are used in diverse fields, from classical thermodynamics, where it was first recognized, to the microscopic description of nature in statistical physics, and to the principles of information theory. It has found far-ranging applications in chemistry and physics, in biological systems and their relation to life, in cosmology, economics, sociology, weather science, climate change, and information systems including the transmission of information in telecommunication.The thermodynamic concept was referred to by Scottish scientist and engineer Macquorn Rankine in 1850 with the names thermodynamic function and heat-potential. In 1865, German physicist Rudolph Clausius, one of the leading founders of the field of thermodynamics, defined it as the quotient of an infinitesimal amount of heat to the instantaneous temperature. He initially described it as transformation-content, in German Verwandlungsinhalt, and later coined the term entropy from a Greek word for transformation. Referring to microscopic constitution and structure, in 1862, Clausius interpreted the concept as meaning disgregation.A consequence of entropy is that certain processes are irreversible or impossible, aside from the requirement of not violating the conservation of energy, the latter being expressed in the first law of thermodynamics. Entropy is central to the second law of thermodynamics, which states that the entropy of isolated systems left to spontaneous evolution cannot decrease with time, as they always arrive at a state of thermodynamic equilibrium, where the entropy is highest.
Austrian physicist Ludwig Boltzmann explained entropy as the measure of the number of possible microscopic arrangements or states of individual atoms and molecules of a system that comply with the macroscopic condition of the system. He thereby introduced the concept of statistical disorder and probability distributions into a new field of thermodynamics, called statistical mechanics, and found the link between the microscopic interactions, which fluctuate about an average configuration, to the macroscopically observable behavior, in form of a simple logarithmic law, with a proportionality constant, the Boltzmann constant, that has become one of the defining universal constants for the modern International System of Units (SI).
In 1948, Bell Labs scientist Claude Shannon developed similar statistical concepts of measuring microscopic uncertainty and multiplicity to the problem of random losses of information in telecommunication signals. Upon John von Neumann's suggestion, Shannon named this entity of missing information in analogous manner to its use in statistical mechanics as entropy, and gave birth to the field of information theory. This description has been proposed as a universal definition of the concept of entropy.

View More On Wikipedia.org
  1. P

    Two body system ,entropy, max work

    Homework Statement Two equal bodies with temperatures T1 and T2. T1 > T2. The specific heat c does not depend on temperature. What is the maximal work which can be done from this system? I have to get equation for max work which includes c and temperatures. Homework Equations This seems to...
  2. S

    Are "isentropic" and "adiabatic" same?

    Isentropic means a process where entropy remains constant. Now formula for entropy is ΔS = ΔQ/T now in an isentropic process, ΔS=0...so that means ΔQ = 0 ...right? but if ΔQ = 0, that is an adiabatic process. so are isentropic and adiabatic processes are...
  3. B

    Why is there a factor 2 in entropy development

    Hi, How do you explain the factor 2Nklog(2) in the last equation. Is there any mistake here?
  4. Chemer

    Understanding Thermodynamics Entropy: Common Questions Answered

    Hi, I've a few questions about entropy. Entropy is the measure of disorder in universe, and the entropy of universe always increase. So, is saying this correct that entropy is the unusable energy causing the disorder and due to this the amount of useable energy decrease every time when the...
  5. S

    Making sense of the units of entropy: J/K

    Hi everyone, I have a conceptual question about entropy. I understand perfectly why mathematically the units of entropy are energy per temperature (SI: J / K). However, I would like to better understand the significance of these units. For example, the SI units for speed/velocity are m / s...
  6. avito009

    Entropy as number of microstates

    As we know S=Q/T. And Entropy is defined as number of microstates of a system. So does that prove that, the lower the temperature the more the microstates available?
  7. J

    MHB Max Entropy of 16-Symbol Source

    Hi I am studying entropy and I am new to the concept I don't know where to start in this question: State the maximum entropy of a 16-symbol source. thank you
  8. avito009

    How Does Entropy Influence Hawking Radiation in Black Holes?

    I know that entropy is a measure of disorder. But Entropy is also a function of the state of a system, and has a value determined by the state variables of the system. Does that mean Entropy describes the equilibrium state of a system. Please explain in layman terms in this context what is...
  9. L

    Entropy of translation and rotation of a molecules

    Homework Statement Hi all, There is a question from the course book: Homework Equations S=k_B ln W The Attempt at a Solution My solution: So first of all, for each molecule, there are 2 motions: translational and rotational. For rotational I get: W_1 =\Omega \left ( \theta \right ) For...
  10. M

    What is the Entropy of a Half Reaction?

    Hi everybody, I have some troubles to define the enthalpy and entropy of a half reaction. If we consider the 2 following reactions : Anode : H2 = 2H+ + 2e- Cathode : 2H+ + 2e- + 1/2O2 = H2O So the global reaction is : H2 + 1/2O2 = H2O We know the global reaction's entropy can...
  11. Paul Howard A

    Progression of Time & Entropy: Is the Pass. Slowing?

    The directionality of time seems to be linked to the process of increasing disorder. Is the 'passage' of time similarly linked? If so, it would seem that the passage of time would generally slow down as the universe cools. And perhaps time should pass more slowly in cooler regions of the...
  12. Y

    Understanding the Relationship between Entropy and Temperature

    I am unable to grasp why is entropy inversely proportional to temperature. My book says that "Heat added to a system at a lower temperature causes higher entropy increase than heat added to the same system at a higher temperature." What is meant by this statement?
  13. T

    Understanding the Second Order Relation of Entropy: A Homework Guide

    Homework Statement Find: Homework Equations The Attempt at a Solution
  14. S

    Understanding Entropy: The Impact on Systems

    What is entropy ?, And how it effect the system?
  15. F

    Understanding entropy calculations

    Homework Statement A mass m of water cools down from 50degc to 10degc (the temperature of the surrounding environment). Calculate the entropy increase of the system (the water). The water has specific heat capacity c. Homework Equations dS=dQrev/T S is entropy, Q is heat added to the system, T...
  16. S

    How Does a Constant Temperature Affect Spring Entropy?

    Homework Statement Homework Equations The Attempt at a Solution I have already submitted these questions and have gotten them wrong. I'm just wanting to see how to properly do it. Thanks.
  17. S

    Change in entropy of system and universe

    Homework Statement 50.0g of water (the system) at 30C is frozen to ice at a final temp of -10C in a freezer. Assuming that the volume of water remains the same during the process, calculate the change in entropy of the system and the change of entropy of the thermal universe when the system...
  18. R

    Entropy of the initital state of the universe

    I saw an old interview with Roger Penrose where at one point he was talking about the degree of organization the universe exhibited at it's initial state. He said the second law of thermodynamics tells us as time passes the universe is becoming more disorderly, which means if we were to go back...
  19. ChristineMarie

    Calculating entropy for expansion

    How do you calculate the entropy of an ideal gas with n = 1, Cv,m = 1.5R, Ti = 300K, P=3bar and expands against Pext = 1bar until final volume is twice initial volume at Tf = 200K?
  20. V

    Shannon Information Theory: Transducer Entropy doesn't increase

    HI, I am reading Shannon's paper on Theory of Communication and I having trouble with a concept. Shannon writes: The output of a finite state transducer driven by a finite state statistical source is a finite state statistical source, with entropy (per unit time) less than or equal to that of...
  21. S

    Entropy: Joules per Kelvin Explained

    Whilst I understand that entropy is a measure of the number of specific ways in which a system may be arranged. The units for entropy don't make sense to me intuitively. Why joules per kelvin? What way at all does that show how "disordered" a system is. When I hear joules per kelvin, I think of...
  22. SalfordPhysics

    Derive Entropy Change for Ideal Monatomic Gas

    A Monatomic gas passes from state 1 (pressure p1, volume V1) to state 2 (p2, V2). Derive an expression for the change in entropy of a monatomic ideal gas. The required final equation is: ΔS = Cv ln(T2/T1) + nRln(V2/V1) In my attempt, I am retrieving ΔS = Cv ln(T2/T1) + Rln(V2/V1) i.e.; the...
  23. H

    Deriving Boltzmann's Distribution

    I am sure this has a simple answer, but I don't seem to get it at the moment. I am going through a derivation of the Boltzmann's distribution by maximising the entropy with the constraints that the sum of the probabilities add to 1 and the average energy is some constant value. My question is...
  24. ZetaOfThree

    Entropy of a loaded dice throw

    Homework Statement A 6 sided dice is loaded such that 6 occurs twice as often as 1. What is the total probability of rolling a 6 if the Shannon entropy is a maximum? Homework Equations Shannon Entropy: $$S=-\sum_i p_i \ln{p_i}$$ where ##p_i## is the probability that we roll ##i##. The Attempt...
  25. C

    Entropy in isothermal expansion

    Air: V1= 0,1 m3 P1= 1 MPa T1= 20 C After isothermal expansion P2= 0,1 MPa I had to find T2, M, V2, L, Q and found all those (T2=20 C; M=1,1927 kg; V2=1 m3; L=Q=230258 J) but need s (enthropy) for creating illustration in T-s I can`t find how it`s possible to calculate s1 and s2, is it possible...
  26. Q

    Is it possible to create order from disorder in a thermodynamic system?

    Hi all I hope you can help me with the statistical origins of the Second Law. I cannot find anything that mathematically proves that order from disorder is impossible only improbable. Leading me to think that a system (Kelvin engine) that allows order to be created from disorder (work from...
  27. C

    Thermodynamics - Specific Entropy

    Homework Statement 1)[/B] A quantity of propane is contained in a piston-cylinder assembly. This working fluid undergoes a process starting from an initial state of 2.0 MPa and 60oC. At the end of the process the pressure of the propane is 1.0 MPa and the specific entropy is 0.089 kJ/kgK higher...
  28. C

    Thermodynamics Steam Turbine Specific Entropy

    Homework Statement The mass flow rate through a steam turbine operating under steady conditions is 100 kg/s. Steam enters the turbine at 12 MPa and 400oC. A mixture of vapour and liquid water exits the turbine at 10 kPa. At the exit state 93% of the mass of the water is in vapour form. The...
  29. I

    Calculating Entropy Change in an expansion

    1. Suppose that you have a sample of a gas in a cylinder equipped with a piston that has a volume of 1.50 L, a pressure of 1.20 atm, and a temperature of 250 K. Suppose that the gas is expanded reversibility under isothermal conditions until the pressure is 0.75 atm. What is the entropy change...
  30. T

    How Does Mixing Water at Different Temperatures Affect Entropy?

    Homework Statement An aluminum can, with negligible heat capacity, is filled with 150g of water at 0 ∘C and then is brought into thermal contact with a similar can filled with 150g of water at 53∘C. Find the change in entropy of the system if no heat is allowed to exchange with the...
  31. T

    Entropy change when mixing two gases

    Homework Statement 1.00mole of nitrogen (N2) gas and 1.00mole of argon (Ar) gas are in separate, equal-sized, insulated containers at the same temperature. The containers are then connected and the gases (assumed ideal) allowed to mix. A) What is the change in entropy of the system? B) What is...
  32. F

    Change in entropy, quasistatic, isothermal expansion

    Homework Statement I am to show that ΔS=Q/T for the isothermal expansion of a monoatomic ideal gas, when the expansion is so slow that the gas is always in equilibrium. Homework Equations 1. law: ΔU=Q+W (We mustn't use dQ and dW - our teacher hates that :( ). Ideal gas law: PV=NkT We need the...
  33. B

    Thermodynamics atmospheric pressure Question

    Homework Statement A liter of air, initially at room temperature and atmospheric pressure, is heated at constant pressure until it doubles in volume. Calculate the increase in its entropy during this process. so Ti= 300K, Volume which is 2Vi=Vf; Pressure is constant Homework Equations ΔS...
  34. C

    Calculating the change in entropy of an ideal gas under compression

    Homework Statement Initial pressure: 140kPa Temperature: 25C or 298K Volume: 0.14m^3 Final Pressure:1.4MPa or 1400kPa It uses index compression, n=1.25. So PV^1.25 = constant. c_p = 1.041kJ/kg.K and c_v = 0.743 kJ/kg.K Homework Equations ¥ = c_p/c_v ΔS=c_v*ln(Tf/Ti) + R*ln(Vf/Vi) [i...
  35. A

    Why D? Exploring Isothermal Expansion

    Homework Statement http://puu.sh/c09sc/b1d02302bd.png Homework Equations Conceptual question. The Attempt at a Solution The answer is isothermal expansion(D). but heat does not decrease due to isothermal process and expansion leads to lesser collision of particles on walls of container. So...
  36. D

    Ideal gas configurational entropy -Swendsen 4.6?

    I am teaching myself Stat Mech / thermo from Swendsen's "An Introduction to statistical mechanics and thermodynamics". To this point I find the book interesting and clear to follow. But in section 4.6, Probability and Entropy, he confuses me by concluding that the entropy that he defines there...
  37. N

    Connection between Entropy, Energy and Zustandsum

    Hi. Say you have a canonical ensemble, and its zustandssumme is ##Z = \sum_j e^{- \beta E_j}##. Then $$d \: ln(Z) = \frac{-d\beta}{Z} \sum_j e^{- \beta E_j} E_j - \frac{-\beta}{Z} \sum_j e^{- \beta E_j} dE_j$$ Further, my book says the second term is given by the work ##dW## done on the...
  38. M

    Memory, Entropy and the Arrow of Time

    Sean Carroll has stated several times that the reason we can remember the past and not the future is because entropy is increasing, i.e. because there is an arrow of time. Is this statement justifiable? Remember that life and its processes, including memory, require negentropy. In other words...
  39. avito009

    Entropy: Example of Wear & Tear with a Broken Door

    A few months ago my door broke, so can I say the Entropy of the door is increased? This is because I read that Entropy is wear and tear. So the door broke due to wear and tear.
  40. A

    Thermodynamics Interesting Entropy Problem

    Homework Statement A piston‐cylinder initially contains 0.5 m3 of an ideal gas at 150 kPa and 20 degrees. The gas is suddenly subjected to a constant external pressure of 400 kPa and it is compressed in a manner that the final temperature is also 20oC. Assume the surroundings are also at 20...
  41. P

    Less irreversibility = less change in entropy

    I have a conceptual question that I am trying to clear up. A reversible process means that the net change in entropy is zero. If we have two scenarios, where case 1 has a ΔS= 0.1 J/K and case 2 has a ΔS= 0.5 J/K. Is it a correct statement to say that case 1 is "less irreversible (i.e...
  42. H

    Is nuclear fusion reverse entropy?

    Certainly fission is a prime example of entropy. But what about fusion? Doesn't fusion look like a process that goes from a disordered state to an ordered one? Out of chaos comes order!
  43. L

    Dark matter, entropy and gravity

    If dark matter affects normal matter (by gravity), does that mean that normal matter also affects dark matter? I think it does... In which case; Black holes could attract BOTH dark and normal matter? Does this give any opportunity to "information loss"? What if some information in normal...
  44. T

    Do Different Observers Agree on Entropy in the Unruh Effect?

    Do different observers, say, inertial and accelerated, moving thru the same point in space, agree on the entropy of the same isolated system they observe? I am interested in it in the context of Unruh effect. If we switch between inertial and accelerated frames, we switch Unruh particles...
  45. B

    The big crunch effect on entropy and time

    Assuming a big crunch theory were to be true (I know it's not too popular a theory these days) I figure a collapsing universe would need to have decreasing entropy. If entropy is decreasing, would the arrow of time flip? Also, because physics is just as valid with time moving backwards, would...
  46. D

    Change in Entropy of surroundings for irreversible process

    Homework Statement I know that the equation ΔSsystem = Q/T is only valid for a reversible process but whenever i see problems involving a irreversible isothermal expansion of ideal gas, the ΔSsurroundings is taken as -Qirr/T. Why is that equation valid for surroundings, is it because the...
  47. F

    Entropy change of melting ice cube initially at -5°C

    Homework Statement Calculate the entropy change of an ice cube of mass 10g, at an initial temperature of -5°C, when it completely melts. cice = 2.1 kJkg-1K-1 Lice-water = 3.34x105 Jkg-1 Homework Equations dQ = mcdT dS = \frac{dQ}{T} ΔS = \frac{Q}{T} Q = mL The Attempt at a...
  48. Feodalherren

    Thermodynamics - find entropy in isovolumetric system

    Homework Statement A well-insulated rigid tank contains 7 kg of a saturated liquid-vapor mixture of water at 150 kPa. Initially, three-quarters of the mass is in the liquid phase. An electric resistance heater placed in the tank is now turned on and kept on until all the liquid in the tank is...
  49. Art_Vandelay

    How Much Does Entropy Increase for Aluminum When Heated?

    Homework Statement Imagine that the temperature of 255 g of aluminum sitting in the sum increases from 278 K to 294 K. By how much has its entropy increased? Homework Equations Q=mcΔT ΔS=Q/T The Attempt at a Solution Q=(255 g)(.90 J/gK)(294 K -278 K) Q=3672 J ΔS=Q/T...
  50. Art_Vandelay

    What is the change in entropy when gallium melts in your hand?

    Homework Statement If 25.0 g of gallium melts in your hand, what is the change in entropy of the gallium? What about the change of entropy in your hand? Is it positive or negative? Is its magnitude greater or less than that of the change in entropy of the gallium? The melting...
Back
Top