- #1
manishbit
- 4
- 0
Hello,
Can you Prove that information is either increasing or remaining constant with time.
Thanks.
Can you Prove that information is either increasing or remaining constant with time.
Thanks.
The central idea in Shannon's information theory is entropy...entropy is a measure of information...in a sense thermodynamics is just a special case of information theory...Shannon's measure of randomness is precisely the same function as Boltzmann entropy...Nature it seems, attempts to dissipate stored information just as it attempts to increase entropy;the two ideas are exactly the same...
manishbit said:Hello,
Can you Prove that information is either increasing or remaining constant with time.
Thanks.
Merely by existing, all physical systems register information. And by evolving dynamically in time, they transform and process that information. The laws of physics determine the amount of information that a physical system can register (number of bits) and the number of elementary logic operations that a system can perform (number of ops). The universe is a physical system. This paper quantifies the amount of information that the universe can register and the number of elementary operations that it can have performed over its history. The universe can have performed no more than 10120 ops on 1090bits
Information is not negative entropy , its like H(x) = E(I(x)).juanrga said:First you would define information, which is not a physical property.
Some guys define information as minus entropy. Then, using the second law, it is proved that information decreases or remains constant for isolated systems.
manishbit said:juanrga said:First you would define information, which is not a physical property.
Some guys define information as minus entropy. Then, using the second law, it is proved that information decreases or remains constant for isolated systems.
Information is not negative entropy , its like H(x) = E(I(x)).
H, E, I are entropy, Expected value, Information respectively of a random variable x.
Btw, it can never decrease. Its a known physical fact. (Even Steven Hawking accepted the mistake when once he said it is destroyed in black holes)
http://webdocs.cs.uAlberta.ca/~aixplore/learning/DecisionTrees/InterArticle/4-DecisionTree.htmlRecall that "information = minus entropy"
manishbit said:Hello,
Can you Prove that information is either increasing or remaining constant with time.
Thanks.
juanrga said:You continue without giving us a definition of information, but from your expressions I assume that you mean something as I(x)=-log p(x). This definition of information increases or remains constant because H≥0.
manishbit said:Now I am wondering why people are asking me to define information.
I assume they might have seen different definitions in different fields. But are they really different! How can "information" be different from "information" just because its a part of different subject (scientific).
Science should be able to define information in one precise way, so that even an 8 year old can understand in a crystal clear way.
So, Can somebody define information for me from scientific point of view ?
Thanks.
P.S. : I hate when people say - "forces" in chemistry is different than forces" in physics u know.
In this context, information refers to any data, knowledge, or facts that can be communicated or received by an individual or system.
One way to measure the increase or constancy of information is by looking at the amount of data that is being generated and collected over time. Another way is to analyze the complexity and diversity of information being produced.
The increase of information over time can be attributed to advancements in technology, the growth of human knowledge and understanding, and the accumulation of historical data.
The rate of information increase can vary greatly across different fields or industries, depending on the amount of research and development being conducted in each field, the availability of technology, and the demand for new information in that particular industry.
In rare cases, information can decrease over time due to data loss or destruction, but overall, the trend is for information to either increase or remain constant as new information is constantly being generated and added to existing knowledge.