What is Information: Definition and 999 Discussions

Information can be thought of as the resolution of uncertainty; it answers the question of "What an entity is" and thus defines both its essence and the nature of its characteristics. The concept of information has different meanings in different contexts. Thus the concept becomes synonymous to notions of constraint, communication, control, data, form, education, knowledge, meaning, understanding, mental stimuli, pattern, perception, proposition, representation, and entropy.
Information is associated with data. The difference is that information resolves uncertainty. Data can represent redundant symbols, but approaches information through optimal data compression.
Information can be transmitted in time, via data storage, and space, via communication and telecommunication. Information is expressed either as the content of a message or through direct or indirect observation. That which is perceived can be construed as a message in its own right, and in that sense, information is always conveyed as the content of a message.
Information can be encoded into various forms for transmission and interpretation (for example, information may be encoded into a sequence of signs, or transmitted via a signal). It can also be encrypted for safe storage and communication.
The uncertainty of an event is measured by its probability of occurrence. Uncertainty is inversely proportional to the probability of occurrence. Information theory takes advantage of this fact by concluding that more uncertain events require more information to resolve their uncertainty. The bit is a typical unit of information. It is 'that which reduces uncertainty by half'. Other units such as the nat may be used. For example, the information encoded in one "fair" coin flip is log2(2/1) = 1 bit, and in two fair coin flips is log2(4/1) = 2 bits. A 2011 Science article estimated that 97% of technologically stored information was already in digital bits in 2007, and that the year 2002 was the beginning of the digital age for information storage (with digital storage capacity bypassing analog for the first time).

View More On Wikipedia.org
  1. M

    Information Theory - Shannon's Self-Information units

    Information Theory - Shannon's "Self-Information" units Hi, I'm familiar with information and coding theory, and do know that the units of Shannon information content (-log_2(P(A))) are "bits". Where "bit" is a "binary digit", or a "storage device that has two stable states". But, can...
  2. J

    Need Information about statics class offered online?

    URGENT need Information about statics class offered online?? I need to find a university or comm. college that will be offering statics online over the summer. If you have any ideas of schools i could call please list them. Thanks!
  3. Pythagorean

    Astrocytes as information processors in the brain.

    Below are two excellent papers that outline the mechanism by which astrocytes regulate synaptic strength. The first one shows the most important pathway, I think. Here's my summary of the story from the first paper: 1) ATP released locally by local activity (either from the granule neurons...
  4. A

    [Quantum Mechanics] Quantum Fisher Information for a Pure State

    Hi everyone. Homework Statement We are given N spins 1/2. A rotation is defined as \rho_\theta=e^{-i\theta J_n}\rho_\theta e^{i\theta J_n} on an Hilbert Space H, with J_n=n_xJ_x+n_yJ_y+n_zJ_z\:,\quad n_x^2+n_y^2+n_z^2=1, and \theta isn't related to any observable. Given a quantum state...
  5. T

    Extracting Useful Information from Impedances

    I've recently found myself conducting large numbers of tests on nanoscale devices in a liquid. The device themselves are an insulated silicon wire, with an electrochemically active tip. The circuit in which they are placed can be described as follows, though my notation is most likely...
  6. S

    Good Information on Thin Films

    any one have good information about thin films
  7. B

    Good book on entropy and information theory

    Hello, I would like someone to suggest me a good book on entropy and information theory. I need something that explains these subjects intuitively, rather than all mathematics. I have fairly strong knowledge of mathematics behind entropy, but all is kind of scrambled what is what...
  8. J

    Information processing in the brain

    I've always wanted to study something that has to do with how information is processed in the brain. I don't know if this sounds silly but almost like "reading" the brain. Perhaps like data/mathematical modelling? I don't really know what educational path I must choose. I am thinking that the...
  9. C

    What are some recommended books for beginners in Information Theory?

    I do not know if this is the right place for this post, but if I am doing a mistake by putting it here, If it is so, please let me know where is the right place to put it. So, I am learning Information Theory, this is first approach and I would like to know a few names of good books for...
  10. J

    Is your information destroyed when you reach the singularity

    from my understanding from an observer in the universe, your information is plastered on the event horizon, and ultimately retrieved when the event horizon shrinks to the schwartschild radius and the singularity explodes. please coreect me if I am wrong on that. if the singularity does not...
  11. A

    Faster than Light Information Sending Solved?

    I may have figured out a way to do that, unless there is some fundamental principle I am not currently aware of. I should preface this by saying that I am not an expert. I have only recently decided to major in physics, and have not even begun school. But I just had a eureka moment. It works by...
  12. J

    Uncertainty principle and information theory

    does the fact that there is a limit on how much can be observed on electrons location and momentum have anything to do with the finiteness and conservation of information? is the total momentum plus location of an electron unknown to us or is it also unknown to the universe? meaning, does...
  13. M

    Finding Relationship Information from Graph (direct proportionality)

    First of all sorry if this is the wrong section! For a physics assignment, I am given a graph of which I am to gather data from. Graph 1: In an experiment to investigate how the celcius temperature, T, affects the volume, V, of an enclosed sample of air at a constant pressure, a students...
  14. R

    What is the true significance of Quantum Information Theory?

    Hi! As I understand it, Quantum Information Theory is an attempt to apply the Classical Information Theory (i.e 0's and 1's) into the Quantum realm of superpositions. I recently came across a fascinating interpretation of QIT wherein it was described as possibly the law that effectively...
  15. H

    What creates information in a 2D particle system and how can it be measured?

    Hey folks, so the extent of my knowledge in math is basic concepts from Calc I (I'm more of a programmer). Now, I was working on a 2D particle system and had a random thought: if I wanted to gauge the total amount of information contained in the system, how would I do it? The first idea I had...
  16. M

    What is (physical) information?

    Hello PF! (Not sure this is in the right section.) I've learned very little about maths/physics in school, but went back to uni last year to do maths. Physics is still a bit of an alien territory, but nevertheless I like exploring it in my own amateur way. One of the things that started...
  17. D

    Solving for Motion Information on a elevator and some lights

    Homework Statement A decorative light fixture in an elevator consists of a 2.0 kg light suspended by a cable from the ceiling of the elevator. From this light, a separate presses the emergency stop button. During the stop, the upper cable snaps. The elevator engineer says that the cable could...
  18. D

    PPE Requirements and Responsibilities for Employees and Employers

    hi i seem to be finding it difficult to understand the legal terminology and understand what I am actually reading, i work in an industry that requires me to wear ear protection, protective footwear and eye protection. The Ear protection is provided and meets all Health and safety criteria...
  19. N

    How can I ignore information in my wave function?

    Hello, Say I have a system with a spatial part and a spin degree of freedom, hence the wavefunction generally looks like \psi_+(\textbf r) |+\rangle + \psi_-(\textbf r) |- \rangle w.r.t. for example the z-axis. Now what if I'm simply interested in the spatial part? Can I perform an...
  20. R

    Doesnt information travel faster than light in case of black holes?

    hi, i was wondering, for a black hole, as everyone knows,the escape velocity is greater than light. this means that the information about the existence of the black hole in terms of light never reaches the observer. so if the black hole were the cease to exist at an instant of time, the...
  21. M

    Need information regarding accelerometers

    I am an undergraduate student and full-time Emergency Medical Technician and I am trying to obtain a few basic measurements requiring the use of an accelerometer. What I require is a device that can measure acceleration of two directions, such as forward to rear acceleration and side to side...
  22. S

    How to understand fisher information ?

    How to understand "fisher information"? Hello, I am trying to understand what "fisher information is." It is defined as V [∂/∂∅(lnf(X,∅)) ]=E[ (∂/∂∅[lnf(X,∅)])^2 ]. From Wikipedia: Can you please help me understand why this is the case? How can this be explained by looking at the...
  23. N

    What is the Group Velocity of Infrared Radiation in a Dispersive Medium?

    Infrared radiation, of wavelength λair = 1um in air, travels through a dispersive medium with refractive index n = 1.4505 and with dn/dλair = -0.01 per um at this wavelength. Calculate the speed at which the radiation carries information. So know that c/n = λf radiation carries...
  24. H

    What Can Be Deduced About a Wave's Properties from Its Magnetic Field Equation?

    Homework Statement A wave traveling through a block of glass has a magnetic field of the for B(z,t0 = BI sin(2x10^15t - 2x10^10z) What information can you extract from the equation above Homework Equations well ω=2∏f k = 2∏/λ v=ω/λ n = c/v The Attempt at a Solution I know can find...
  25. W

    Schools Scope for Quantum Information theory - Graduate school and beyond

    Hi, I am a student in Europe. I have been reading through the posts on Graduate schools and the essays like the one by Zapper on how to become a physicist. I am now in the stage of searching for a PhD position. 1. I would like to know what you guys think about the scope of Quantum...
  26. P

    Quantity of Information in Information Theory

    Hello there. I'm a 4th year computer engineering student who is just at the end of an Information theory class. It was nice, I thought I got a grip on all the concepts and so... But, I tried to explain to my girlfriend today the basics of information theory, and I failed to do so. The...
  27. P

    Help finding physics information

    Hello, I am a french 15 aged boy and I have been loving science, engineering, physics for 3 years now. I inform myself on the internet and I learn bunch of things at school but I feel like I haven't learned enough, and I'd like to know where I could learn all the physics bases from my class...
  28. P

    What is Information? Simplest Answer

    They (physicists) say that information can't be lost and I heard Susskind saying that he thought information of objects going into a black hole was stored in the outside of the black hole while the material was sucked in. I thought information was almost like a fossil, where an imprint of an...
  29. ArcanaNoir

    Need information on equidistribution

    Homework Statement I'm working on some proofs involving equivalent definitions of an equidistributed sequence. I need some resources to learn about equidistribution. Any links or book titles would be greatly appreciated. Homework Equations For an equidistributed sequence, \lim_{n\to \infty...
  30. M

    Should Prospective Employers use Financial Information

    Should prospective employers have access to financial information about prospective employees? Is access to that information useful enough at a level where an individual's rights to privacy should be disregarded? Should employers be allowed to ask for a credit check? It is my assertion that...
  31. Elroch

    Large black holes and information

    Hawking and others suggest that it is a very special deal that macroscopic black holes lose quantum information, but I only partially agree. It is clearly important that they do not preserve most quantum numbers - black holes may be a way to break a lot of conservation laws of particle physics...
  32. Dembadon

    What information do you want covered in lectures?

    A classmate approached me last week (after class) and asked why I ask about things that probably aren't going to be on the exam. I told him that it helps me understand things on a deeper level. He then said, "Do your understanding on your own, because it makes things confusing for the rest of...
  33. Z

    How can information be conserved if we live in a quantum universe?

    For example, after the big bang, the only thing that decides the future is Newtons laws. However, we must take into account quantum effects we cannot be for sure what the future holds. Doesn't the same thing apply with information. How can we know the information about a system if there is...
  34. P

    Information Equivalent of the Svalbard Global Seed Vault

    I was wondering if there is currently a project by some government or NGO, in the same spirit as the Svalbard Global Seed Vault, to digitize all information (history, math/science, literature, etc.) and store it either somewhere safe on the planet or better yet on some other celestial body in...
  35. C

    Which path information for a photon reflecting from a mirror as in Feyman's QED

    I would like to know whether it is possible to determine which path information for a photon reflecting from a mirror as shown in the book QED by Feynman page 40 and 43 (or available by googling mirror reflection Feynman or similar) if photons are fired one at a time from the source (unaimed)...
  36. F

    Can we understand neutrinos as information?

    I posted this question on two philosophy sites, but so far I have gotten no meaningful responses, predictably so because I'll admit this is a rather far-our idea. But wherever laws deemed absolute are broken, trying to deduce the explanation from the known and understood is not going to work...
  37. M

    Prove that information is either increasing or remaining constant with time.

    Hello, Can you Prove that information is either increasing or remaining constant with time. Thanks.
  38. Spinnor

    1D QED on a lattice, how much information?

    Suppose we were to simulate 1D QED on a 1D lattice. How much information do we need at each lattice site given the mass, charge, and spin of the particles (does spin make sense in 1-1D spacetime?)? The links between lattice sites represent the gauge field? How much information is needed at...
  39. Y

    Black Hole Information Loss Question

    If I understand correctly, Hawking Radiation is created when the anti-particle of a virtual particle pair falls into a black hole while the particle of the pair escapes. The anti-particle goes on to annihilate with a particle in the black hole. Is not the annihilated particle identical to the...
  40. P

    Mutual information. concave/convex

    hi everybody, :smile: while looking on the mutual information of two variables, one find that it is concave of p(x) given p(x|y) and convex of p(x|y) given p(x). the first statement is okey, but when it comes to proving the second, i get stuck, even when i find proofs already done i...
  41. C

    Radio waves & information transition

    How do radio waves carry the information? I mean the information is digital: 1 or 0, but what is 1 and what is 0 from perspective of radio waves?
  42. W

    News Should Members of Congress Be Permitted to Profit From Insider Information?

    It was reported by 60 minutes that members of Congress may have benefited personally from information gained during the course of their work. This behavior is strictly prohibited on Wall Street - should the same rules apply to elected officials...
  43. B

    Information theory and source coding-application

    So I am enrolled into this course. And we are learning probability and statistics and all that good stuff. But one thing bothers me VERY much. I lie, a lot of things bother me about this course but here is the first one: Transformation of random variables. So far we have been...
  44. A

    Real-time traffic information in big cities

    Hey! I am a student and would like to know if it is possible to collect and handle real time information from traffic participants and find solutions with this information to traffic problems like traffic jams? Can you also cluster this information? Thanks Angelika
  45. S

    Aspiring automotive engineer looking for advanced information.

    Hello there, (Sorry, I hope not to come on here too forward or over anyone's head). I am 25 years old (Junior), I seek information and am super hungry for it. I seek how to design cars, and all aspects thereof. I have decided to pursue establishing my own automotive engineering firm, and...
  46. B

    Is there a limit to information storage on the surface of a black hole?

    Hello, I'll try to explain this as well as I can... I was watching NOVA's special on The Fabric of the Cosmos and the segment on how information is both lost in the black hole and stored on the surface got me wondering "Is there a limit to how much information can be stored on the surface...
  47. O

    Testing Information about the Math GRE

    I was planning to skip fields, Lebesque measures/integration and complex analysis. Can someone who's given the test tell me how important these topics are? (I haven't looked at any practice tests yet) I haven't done this stuff in college yet so understanding them will take quite an effort on my...
  48. A

    Is it Information or Interaction that Observes ?

    Is it "Information" or "Interaction" that "Observes"? First off, I know there are many questions on this forum in regards to "does consciousness collapse the wavefunction" and I admit that this is roughly the same question in a different way. I wanted to approach this in a new topic though...
  49. A

    Quantum Information and Brain neurons

    Hello, i want to know if there is any way we can describe the way our brain transfers information using Quantum Information theory. I have been looking at Quantum Information theory for some time now and would want to know if it will ever be possible to transfer information directly from the...
  50. B

    Wondering about quantum information and phase factors.

    I seem to be at a loss to understand something pertaining to the role of the phase factors in defining quantum states and their consequences in quantum computing. So, I learned in class and read in numerous books, and online, that the phase factor has no physical significance as it does not...
Back
Top