Trigpoint
Collections › Information Theory › Information theory and cognitive science
Retelling a story from an unfamiliar culture, subjects turned the details they did not understand into plausible ones.

Information theory and cognitive science

Information Theory and Cognitive Science · Miller (1956) / Bartlett (1932) / Simon (1955)
Bibliography checked ✓ Information theory · cross-domain interface Read first: Channel and capacity Read first: Coding and compression Tell the editor privately ▸
In three sentences The mind is an information-processing system working under capacity limits and noise. It does not store raw data, it compresses; and recall is not retrieval but reconstruction from compressed cues. So understanding loses something and memory drifts. That is the normal output of the mechanism.

↳ Seen a counter-example?

Information theory and cognitive science Miller (1956) · Bartlett (1932) · Simon (1955) Every station loses something; none reports it World everything Perception capacity bites Compression no original kept Reconstruction recall rebuilds Decision seems sound each station drops something, and not at random: it drifts toward the existing frame Why no capacity number appears here the author of that famous number himself suspected the sevens were a coincidence The dispute is still live control for chunking and rehearsal and it drops picking a side in an open dispute is not honest either The flow is conceptual; each station's loss is marked by existence and direction, never by amount. The distortion has a direction, so it does not cancel: agreeing recollections are not independent evidence. Calling the mind a channel borrows a structure to ask questions; it does not claim the theorems apply to neurons. Figure: trigpoint.pub
Figure 1 · The route a message travels from the outside world to a decision. Every station has a capacity limit and noise, so every station loses something. The figure deliberately marks no capacity number at all; the reason is in the verification layer of this page, where that famous number turns out to be under dispute. View full size ▸

1. What happened

When subjects retold a story from an unfamiliar culture, the unfamiliar details came back as versions that made sense to them. Carry the shelf's concepts of noise, capacity and compression over to people and a fairly consistent picture appears. Attention, working memory and processing speed all have ceilings, so input has to be filtered. What is kept is not stored as it came but compressed into some structure. When it is needed later, that structure is used to reconstruct rather than to retrieve the original. Every station has noise, and every station loses something.

That memory is reconstruction and not recording had experimental support as early as Bartlett's 1932 book[4]Bartlett, F. C. (1932). Remembering: A Study in Experimental and Social Psychology. Cambridge: Cambridge University Press. Bibliographic details checked against the publisher's record. Consistent with the abstract. The classic source for memory as reconstruction rather than recording: retelling a ghost story from an unfamiliar culture, subjects changed the details they did not understand.: retelling a story from an unfamiliar culture, subjects changed the details that were unfamiliar to them or that they did not understand into versions that seemed plausible to them. That is the characteristic consequence of compression plus reconstruction: the loss happens at the encoding end, the error shows up at the decoding end, and no step in between reports anything.

Bounded rationality is the same picture in the setting of decisions[5]Simon, H. A. (1955). A Behavioral Model of Rational Choice. Quarterly Journal of Economics, 69(1), 99–118. DOI 10.2307/1884852. Bibliographic details checked against the official record. This paper's place in the history of the concept of bounded rationality follows secondary accounts that agree with one another. Often regarded as an early statement of the concept of bounded rationality: it replaces the assumption of all-knowing optimisation with the information and computational capacity that organisms actually possess.: people are not optimising machines, because the computation and the information that optimising needs exceed the available capacity, so real decisions look for a good enough solution under limited capacity. That is often misread as people being irrational, while the original sense is the opposite: it describes reasonable behaviour under given constraints.

As for how large the capacity actually is, this page has to stop and be clear, because that number is both the most famous and the most misused thing on it. The number that entered common circulation from Miller's 1956 paper does exist and has been influential, but its own author already withheld judgment at the end of the paper and suspected that the recurring sevens were only a coincidence[1]Miller, G. A. (1956). The Magical Number Seven, Plus or Minus Two: Some Limits on Our Capacity for Processing Information. Psychological Review, 63(2), 81–97. DOI 10.1037/h0043158. Bibliographic details checked against the official record. Claims matched against the full text. The source of the circulating number. At the end of the paper the author withholds judgment on the recurring sevens and says he suspects they are only a coincidence.. Cowan's 2001 paper reads the number as a rough estimate and a rhetorical device rather than a real ceiling on capacity.

That paper also reports that work controlling for chunking and rehearsal measured a distinctly lower figure[2]Cowan, N. (2001). The Magical Number 4 in Short-Term Memory: A Reconsideration of Mental Storage Capacity. Behavioral and Brain Sciences, 24(1), 87–114. DOI 10.1017/S0140525X01003922. Bibliographic details checked against the official record. Claims matched against the full text. Under conditions that block rehearsal and stop items being regrouped into larger chunks, a wide range of data points to a capacity limit distinctly below the circulating number. The paper reads the 1956 number as a rough estimate and a rhetorical device rather than a real capacity limit; that is this paper's reading, not the original author's words.. That argument is still live today. A separate line of research redefines the chunk as a maximally compressed unit, which connects the question of capacity to the section “How to shrink it: the three limits of compression” on this shelf[3]Mathy, F. & Feldman, J. (2012). What's Magic about Magic Numbers? Chunking and Data Compression in Short-Term Memory. Cognition, 122(3), 346–362. DOI 10.1016/j.cognition.2011.11.003. Bibliographic details checked against the official record. Consistent with the abstract. Restates the chunk in terms of compression: a chunk is a unit in a maximally compressed code..

Attribution where due: Memory as reconstruction rather than recording belongs to Bartlett (1932)[4]Bartlett, F. C. (1932). Remembering: A Study in Experimental and Social Psychology. Cambridge: Cambridge University Press. Bibliographic details checked against the publisher's record. Consistent with the abstract. The classic source for memory as reconstruction rather than recording: retelling a ghost story from an unfamiliar culture, subjects changed the details they did not understand.. An early statement of bounded rationality belongs to Simon (1955)[5]Simon, H. A. (1955). A Behavioral Model of Rational Choice. Quarterly Journal of Economics, 69(1), 99–118. DOI 10.2307/1884852. Bibliographic details checked against the official record. This paper's place in the history of the concept of bounded rationality follows secondary accounts that agree with one another. Often regarded as an early statement of the concept of bounded rationality: it replaces the assumption of all-knowing optimisation with the information and computational capacity that organisms actually possess.. The widely circulated number for working-memory capacity belongs to Miller (1956), while its character is a historical and rhetorical anchor and not an established limit: its author already suspected the sevens were a coincidence, and rhetorical device is the reading of later work[1]Miller, G. A. (1956). The Magical Number Seven, Plus or Minus Two: Some Limits on Our Capacity for Processing Information. Psychological Review, 63(2), 81–97. DOI 10.1037/h0043158. Bibliographic details checked against the official record. Claims matched against the full text. The source of the circulating number. At the end of the paper the author withholds judgment on the recurring sevens and says he suspects they are only a coincidence.[2]Cowan, N. (2001). The Magical Number 4 in Short-Term Memory: A Reconsideration of Mental Storage Capacity. Behavioral and Brain Sciences, 24(1), 87–114. DOI 10.1017/S0140525X01003922. Bibliographic details checked against the official record. Claims matched against the full text. Under conditions that block rehearsal and stop items being regrouped into larger chunks, a wide range of data points to a capacity limit distinctly below the circulating number. The paper reads the 1956 number as a rough estimate and a rhetorical device rather than a real capacity limit; that is this paper's reading, not the original author's words.. The corrective work controlling for chunking and rehearsal belongs to Cowan (2001)[2]Cowan, N. (2001). The Magical Number 4 in Short-Term Memory: A Reconsideration of Mental Storage Capacity. Behavioral and Brain Sciences, 24(1), 87–114. DOI 10.1017/S0140525X01003922. Bibliographic details checked against the official record. Claims matched against the full text. Under conditions that block rehearsal and stop items being regrouped into larger chunks, a wide range of data points to a capacity limit distinctly below the circulating number. The paper reads the 1956 number as a rough estimate and a rhetorical device rather than a real capacity limit; that is this paper's reading, not the original author's words., and the restatement of the chunk in terms of compression belongs to Mathy and Feldman (2012)[3]Mathy, F. & Feldman, J. (2012). What's Magic about Magic Numbers? Chunking and Data Compression in Short-Term Memory. Cognition, 122(3), 346–362. DOI 10.1016/j.cognition.2011.11.003. Bibliographic details checked against the official record. Consistent with the abstract. Restates the chunk in terms of compression: a chunk is a unit in a maximally compressed code.. A contemporary line brings perception and action together under the minimisation of prediction error[6]Friston, K. (2010). The Free-Energy Principle: A Unified Brain Theory? Nature Reviews Neuroscience, 11(2), 127–138. DOI 10.1038/nrn2787. Bibliographic details checked against the official record. Consistent with the abstract. The free-energy principle: it brings perception, action and learning together under the minimisation of surprise (prediction error). This site has not separately checked the disputes attached to it, and lists it as context only.; no claim on this page rests on it. The signing discipline on this page is stricter than on the others: when citing that number, the dispute has to be cited with it, or a statement its own author hedged is being passed off as a conclusion.

2. Why this matters to you

The first corollary is the most usable: whether what you hand over can be used depends on the other end's capacity, not on your completeness.

Writers naturally optimise for completeness, because completeness can be self-checked while the other end's capacity is invisible. The result is a document with no errors, comprehensive coverage, and no chance of being read through. The page Channel and Capacity said that transmission past capacity reports no error. This page supplies the other half: the receiving end does not know it overflowed either, and will give you a reasonable response built on truncated input. Neither side finds out.

The second corollary: compression is not a courtesy but a precondition. Since the receiving end will compress regardless, the only question is who does it. If you do not, they will, and they will do it with their frames and their priors, and you have no control over which part gets dropped. Compress first and at least you decide where the distortion falls. Coding and Compression says that the only part you can remove without loss is what the receiving end could already work out; remove anything else and it is distortion. So before compressing, write down what you allow yourself to lose.

The third corollary concerns the reliability of memory, and it bears directly on collaboration: the version a participant remembers differing from what happened is the normal case, not a sign that anyone is dishonest. Since recall is reconstruction, any process that depends on later recall is using a source with a systematic bias. The workable countermeasure is not to ask everyone to remember more clearly. It is to leave a record at the time, so that later reconstruction has something to calibrate against.

The fourth point is about this page itself. Calling the mind a channel is an illuminating analogy. It gets you to the right questions, and it authorises no numerical transfer at all. This page deliberately gives no capacity number; the reason is in the next section.

Verification layer · Members
The guided layer of this node is open to all readers.
Verification details and failure boundaries are for members.
US$8.25 a month on average · or subscribe monthly ▸

Lab cases Written only where there is evidence

No field record for this node yet.

Common misreadings

Page verification: Bibliography checked ✓ · Content last revised 2026-11-17

  • A common account says working-memory capacity is seven plus or minus two and that this is settled psychology. Miller's 1956 paper is a classic and genuinely exists, but at its end the author already withheld judgment on the recurring sevens and suspected they were only a coincidence; later research reads the number as a rough estimate and a rhetorical device, and, controlling for chunking and rehearsal, measured a distinctly lower figure. The argument is still live today. Citing it as settled treats a claim its own author held back as a conclusion. #
  • A common account says memory distorts because people do not concentrate enough. Memory is not a recording in the first place; it is reconstruction after compression. Distortion is the normal product of that mechanism, not a symptom of insufficient attention. #
References

How to read the source notes “Bibliographic details checked” means author, year, title and venue were confirmed. It does not mean the source's claims were checked. “Consistent with the abstract” means the claim agrees with the paper's abstract. It does not include sentence-by-sentence checking against the full text. “Matched against the full text” means the claim was compared with the text of the source itself. “Follows secondary accounts” means the claim rests on sources that report it, not on the original document. Definitions as of 2026-09-20.

  1. [1] Miller, G. A. (1956). The Magical Number Seven, Plus or Minus Two: Some Limits on Our Capacity for Processing Information. Psychological Review, 63(2), 81–97. ↩
  2. [2] Cowan, N. (2001). The Magical Number 4 in Short-Term Memory: A Reconsideration of Mental Storage Capacity. Behavioral and Brain Sciences, 24(1), 87–114. ↩
  3. [3] Mathy, F. & Feldman, J. (2012). What's Magic about Magic Numbers? Chunking and Data Compression in Short-Term Memory. Cognition, 122(3), 346–362. ↩
  4. [4] Bartlett, F. C. (1932). Remembering: A Study in Experimental and Social Psychology. Cambridge: Cambridge University Press. ↩
  5. [5] Simon, H. A. (1955). A Behavioral Model of Rational Choice. Quarterly Journal of Economics, 69(1), 99–118. ↩
  6. [6] Friston, K. (2010). The Free-Energy Principle: A Unified Brain Theory? Nature Reviews Neuroscience, 11(2), 127–138. Bibliographic details checked against the official record. Consistent with the abstract. Mentioned as context only. This site has not checked the disputes attached to it, and deliberately uses it as the basis for none of this page's claims. ↩

↳ Is a citation wrong?

Tell me when a new shelf opens

Tell me when a new shelf opens

Shelf notices are sent only when a new shelf opens or when the reading rules change.

Trial

Tell the editor privately: a correction, a counter-example or where it applies

Submissions are read only by the editor, and nothing is published before they are handled. Once a note is handled, a summary and response written by the editor are published. No sign-up is needed, and the nickname may be left blank.

What are you submitting?
Set a public name to be credited by name ▸
Submit anonymously, without signing in

Signing in lets you follow the status on your page. What you have written is kept.

You are signed in: this note is linked to your account, visible only to you and the editor, so you can follow its status on your page. The text is never published. Full privacy policy ▸

Submit anonymously instead, not linked to your account ▸

No email is collected. Your original text and nickname are read only by the editor and are never published; the site publishes only a summary the editor writes. The human check is provided by Cloudflare Turnstile. To limit abuse, the system keeps a hash of your IP address, not the address itself. Your original text is stored with our cloud provider and can be deleted on request. Full privacy policy ▸