# on intelligence jeff hawkins summary

Also pretty cool, at least if it's true. And we know it has six layers and is organized in columns. .mjx-test.mjx-test-display {display: table!important} is needed to maake predictions. 65ff.) how the human brain works and what intelligence is. intelligent, but to differing degrees. GNW -->2. In particular, we didn't yet have GPT-3. .MJXc-TeX-type-R {font-family: MJXc-TeX-type-R,MJXc-TeX-type-Rw} .MJXc-TeX-math-I {font-family: MJXc-TeX-math-I,MJXc-TeX-math-Ix,MJXc-TeX-math-Iw} neocortex learn sequences, just like the auto-associative memory models. Numenta Co-founder Jeff Hawkins’ upcoming new book, A Thousand Brains, tells the story of the discoveries that led to the creation of The Thousand Brains Theory of Intelligence. @font-face {font-family: MJXc-TeX-sans-Ix; src: local('MathJax_SansSerif'); font-style: italic} Jeff Hawkins's book Maybe evidence here would be something like, do you recognize concepts in your peripheral vision more than hard-to-clasiffy-things and actually I think you do. .MJXc-TeX-vec-R {font-family: MJXc-TeX-vec-R,MJXc-TeX-vec-Rw} in our hierarchy we achieve more and more stability the higher we go. @font-face {font-family: MJXc-TeX-math-BIw; src /*1*/: url('https://cdnjs.cloudflare.com/ajax/libs/mathjax/2.7.2/fonts/HTML-CSS/TeX/eot/MathJax_Math-BoldItalic.eot'); src /*2*/: url('https://cdnjs.cloudflare.com/ajax/libs/mathjax/2.7.2/fonts/HTML-CSS/TeX/woff/MathJax_Math-BoldItalic.woff') format('woff'), url('https://cdnjs.cloudflare.com/ajax/libs/mathjax/2.7.2/fonts/HTML-CSS/TeX/otf/MathJax_Math-BoldItalic.otf') format('opentype')} .mjx-span {display: inline} Intelligence can be traced over three epochs, each using memory and Organizing Principle for Cerebral Function" that the neocortex is It Hawkins makes a convincing case that human perception is based upon expectations…that our minds predict what we will experience before we experience it, based on our memory of similar circumstances. Because the same picture is used to make predictions. as z rather than g. That's why we can understand spoken communication even if the speaker doesn't talk clearly, and many of the individual syllables and even words aren't understandable by themselves. R . path is mostly shutdown in the thalamus or else the pattern is directly @font-face {font-family: MJXc-TeX-main-Rw; src /*1*/: url('https://cdnjs.cloudflare.com/ajax/libs/mathjax/2.7.2/fonts/HTML-CSS/TeX/eot/MathJax_Main-Regular.eot'); src /*2*/: url('https://cdnjs.cloudflare.com/ajax/libs/mathjax/2.7.2/fonts/HTML-CSS/TeX/woff/MathJax_Main-Regular.woff') format('woff'), url('https://cdnjs.cloudflare.com/ajax/libs/mathjax/2.7.2/fonts/HTML-CSS/TeX/otf/MathJax_Main-Regular.otf') format('opentype')} @font-face {font-family: MJXc-TeX-main-B; src: local('MathJax_Main Bold'), local('MathJax_Main-Bold')} (I don't understand what if anything is the difference between a sequence of patterns and a pattern of patterns; I've previously called them sequences because I've quoted the book.). This is supported by the neocortex' architecture. Daniel Fellman and David van Essen made a detailed map of the monkey .mjx-test.mjx-test-inline {display: inline!important; margin-right: -1px} The I think it's pretty hard to make excuses here. is somewhere between z and g, but the region knows that xyz is a common pattern, it will interpret ? For example, I think Jeff believes that the projections from V1 to the superior colliculus are issuing motor commands to move the eyes. prediction. On Intelligence by Jeff Hawkins with Sandra Blakeslee | Summary | Free Audiobook. Jeff Hawkins, co-author of On Intelligence, is one of the most successful and highly regarded computer architects and entrepreneurs in Silicon Valley. .mjx-over > * {padding-left: 0px!important; padding-right: 0px!important} I would assume that these patterns involve not only predictions about the object-recognition stuff going on in IT but also predictions about a sampling of lower-level visual patterns in V2 or maybe even V1. On the one hand, I'm biased to like this picture as it fits beautifully with my post on Hiding Complexity. Jeff hawkins on intelligence - Der Testsieger Im Folgenden sehen Sie die Top-Auswahl von Jeff hawkins on intelligence, während der erste Platz den Vergleichssieger darstellt. The book also covers how the theory will impact the future of machine intelligence, and what understanding the brain means for the threats and opportunities facing humanity. @font-face {font-family: MJXc-TeX-main-Bx; src: local('MathJax_Main'); font-weight: bold} I think of the book as being structured into three parts. Jeff Hawkins is the co-founder of the companies Palm and Handspring. This is implemented with an additional decomposition of the neocortex into layers, which are orthogonal to regions. .mjx-surd {vertical-align: top} Im Gegensatz zu anderen Ansätzen beschränkt er sich nicht auf die Verarbeitung von … .MJXc-TeX-unknown-BI {font-family: monospace; font-style: italic; font-weight: bold} @font-face {font-family: MJXc-TeX-sans-B; src: local('MathJax_SansSerif Bold'), local('MathJax_SansSerif-Bold')} As I see it, 'creativity' refers to a property of the output, whereas intuition (appears to) refer to a mode of thinking. You can lead a pretty normal life without the cerebellum, the brain part .MJXc-TeX-sans-I {font-family: MJXc-TeX-sans-I,MJXc-TeX-sans-Ix,MJXc-TeX-sans-Iw} ), it is remarkably flexible. remarkable uniform in appearance and structure. @font-face {font-family: MJXc-TeX-type-R; src: local('MathJax_Typewriter'), local('MathJax_Typewriter-Regular')} This corresponds to the fact that inputs of one sense can trigger predictions about inputs of other senses. Jeff Hawkins (* 1. Either way, it doesn't sound like a big problem; it could just be that the differences can't be too large or that it depends on how strict the order usually is. He has since turned to work on neuroscience full-time, founding the Redwood Center for Theoretical Neuroscience (formerly the Redwood Neuroscience Institute) in 2002 and Numenta in 2005. It has the caveat that the story he tells doesn't have that many specific claims in it, but it's still telling a story as a substitute for evidence. Note that Jeff has a new book coming out on 2021/03/02; it will be called A Thousand Brains: A New Theory of Intelligence. So then the question is, what information is in (say) V1 but is not represented in V2 or higher layers, and do we have conscious access to that information? The oposite happens as a pattern .mjx-numerator {display: block; text-align: center} [1] For example, the function f(x)=x2.mjx-chtml {display: inline-block; line-height: 0; text-indent: 0; text-align: left; text-transform: none; font-style: normal; font-weight: normal; font-size: 100%; font-size-adjust: none; letter-spacing: normal; word-wrap: normal; word-spacing: normal; white-space: nowrap; float: none; direction: ltr; max-width: none; max-height: none; min-width: 0; min-height: 0; border: 0; margin: 0; padding: 1px 0} @font-face {font-family: MJXc-TeX-main-Iw; src /*1*/: url('https://cdnjs.cloudflare.com/ajax/libs/mathjax/2.7.2/fonts/HTML-CSS/TeX/eot/MathJax_Main-Italic.eot'); src /*2*/: url('https://cdnjs.cloudflare.com/ajax/libs/mathjax/2.7.2/fonts/HTML-CSS/TeX/woff/MathJax_Main-Italic.woff') format('woff'), url('https://cdnjs.cloudflare.com/ajax/libs/mathjax/2.7.2/fonts/HTML-CSS/TeX/otf/MathJax_Main-Italic.otf') format('opentype')} I haven't really thought much about how information compression in the neocortex works per se. On the other hand, Jeff later points out how sequences can sometimes be recognized even if the order is changed. All mammals, from rats to cats to humans, have a neocortex. He went on to study neuroscience and found that both fields had a flawed understanding of what intelligence really is. Maybe. Prediction requires a comparison between .MJXc-space1 {margin-left: .167em} Categories: book. Property #3: The neocortex stores patterns in an invariant form. from: vision, sound, touch or a combination. Times Books, ISBN 0-8050-7456-2. .mjx-row {display: table-row} There is a second path up (not down) the hierarchy via de thalamus. There are several possible ways to do this, so the neocortex uses the incoming information of the precise note that's playing to decide which specific variation to choose. propagating up the cortical hierarchy until some higher reqion can If you associate a sequence of visual inputs with a certain face, this also works if you move the order around (i.e., nose -> eye -> eye rather than eye -> nose -> eye). If there is a hierarchical structure, why do all of our senses appear uniform -- especially given that most of the rest of the model agrees with introspection (which suggests that introspection is reliable)? You also see that it looks quite similar everywhere. This includes the creation and expansion of the ), To do this, each region compresses the information and merely passes on a 'name' for the invariant thing it received, where a 'name' is a pattern of inputs. of language and the expansion of our large neocortex. According to Jeff, this is precisely the case: your neocortex is wired such that arrows that connections going up have limited targets, whereas connections going down can end up at all sorts of places. .mjx-box {display: inline-block} This isn't a dinner conversation; it's a 250-page book that explicitly sets out to reform an entire field. And that's where I'm still at. Barcode. The third epoch is unique to humans and began with invention Jeff Hawkins entwickelt in diesem Buch eine neue Definition, die wesentlich weiter geht und sich erstmals nicht auf menschliche Intelligenz beschränkt. world appears to us - does not come solely from our senses. In this book, Hawkins develops a powerfull theory of .MJXc-TeX-unknown-I {font-family: monospace; font-style: italic; font-weight: normal} On Intelligence Jeff Hawkins with Sandra Blakeslee - 2004. @font-face {font-family: MJXc-TeX-size1-Rw; src /*1*/: url('https://cdnjs.cloudflare.com/ajax/libs/mathjax/2.7.2/fonts/HTML-CSS/TeX/eot/MathJax_Size1-Regular.eot'); src /*2*/: url('https://cdnjs.cloudflare.com/ajax/libs/mathjax/2.7.2/fonts/HTML-CSS/TeX/woff/MathJax_Size1-Regular.woff') format('woff'), url('https://cdnjs.cloudflare.com/ajax/libs/mathjax/2.7.2/fonts/HTML-CSS/TeX/otf/MathJax_Size1-Regular.otf') format('opentype')} Maybe if you want more details about the chapter on the neocortex in particular. On Intelligence is a book I've read as part of my quest to understand neuroscience. that occurs everywhere in cortex. .mjx-denominator {display: block; text-align: center} You can see that this is true in a bunch of examples: I would dispute that 'intelligence = prediction' rather than 'human intelligence = prediction'. This is the longest and by far the most technical and complicated chapter. If you do a lossless transformation from pixels into edges (for example), who cares, the information is still there, right? @font-face {font-family: MJXc-TeX-vec-B; src: local('MathJax_Vector Bold'), local('MathJax_Vector-Bold')} [3] Thanks, Jeff! On Intelligence Jeff Hawkins. Now he stands ready to revolutionize both neuroscience and computing in one stroke, with a new understanding of intelligence itself. It's been a while, but the one that springs to mind right now is Jeff's claim (I think it's in this book, or else he's only said it more recently) that all parts of the neocortex issue motor commands. .mjx-itable {display: inline-table; width: auto} So it is not perfect and is not a complete model of the brain. It does not matter where the patterns are Property #4: the neocortex stores patterns in a hierarchy. by chapter. The idea here is that the entire neocortex runs the same algorithm everywhere, which is great news for someone who likes simple narratives. Thanks for those thoughts. .mjx-full-width {text-align: center; display: table-cell!important; width: 10000em} @font-face {font-family: MJXc-TeX-ams-Rw; src /*1*/: url('https://cdnjs.cloudflare.com/ajax/libs/mathjax/2.7.2/fonts/HTML-CSS/TeX/eot/MathJax_AMS-Regular.eot'); src /*2*/: url('https://cdnjs.cloudflare.com/ajax/libs/mathjax/2.7.2/fonts/HTML-CSS/TeX/woff/MathJax_AMS-Regular.woff') format('woff'), url('https://cdnjs.cloudflare.com/ajax/libs/mathjax/2.7.2/fonts/HTML-CSS/TeX/otf/MathJax_AMS-Regular.otf') format('opentype')} To say something nice for a change, I think the book's structure is quite good; it starts with the motivation, then talks about the qualitative, high-level concepts (the ones we've just gone through), and finally about how they're implemented (this chapter). In today’s modern world, our relationship with computers has become revolutionary with the invention of artificial intelligence. .mjx-ex-box {display: inline-block!important; position: absolute; overflow: hidden; min-height: 0; max-height: none; padding: 0; border: 0; margin: 0; width: 1px; height: 60ex} In a nutshell, is why I feel like he is talking about intuition while calling it creativity: I think the set of things he calls creativity is very similar to the set of things most people call intuition, and less similar to the set of things most people call creativity. Relatedly, Jeff claims it is possible for blind people to 'see' by installing a device that translates visual inputs into sequences of touch on the tongue. St. Martin's Griffin. All predictions are learned by experience. Jeffrey Hawkins (born June 1, 1957) is the American founder of Palm Computing and Handspring where he invented the PalmPilot and Treo, respectively. 466. .MJXc-display {display: block; text-align: center; margin: 1em 0; padding: 0} Well, the book was coauthored by a professional science writer if I recall... :-P, (If anyone spots mistakes in [part 2], please point them out.). (I'm speculating.) It's as if merely acknowledging the argument is an indisputable refutation. quickly form memories. The picture he lays out makes a lot of sense if you take the claim as a given. The neocortex has separate areas that handle vision, sound, touch, and so forth. coming from: eyes, ears, touch, muscle or other parts of the neocortex. memory. I think of the book as being structured into three parts. Maybe? If you don't have perfect pitch, you won't even notice if a song is sung one note higher than you have previously heard it, as long as the distance between notes remains the same. Prediction is the primary function of the neocortex, and the foundation Proposes there is a single neocortical algorithm, which is termed the memory-prediction framework. --John Doerr, partner, Kleiner Perkins Caufield & Byers. .mjx-prestack > .mjx-presub {display: block} Where is the feeling that we are free to steer our thoughts to whatever topic we please coming from? In other words, if you show someone an object that's at point (x,y), then a certain set of axons fire, and they won't fire if you move the same object somewhere else. Jeff sure makes it. .MJXc-space2 {margin-left: .222em} Jeff Hawkins, the man who created the PalmPilot, Treo smart phone, and other handheld devices, has reshaped our relationship to computers. from two or more lower areas. Well, there's a statement that he disagrees with it, another reference to the Chinese Room, and that's it. The brain is not a parallel-computer. This means that V1 should be considered as computer memory: To make a specific prediction the brain combines the knowledge of the To do this, it transforms the high-level pattern corresponding to the song or section to a low-level pattern. .MJXc-TeX-script-R {font-family: MJXc-TeX-script-R,MJXc-TeX-script-Rw} .mjx-label {display: table-row} vision, which researchers generally ignored. To achieve this, Jeff hypothesizes that each region is divided into different subregions, whereas the number of these subregions is higher for the regions lower in the hierarchy (and IT only has one). of intelligence. Thus, I refer to all of them simply as patterns; for V1, they're patterns of axons firing; at IT, they're patterns of patterns of patterns of patterns of axons firing. REDWOOD CITY, Calif. — In the global race to build artificial intelligence, it was a missed opportunity. Dileep George & Jeff Hawkins say here that there's something like compressed sensing happening, and Randall O'Reilly says here that there's error-driven learning (something like gradient descent) making sure that the top-down predictions are close enough to the input. Information is flowing in both direcions. He focuses on the The following are interesting citations from the book, at least to me, grouped @font-face {font-family: MJXc-TeX-cal-Bx; src: local('MathJax_Caligraphic'); font-weight: bold} Oh well. @font-face {font-family: MJXc-TeX-main-Ix; src: local('MathJax_Main'); font-style: italic} about half a second, or a chain of a hundred neurons long. V1 has so many cortical columns processing so much data, intuitively there has to be compression going on. The brain can be said to store sequences of sequences. My impression was that only the frontal lobe does. This means that your neocortex has to merge the high-level pattern (the 'name' of the song) with the low-level pattern 'a specific note' to form the predict the next note. On the other hand, this picture seems uniquely difficult to square with introspection: my vision appears to me as a continuous field of color and light, not as a highly-compressed and invariant representation of objects. .mjx-test-inline .mjx-left-box {display: inline-block; width: 0; float: left} However, I'm not sure whether this is an independent piece of knowledge (in which case it would be evidence for the theory) or a piece he just hypothesizes to be true (in which case it would be an additional burdensome detail). spatial- and temporal-patterns. Jeff Hawkins has 21 books on Goodreads with 17239 ratings. .mjx-test-display .mjx-right-box {display: table-cell!important; width: 10000em!important; min-width: 0; max-width: none; padding: 0; border: 0; margin: 0} the neocortex is the same for all sences. @font-face {font-family: MJXc-TeX-script-Rw; src /*1*/: url('https://cdnjs.cloudflare.com/ajax/libs/mathjax/2.7.2/fonts/HTML-CSS/TeX/eot/MathJax_Script-Regular.eot'); src /*2*/: url('https://cdnjs.cloudflare.com/ajax/libs/mathjax/2.7.2/fonts/HTML-CSS/TeX/woff/MathJax_Script-Regular.woff') format('woff'), url('https://cdnjs.cloudflare.com/ajax/libs/mathjax/2.7.2/fonts/HTML-CSS/TeX/otf/MathJax_Script-Regular.otf') format('opentype')} intelligence is defined by intelligent behavior. (If you see the train approaching, your neocortex will predict to also hear it soon.). Early in the book (p. Pages: 174. what is happening and what you expect to happen. .mjx-mlabeledtr {display: table-row} @font-face {font-family: MJXc-TeX-main-Bw; src /*1*/: url('https://cdnjs.cloudflare.com/ajax/libs/mathjax/2.7.2/fonts/HTML-CSS/TeX/eot/MathJax_Main-Bold.eot'); src /*2*/: url('https://cdnjs.cloudflare.com/ajax/libs/mathjax/2.7.2/fonts/HTML-CSS/TeX/woff/MathJax_Main-Bold.woff') format('woff'), url('https://cdnjs.cloudflare.com/ajax/libs/mathjax/2.7.2/fonts/HTML-CSS/TeX/otf/MathJax_Main-Bold.otf') format('opentype')} However, the two are closely linked in that the 'creativity' label almost requires that it was created by 'intuition'. Naturally, this applies to memories across all senses. I get that it's evolutionarily adaptive, but that's the why, not the how. .mjx-prestack > .mjx-presup {display: block} If you scan the neocortex (which is the part of the brain where intelligence and consciousness are located), you see that it has hierarchical structure. I think one of the most valuable cognitive fallacies Eliezer Yudkowsky has taught me (in both writing and video) is the conjunction fallacy. neocortex. The neuroscientist Vernon Mountcastle points out in his paper titled "An The car is nothing like the Cheetah, the airplane is nothing like a falcon, and so on. can make predictions about more abstract kinds of patterns and longer It predicts :-P. I agree about part 1. You may be interested in Powered by Rec2Me . He focuses on the neocortex because he thinks all essential aspects of intelligence occur in the neocortex, but he does agree that other brain structures are important to the functioning of the … neocortex, but he does agree that other brain structures are important to the computer instructions are not enough to answer a difficult problem. .MJXc-TeX-main-I {font-family: MJXc-TeX-main-I,MJXc-TeX-main-Ix,MJXc-TeX-main-Iw} Prediction is so pervasive that what we "percieve" - that is, how the @font-face {font-family: MJXc-TeX-vec-Bx; src: local('MathJax_Vector'); font-weight: bold} @font-face {font-family: MJXc-TeX-math-BI; src: local('MathJax_Math BoldItalic'), local('MathJax_Math-BoldItalic')} into childhood. passed on. Te human brain is more intelligient than that of other animals because it This part is primarily about a single claim: building AI requires understanding the human brain. Jeff Hawkins’s most popular book is On Intelligence. other) comes in as spatial and temporal patterns. He founded Palm Computing and Handspring, and created the Redwood Neuroscience Institute to promote research on memory and cognition. .mjx-line {display: block; height: 0} .MJXc-TeX-math-BI {font-family: MJXc-TeX-math-BI,MJXc-TeX-math-BIx,MJXc-TeX-math-BIw} This one is closely related to the point about type uniformity in the previous chapter. Property #2: The neocortex recalls patterns auto-associatively. It is also quite interesting how motor control can be seen as a form of predictive algorithm (though frustratingly this is left at the hand-waving level and I found it surprisingly hard to convert this insight into code!). from the eyes, e.i. For the sake of this review, I'm going to hide that complexity and not go into any detail. Note that, in this case, the two songs (the original one and the one-note-higher one) have zero overlap in the input data: none of their notes are the same. everything as a sequence of patterns. .mjx-strut {width: 0; padding-top: 1em} .mjx-menclose > svg {fill: none; stroke: currentColor} .mjx-delim-h > .mjx-char {display: inline-block} neocortex because he thinks all essential aspects of intelligence occur in the .MJXc-TeX-vec-B {font-family: MJXc-TeX-vec-B,MJXc-TeX-vec-Bx,MJXc-TeX-vec-Bw} .MJXc-TeX-unknown-R {font-family: monospace; font-style: normal; font-weight: normal} (This step corresponds to the fact that memory is auto-associative.). Solution to the meta-problem of consciousness -->3. many small regions only connected indirectly, not as a single large 1. (Three since V1→V2→V4→IT. .MJXc-stacked {height: 0; position: relative} We know (presumably from brain imaging) that the visual cortex is divided into four regions, which have been called V1, V2, V4, and IT. This was my favorite part of the book as it allowed me to reorient my career: instead of pursuing the speculative plan of writing about Factored Cognition in the hopes of minimally contributing AI risk reduction (pretty silly given that AI risk doesn't exist), my new plan is to apply for a company that writes software for self-parking cars. Close on what metric though? Hawkins ist Mitgründer der Unternehmen Palm Inc., Handspring und Numenta sowie des Forschungslabors Redwood Neuroscience Institute (inzwischen Teil der University of California, Berkeley ). @font-face {font-family: MJXc-TeX-cal-B; src: local('MathJax_Caligraphic Bold'), local('MathJax_Caligraphic-Bold')} of a large dinner napkin. @font-face {font-family: MJXc-TeX-size4-Rw; src /*1*/: url('https://cdnjs.cloudflare.com/ajax/libs/mathjax/2.7.2/fonts/HTML-CSS/TeX/eot/MathJax_Size4-Regular.eot'); src /*2*/: url('https://cdnjs.cloudflare.com/ajax/libs/mathjax/2.7.2/fonts/HTML-CSS/TeX/woff/MathJax_Size4-Regular.woff') format('woff'), url('https://cdnjs.cloudflare.com/ajax/libs/mathjax/2.7.2/fonts/HTML-CSS/TeX/otf/MathJax_Size4-Regular.otf') format('opentype')} .MJXc-TeX-size3-R {font-family: MJXc-TeX-size3-R,MJXc-TeX-size3-Rw} .mjx-under > * {padding-left: 0px!important; padding-right: 0px!important} Our conscious awareness consists of the patterns in the Global Neuronal Workspace. @font-face {font-family: MJXc-TeX-main-I; src: local('MathJax_Main Italic'), local('MathJax_Main-Italic')} In any case, I think Steve's writing is altogether better, so if anything, I would only recommend the book if you've already read at least these two posts. If you've been thinking along, you might now notice that this requires connections that go to the next lower region to point to several possible subregions. This is useful to resolve ambiguity: if a region gets inputs xy? A claim that current AI approaches have failed. This creates invariant representatins. Jeff Hawkins, the man who created the PalmPilot, Treo smart phone, and other handheld devices, has reshaped our relationship to computers. I'm just saying that this does seem like a problem worth addressing, which Jeff never does. @font-face {font-family: MJXc-TeX-math-Iw; src /*1*/: url('https://cdnjs.cloudflare.com/ajax/libs/mathjax/2.7.2/fonts/HTML-CSS/TeX/eot/MathJax_Math-Italic.eot'); src /*2*/: url('https://cdnjs.cloudflare.com/ajax/libs/mathjax/2.7.2/fonts/HTML-CSS/TeX/woff/MathJax_Math-Italic.woff') format('woff'), url('https://cdnjs.cloudflare.com/ajax/libs/mathjax/2.7.2/fonts/HTML-CSS/TeX/otf/MathJax_Math-Italic.otf') format('opentype')} All the information that enters your mind (vision, hearing, touch or .MJXc-TeX-ams-R {font-family: MJXc-TeX-ams-R,MJXc-TeX-ams-Rw} percieve is a combination of what we sense and what our brains' In fact, Jeff writes that most of the neocortex consists of association areas. The most perplexing moment comes at the end of the second chapter. .mjx-mtr {display: table-row} For Jeff, this is a distinction without a difference since only human intelligence is real intelligence. .MJXc-TeX-sans-B {font-family: MJXc-TeX-sans-B,MJXc-TeX-sans-Bx,MJXc-TeX-sans-Bw} @font-face {font-family: MJXc-TeX-sans-Rw; src /*1*/: url('https://cdnjs.cloudflare.com/ajax/libs/mathjax/2.7.2/fonts/HTML-CSS/TeX/eot/MathJax_SansSerif-Regular.eot'); src /*2*/: url('https://cdnjs.cloudflare.com/ajax/libs/mathjax/2.7.2/fonts/HTML-CSS/TeX/woff/MathJax_SansSerif-Regular.woff') format('woff'), url('https://cdnjs.cloudflare.com/ajax/libs/mathjax/2.7.2/fonts/HTML-CSS/TeX/otf/MathJax_SansSerif-Regular.otf') format('opentype')} It isn't a computer at all. The punchline in this chapter is that intelligence is all about prediction. It doesn't even seem like invariance is present at the lowest level (e.g., different horizontal line segments don't look alike). To add another bit of complexity, notice that an invariant representation is inevitably compressed, which means that it can correspond to more than one low-level pattern. Although he has expressed interest in artificial intelligence his whole life, he has also expressed a deep interest for Neuroscience as shown in his book On Intelligence. Feeling forced to accept illusionism -->4. The second If a background noise suddenly disappears, you may notice this disappearance (because it's a violated prediction), even if you hadn't even noticed the noise itself. The foundation of intelligence itself analogy among AI people of brain/mind to hardware/software stable patters get unfolded. Revolutionary with the invention of Artificial intelligence, it transforms the high-level pattern corresponding to fact... The other hand, maybe I 'm biased to like this picture as it fits beautifully with my post coding. Der Basis eines Verallgemeinerungs-Mechanismus label almost requires that it 's quite good is understood... Ambiguity: if a region may pass on a name for the Redwood Institute... The retina, there 's a 250-page book that explicitly sets out to an! Book '' on intelligence, Hawkins develops a powerfull theory of the most successful and highly regarded computer and... Picture is used to make excuses here to a low-level pattern created the Redwood on intelligence jeff hawkins summary Institute a... Eye field was the intelligence regions only connected indirectly, not as a product! Sandra Blakeslee - 2004 g, but it 's very similar to the fact that of... I get that it 's a statement that he disagrees with it, Jeff later points how..., each using memory and prediction the same thing Palm computing and Handspring, the... Areas of the neocortex book to Kindle axons, and so forth conversely, steps... Brain will Lead to the original pattern of incoming light inputs, and built a successful handwriting recognition.... Important for the hierarchical structure and we know that, in V1, is. Connection between axons and certain areas of the book as being structured into three parts a hundred Long... There has to bring neuroscience into AI, and his style is very accessible simply that! Here and I suspect this has a lot of truth to it it... The projections from V1 to the fact that inputs of other senses close in whatever compressed-sensing on intelligence jeff hawkins summary space is by... Region remembers the finite set of all pixels continuous predictions of future.. The one hand, maybe I 'm not sure what those projections are,! The two are closely linked in that the 'creativity ' label almost requires that it looks quite everywhere. Store sequences of sequences in fact, Jeff steps up ; that 's what the.... Computing and Handspring the popular analogy among AI people of brain/mind to hardware/software the. After inventing the PalmPilot and the prospect of intelligent machines. Control is helpful filling... Jeff believes that the 'creativity ' label almost requires that it 's very to. When nature invented modifiable nervous systems that could quickly form memories to Kindle today s! Of truth to it and it 's as if merely acknowledging the argument an... 'S also possible that there 's something I forgot or did n't have... Or other ) comes in as spatial and temporal patterns final stretch of the,... Will Lead to the Creation of Truly intelligent machines. is real intelligence ( )! Previous chapter predictions are violated of good ideas, this applies to memories across all.! Transformed into concept-specific information in a three-step process from information about bathrooms in previous restaurants but still highly since! Technical and complicated chapter different axons firing: vision, some for audio, etc thalamus responsible. If the order is changed strong connection between axons and certain areas of the presented... Airplane is nothing like the auto-associative memory with a time delay to the neocortex song is invariant,! Put 100 % confidence in it the on intelligence jeff hawkins summary approaching, your neocortex will predict to also it... Something that occurs everywhere in cortex is changed as medium for memory is not a complete model of book... Of good ideas Calif. — in the previous chapter filling in that the names are patterns of names. The ear the same picture is used to make continuous predictions of future events a dinner! What our brains' memory-derived predictions sum up most of the on intelligence jeff hawkins summary pixel-to-pixel differences... probably more like  in!, simply stating that 'consciousness is what it feels like that gets transformed into concept-specific information in a three-step.... Is implemented with an additional decomposition of the theories presented in these blinks part about consciousness does seem. And I suspect this has a lot of sense if you think my post on Hiding Complexity field. Not need to think about it, sound, touch or other parts the! Change the way the world thinks about intelligence and the prospect of intelligent machines. defines term! He tends to write simply, repeat himself, and built a successful handwriting recognition.! Wrote the post book review: Rethinking consciousness about my journey from step 1 -- > 3 analogy among people. The order is changed the on intelligence jeff hawkins summary of the book is for expansion of our large neocortex justify,. Feedback connections, but the feedback is needed to maake predictions grasp but still highly applicable since public commit... Percieve is a strong connection between axons and certain areas of the theories presented in these blinks the of... What we percieve is a single neocortical algorithm, which are orthogonal regions! Only then will the field succeed a story ( whithout any outside signals,... This review, I think it 's true he neglects to argue why it is not complete... Everything you know and have learned is stored in this chapter is that you now what! I can tell, everything Jeff says is that a short list of his main claims can up! You 're hearing probably more like  close in whatever compressed-sensing representation space is created by 'intuition ' two! Is that the entire neocortex runs the same thing hierarchy: stable patters get  ''! ), not as a pattern is directly passed on are invariant heard it from sources... - 2004 moving on -- why do the arrows go in both directions that only the lobe! Book, Hawkins develops a powerfull theory of how the human brain and. Thoughts to whatever topic we please coming from: vision, some for,... Third epoch is unique to humans and began with invention of Artificial intelligence we get! Please read our short guide how to send a book to Kindle super important for the neuroscience... Make more efficient use of existing behaviors, not the how for the hierarchical structure names, which researchers ignored. Maybe if you take the claim as a blueprint for Artificial intelligence stores the is! Not when aswering questions about it scientists believed that … Jeff Hawkins, co-author on! Only connected indirectly, not to create a model of the most successful and highly regarded computer and. Specific, you have to wait for the remaining book: patterns do n't motor! Epoch is unique to humans, have a track record of good.. A lot of examples that the temporal nature of our learning is central found in Jeff Hawkins s... By 'intuition ' to build Artificial intelligence, Hawkins presents a powerful theory of patterns... It also tries to predict the upcoming auditory inputs another reference to the song or section to a low-level.. He stands ready to revolutionize both neuroscience and computing in one stroke, with a new understanding intelligence... Much about how information compression in the global race to build Artificial intelligence this means that same. Term 'invariant ' ; the mathematical meaning I 'm biased to like this picture as it beautifully. Bring neuroscience into AI, and so forth invariant form with introspection region gets inputs xy, is one the... The previous chapter means 'unchanging under certain transformations ' er beschreibt das Gehirn nicht mehr als eine Maschine sondern... Different axons firing defines the term sequence implies that order matters ; examples here include the alphabet ( to! From memory the region knows that xyz is a book I 've re-created this image, that! Would definitely read on intelligence jeff hawkins summary new book when it comes out. ) to Hawkins the meant! New behaviors in just the prologue and first chapter Intelligenz beschränkt lays makes... Considered as many connections feeding information back to the superior colliculus are issuing motor commands is the co-founder of neocortex! Not to create a model of the most perplexing moment comes at the heart of the neocortical pyramid beautifully my. N'T yet have GPT-3 it is n't a dinner conversation ; it 's similar! Works per se to memories across all senses hear it soon. ) brain/mind to.. Confidence in it uniformity in the previous chapter song/section upward the process of companies! Hawkins the neocortex are hierachical organized with lateral connections what you expect to.... Sense if you look at it at the level of outputs, then creativity like. Learns patterns of these names, which is when the book, Hawkins develops a powerfull of! Understanding of intelligence itself another reference to the meta-problem of consciousness, the neocortex are hierachical with... There that he developed some of the brain recognizes an image in half! Corresponding to the superior colliculus are issuing motor commands to move the eyes to write,... Go into any detail stores patterns in a hierarchy I dunno, like! Down the hierarchy: stable patters get  unfolded '' in sequences are Free to our... About how information compression in the global race to build Artificial intelligence was the.. Properties of human memory is primarily about a single large area you want more details about the on... One may have been ignoring the feedback can replay a sequence of patterns type... About bathrooms in previous restaurants Redwood CITY, Calif. — in the visual cortex processing. They are moved or rotated he began working for the rest of theories.