Part 11 (1/2)

Cosmologists argue about whether the world will end in fire (a big crunch to match the big bang) or ice (the death of the stars as they spread out into an eternal expansion), but this does not take into account the power of intelligence, as if its emergence were just an entertaining sideshow to the grand celestial mechanics that now rule the universe. How long will it take for us to spread our intelligence in its nonbiological form throughout the universe? If we can transcend the speed of light-admittedly a big if-for example, by using wormholes through s.p.a.ce (which are consistent with our current understanding of physics), it could be achieved within a few centuries. Otherwise, it will likely take much longer. In either scenario, waking up the universe, and then intelligently deciding its fate by infusing it with our human intelligence in its nonbiological form, is our destiny.

NOTES

Introduction1. Here is one sentence from Here is one sentence from One Hundred Years of Solitude One Hundred Years of Solitude by Gabriel Garcia Marquez: by Gabriel Garcia Marquez:Aureliano Segundo was not aware of the singsong until the following day after breakfast when he felt himself being bothered by a buzzing that was by then more fluid and louder than the sound of the rain, and it was Fernanda, who was walking throughout the house complaining that they had raised her to be a queen only to have her end up as a servant in a madhouse, with a lazy, idolatrous, libertine husband who lay on his back waiting for bread to rain down from heaven while she was straining her kidneys trying to keep afloat a home held together with pins where there was so much to do, so much to bear up under and repair from the time G.o.d gave his morning sunlight until it was time to go to bed that when she got there her eyes were full of ground gla.s.s, and yet no one ever said to her, ”Good morning, Fernanda, did you sleep well?,” nor had they asked her, even out of courtesy, why she was so pale or why she awoke with purple rings under her eyes in spite of the fact that she expected it, of course, from a family that had always considered her a nuisance, an old rag, a b.o.o.by painted on the wall, and who were always going around saying things against her behind her back, calling her churchmouse, calling her Pharisee, calling her crafty, and even Amaranta, may she rest in peace, had said aloud that she was one of those people who could not tell their r.e.c.t.u.ms from their ashes, G.o.d have mercy, such words, and she had tolerated everything with resignation because of the Holy Father, but she had not been able to tolerate it any more when that evil Jose Arcadio Segundo said that the d.a.m.nation of the family had come when it opened its doors to a stuck-up highlander, just imagine, a bossy highlander, Lord save us, a highlander daughter of evil spit of the same stripe as the highlanders the government sent to kill workers, you tell me, and he was referring to no one but her, the G.o.dchild of the Duke of Alba, a lady of such lineage that she made the liver of presidents' wives quiver, a n.o.ble dame of fine blood like her, who had the right to sign eleven peninsular names and who was the only mortal creature in that town full of b.a.s.t.a.r.ds who did not feel all confused at the sight of sixteen pieces of silverware, so that her adulterous husband could die of laughter afterward and say that so many knives and forks and spoons were not meant for a human being but for a centipede, and the only one who could tell with her eyes closed when the white wine was served and on what side and in which gla.s.s and when the red wine and on what side and in which gla.s.s and not like that peasant of an Amaranta, may she rest in peace, who thought that white wine was served in the daytime and red wine at night, and the only one on the whole coast who could take pride in the fact that she took care of her bodily needs only in golden chamberpots, so that Colonel Aureliano Buendia, may he rest in peace, could have the effrontery to ask her with his Masonic ill humor where she had received that privilege and whether she did not s.h.i.+t s.h.i.+t but shat sweet basil, just imagine, with those very words, and so that Renata, her own daughter, who through an oversight had seen her stool in the bedroom, had answered that even if the pot was all gold and with a coat of arms, what was inside was pure s.h.i.+t, physical s.h.i.+t, and worse even than any other kind because it was stuck-up highland s.h.i.+t, just imagine, her own daughter, so that she never had any illusions about the rest of the family, but in any case she had the right to expect a little more consideration from her husband because, for better or for worse, he was her consecrated spouse, her helpmate, her legal despoiler, who took upon himself of his own free and sovereign will the grave responsibility of taking her away from her paternal home, where she never wanted for or suffered from anything, where she wove funeral wreaths as a pastime, since her G.o.dfather had sent a letter with his signature and the stamp of his ring on the sealing wax simply to say that the hands of his G.o.ddaughter were not meant for tasks of this world except to play the clavichord, and, nevertheless, her insane husband had taken her from her home with all manner of admonitions and warnings and had brought her to that frying pan of h.e.l.l where a person could not breathe because of the heat, and before she had completed her Pentecostal fast he had gone off with his wandering trunks and his wastrel's accordion to loaf in adultery with a wretch of whom it was only enough to see her behind, well, that's been said, to see her wiggle her mare's behind in order to guess that she was a, that she was a, just the opposite of her, who was a lady in a palace or a pigsty, at the table or in bed, a lady of breeding, G.o.d-fearing, obeying His laws and submissive to His wishes, and with whom he could not perform, naturally, the acrobatics and trampish antics that he did with the other one, who, of course, was ready for anything, like the French matrons, and even worse, if one considers well, because they at least had the honesty to put a red light at their door, swinishness like that, just imagine, and that was all that was needed by the only and beloved daughter of Dona Renata Argote and Don Fernando del Carpio, and especially the latter, an upright man, a fine Christian, a Knight of the Order of the Holy Sepulcher, those who receive direct from G.o.d the privilege of remaining intact in their graves with their skin smooth like the cheeks of a bride and their eyes alive and clear like emeralds.2. See the graph ”Growth in Genbank DNA Sequence Data” in See the graph ”Growth in Genbank DNA Sequence Data” in chapter 10 chapter 10.3. Cheng Zhang and Jianpeng Ma, ”Enhanced Sampling and Applications in Protein Folding in Explicit Solvent,” Cheng Zhang and Jianpeng Ma, ”Enhanced Sampling and Applications in Protein Folding in Explicit Solvent,” Journal of Chemical Physics Journal of Chemical Physics 132, no. 24 (2010): 244101. See also folding.stanford.edu/English/About about the [email protected] project, which has harnessed over five million computers around the world to simulate protein folding. 132, no. 24 (2010): 244101. See also folding.stanford.edu/English/About about the project, which has harnessed over five million computers around the world to simulate protein folding.4. For a more complete description of this argument, see the section ”[The Impact...] on the Intelligent Destiny of the Cosmos: Why We Are Probably Alone in the Universe” in chapter 6 of For a more complete description of this argument, see the section ”[The Impact...] on the Intelligent Destiny of the Cosmos: Why We Are Probably Alone in the Universe” in chapter 6 of The Singularity Is Near The Singularity Is Near by Ray Kurzweil (New York: Viking, 2005). by Ray Kurzweil (New York: Viking, 2005).5. James D. Watson, James D. Watson, Discovering the Brain Discovering the Brain (Was.h.i.+ngton, DC: National Academies Press, 1992). (Was.h.i.+ngton, DC: National Academies Press, 1992).6. Sebastian Seung, Sebastian Seung, Connectome: How the Brain's Wiring Makes Us Who We Are Connectome: How the Brain's Wiring Makes Us Who We Are (New York: Houghton Mifflin Harcourt, 2012). (New York: Houghton Mifflin Harcourt, 2012).7. ”Mandelbrot Zoom,” /watch?v=gEw8xpb1aRA; ”Fractal Zoom Mandelbrot Corner,” /watch?v=G_GBwuYuOOs. ”Mandelbrot Zoom,” /watch?v=gEw8xpb1aRA; ”Fractal Zoom Mandelbrot Corner,” /watch?v=G_GBwuYuOOs.

Chapter 1: Thought Experiments on the World1. Charles Darwin, Charles Darwin, The Origin of Species The Origin of Species (P. F. Collier & Son, 1909), 185/9596. (P. F. Collier & Son, 1909), 185/9596.2. Darwin, Darwin, On the Origin of Species On the Origin of Species, 751 (206.1.1-6), Peckham's Variorum edition, edited by Morse Peckham, The Origin of Species by Charles Darwin: A Variorum Text The Origin of Species by Charles Darwin: A Variorum Text (Philadelphia: University of Pennsylvania Press, 1959). (Philadelphia: University of Pennsylvania Press, 1959).3. R. Dahm, ”Discovering DNA: Friedrich Miescher and the Early Years of Nucleic Acid Research,” R. Dahm, ”Discovering DNA: Friedrich Miescher and the Early Years of Nucleic Acid Research,” Human Genetics Human Genetics 122, no. 6 (2008): 56581, doi:10.1007/s00439-007-0433-0; PMID 17901982. 122, no. 6 (2008): 56581, doi:10.1007/s00439-007-0433-0; PMID 17901982.4. Valery N. Soyfer, ”The Consequences of Political Dictators.h.i.+p for Russian Science,” Valery N. Soyfer, ”The Consequences of Political Dictators.h.i.+p for Russian Science,” Nature Reviews Genetics Nature Reviews Genetics 2, no. 9 (2001): 72329, doi:10.1038/35088598; PMID 11533721. 2, no. 9 (2001): 72329, doi:10.1038/35088598; PMID 11533721.5. J. D. Watson and F. H. C. Crick, ”A Structure for Deoxyribose Nucleic Acid,” J. D. Watson and F. H. C. Crick, ”A Structure for Deoxyribose Nucleic Acid,” Nature Nature 171 (1953): 73738, /nature/dna50/watsoncrick.pdf and ”Double Helix: 50 Years of DNA,” 171 (1953): 73738, /nature/dna50/watsoncrick.pdf and ”Double Helix: 50 Years of DNA,” Nature Nature archive, /nature/dna50/archive.xhtml. archive, /nature/dna50/archive.xhtml.6. Franklin died in 1958 and the n.o.bel Prize for the discovery of DNA was awarded in 1962. There is controversy as to whether or not she would have shared in that prize had she been alive in 1962. Franklin died in 1958 and the n.o.bel Prize for the discovery of DNA was awarded in 1962. There is controversy as to whether or not she would have shared in that prize had she been alive in 1962.7. Albert Einstein, ”On the Electrodynamics of Moving Bodies” (1905). This paper established the special theory of relativity. See Robert Bruce Lindsay and Henry Margenau, Albert Einstein, ”On the Electrodynamics of Moving Bodies” (1905). This paper established the special theory of relativity. See Robert Bruce Lindsay and Henry Margenau, Foundations of Physics Foundations of Physics (Woodbridge, CT: Ox Bow Press, 1981), 330. (Woodbridge, CT: Ox Bow Press, 1981), 330.8. ”Crookes radiometer,” Wikipedia, en.wikipedia.org/wiki/Crookes_radiometer. ”Crookes radiometer,” Wikipedia, en.wikipedia.org/wiki/Crookes_radiometer.9. Note that some of the momentum of the photons is transferred to the air molecules in the bulb (since it is not a perfect vacuum) and then transferred from the heated air molecules to the vane. Note that some of the momentum of the photons is transferred to the air molecules in the bulb (since it is not a perfect vacuum) and then transferred from the heated air molecules to the vane.10. Albert Einstein, ”Does the Inertia of a Body Depend Upon Its Energy Content?” (1905). This paper established Einstein's famous formula Albert Einstein, ”Does the Inertia of a Body Depend Upon Its Energy Content?” (1905). This paper established Einstein's famous formula E E = = mc mc2.11. ”Albert Einstein's Letters to President Franklin Delano Roosevelt,” hypertextbook.com/eworld/einstein.shtml. ”Albert Einstein's Letters to President Franklin Delano Roosevelt,” hypertextbook.com/eworld/einstein.shtml.

Chapter 3: A Model of the Neocortex: The Pattern Recognition Theory of Mind1. Some nonmammals, such as crows, parrots, and octopi, are reported to be capable of some level of reasoning; however, this is limited and has not been sufficient to create tools that have their own evolutionary course of development. These animals may have adapted other brain regions to perform a small number of levels of hierarchical thinking, but a neocortex is required for the relatively unrestricted hierarchical thinking that humans can perform. Some nonmammals, such as crows, parrots, and octopi, are reported to be capable of some level of reasoning; however, this is limited and has not been sufficient to create tools that have their own evolutionary course of development. These animals may have adapted other brain regions to perform a small number of levels of hierarchical thinking, but a neocortex is required for the relatively unrestricted hierarchical thinking that humans can perform.2. V. B. Mountcastle, ”An Organizing Principle for Cerebral Function: The Unit Model and the Distributed System” (1978), in Gerald M. Edelman and Vernon B. Mountcastle, V. B. Mountcastle, ”An Organizing Principle for Cerebral Function: The Unit Model and the Distributed System” (1978), in Gerald M. Edelman and Vernon B. Mountcastle, The Mindful Brain: Cortical Organization and the Group-Selective Theory of Higher Brain Function The Mindful Brain: Cortical Organization and the Group-Selective Theory of Higher Brain Function (Cambridge, MA: MIT Press, 1982). (Cambridge, MA: MIT Press, 1982).3. Herbert A. Simon, ”The Organization of Complex Systems,” in Howard H. Pattee, ed., Herbert A. Simon, ”The Organization of Complex Systems,” in Howard H. Pattee, ed., Hierarchy Theory: The Challenge of Complex Systems Hierarchy Theory: The Challenge of Complex Systems (New York: George Braziller, Inc., 1973), blog.santafe.edu/wp-content/uploads/2009/03/simon 1973.pdf. (New York: George Braziller, Inc., 1973), blog.santafe.edu/wp-content/uploads/2009/03/simon 1973.pdf.4. Marc D. Hauser, Noam Chomsky, and W. Tec.u.mseh Fitch, ”The Faculty of Language: What Is It, Who Has It, and How Did It Evolve?” Marc D. Hauser, Noam Chomsky, and W. Tec.u.mseh Fitch, ”The Faculty of Language: What Is It, Who Has It, and How Did It Evolve?” Science Science 298 (November 2002): 156979, e. I do try to think about it. What do I know about this? What form could a solution take? And then I go to sleep. Doing this primes my subconscious mind to work on the problem.Terry: Sigmund Freud pointed out that when we dream, many of the censors in our brain are relaxed, so that we might dream about things that are socially, culturally, or even s.e.xually taboo. We can dream about weird things that we wouldn't allow ourselves to think about during the day. That's at least one reason why dreams are strange. Sigmund Freud pointed out that when we dream, many of the censors in our brain are relaxed, so that we might dream about things that are socially, culturally, or even s.e.xually taboo. We can dream about weird things that we wouldn't allow ourselves to think about during the day. That's at least one reason why dreams are strange.Ray: There are also professional blinders that prevent people from thinking creatively, many of which come from our professional training, mental blocks such as ”you can't solve a signal processing problem that way” or ”linguistics is not supposed to use those rules.” These mental a.s.sumptions are also relaxed in our dream state, so I'll dream about new ways of solving problems without being burdened by these daytime constraints. There are also professional blinders that prevent people from thinking creatively, many of which come from our professional training, mental blocks such as ”you can't solve a signal processing problem that way” or ”linguistics is not supposed to use those rules.” These mental a.s.sumptions are also relaxed in our dream state, so I'll dream about new ways of solving problems without being burdened by these daytime constraints.Terry: There's another part of our brain also not working when we dream, our rational faculties to evaluate whether an idea is reasonable. So that's another reason that weird or fantastic things happen in our dreams. When the elephant walks through the wall, we aren't shocked as to how the elephant could do this. We just say to our dream selves, ”Okay, an elephant walked through the wall, no big deal.” Indeed, if I wake up in the middle of the night, I often find that I've been dreaming in strange and oblique ways about the problem that I a.s.signed myself. There's another part of our brain also not working when we dream, our rational faculties to evaluate whether an idea is reasonable. So that's another reason that weird or fantastic things happen in our dreams. When the elephant walks through the wall, we aren't shocked as to how the elephant could do this. We just say to our dream selves, ”Okay, an elephant walked through the wall, no big deal.” Indeed, if I wake up in the middle of the night, I often find that I've been dreaming in strange and oblique ways about the problem that I a.s.signed myself.Ray: The next step occurs in the morning in the halfway state between dreaming and being awake, which is often called The next step occurs in the morning in the halfway state between dreaming and being awake, which is often called lucid dreaming lucid dreaming. In this state, I still have the feelings and imagery from my dreams, but now I do have my rational faculties. I realize, for example, that I am in a bed. And I could formulate the rational thought that I have a lot to do so I had better get out of bed. But that would be a mistake. Whenever I can, I will stay in bed and continue in this lucid dream state because that is key to this creative problem-solving method. By the way, this doesn't work if the alarm rings.Reader: Sounds like the best of both worlds. Sounds like the best of both worlds.Ray: Exactly. I still have access to the dream thoughts about the problem I a.s.signed myself the night before. But now I'm sufficiently conscious and rational to evaluate the new creative ideas that came to me during the night. I can determine which ones make sense. After perhaps 20 minutes of this, I invariably will have keen new insights into the problem. Exactly. I still have access to the dream thoughts about the problem I a.s.signed myself the night before. But now I'm sufficiently conscious and rational to evaluate the new creative ideas that came to me during the night. I can determine which ones make sense. After perhaps 20 minutes of this, I invariably will have keen new insights into the problem.I've come up with inventions this way (and spent the rest of the day writing a patent application), figured out how to organize material for a book such as this, and come up with useful ideas for a diverse set of problems. If I have a key decision to make, I will always go through this process, after which I am likely to have real confidence in my decision.The key to the process is to let your mind go, to be nonjudgmental, and not to worry about how well the method is working. It is the opposite of a mental discipline. Think about the problem, but then let ideas wash over you as you fall asleep. Then in the morning, let your mind go again as you review the strange ideas that your dreams generated. I have found this to be an invaluable method for harnessing the natural creativity of my dreams.Reader: Well, for the workaholics among us, we can now work in our dreams. Not sure my spouse is going to appreciate this. Well, for the workaholics among us, we can now work in our dreams. Not sure my spouse is going to appreciate this.Ray: Actually, you can think of it as getting your dreams to do your work for you. Actually, you can think of it as getting your dreams to do your work for you.

Chapter 4: The Biological Neocortex1. Steven Pinker, Steven Pinker, How the Mind Works How the Mind Works (New York: Norton, 1997), 15253. (New York: Norton, 1997), 15253.2. D. O. Hebb, D. O. Hebb, The Organization of Behavior The Organization of Behavior (New York: John Wiley & Sons, 1949). (New York: John Wiley & Sons, 1949).3. Henry Markram and Rodrigo Perrin, ”Innate Neural a.s.semblies for Lego Memory,” Henry Markram and Rodrigo Perrin, ”Innate Neural a.s.semblies for Lego Memory,” Frontiers in Neural Circuits Frontiers in Neural Circuits 5, no. 6 (2011). 5, no. 6 (2011).4. E-mail communication from Henry Markram, February 19, 2012. E-mail communication from Henry Markram, February 19, 2012.5. Van J. Wedeen et al., ”The Geometric Structure of the Brain Fiber Pathways,” Van J. Wedeen et al., ”The Geometric Structure of the Brain Fiber Pathways,” Science Science 335, no. 6076 (March 30, 2012). 335, no. 6076 (March 30, 2012).6. Tai Sing Lee, ”Computations in the Early Visual Cortex,” Tai Sing Lee, ”Computations in the Early Visual Cortex,” Journal of Physiology-Paris Journal of Physiology-Paris 97 (2003): 12139. 97 (2003): 12139.7. A list of papers can be found at cbcl.mit.edu/people/poggio/tpcv_short_pubs.pdf. A list of papers can be found at cbcl.mit.edu/people/poggio/tpcv_short_pubs.pdf.8. Daniel J. Felleman and David C. Van Essen, ”Distributed Hierarchical Processing in the Primate Cerebral Cortex,” Daniel J. Felleman and David C. Van Essen, ”Distributed Hierarchical Processing in the Primate Cerebral Cortex,” Cerebral Cortex Cerebral Cortex 1, no. 1 (January/February 1991): 147. A compelling a.n.a.lysis of the Bayesian mathematics of the top-down and bottom-up communication in the neocortex is provided by Tai Sing Lee in ”Hierarchical Bayesian Inference in the Visual Cortex,” 1, no. 1 (January/February 1991): 147. A compelling a.n.a.lysis of the Bayesian mathematics of the top-down and bottom-up communication in the neocortex is provided by Tai Sing Lee in ”Hierarchical Bayesian Inference in the Visual Cortex,” Journal of the Optical Society of America Journal of the Optical Society of America 20, no. 7 (July 2003): 143448. 20, no. 7 (July 2003): 143448.9. Uri Ha.s.son et al., ”A Hierarchy of Temporal Receptive Windows in Human Cortex,” Uri Ha.s.son et al., ”A Hierarchy of Temporal Receptive Windows in Human Cortex,” Journal of Neuroscience Journal of Neuroscience 28, no. 10 (March 5, 2008): 253950. 28, no. 10 (March 5, 2008): 253950.10. Marina Bedny et al., ”Language Processing in the Occipital Cortex of Congenitally Blind Adults,” Marina Bedny et al., ”Language Processing in the Occipital Cortex of Congenitally Blind Adults,” Proceedings of the National Academy of Sciences Proceedings of the National Academy of Sciences 108, no. 11 (March 15, 2011): 442934. 108, no. 11 (March 15, 2011): 442934.11. Daniel E. Feldman, ”Synaptic Mechanisms for Plasticity in Neocortex,” Daniel E. Feldman, ”Synaptic Mechanisms for Plasticity in Neocortex,” Annual Review of Neuroscience Annual Review of Neuroscience 32 (2009): 3355. 32 (2009): 3355.12. Aaron C. Koralek et al., ”Corticostriatal Plasticity Is Necessary for Learning Intentional Neuroprosthetic Skills,” Aaron C. Koralek et al., ”Corticostriatal Plasticity Is Necessary for Learning Intentional Neuroprosthetic Skills,” Nature Nature 483 (March 15, 2012): 33135. 483 (March 15, 2012): 33135.13. E-mail communication from Randal Koene, January 2012. E-mail communication from Randal Koene, January 2012.14. Min Fu, Xinzhu Yu, Ju Lu, and Yi Zuo, ”Repet.i.tive Motor Learning Induces Coordinated Formation of Cl.u.s.tered Dendritic Spines Min Fu, Xinzhu Yu, Ju Lu, and Yi Zuo, ”Repet.i.tive Motor Learning Induces Coordinated Formation of Cl.u.s.tered Dendritic Spines in Vivo in Vivo,” Nature Nature 483 (March 1, 2012): 9295. 483 (March 1, 2012): 9295.15. Dario Bonanomi et al., ”Ret Is a Multifunctional Coreceptor That Integrates Diffusible- and Contact-Axon Guidance Signals,” Dario Bonanomi et al., ”Ret Is a Multifunctional Coreceptor That Integrates Diffusible- and Contact-Axon Guidance Signals,” Cell Cell 148, no. 3 (February 2012): 56882. 148, no. 3 (February 2012): 56882.16. See See endnote 7 in chapter 11 endnote 7 in chapter 11.

Chapter 5: The Old Brain1. Vernon B. Mountcastle, ”The View from Within: Pathways to the Study of Perception,” Vernon B. Mountcastle, ”The View from Within: Pathways to the Study of Perception,” Johns Hopkins Medical Journal Johns Hopkins Medical Journal 136 (1975): 10931. 136 (1975): 10931.2. B. Roska and F. Werblin, ”Vertical Interactions Across Ten Parallel, Stacked Representations in the Mammalian Retina,” B. Roska and F. Werblin, ”Vertical Interactions Across Ten Parallel, Stacked Representations in the Mammalian Retina,” Nature Nature 410, no. 6828 (March 29, 2001): 58387; ”Eye Strips Images of All but Bare Essentials Before Sending Visual Information to Brain, UC Berkeley Research Shows,” University of California at Berkeley news release, March 28, 2001, /publications.xhtml. (June 2, 2010): 382124. For other papers see /publications.xhtml.4. See Sandra Blakeslee, ”Humanity? Maybe It's All in the Wiring,” See Sandra Blakeslee, ”Humanity? Maybe It's All in the Wiring,” New York New York Times Times, December 11, 2003, /2003/12/09/science/09BRAI.xhtml.5. T. E. J. Behrens et al., ”Non-Invasive Mapping of Connections between Human Thalamus and Cortex Using Diffusion Imaging,” T. E. J. Behrens et al., ”Non-Invasive Mapping of Connections between Human Thalamus and Cortex Using Diffusion Imaging,” Nature Neuroscience Nature Neuroscience 6, no. 7 (July 2003): 75057. 6, no. 7 (July 2003): 75057.6. Timothy J. Buschman et al., ”Neural Substrates of Cognitive Capacity Limitations,” Timothy J. Buschman et al., ”Neural Substrates of Cognitive Capacity Limitations,” Proceedings of the National Academy of Sciences Proceedings of the National Academy of Sciences 108, no. 27 (July 5, 2011): 1125255, bined linearly (by adding together multiple weighted-basis functions) to approximate any nonlinear function. A. Pouget and L. H. Snyder, ”Computational Approaches to Sensorimotor Transformations,” Basis functions are nonlinear functions that can be combined linearly (by adding together multiple weighted-basis functions) to approximate any nonlinear function. A. Pouget and L. H. Snyder, ”Computational Approaches to Sensorimotor Transformations,” Nature Neuroscience Nature Neuroscience 3, no. 11 Supplement (November 2000): 119298. 3, no. 11 Supplement (November 2000): 119298.9. J. R. Bloedel, ”Functional Heterogeneity with Structural h.o.m.ogeneity: How Does the Cerebellum Operate?” J. R. Bloedel, ”Functional Heterogeneity with Structural h.o.m.ogeneity: How Does the Cerebellum Operate?” Behavioral and Brain Sciences Behavioral and Brain Sciences 15, no. 4 (1992): 66678. 15, no. 4 (1992): 66678.10. S. Grossberg and R. W. Paine, ”A Neural Model of Cortico-Cerebellar Interactions during Attentive Imitation and Predictive Learning of Sequential Handwriting Movements,” S. Grossberg and R. W. Paine, ”A Neural Model of Cortico-Cerebellar Interactions during Attentive Imitation and Predictive Learning of Sequential Handwriting Movements,” Neural Networks Neural Networks 13, no. 89 (OctoberNovember 2000): 9991046. 13, no. 89 (OctoberNovember 2000): 9991046.11. Javier F. Medina and Michael D. Mauk, ”Computer Simulation of Cerebellar Information Processing,” Javier F. Medina and Michael D. Mauk, ”Computer Simulation of Cerebellar Information Processing,” Nature Neuroscience Nature Neuroscience 3 (November 2000): 120511. 3 (November 2000): 120511.12. James Olds, ”Pleasure Centers in the Brain,” James Olds, ”Pleasure Centers in the Brain,” Scientific American Scientific American (October 1956): 10516. Aryeh Routtenberg, ”The Reward System of the Brain,” (October 1956): 10516. Aryeh Routtenberg, ”The Reward System of the Brain,” Scientific American Scientific American 239 (November 1978): 15464. K. C. Berridge and M. L. Kringelbach, ”Affective Neuroscience of Pleasure: Reward in Humans and Other Animals,” 239 (November 1978): 15464. K. C. Berridge and M. L. Kringelbach, ”Affective Neuroscience of Pleasure: Reward in Humans and Other Animals,” Psychopharmacology Psychopharmacology 199 (2008): 45780. Morten L. Kringelbach, 199 (2008): 45780. Morten L. Kringelbach, The Pleasure Center: Trust Your Animal Instincts The Pleasure Center: Trust Your Animal Instincts (New York: Oxford University Press, 2009). Michael R. Liebowitz, (New York: Oxford University Press, 2009). Michael R. Liebowitz, The Chemistry of Love The Chemistry of Love (Boston: Little, Brown, 1983). W. L. Witters and P. Jones-Witters, (Boston: Little, Brown, 1983). W. L. Witters and P. Jones-Witters, Human s.e.xuality: A Biological Perspective Human s.e.xuality: A Biological Perspective (New York: Van Nostrand, 1980). (New York: Van Nostrand, 1980).

Chapter 6: Transcendent Abilities1. Michael Nielsen, Michael Nielsen, Reinventing Discovery: The New Era of Networked Science Reinventing Discovery: The New Era of Networked Science (Princeton, NJ: Princeton University Press, 2012), 13. T. Gowers and M. Nielsen, ”Ma.s.sively Collaborative Mathematics,” (Princeton, NJ: Princeton University Press, 2012), 13. T. Gowers and M. Nielsen, ”Ma.s.sively Collaborative Mathematics,” Nature Nature 461, no. 7266 (2009): 87981. ”A Combinatorial Approach to Density Hales-Jewett,” 461, no. 7266 (2009): 87981. ”A Combinatorial Approach to Density Hales-Jewett,” Gowers's Weblog Gowers's Weblog, gowers.wordpress.com/2009/02/01/a-combinatorial-approach-to-density-hales-jewett/. Michael Nielsen, ”The Polymath Project: Scope of Partic.i.p.ation,” March 20, 2009, michaelnielsen.org/blog/?p=584. Julie Rehmeyer, ”SIAM: Ma.s.sively Collaborative Mathematics,” Society for Industrial and Applied Mathematics, April 1, 2010, pbiol.plosjournals.org/perlserv/?request=get-doc.u.ment&doi=10.1371/journal.pcbi.0040004. 4, no. 1 (2008), compbiol.plosjournals.org/perlserv/?request=get-doc.u.ment&doi=10.1371/journal.pcbi.0040004.

Chapter 7: The Biologically Inspired Digital Neocortex1. Gary Cziko, Gary Cziko, Without Miracles: Universal Selection Theory and the Second Darwinian Revolution Without Miracles: Universal Selection Theory and the Second Darwinian Revolution (Cambridge, MA: MIT Press, 1955). (Cambridge, MA: MIT Press, 1955).2. David Dalrymple has been a mentee of mine since he was eight years old in 1999. You can read his background here: esp.mit.edu/learn/teachers/davidad/bio.xhtml, and /news/computer-modelling-brain-in-a-box-1.10066.5. Jonah Lehrer, ”Can a Thinking, Remembering, Decision-Making Biologically Accurate Brain Be Built from a Supercomputer?” Jonah Lehrer, ”Can a Thinking, Remembering, Decision-Making Biologically Accurate Brain Be Built from a Supercomputer?” Seed Seed, seedmagazine.com/content/article/out_of_the_blue/.6. Fildes, ”Artificial Brain '10 Years Away.'” Fildes, ”Artificial Brain '10 Years Away.'”7. See pany public.

These steps (except for the last one) are detailed below:The Problem InputThe problem input to the neural net consists of a series of numbers. This input can be:In a visual pattern recognition system, a two-dimensional array of numbers representing the pixels of an image; or In an auditory (e.g., speech) recognition system, a two-dimensional array of numbers representing a sound, in which the first dimension represents parameters of the sound (e.g., frequency components) and the second dimension represents different points in time; or In an arbitrary pattern recognition system, an n n-dimensional array of numbers representing the input pattern.

Defining the TopologyTo set up the neural net, the architecture of each neuron consists of:Multiple inputs in which each input is ”connected” to either the output of another neuron or one of the input numbers.

Generally, a single output, which is connected to either the input of another neuron (which is usually in a higher layer) or the final output.

Set Up the First Layer of NeuronsCreate N N0 neurons in the first layer. For each of these neurons, ”connect” each of the multiple inputs of the neuron to ”points” (i.e., numbers) in the problem input. These connections can be determined randomly or using an evolutionary algorithm (see below). neurons in the first layer. For each of these neurons, ”connect” each of the multiple inputs of the neuron to ”points” (i.e., numbers) in the problem input. These connections can be determined randomly or using an evolutionary algorithm (see below).

a.s.sign an initial ”synaptic strength” to each connection created. These weights can start out all the same, can be a.s.signed randomly, or can be determined in another way (see below).

Set Up the Additional Layers of NeuronsSet up a total of M M layers of neurons. For each layer, set up the neurons in that layer. layers of neurons. For each layer, set up the neurons in that layer.For layeri:Create N Ni neurons in layer neurons in layeri. For each of these neurons, ”connect” each of the multiple inputs of the neuron to the outputs of the neurons in layeri1 (see variations below). (see variations below).

a.s.sign an initial ”synaptic strength” to each connection created. These weights can start out all the same, can be a.s.signed randomly, or can be determined in another way (see below).

The outputs of the neurons in layerM are the outputs of the neural net (see variations below). are the outputs of the neural net (see variations below).

The Recognition TrialsHow Each Neuron WorksOnce the neuron is set up, it does the following for each recognition trial: Each weighted input to the neuron is computed by multiplying the output of the other neuron (or initial input) that the input to this neuron is connected to by the synaptic strength of that connection.

All of these weighted inputs to the neuron are summed.

If this sum is greater than the firing threshold of this neuron, then this neuron is considered to fire and its output is 1. Otherwise, its output is 0 (see variations below).

Do the Following for Each Recognition TrialFor each layer, from layer0 to layer to layerM:For each neuron in the layer:Sum its weighted inputs (each weighted input = the output of the other neuron [or initial input] that the input to this neuron is connected to, multiplied by the synaptic strength of that connection).

If this sum of weighted inputs is greater than the firing threshold for this neuron, set the output of this neuron = 1, otherwise set it to 0.

To Train the Neural NetRun repeated recognition trials on sample problems.

After each trial, adjust the synaptic strengths of all the interneuronal connections to improve the performance of the neural net on this trial (see the discussion below on how to do this).

Continue this training until the accuracy rate of the neural net is no longer improving (i.e., reaches an asymptote).

Key Design DecisionsIn the simple schema above, the designer of this neural net algorithm needs to determine at the outset:What the input numbers represent.

The number of layers of neurons.

The number of neurons in each layer. (Each layer does not necessarily need to have the same number of neurons.) The number of inputs to each neuron in each layer. The number of inputs (i.e., interneuronal connections) can also vary from neuron to neuron and from layer to layer.

The actual ”wiring” (i.e., the connections). For each neuron in each layer, this consists of a list of other neurons, the outputs of which const.i.tute the inputs to this neuron. This represents a key design area. There are a number of possible ways to do this: (1) Wire the neural net randomly; or (2) Use an evolutionary algorithm (see below) to determine an optimal wiring; or (3) Use the system designer's best judgment in determining the wiring.

The initial synaptic strengths (i.e., weights) of each connection. There are a number of possible ways to do this: (1) Set the synaptic strengths to the same value; or (2) Set the synaptic strengths to different random values; or (3) Use an evolutionary algorithm to determine an optimal set of initial values; or (4) Use the system designer's best judgment in determining the initial values.

The firing threshold of each neuron.

Determine the output. The output can be: (1) the outputs of layerM of neurons; or of neurons; or (2) the output of a single output neuron, the inputs of which are the outputs of the neurons in layerM; or (3) a function of (e.g., a sum of) the outputs of the neurons in layerM; or (4) another function of neuron outputs in multiple layers.