Skip to main content Accessibility help

We use cookies to distinguish you from other users and to provide you with a better experience on our websites. Close this message to accept cookies or find out how to manage your cookie settings.

Close cookie message
×
Hostname: page-component-84b7d79bbc-l82ql Total loading time: 0 Render date: 2024-07-29T08:19:22.770Z Has data issue: false hasContentIssue false

23 - Neuromorphic electronics

from Section VI - Bio-inspired systems

Published online by Cambridge University Press:  02 December 2010

Rahul Sarpeshkar
Rahul Sarpeshkar
Affiliation:
Massachusetts Institute of Technology
Get access

Summary

It is the unification and simplification of knowledge that gives us hope for the future of our culture. To the extent that we encourage future generations to understand deeply, to see previously unseen connections, and to follow their conviction that such endeavors are noble undertakings of the human spirit, we will have contributed to a brighter future.

Carver Mead

Biological systems are the most energy-efficient systems in the world. For example, the ~ 22 billion neuronal cells of the brain dominate the ~14.6 W brain power consumption of an average 65 kg male. These numbers imply a power consumption of ~ 0.66 nW per neuron. The hybrid analog-digital brain performs at least 6 ×1016 FLOPS (floating-point operations per second) such that its energy efficiency is a staggeringly low 0.24 fJ/FLOP. This energy efficiency is about 5–6 orders of magnitude more efficient than that of even the most energy-efficient digital microprocessor or digital signal processor ever built. The human eye's retina consumes nearly ~ 3.4 mW, making the 135 million photoreceptor array in the eye the lowest power wide-dynamic-range imager and image compressor ever built. The retina in the eye performs sophisticated analog gain control, analog spatial filtering, and analog temporal filtering such that nearly ~ 36 Gb/s of wide-dynamic-range raw image data from its photoreceptor array is compressed to ~ 20 Mb/s of useful optic-nerve spiking output information.

Type
Chapter
Information
Ultra Low Power Bioelectronics
Fundamentals, Biomedical Applications, and Bio-Inspired Systems
 , pp. 697 - 752
Publisher: Cambridge University Press
Print publication year: 2010

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

Koch, Christof. Biophysics of Computation: Information Processing in Single Neurons (New York: Oxford University Press, 1999).Google Scholar
Aiello, L. C.. Brains and guts in human evolution: The expensive tissue hypothesis. Brazilian Journal of Genetics, 20 (1997).CrossRefGoogle Scholar
Allman, John Morgan. Evolving Brains (New York: Scientifc American Library: Distributed by W.H. Freeman and Co., 1999).Google Scholar
Mead, C. A.. Neuromorphic electronic systems. Proceedings of the IEEE, 78 (1990), 1629–1636.CrossRefGoogle Scholar
Mead, Carver. Analog VLSI and Neural Systems (Reading, Mass.: Addison-Wesley, 1989).Google Scholar
Solga, A., Cerman, Z., Striffler, B. F., Spaeth, M. and Barthlott, W.. The dream of staying clean: Lotus and biomimetic surfaces. Bioinspiration and Biomimetics, 2 (2007), 126.CrossRefGoogle ScholarPubMed
Hassenstein, B. and Reichardt, W.. Systemtheoretische analyse der zeit-, reihenfolgen-und vorzeichenauswertung bei der bewegungsperzeption des rüsselkäfers chlorophanus. Zeitschrift für Naturforschung, 11 (1956), 513–524.Google Scholar
Dickinson, M. H., Lehmann, F. O. and Sane, S. P.. Wing rotation and the aerodynamic basis of insect flight. Science, 284 (1999), 1954–1960.CrossRefGoogle ScholarPubMed
Robinson, D. A., Gordon, J. L. and Gordon, S. E.. A model of the smooth pursuit eye movement system. Biological Cybernetics, 55 (1986), 43–57.CrossRefGoogle ScholarPubMed
Kandel, Eric R., Schwartz, James H. and Jessell, Thomas M.. Principles of Neural Science. 3rd ed. (Norwalk, Conn.: Appleton & Lange, 1991).Google Scholar
Sarpeshkar, R. and O'Halloran, M.. Scalable hybrid computation with spikes. Neural Computation, 14 (2002), 2003–2038.CrossRefGoogle ScholarPubMed
Mandal, S., Zhak, S. M. and Sarpeshkar, R.. A bio-inspired active radio-frequency silicon cochlea. IEEE Journal of Solid-State Circuits, 44 (2009), 1814–1828.CrossRefGoogle Scholar
Sarpeshkar, R.. Brain power: Borrowing from biology makes for low power computing. IEEE Spectrum, 43 (2006), 24–29.CrossRefGoogle Scholar
Sarpeshkar, R., Salthouse, C. D., Sit, J. J., Baker, M. W., Zhak, S. M., Lu, T. K. T., Turicchia, L. and Balster, S.. An ultra-low-power programmable analog bionic ear processor. IEEE Transactions on Biomedical Engineering, 52 (2005), 711–727.CrossRefGoogle ScholarPubMed
Mitola, J. and Jr, G. Q. Maguire. Cognitive radio: making software radios more personal. IEEE Personal Communications, 6 (1999), 13–18.CrossRefGoogle Scholar
Bhattacharya, A. and Zeng, F. G.. Companding to improve cochlear-implant speech recognition in speech-shaped noise. The Journal of the Acoustical Society of America, 122 (2007), 1079.CrossRefGoogle ScholarPubMed
Guinness, J., Raj, B., Schmidt-Nielsen, B., Turicchia, L. and Sarpeshkar, R.. A companding front end for noise-robust automatic speech recognition. Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), Philadelphia, Penn., 2005.Google Scholar
Wee, K. H., Turicchia, L. and Sarpeshkar, R.. An Analog Integrated-Circuit Vocal Tract. IEEE Transactions on Biomedical Circuits and Systems, 2 (2008), 316–327.CrossRefGoogle Scholar
Bohorquez, J., Sanchez, W., Turicchia, L. and Sarpeshkar, R., An integrated-circuit switched-capacitor model and implementation of the heart. Proceedings of the First International Symposium on Applied Sciences on Biomedical and Communication Technologies (ISABEL), Aalborg, Denmark, 1–5, 2008.Google Scholar
Chua, Leon O. and Roska, T.. Cellular Neural Networks and Visual Computing: Foundation and Applications (Cambridge, UK; New York, NY: Cambridge University Press, 2002).CrossRefGoogle Scholar
,International Technology Roadmap for Semiconductors Emerging Research Devices Report, 2007.
Lee, Thomas H.. The Design of CMOS Radio-Frequency Integrated Circuits, 2nd ed. (Cambridge, UK; New York: Cambridge University Press, 2004).Google Scholar
Lu, T. K., Zhak, S., Dallos, P. and Sarpeshkar, R.. Fast cochlear amplification with slow outer hair cells. Hearing Research, 214 (2006), 45–67.CrossRefGoogle ScholarPubMed
Pickles, James O.. An Introduction to the Physiology of Hearing. 2nd ed. (London; New York: Academic Press, 1988).Google Scholar
Mandal, S., Zhak, S. and Sarpeshkar, R., inventors. Architectures for Universal or Software Radio, U.S. Provisional Patent 60/870,719, filed December 19, 2006; Utility Patent 11/958,990, filed December 18, 2007.
Zweig, G.. Finding the impedance of the organ of Corti. The Journal of the Acoustical Society of America, 89 (1991), 1229.CrossRefGoogle ScholarPubMed
Shera, C. A.. Mammalian spontaneous otoacoustic emissions are amplitude-stabilized cochlear standing waves. The Journal of the Acoustical Society of America, 114 (2003), 244.CrossRefGoogle ScholarPubMed
Schiff, Leonard I.. Quantum Mechanics. 3rd ed. (New York,: McGraw-Hill, 1968).Google Scholar
Watts, L.. Cochlear mechanics: Analysis and analog VLSI. Ph.D. Thesis, Electrical Engineering, California Institute of Technology (1992).Google Scholar
Lyon, R. F. and Mead, C. A.. An analog electronic cochlea. IEEE Transactions on Acoustics, Speech and Signal Processing, 36 (1988), 1119–1134.CrossRefGoogle Scholar
Sarpeshkar, R., Lyon, R. F. and Mead, C. A.. A low-power wide-dynamic-range analog VLSI cochlea. Analog Integrated Circuits and Signal Processing, 16 (1998), 245–274.CrossRefGoogle Scholar
Turicchia, L. and Sarpeshkar, R.. A bio-inspired companding strategy for spectral enhancement. IEEE Transactions on Speech and Audio Processing, 13 (2005), 243–253.CrossRefGoogle Scholar
Siebert, William McC. Circuits, Signals, and Systems (Cambridge, Mass.; New York: MIT Press; McGraw-Hill, 1986).Google Scholar
Williams, E. M.. Radio-Frequency Spectrum Analyzers. Proceedings of the IRE, 34 (1946), 18p–22p.CrossRefGoogle Scholar
Mandal, S., Zhak, S. and Sarpeshkar, R., inventors. Architectures for Universal or Software Radio.
Liu, W., Andreou, A. G. and Goldstein, M. H.. Voiced-speech representation by an analog silicon model of the auditory periphery. IEEE Transactions on Neural Networks, 3 (1992), 477–487.CrossRefGoogle ScholarPubMed
Hamilton, T. J., Jin, C., Schaik, A. and Tapson, J., A 2-D silicon cochlea with an improved automatic quality factor control-loop. Proceedings of the IEEE International Symposium on Circuits and Systems (ISCAS), Seattle, Wash., 1772–1775, 2008.Google Scholar
Zhak, S. M.. Modeling and design of an active silicon cochlea. Ph.D. Thesis, Electrical Engineering, Massachusetts Institute of Technology (2008).Google Scholar
Oxenham, A. J., Simonson, A. M., Turicchia, L. and Sarpeshkar, R.. Evaluation of companding-based spectral enhancement using simulated cochlear-implant processing. The Journal of the Acoustical Society of America, 121 (2007), 1709–1716.CrossRefGoogle ScholarPubMed
Raj, B., Turicchia, L., Schmidt-Nielsen, B. and Sarpeshkar, R.. An FFT-based companding front end for noise-robust automatic speech recognition. EURASIP Journal on Audio, Speech, and Music Processing, Article ID 65420 (2007), 13.
Bellman, R.. Dynamic programming. Science, 153 (1966), 34–37.CrossRefGoogle ScholarPubMed
Kenneth, N.Stevens. Acoustic Phonetics (Cambridge, MA: MIT Press, 2000).Google Scholar
Wee, K. H. and Sarpeshkar, R.. An electronically tunable linear or nonlinear MOS resistor. IEEE Transactions on Circuits and Systems I: Regular Papers, 55 (2008), 2573–2583.Google Scholar
Mahowald, M. A. and Mead, C. A.. Silicon Retina. In Addison-Wesley VLSI Systems Series, ed. Mead, C A. (Reading, Mass.: Addison-Wesley; 1989), pp. 257–278.Google Scholar
Boahen, K. A. and Andreou, A. G., A contrast sensitive silicon retina with reciprocal synapses. Proceedings of the IEEE Neural Information Processing Systems (NIPS), Denver, Colorado, 764–772, 1992.Google Scholar
Delbruck, T.. Silicon retina with correlation-based, velocity-tuned pixels. IEEE Transactions on Neural Networks, 4 (1993), 529–541.CrossRefGoogle ScholarPubMed
Yagi, T., Funahashi, Y. and Ariki, F., Dynamic model of dual layer neural network for vertebrate retina. Proceedings of the International Joint Conference on Neural Networks (IJCNN), Washington, DC, 787–789, 1989.CrossRefGoogle Scholar
Harrison, R. R. and Koch, C.. A silicon implementation of the fly's optomotor control system. Neural Computation, 12 (2000), 2291–2304.CrossRefGoogle ScholarPubMed
Sarpeshkar, R., Kramer, J. È., Indiveri, G. and Koch, C.. Analog VLSI architectures for motion processing: From fundamental limits to system applications. Proceedings of the IEEE, 84 (1996), 969–987.CrossRefGoogle Scholar
Indiveri, G.. Neuromorphic analog VLSI sensor for visual tracking: circuits and application examples. IEEE Transactions on Circuits and Systems II: Analog and Digital Signal Processing, 46 (1999), 1337–1347.CrossRefGoogle Scholar
Eliasmith, Chris and Anderson, C. H.. Neural Engineering: Computation, Representation, and Dynamics in Neurobiological Systems (Cambridge, Mass.: MIT Press, 2003).Google Scholar
Herz, J., Krogh, A. and Palmer, R. G.. Introduction to the Theory of Neural Computation (Reading, Mass.: Addison Wesley, 1991).Google Scholar
Sarpeshkar, R.. Analog versus digital: extrapolating from electronics to neurobiology. Neural Computation, 10 (1998), 1601–1638.CrossRefGoogle ScholarPubMed
Hahnloser, R. H. R., Sarpeshkar, R., Mahowald, M. A., Douglas, R. J. and Seung, H. S.. Digital selection and analogue amplification coexist in a cortex-inspired silicon circuit. Nature, 405 (2000), 947–951.CrossRefGoogle Scholar
Attwell, D. and Laughlin, S. B.. An energy budget for signaling in the grey matter of the brain. Journal of Cerebral Blood Flow and Metabolism, 21 (2001), 1133–1145.CrossRefGoogle Scholar
MacNeilage, P. F., Rogers, L. J. and Vallortigara, G.. Origins of the left & right brain. Scientific American, 301 (2009), 60–67.CrossRefGoogle ScholarPubMed
Liu, S-C., Kramer, J. È., Indiveri, G., Delbruck, T., Burg, T. and Douglas, R.. Orientation-selective a VLSI spiking neurons. Neural Networks, 14 (2001), 629–643.CrossRefGoogle ScholarPubMed
Boahen, K. A.. Point-to-point connectivity between neuromorphic chips using address events. IEEE Transactions on Circuits and Systems II: Analog and Digital Signal Processing, 47 (2000), 416–434.CrossRefGoogle Scholar
Horiuchi, T. K.. “Seeing” in the dark: Neuromorphic VLSI modeling of bat echolocation. IEEE Signal Processing Magazine, 22 (2005), 134–139.CrossRefGoogle Scholar
Lewis, M. A., Etienne-Cummings, R., Cohen, A. H. and Hartmann, M.. Toward biomorphic control using custom aVLSI CPG chips. Proceedings of the International Conference on Robotics and Automation (ICRA), 494–500, 2000.Google Scholar
Diorio, C., Hasler, P., Minch, A. and Mead, C. A.. A single-transistor silicon synapse. IEEE Transactions on Electron Devices, 43 (1996), 1972–1980.CrossRefGoogle Scholar
Cauwenberghs, Gert and Bayoumi, Magdy A.. Learning on Silicon: Adaptive VLSI Neural Systems (Boston: Kluwer Academic, 1999).Google Scholar
Berg, Y., Sigvartsen, R. L., Lande, T. S. and Abusland, A.. An analog feed-forward neural network with on-chip learning. Analog Integrated Circuits and Signal Processing, 9 (1996), 65–75.CrossRefGoogle Scholar
Rapoport, B. I., Wattanapanitch, W., Penagos, J. L., Musallam, S., Andersen, R. and Sarpeshkar, R., A biomimetic adaptive algorithm and low-power architecture for implantable neural decoders. Proceedings of the 31st Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), Minneapolis, MN, 2009.Google Scholar
Aizenberg, J.. Crystallization in Patterns: A Bio-Inspired Approach. Advanced Materials, 16 (2004), 1295–1302.CrossRefGoogle Scholar
Izhikevich, E. M.. Which model to use for cortical spiking neurons?IEEE Transactions on Neural Networks, 15 (2004), 1063–1070.CrossRefGoogle ScholarPubMed
Okawa, H., Sampath, A. P., Laughlin, S. B. and Fain, G. L.. ATP consumption by mammalian rod photoreceptors in darkness and in light. Current Biology, 18 (2008), 1917–1921.CrossRefGoogle ScholarPubMed
Koch, K., McLean, J., Berry, M., Sterling, P., Balasubramanian, V. and Freed, M. A.. Efficiency of information transmission by retinal ganglion cells. Current Biology, 14 (2004), 1523–1530.CrossRefGoogle ScholarPubMed
Johnstone, B. M.. Genesis of the cochlear endolymphatic potential. Current Topics in Bioenergetics, 2 (1967), 335–352.CrossRefGoogle Scholar

Save book to Kindle

To save this book to your Kindle, first ensure coreplatform@cambridge.org is added to your Approved Personal Document E-mail List under your Personal Document Settings on the Manage Your Content and Devices page of your Amazon account. Then enter the ‘name’ part of your Kindle email address below. Find out more about saving to your Kindle.

Note you can select to save to either the @free.kindle.com or @kindle.com variations. ‘@free.kindle.com’ emails are free but can only be saved to your device when it is connected to wi-fi. ‘@kindle.com’ emails can be delivered even when you are not connected to wi-fi, but note that service fees apply.

Find out more about the Kindle Personal Document Service.

  • Neuromorphic electronics
  • Rahul Sarpeshkar, Massachusetts Institute of Technology
  • Book: Ultra Low Power Bioelectronics
  • Online publication: 02 December 2010
  • Chapter DOI: https://doi.org/10.1017/CBO9780511841446.023
Available formats
×

Save book to Dropbox

To save content items to your account, please confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your account. Find out more about saving content to Dropbox.

  • Neuromorphic electronics
  • Rahul Sarpeshkar, Massachusetts Institute of Technology
  • Book: Ultra Low Power Bioelectronics
  • Online publication: 02 December 2010
  • Chapter DOI: https://doi.org/10.1017/CBO9780511841446.023
Available formats
×

Save book to Google Drive

To save content items to your account, please confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your account. Find out more about saving content to Google Drive.

  • Neuromorphic electronics
  • Rahul Sarpeshkar, Massachusetts Institute of Technology
  • Book: Ultra Low Power Bioelectronics
  • Online publication: 02 December 2010
  • Chapter DOI: https://doi.org/10.1017/CBO9780511841446.023
Available formats
×