Department of Cognitive Science
Lars Marstaller (firstname.lastname@example.org)Macquarie Centre for Cognitive Science, Macquarie University, Sydney
Arend Hintze (email@example.com)Keck Graduate Institute for Applied Life Sciences, Claremont, CA
Christoph Adami (firstname.lastname@example.org)Keck Graduate Institute for Applied Life Sciences, Claremont, CA
AbstractWe present a measure of representation in neural networks that we call ‘R’, which is based on information theory. We show how R relates to an analysis of distributed representation, viz. a principal components analysis of activation space. Finally, we argue that R is well suited to measure representation in neural networks.
Citation details for this article:Marstaller, L., Hintze, A., Adami, C. (2010). Measuring representation. In W. Christensen, E. Schier, and J. Sutton (Eds.), ASCS09: Proceedings of the 9th Conference of the Australasian Society for Cognitive Science (pp. 232-237). Sydney: Macquarie Centre for Cognitive Science.
Download the PDF here
- Adami, C. & Cerf, N. J. (2000) Physical complexity of symbolic sequences. Physica D, 120.
- Brooks, R. A. (1991). Intelligence without representation. Artificial Intelligence, 47, 139–159.
- Churchland, P. & Sejnowski, T. J. (1992). The computational brain. Cambridge, MA: MIT Press.
- Clark, A. (1993) Associative engines. Connectionism, concepts, and representational change. Cambridge, MA: MIT Press.
- Clark, A. (1997). Being there: putting brain, body, and world together again. Cambridge, MA: MIT Press.
- Elman, J. L. (1991). Distributed representations, simple recurrent networks, and grammatical structure. Machine Learning, 7, 195-225.
- O’Brien, G. & Opie, J. (2009). The role of representation in computation. Cognitive Processing, 10, 53-62.
- Pylyshyn, Z. (1984). Computation and cognition: toward a foundation for cognitive science. Cambridge, MA: MIT Press.
- Shannon, C. E. (1948) A mathematical theory of communication. Bell System Technical Journal, 27, 379–423 & 623–656.
- Smolensky, P. (1987). Connectionist AI, symbolic AI, and the brain. Artificial Intelligence Review, 1, 95-109.
- Thornton, C. (2009) Representation recovers information. Cognitive Science 33(8), 1-30.
- Friday 24th Jul,
Dr. Marta Garridos,
"Dynamic Causal Modeling for Evoked Responses"
- Friday 31st Jul,
Professor Roy Kessels,
"Working memory deficits and compensatory mechanisms in ageing and Mild ..."
- Friday 14th Aug,
Dr Patricia Morgan and Dr George Khut,
"Translating the ineffable: Philosophical and Arts-based Approaches"
- Professor Naomi (Wenkai) Chen
- Chloe Garret
- Professor Carl Craver
- Professor Ken Forster
- Dr Devin Kearns
- Dr Oren Civier
- Robert Keys
- Professor Naama Friedmann [Previous Visitors]