Department of Cognitive Science
Lars Marstaller (email@example.com)Macquarie Centre for Cognitive Science, Macquarie University, Sydney
Arend Hintze (firstname.lastname@example.org)Keck Graduate Institute for Applied Life Sciences, Claremont, CA
Christoph Adami (email@example.com)Keck Graduate Institute for Applied Life Sciences, Claremont, CA
AbstractWe present a measure of representation in neural networks that we call ‘R’, which is based on information theory. We show how R relates to an analysis of distributed representation, viz. a principal components analysis of activation space. Finally, we argue that R is well suited to measure representation in neural networks.
Citation details for this article:Marstaller, L., Hintze, A., Adami, C. (2010). Measuring representation. In W. Christensen, E. Schier, and J. Sutton (Eds.), ASCS09: Proceedings of the 9th Conference of the Australasian Society for Cognitive Science (pp. 232-237). Sydney: Macquarie Centre for Cognitive Science.
Download the PDF here
- Adami, C. & Cerf, N. J. (2000) Physical complexity of symbolic sequences. Physica D, 120.
- Brooks, R. A. (1991). Intelligence without representation. Artificial Intelligence, 47, 139–159.
- Churchland, P. & Sejnowski, T. J. (1992). The computational brain. Cambridge, MA: MIT Press.
- Clark, A. (1993) Associative engines. Connectionism, concepts, and representational change. Cambridge, MA: MIT Press.
- Clark, A. (1997). Being there: putting brain, body, and world together again. Cambridge, MA: MIT Press.
- Elman, J. L. (1991). Distributed representations, simple recurrent networks, and grammatical structure. Machine Learning, 7, 195-225.
- O’Brien, G. & Opie, J. (2009). The role of representation in computation. Cognitive Processing, 10, 53-62.
- Pylyshyn, Z. (1984). Computation and cognition: toward a foundation for cognitive science. Cambridge, MA: MIT Press.
- Shannon, C. E. (1948) A mathematical theory of communication. Bell System Technical Journal, 27, 379–423 & 623–656.
- Smolensky, P. (1987). Connectionist AI, symbolic AI, and the brain. Artificial Intelligence Review, 1, 95-109.
- Thornton, C. (2009) Representation recovers information. Cognitive Science 33(8), 1-30.
- Wednesday 19th Oct,
Dr Lyn Tieu,
"Preschoolers' knowledge of plural meanings."
- Friday 28th Oct,
Research Assistant Professor Tal Yarkoni,
"What can large-scale meta-analytic modelling of fMRI data tell us ..."
- Monday 31st Oct,
Professor Kyo Kageura,
"Scaffolding communications and interactions in translator training: ..."
- Tuesday 8th Nov,
"Respect. Now. Always. Project."
- Dr Mariia Kaliuzhna
- Dr Devin Terhune
- Professor Karin Landerl
- Dr Ashleigh Smith
- Adam Lalak
- Professor Oron Shagrir
- Xiaohe Yuan [Previous Visitors]