Connectionist Knowledge Representation and
Intelligent systems based on symbolic knowledge processing on the one hand, and on artificial neural networks (also called connectionist systems) on the other, differ substantially. They are both standard approaches to artificial intelligence and it would be very desirable to combine the robust neural networking machinery with symbolic knowledge representation and reasoning paradigms like logic programming in such a way that the strengths of either paradigm will be retained. While significant progress has recently been made on knowledge representation and reasoning using neural networks on the one side and direct processing of symbolic and structured data with neural methods on the other side, the integration of neural computation and expressive logics such as first order logic is still in its early stages of development. In this tutorial, we will present past achievements and present state of the art in neural-symbolic integration. We believe in the potential of neural-symbolic integration for machine learning applications and for furthering fundamental insights into the working of the human mind. The course thus shall display the importance of neural-symbolic integration as a research area and stimulate discussions and a strengthening of the field.
The tutorial is aimed at researchers and PhD students interested in getting to know the recently evolving field of neural-symbolic integration research. It is designed to suit both the practitioner interested in a new machine learning paradigm and its application to areas such as bioinformatics, as well as the scientist interested in understanding the knowledge processing abilities of the human mind from a formal perspective.
We will present past and present achievements in neural-symbolic integration. Starting from successful achievements for propositional logic and integration of symbolic information into recursive neural systems as well as principled limitations and problems, we will work towards discussing state-of-the-art research on the integration of first-order logic programming and connectionism, based on recent research publications by the lecturers. We believe in the potential of neural-symbolic integration for machine learning applications and for furthering fundamental insights into the working of the human mind. The course thus shall display the importance of neural-symbolic integration as a research area and stimulate discussions and a strengthening of the field.
Introduction (ppt, 614 KB)
Part 1 (ppt, 1.311 KB)
Part 2 (zipped ps, 3.501 KB)
|Prof. Dr. Barbara Hammer has accepted a call for a professorship for Theoretical Computer Science at Clausthal University of Technology in late 2005. Beforehand, she has been the leader of a young researchers group with research topic 'Learning with Neural Methods on Structured Data' at the University of Osnabrück which has been funded by the MWK Niedersachsen. Her research interests focus on possibilities to directly process and represent structures by means of connectionist methods, the development and exact mathematical investigation of involved models, as well as applications ranging from bioinformatics up to industrial cooperations. Her research record includes more than 70 publications (including two books) covering diverse topics regarding mathematics of neural networks, processing of structured data, structural bias of learning, compositionality, learning metrics, self-organization etc. She is a member of the editorial board of Neurocomputing, a member of the program committee of the ESANN conference, and she has organized several special sessions and a special issue connected to the topic of the tutorial jointly with colleagues. Besides, she serves as reviewer for various international journals and conferences. Since 1999, she has tought courses connected to Neural Networks, Machine Learning, Softcomputing, and other topics of Computer Science at the Universities of Osnabrueck and Clausthal.||Dr. Pascal Hitzler is project leader and researcher at the Institute for Applied Informatics and Formal Description Methods (AIFB) at the University of Karlsruhe in Germany. His research record lists over 50 publications in such diverse areas as neural-symbolic integration, knowledge representation and reasoning, semantic web, lattice and domain theory, denotational semantics, and set-theoretic topology. He is co-organizer of the IJCAI-05 workshop on Neural-symbolic Learning and Reasoning (NeSy'05). At ESSLLI'2005, he will give a tutorial on Integrating logic programs and connectionist systems. He has taught seminars and lectures in the field of the tutorial at TU Dresden since 2002. He serves as a reviewer for international journals, conferences, and research project applications. He has also been an organizer of international enhancement programmes for highly skilled students in Mathematics and Computer Science, and has served as an editor for several books in this area.|