Neurosymbolic Artificial Intelligence - Volume Pre-press, issue Pre-press

Authors: Sun, Ron

Article Type: Research Article

Abstract: This position paper discusses relationships among hybrid neural-symbolic models, dual-process theories, and cognitive architectures. It provides some historical backgrounds and argues that dual-process (implicit versus explicit) theories have significant implications for developing neural-symbolic (neurosymbolic) models. Furthermore, computational cognitive architectures can help to disentangle issues concerning dual-process theories and thus help the development of neural-symbolic models (in this way as well as in other ways).

Keywords: Neural-symbolic, neurosymbolic, dual process, cognitive architecture, Clarion, implicit, explicit, psychology

DOI: 10.3233/NAI-240720

Citation: Neurosymbolic Artificial Intelligence, vol. Pre-press, no. Pre-press, pp. 1-9, 2024

Authors: Khan, M. Jaleed | Ilievski, Filip | Breslin, John G. | Curry, Edward

Article Type: Research Article

Abstract: Combining deep learning and common sense knowledge via neurosymbolic integration is essential for semantically rich scene representation and intuitive visual reasoning. This survey paper delves into data- and knowledge-driven scene representation and visual reasoning approaches based on deep learning, common sense knowledge and neurosymbolic integration. It explores how scene graph generation, a process that detects and analyses objects, visual relationships and attributes in scenes, serves as a symbolic scene representation. This representation forms the basis for higher-level visual reasoning tasks such as visual question answering, image captioning, image retrieval, image generation, and multimodal event processing. Infusing common sense knowledge, particularly …through the use of heterogeneous knowledge graphs, improves the accuracy, expressiveness and reasoning ability of the representation and allows for intuitive downstream reasoning. Neurosymbolic integration in these approaches ranges from loose to tight coupling of neural and symbolic components. The paper reviews and categorises the state-of-the-art knowledge-based neurosymbolic approaches for scene representation based on the types of deep learning architecture, common sense knowledge source and neurosymbolic integration used. The paper also discusses the visual reasoning tasks, datasets, evaluation metrics, key challenges and future directions, providing a comprehensive review of this research area and motivating further research into knowledge-enhanced and data-driven neurosymbolic scene representation and visual reasoning. Show more

Keywords: Scene graph, image representation, deep learning, common sense knowledge, neurosymbolic integration, visual reasoning

DOI: 10.3233/NAI-240719

Citation: Neurosymbolic Artificial Intelligence, vol. Pre-press, no. Pre-press, pp. 1-24, 2024

Authors: Hitzler, Pascal | Rayan, Rushrukh | Zalewski, Joseph | Saki Norouzi, Sanaz | Eberhart, Aaron | Vasserman, Eugene Y.

Article Type: Research Article

Abstract: Deep Deductive Reasoning refers to the training and then executing of deep learning systems to perform deductive reasoning in the sense of formal, mathematical logic. We discuss why this is an interesting and relevant problem to study, and explore how hard it is as a deep learning problem. In particular, we present some of the progress made on this topic in recent years, understand some of the theoretical limitations that can be assessed from existing literature, and discuss negative results we have obtained regarding improving on the state of the art.

Keywords: Deductive reasoning, deep learning, theoretical limitations of deep learning, memory networks, transformers

DOI: 10.3233/NAI-240669

Citation: Neurosymbolic Artificial Intelligence, vol. Pre-press, no. Pre-press, pp. 1-13, 2024

Authors: Šír, Gustav

Article Type: Research Article

Abstract: Neural-Symbolic Integration (NSI) aims to marry the principles of symbolic AI techniques, such as logical reasoning, with the learning capabilities of neural networks. In recent years, many systems have been proposed to address this integration in a seemingly efficient manner. However, from the computational perspective, this is in principle impossible to do. Specifically, some of the core symbolic problems are provably hard, hence a general NSI system necessarily needs to adopt this computational complexity, too. Many NSI methods try to circumvent this downside by inconspicuously dropping parts of the symbolic capabilities while mapping the problems into static tensor representations in …exchange for efficient deep learning acceleration. In this paper, we argue that the aim for a general NSI system, properly covering both the neural and symbolic paradigms, has important computational implications on the learning representations, the structure of the resulting computation graphs, and the underlying hardware and software stacks. Particularly, we explain how the currently prominent, tensor-based deep learning with static computation graphs is conceptually insufficient as a foundation for such general NSI, which we discuss in a wider context of established (statistical) relational and structured deep learning methods. Finally, we delve into the underlying hardware acceleration aspects and outline some promising computational directions toward fully expressive and efficient NSI. Show more

Keywords: Neural-symbolic integration, computation graphs, learning representations, relational learning, hardware acceleration, logical reasoning, dynamic deep learning, computational complexity

DOI: 10.3233/NAI-240672

Citation: Neurosymbolic Artificial Intelligence, vol. Pre-press, no. Pre-press, pp. 1-12, 2024

Authors: Fanizzi, Nicola | d’Amato, Claudia

Article Type: Research Article

Abstract: The paper surveys ongoing research on hyperdimensional computing and vector symbolic architectures which represent an alternative approach to neural computing with various advantages and interesting specific properties: transparency, error tolerance, sustainability. In particular, it can be demonstrated that hyperdimensional patterns are well-suited for the encoding of complex knowledge structures. Consequently, the related architectures offer perspectives for the development of innovative neurosymbolic models with a closer correspondence to cognitive processes in human brains. We revisit the fundamentals of hyperdimensional representations and examine some recent applications of related methods for analogical reasoning and learning tasks, with a particular focus on knowledge graphs. …We then propose potential extensions and delineate prospective avenues for future investigations. Show more

Keywords: Hyperdimensional computing, vector symbolic architectures, analogical reasoning, similarity-based classification, logic axioms, knowledge graphs, embedding models

DOI: 10.3233/NAI-240675

Citation: Neurosymbolic Artificial Intelligence, vol. Pre-press, no. Pre-press, pp. 1-15, 2024

Authors: Alam, Mehwish | van Harmelen, Frank | Acosta, Maribel

Article Type: Research Article

Abstract: Embedding based Knowledge Graph (KG) completion has gained much attention over the past few years. Most of the current algorithms consider a KG as a multidirectional labeled graph and lack the ability to capture the semantics underlying the schematic information. This position paper revises the state of the art and discusses several variations of the existing algorithms for KG completion, which are discussed progressively based on the level of expressivity of the semantics utilized. The paper begins with analysing various KG completion algorithms considering only factual information such as transductive and inductive link prediction and entity type prediction algorithms. It …then revises the algorithms utilizing Large Language Models as background knowledge. Afterwards, it discusses the algorithms progressively utilizing semantic information such as class hierarchy information within the KGs and semantics represented in different description logic axioms. The paper concludes with a critical reflection on the current state of work in the community, where we argue that the aspects of semantics, rigorous evaluation protocols, and bias against external sources have not been sufficiently addressed in the literature, which hampers a more thorough understanding of advantages and limitations of existing approaches. Lastly, we provide recommendations for future directions. Show more

Keywords: Knowledge graph embeddings, semantics in knowledge graph embeddings, large language models

DOI: 10.3233/NAI-240731

Citation: Neurosymbolic Artificial Intelligence, vol. Pre-press, no. Pre-press, pp. 1-17, 2024

Authors: Confalonieri, Roberto | Guizzardi, Giancarlo

Article Type: Research Article

Abstract: There has been a renewed interest in symbolic AI in recent years. Symbolic AI is indeed one of the key enabling technologies for the development of neuro-symbolic AI systems, as it can mitigate the limited capabilities of black box deep learning models to perform reasoning and provide support for explanations. This paper discusses the different roles that explicit knowledge, in particular ontologies, can play in drawing intelligible explanations in neuro-symbolic AI. We consider three main perspectives in which ontologies can contribute significantly, namely reference modelling, common-sense reasoning, and knowledge refinement and complexity management. We overview some of the existing approaches …in the literature, and we position them according to these three proposed perspectives. The paper concludes by discussing some open challenges related to the adoption of ontologies in explanations. Show more

Keywords: Neuro-symbolic AI, explanations, applied ontologies

DOI: 10.3233/NAI-240754

Citation: Neurosymbolic Artificial Intelligence, vol. Pre-press, no. Pre-press, pp. 1-15, 2024

Authors: Giunchiglia, Eleonora | Imrie, Fergus | van der Schaar, Mihaela | Lukasiewicz, Thomas

Article Type: Research Article

Abstract: In the recent years, machine learning has made great advancements that have been at the root of many breakthroughs in different application domains. However, it is still an open issue how to make them applicable to high-stakes or safety-critical application domains, as they can often be brittle and unreliable. In this paper, we argue that requirements definition and satisfaction can go a long way to make machine learning models even more fitting to the real world, especially in critical domains. To this end, we present two problems in which (i) requirements arise naturally, (ii) machine learning models are or can …be fruitfully deployed, and (iii) neglecting the requirements can have dramatic consequences. Our proposed pyramid development process integrates requirements specification into every stage of the machine learning pipeline, ensuring mutual influence between requirements and subsequent phases. Additionally, we explore the pivotal role of Neuro-symbolic AI in facilitating this integration, paving the way for more reliable and robust machine learning applications in critical domains. Through this approach, we aim to bridge the gap between theoretical advancements and practical implementations, ensuring machine learning’s safe and effective deployment in sensitive areas. Show more

Keywords: Safe AI, machine learning, requirements, machine learning operations, software engineering

DOI: 10.3233/NAI-240767

Citation: Neurosymbolic Artificial Intelligence, vol. Pre-press, no. Pre-press, pp. 1-13, 2024

Authors: Sha, Jingyuan | Shindo, Hikaru | Kersting, Kristian | Dhami, Devendra Singh

Article Type: Research Article

Abstract: The predicates used for Inductive Logic Programming (ILP) systems are usually elusive and need to be hand-crafted in advance, which limits the generalization of the system when learning new rules without sufficient background knowledge. Predicate Invention (PI) for ILP is the problem of discovering new concepts that describe hidden relationships in the domain. PI can mitigate the generalization problem for ILP by inferring new concepts, giving the system a better vocabulary to compose logic rules. Although there are several PI approaches for symbolic ILP systems, PI for Neuro-Symbolic-ILP (NeSy-ILP) systems that can handle 3D visual inputs to learn logical rules …using differentiable reasoning is still unaddressed. To this end, we propose a neuro-symbolic approach, NeSy-π , to invent predicates from visual scenes for NeSy-ILP systems based on clustering and extension of relational concepts, where π denotes the abbrivation of P redicate I nvention. NeSy-π processes visual scenes as input using deep neural networks for the visual perception and invents new concepts that support the task of classifying complex visual scenes. The invented concepts can be used by any NeSy-ILP system instead of hand-crafted background knowledge. Our experiments show that the NeSy-π is capable of inventing high-level concepts and solving complex visual logic patterns efficiently and accurately in the absence of explicit background knowledge. Moreover, the invented concepts are explainable and interpretable, while also providing competitive results with state-of-the-art NeSy-ILP systems. (github: https://github.com/ml-research/NeSy-PI ) Show more

Keywords: Predicate Invention, Inductive Logic Programming, Neuro-Symbolic Artificial Intelligence

DOI: 10.3233/NAI-240712

Citation: Neurosymbolic Artificial Intelligence, vol. Pre-press, no. Pre-press, pp. 1-26, 2024

Authors: Hersche, Michael | Terzić, Aleksandar | Karunaratne, Geethan | Langenegger, Jovin | Pouget, Angéline | Cherubini, Giovanni | Benini, Luca | Sebastian, Abu | Rahimi, Abbas

Article Type: Research Article

Abstract: Distributed sparse block codes (SBCs) exhibit compact representations for encoding and manipulating symbolic data structures using fixed-width vectors. One major challenge however is to disentangle, or factorize, the distributed representation of data structures into their constituent elements without having to search through all possible combinations. This factorization becomes more challenging when SBCs vectors are noisy due to perceptual uncertainty and approximations made by modern neural networks to generate the query SBCs vectors. To address these challenges, we first propose a fast and highly accurate method for factorizing a more flexible and hence generalized form of SBCs, dubbed GSBCs. Our iterative …factorizer introduces a threshold-based nonlinear activation, conditional random sampling, and an ℓ ∞ -based similarity metric. Its random sampling mechanism, in combination with the search in superposition, allows us to analytically determine the expected number of decoding iterations, which matches the empirical observations up to the GSBC’s bundling capacity. Secondly, the proposed factorizer maintains a high accuracy when queried by noisy product vectors generated using deep convolutional neural networks (CNNs). This facilitates its application in replacing the large fully connected layer (FCL) in CNNs, whereby C trainable class vectors, or attribute combinations, can be implicitly represented by our factorizer having F -factor codebooks, each with C F fixed codevectors. We provide a methodology to flexibly integrate our factorizer in the classification layer of CNNs with a novel loss function. With this integration, the convolutional layers can generate a noisy product vector that our factorizer can still decode, whereby the decoded factors can have different interpretations based on downstream tasks. We demonstrate the feasibility of our method on four deep CNN architectures over CIFAR-100, ImageNet-1K, and RAVEN datasets. In all use cases, the number of parameters and operations are notably reduced compared to the FCL. Show more

Keywords: Vector-symbolic architectures, iterative factorizer, sparse block codes, convolutional neural networks, deep learning

DOI: 10.3233/NAI-240713

Citation: Neurosymbolic Artificial Intelligence, vol. Pre-press, no. Pre-press, pp. 1-22, 2024