In a seminal book, Minsky and Papert define the perceptron as a limited implementation of what they called “parallel machines.” They showed that some binary Boolean functions including XOR are not definable in a single layer perceptron due to its limited capacity to learn only linearly separable functions. In this work, we propose a new more powerful implementation of such parallel machines. This new mathematical tool is defined using analytic sinusoids—instead of linear combinations—to form an analytic signal representation of the function that we want to learn. We show that this re-formulated parallel mechanism can learn, with a single layer, any non-linear k-ary Boolean function. Finally, to provide an example of its practical applications, we show that it outperforms the single hidden layer multilayer perceptron in both Boolean function learning and image classification tasks, while also being faster and requiring fewer parameters.
Signal Perceptron: On the Identifiability of Boolean Function Spaces and Beyond
Miguel Ángel Méndez Lucero,Rafael-Michael Karampatsis,E. Gallardo,Vaishak Belle
Published 2022 in Frontiers in Artificial Intelligence
ABSTRACT
PUBLICATION RECORD
- Publication year
2022
- Venue
Frontiers in Artificial Intelligence
- Publication date
2022-06-02
- Fields of study
Mathematics, Computer Science, Medicine
- Identifiers
- External record
- Source metadata
Semantic Scholar, PubMed
CITATION MAP
EXTRACTION MAP
CLAIMS
- No claims are published for this paper.
CONCEPTS
- No concepts are published for this paper.
REFERENCES
Showing 1-50 of 50 references · Page 1 of 1
CITED BY
Showing 1-2 of 2 citing papers · Page 1 of 1