That's not just a pet theory. I'll tell you though that

https://en.wikipedia.org/wiki/Perceptrons_(book)

is a brilliant book from the early days of computer science which is asking questions about the fundamentals of algorithms and what you can and can't do with different methods. (Like the result that it takes at least N log N comparisons to sort N items)