I admit I have almost no knowledge about neural networks, AI, or machine learning, so this is all speculation. But I have a theory about the motivations of neural networks, that is based is on my knowledge of modern programmers.
My theory is that when people train these neural networks to perform a certain function, there is actually a simple statistical principle at play, which in no way requires the layered grid of neurons, or anything resembling a neural network. The neural networks get the job done, but the reason it is done via neural networks instead of a simpler way is to make it look "brain-like" and obfuscate the simple statistical principle that is doing the real work. Maybe some intelligent programmers found out about this principle, but then the Silicon Valley scum forced them to stop or ridiculed them into stopping.
Is anyone here knowledgable about neural networks? Are they really necessary?