About neural networks - what is the cause of their inefficiency?
Too much booze.
About neural networks - what is the cause of their inefficiency?
I do agree that organic computing will be essential to implement the things we take for granted--creativity, intuition, pattern-recognition, etc. But we also need a leap in that area. Neural networks haven't exactly lived up to the hype.
About neural networks - what is the cause of their inefficiency?
The hardware or the used algorithms?
Robert Maxwell
An interesting thing about neural networks is that you can simulate the neurons and their base algoriths, then the neural network learns, and at the end, you have no ideea how what's going on inside this neural network - essentially, the 'processing' is is a foreign language you don't understand in the least.
And you are the person who made the neural network - you should know it intimately, but you don't. Like a ghost in the machine.
You mentioned our current software is deterministic. However, artificial neural networks also operate on deteministic principles (natural neural networks may include quantum effects).
It seems to me that the difference is not so much determinism, but...options. A standard program will give a computer only a limited number of options. A neural network, on the other hand, learned a multitude of options - some of which are dead ends, some of which are efficient; and the more time the neural network spends on a problem, the more options it generates through trial and error.
Essentially, the difference between our software and neural network is learning.
Robert Maxwell
Maybe, when humanity invents the first physical (not simulated) artificial neuron, a quantum leap in AI will follow.
Of course, such a neuron would be essentially a nanite - but a rather simple one.
Then you are misusing the term "nanite," which is used to refer to nanoscale robots.
What you are talking about is more accurately called a nanoscale network, which could be modeled after a neural network or any other kind of network.
Then you are misusing the term "nanite," which is used to refer to nanoscale robots.
What you are talking about is more accurately called a nanoscale network, which could be modeled after a neural network or any other kind of network.
A robot is a machine which is able to do a task on its own.
A nanorobot (nanite) is a nanoscale machine that can do a task on its own, on nanoscale resolution.
A nanoscale network is made of artificial neurons, which, as per the definition of the concept, are nanites.
Robert Maxwell
Physical artificial neurons or nanites - my original point was that the task it has to perform (forming connections to other neurons) is easier than, let's say, manipulating the surronding environment or replicating (the 'traditional' tasks for nanites).
This means we should have artificial neurons before we have self-replicating nanites. Of course, this 'before' means in a few decades, at the earliest.
After we have artificial neurons, will we be able to create AIs, or we will encounter other difficulties (I'm referring to, for example, the fact that natural neurons are more complex than appears to be necessary, having structures that seem to perform no relevant function)?
Robert Maxwell
Physical artificial neurons or nanites - my original point was that the task it has to perform (forming connections to other neurons) is easier than, let's say, manipulating the surronding environment or replicating (the 'traditional' tasks for nanites).
This means we should have artificial neurons before we have self-replicating nanites. Of course, this 'before' means in a few decades, at the earliest.
After we have artificial neurons, will we be able to create AIs, or we will encounter other difficulties (I'm referring to, for example, the fact that natural neurons are more complex than appears to be necessary, having structures that seem to perform no relevant function)?
I would point out that nanites are not necessarily self-replicating. It's a nice feature, but more likely you'll need a machine to generate them for you: a universal assembler. Self-replication is a more difficult task in the sense that the nanites will have to have full instructions for replicating themselves built-in.
I would agree that we would be better able to create artificial neurons than self-replicating nanites, though. If we can come up with a good design for an artificial neuron, we should be able to replicate it infinitely.
I have never heard that neurons are more complex than necessary. They are certainly very complex, but which components of that complexity do you consider to be superfluous? We have a rather poor understanding of how neurons work. We understand the basics but it's still a very wide-open area of research.
Robert Maxwell
Physical artificial neurons or nanites - my original point was that the task it has to perform (forming connections to other neurons) is easier than, let's say, manipulating the surronding environment or replicating (the 'traditional' tasks for nanites).
This means we should have artificial neurons before we have self-replicating nanites. Of course, this 'before' means in a few decades, at the earliest.
After we have artificial neurons, will we be able to create AIs, or we will encounter other difficulties (I'm referring to, for example, the fact that natural neurons are more complex than appears to be necessary, having structures that seem to perform no relevant function)?
I would point out that nanites are not necessarily self-replicating. It's a nice feature, but more likely you'll need a machine to generate them for you: a universal assembler. Self-replication is a more difficult task in the sense that the nanites will have to have full instructions for replicating themselves built-in.
Robert Maxwell, you're telling me nothing I don't already know:
"manipulating the surronding environment or replicating (the 'traditional' tasks for nanites)."
I would agree that we would be better able to create artificial neurons than self-replicating nanites, though. If we can come up with a good design for an artificial neuron, we should be able to replicate it infinitely.
I have never heard that neurons are more complex than necessary. They are certainly very complex, but which components of that complexity do you consider to be superfluous? We have a rather poor understanding of how neurons work. We understand the basics but it's still a very wide-open area of research.
About the natural network complexities:
http://en.wikipedia.org/wiki/Neural_network
So - your opinion is that, if we can create an artificial neuron (similar to the virtual ones we have today), we'll be able to create an AI or will the artificial neuron prove too simplistic?
Space:1999
Oh, wait...
We use essential cookies to make this site work, and optional cookies to enhance your experience.