Questions tagged [neural-computing]
21 questions
11
votes
1 answer
How many layers should a neural network have?
Are there any advantages of having more than 2 hidden layers in a Neural Network?
I've seen some places that recommend it, others prove that there is no advantage.
Which one is right?
user1631
5
votes
1 answer
Predicting next action to take to reach a final state
Does anyone know of an algorithm that could be used to determine the next action to take to reach a desired state when trained on time-series data?
For example, a robot starts at a certain state, then takes an action to get to another state. This…
oalbrecht
- 151
- 2
4
votes
1 answer
Analog circuits for neural networks?
Neural networks in machine learning are inherently a continuous model of computation. Yet we use digital logic circuits with floating point numbers to "emulate" this continuity.
I am wondering: is there a possiblity to develop an analog-based ASIC…
user600670
- 277
- 1
- 6
3
votes
1 answer
NeuroEvolution: NEAT algorithm innovation numbers
I have been reading up on the NeuronEvolution of Augmented Topologies and there's this little thing that's been bothering me. While reading Kenneth Stanley's Paper on NEAT I came on this figure here:
The innovation numbers go from 1,2,3,4,5,6 to…
Rikku121
- 133
- 5
2
votes
1 answer
How to model a set of categorical values in the input of a neural network
One of the inputs to my neural network is a set. I have a set $S = \{s_0, s_1, ..., s_n\}$ in which all values $s_i$ are constant. An example of such a set could be the set of French wines (Beaujolais, Languedoc-Rousillon, Champagne) or the set of…
Klangen
- 1,100
- 8
- 15
2
votes
1 answer
Determining if my artificial neural network needs additional layers
I have implemented a neural network for load forecasting in Microsoft Excel. My structure is very simplistic and involves only 1 hidden layer and 4 neurons. (See picture)
I trained my network with a very large set of data and the predictions are as…
stjenkins
- 23
- 3
1
vote
1 answer
Is deep learning appropriate to approximate dynamic programming problems?
I have a problem which can be completely solved using dynamic programming, but in a very intractable way (On^4, where n is around 1000). I won't get into the details of the problem since it's a bit complicated, but it involves comparing properties…
lightning
- 225
- 1
- 7
1
vote
1 answer
What factors must one consider choosing an NN structure?
Suppose we have a classification problem and we wish to solve the problem by Neural Network. What factors must one consider choosing an NN structure? e.g Feed Forward, Recurrent and other available structures.
Gigili
- 2,213
- 3
- 22
- 31
1
vote
0 answers
NEAT (Neuroevolution): are innovation numbers needed?
This is related to this question: NeuroEvolution: NEAT algorithm innovation numbers
However, I am still struggling to understand why innovation numbers are useful in the first place? As I understand it, there is a one to one mapping between unique…
Chechy Levas
- 111
- 3
1
vote
0 answers
In theory, should neuromorphic computers be more efficient than traditional computers when performing logic?
There is this general sentiment about neuromorphic computers that they are simply "more efficient" than von Neuman.
I've heard a lot of talk about neuromorphic computers in the context of machine learning.
But, is there any research into performing…
markonius
- 111
- 1
0
votes
0 answers
Replace EKF by Neural Networks
I made a SLAM (Simultaneous Localization And Mapping) using Extended Kalman Filter (EKF) and it works really good, but I want to see if it works better using Neural Networks.
For the EKF I used an initialization step, prediction step and update…
Unnamed
- 101
0
votes
1 answer
Is it Possible to Get Maximum Weighted Input Value in a Neural Network?
Let's say that I have a standard feedforward neural network which has $M$ inputs, some number of hidden layers $N$, and a single neuron in the output.
Is it possible to construct a network such that the output neuron's output value is the maximum…
Alan Wolfe
- 1,358
- 11
- 22
0
votes
1 answer
Architecture of a chatbot - how to organize and fetch possibilities?
I'm building a chatbot that would respond to text messages.
Let's say that my chatbot works for customers of an internet provider and it can respond to the following things:
Problems:
About payment;
About internet connection.
General…
llanfair
- 101
- 3
0
votes
0 answers
Where to start studying about HTM?
I am looking for references (pedagogic and beginner friendly!) to these two topics,
hierarchical temporal memory algorithms applied to deep planning problems
(multi-layer) neural networks trained via SGD (after some bottom-up pre-learning using…
user6818
- 1,165
- 8
- 13
0
votes
0 answers
Delta rule for binary step function
I have a question of understanding about the Delta Rule:
$\Delta w_i = (y - \hat{y}) \times x_i$
Why does $x$ have to be multiplied again after the difference? If the input is $0$, the product of $w$ and $x$ remains $0$ anyway. Then, it should not…
iwab
- 101