DNN: Number of Neurons, Number of Params, and Number of Combinations

Consider a DNN with 2 dense layers of 10 neurons and 10 neurons.

Number of neurons:
10 + 10 = 20

Number of params:
10*10 + 10*10 = 100 + 100 = 200

Number of combinations:
100 * 100 = 10,000

The DNN should be big enough to fit (but don't overfit, no use):

• More layers enough to fit desired number of  separations
• More neurons in layers enough to fit number of input combinations