Neurons with Paraboloid Decision Boundaries for Improved Neural Network Classification Performance

Short description: This is the paper, in which paraboloid neurons were first introduced. It describes their qualities and the math behind them, backed up by some promising initial experiments.



Abstract: In mathematical terms, an artificial neuron computes the inner product of a d-dimensional input vector x with its weight vector w, compares it with a bias value w0 and fires based on the result of this comparison. Therefore, its decision boundary is given by the equation wTx + w0 = 0. In this paper, we propose replacing the linear, hyperplane decision boundary of a neuron with a curved, paraboloid decision boundary. Thus, the decision boundary of the proposed paraboloid neuron is given by the equation (hTx+h0)2−||xp||2 2 = 0, where h and h0 denote the parameters of the directrix and p denotes the coordinates of the focus. Such paraboloid neural networks are proven to have superior recognition accuracy in a number of applications.

Please cite as:

N.Tsapanos, A.Tefas, N.Nikolaidis and I.Pitas, “Neurons With Paraboloid Decision Boundaries for Improved Neural Network Classification Performance”, IEEE Transactions on Neural Networks and Learning Systems (TNNLS), pp. 284-294, 2018.