We present a method for analyzing the behavior of RBFs in an on-line scenario which provides a description of the learning dynamics without invoking the thermodynamic limit. Our analysis is based on a master equation that describes the dynamics of the weight space probability density for any value of the input space dimension. Because the transition probability appearing in the master equation cannot be written in closed form, some approximate form of the dynamics is developed. We assume a arbitrary small learning rate (small noise) and we derive in this limit the dynamic evolution of the means and the variances of the net weights. The analytic results are then confirmed by simulations.

Dynamics of on-line learning in radial basis function neural networks

SCARPETTA, Silvia;MARINARO, Maria
1999-01-01

Abstract

We present a method for analyzing the behavior of RBFs in an on-line scenario which provides a description of the learning dynamics without invoking the thermodynamic limit. Our analysis is based on a master equation that describes the dynamics of the weight space probability density for any value of the input space dimension. Because the transition probability appearing in the master equation cannot be written in closed form, some approximate form of the dynamics is developed. We assume a arbitrary small learning rate (small noise) and we derive in this limit the dynamic evolution of the means and the variances of the net weights. The analytic results are then confirmed by simulations.
File in questo prodotto:
Non ci sono file associati a questo prodotto.

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11386/3878589
 Attenzione

Attenzione! I dati visualizzati non sono stati sottoposti a validazione da parte dell'ateneo

Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus ND
  • ???jsp.display-item.citation.isi??? 0
social impact