The field of Metrology has seen great use of Machine Learning and Deep Learning models, improving existing Metrology and enabling measurements and estimations that were previously not possible. In the challenging task of gathering training data in various areas of Metrology, a question arises; is it necessary to gather a completely new dataset every time a quality upgrade is done to a measurement system, method or model, or can the formerly trained model be used for new data with higher Signal-to-Noise Ratio (SNR)? This paper investigates how trained neural networks react to new data coming into the testing, with a higher SNR than the training data. In the experiments, Convolutional Neural Networks (CNN), in 1D and 2D, are used on heart sound data, as a test case. The initial results show that the classification accuracy for the new data, with a higher SNR, coming into the 1D CNN is almost as high as if the network had been trained on the higher SNR data. For a 2D CNN working with spectrograms instead of time series data, the change in accuracy is not nearly as high, as the 2D CNN model seems more robust to noise differences. © 2024 IEEE.
Accuracy Impact of Increased Measurement Quality when using Pretrained Networks for Classification
Lundgren J.;Laino V.;Gallo V.;Carratu' M.;
2024
Abstract
The field of Metrology has seen great use of Machine Learning and Deep Learning models, improving existing Metrology and enabling measurements and estimations that were previously not possible. In the challenging task of gathering training data in various areas of Metrology, a question arises; is it necessary to gather a completely new dataset every time a quality upgrade is done to a measurement system, method or model, or can the formerly trained model be used for new data with higher Signal-to-Noise Ratio (SNR)? This paper investigates how trained neural networks react to new data coming into the testing, with a higher SNR than the training data. In the experiments, Convolutional Neural Networks (CNN), in 1D and 2D, are used on heart sound data, as a test case. The initial results show that the classification accuracy for the new data, with a higher SNR, coming into the 1D CNN is almost as high as if the network had been trained on the higher SNR data. For a 2D CNN working with spectrograms instead of time series data, the change in accuracy is not nearly as high, as the 2D CNN model seems more robust to noise differences. © 2024 IEEE.I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.