Identifying voices using convolution neural network models AlexNet and ResNet
Abstract
Deep learning (DL) techniques which implement deep neural networks became popular due to the increase of high-performance computing facilities. DL achieves higher power and flexibility due to its ability to process many features when it deals with unstructured data. DL algorithm passes the data through several layers; each layer is capable of extracting features progressively and passes it to the next layer. Initial layers extract low-level features, and succeeding layers combine features to form a complete representation. This research attempts to utilize DL techniques for identifying sounds. The development in DL models has extensively covered classification and verification of objects through images. However, there have not been any notable findings concerning identification and verification of the voice of an individual from different other individuals using DL techniques. Hence, the proposed research aims to develop DL techniques capable of isolating the voice of an individual from a group of other sounds and classify them based on the use of convolutional neural networks models AlexNet and ResNet, that are used in voice identification. We achieved the classification accuracy of ResNet and AlexNet model for the problem of voice identification is 97.2039 % and 65.95% respectively, in which ResNet model achieves the best result.
References
Bae HS, Lee HJ, Lee SG. Voice recognition based on adaptive MFCC and deep learning. In 2016 IEEE 11th Conference on Industrial Electronics and Applications (ICIEA). 2016. pp. 1542-1546. doi: 10.1109/ICIEA.2016.7603830
Zhou R, Liu F, Gravelle CW. Deep Learning for Modulation Recognition: A Survey With a Demonstration. IEEE Access. 2020, 8: 67366-67376. doi: 10.1109/access.2020.2986330
Deng L, Liu Y. Deep Learning in Natural Language Processing. Springer Singapore, 2018. doi: 10.1007/978-981-10-5209-5
Deng L, Hinton G, Kingsbury B. New types of deep neural network learning for speech recognition and related applications: an overview. 2013 IEEE International Conference on Acoustics, Speech and Signal Processing. Published online May 2013. doi: 10.1109/icassp.2013.6639344
Terzopoulos G, Satratzemi M. Voice Assistants and Smart Speakers in Everyday Life and in Education. Informatics in Education. Published online September 16, 2020: 473-490. doi: 10.15388/infedu.2020.21
Nguyen G, Dlugolinsky S, Bobák M, et al. Machine Learning and Deep Learning frameworks and libraries for large-scale data mining: a survey. Artificial Intelligence Review. 2019, 52(1): 77-124. doi: 10.1007/s10462-018-09679-z
Lee JG, Jun S, Cho YW, et al. Deep Learning in Medical Imaging: General Overview. Korean Journal of Radiology. 2017, 18(4): 570. doi: 10.3348/kjr.2017.18.4.570
Fayek HM, Lech M, Cavedon L. Evaluating deep learning architectures for Speech Emotion Recognition. Neural Networks. 2017, 92: 60-68. doi: 10.1016/j.neunet.2017.02.013
Bashar A. Survey on evolving deep learning neural network architectures. Journal of Artificial Intelligence and Capsule Networks. 2019, 2019(2): 73-82. doi: 10.36548/jaicn.2019.2.003
Khalil RA, Jones E, Babar MI, et al. Speech Emotion Recognition Using Deep Learning Techniques: A Review. IEEE Access. 2019, 7: 117327-117345. doi: 10.1109/access.2019.2936124
Zhang Y, Pezeshki M, Brakel P, et al. Towards End-to-End Speech Recognition with Deep Convolutional Neural Networks. Interspeech 2016. Published online September 8, 2016. doi: 10.21437/interspeech.2016-1446
Lemley J, Bazrafkan S, Corcoran P. Deep Learning for Consumer Devices and Services: Pushing the limits for machine learning, artificial intelligence, and computer vision. IEEE Consumer Electronics Magazine. 2017, 6(2): 48-56. doi: 10.1109/mce.2016.2640698
Parcollet T, Zhang Y, Morchid M, et al. Quaternion Convolutional Neural Networks for End-to-End Automatic Speech Recognition. Interspeech 2018. Published online September 2, 2018. doi: 10.21437/interspeech.2018-1898
Zhang Z. Improved Adam Optimizer for Deep Neural Networks. 2018 IEEE/ACM 26th International Symposium on Quality of Service (IWQoS). Published online June 2018. doi: 10.1109/iwqos.2018.8624183
ShabanAl-Ani M, M. Al-Aloosi W. Biometrics Fingerprint Recognition using Discrete Cosine Transform (DCT). International Journal of Computer Applications. 2013, 69(6): 44-48. doi: 10.5120/11849-7598
Krizhevsky A, Sutskever I, Hinton GE. ImageNet classification with deep convolutional neural networks. Communications of the ACM. 2017, 60(6): 84-90. doi: 10.1145/3065386
Andrew. Nuts and bolts of building AI applications using Deep Learning. NIPS Keynote Talk. 2016.
Malik M, Adavanne S, Drossos K, et al. Stacked convolutional and recurrent neural networks for music emotion recognition. 2017.
Pons J, Slizovskaia O, Gong R, et al. Timbre analysis of music audio signals with convolutional neural networks. In: Proceedings of the 2017 25th European Signal Processing Conference (EUSIPCO) IEEE. pp. 2744-2748.
Bunrit S, Inkian T, Kerdprasop N, et al. Text-Independent Speaker Identification Using Deep Learning Model of Convolution Neural Network. International Journal of Machine Learning and Computing. 2019, 9(2): 143-148. doi: 10.18178/ijmlc.2019.9.2.778
Heaven D. Why deep-learning AIs are so easy to fool. Nature. 2019, 574(7777): 163-166. doi: 10.1038/d41586-019-03013-5
Taylor GR. Integrating quantitative and qualitative methods in research. University press of America. 2005, doi: 10.4236/psych.2020.115053
McEvoy P, Richards D. A critical realist rationale for using a combination of quantitative and qualitative methods. Journal of Research in Nursing. 2006, 11(1): 66-78. doi: 10.1177/1744987106060192
Open Speech and Language Resources. OpenSLR (Version 1) [Dev-clean]. Available online: http://www.openslr.org/12/ (accessed on 7 June 2023).
Nasr MA, Abd-Elnaby M, El-Fishawy AS, et al. Speaker identification based on normalized pitch frequency and Mel Frequency Cepstral Coefficients. International Journal of Speech Technology. 2018, 21(4): 941-951. doi: 10.1007/s10772-018-9524-7
Hossin M, M.N S. A Review on Evaluation Metrics for Data Classification Evaluations. International Journal of Data Mining & Knowledge Management Process. 2015, 5(2): 3-5. doi: 10.5121/ijdkp.2015.5201
Han J, Gondro C, Reid K, et al. Heuristic hyperparameter optimization of deep learning models for genomic prediction. De Koning DJ, ed. G3 Genes|Genomes|Genetics. 2021, 11(7). doi: 10.1093/g3journal/jkab032
Mamyrbayev O, Mekebayev N, Turdalyuly M, et al. Voice Identification Using Classification Algorithms. Intelligent System and Computing. Published online April 29, 2020. doi: 10.5772/intechopen.88239
Copyright (c) 2024 Abdulaziz Alhowaish Luluh, Muniasamy Anandhavalli
This work is licensed under a Creative Commons Attribution 4.0 International License.
Authors contributing to this journal agree to publish their articles under the Creative Commons Attribution 4.0 International License, allowing third parties to share their work (copy, distribute, transmit) and to adapt it for any purpose, even commercially, under the condition that the authors are given credit. With this license, authors hold the copyright.
