Previous [ 1] [ 2] [ 3] [ 4] [ 5] [ 6] [ 7] [ 8] [ 9] [ 10] [ 11] [ 12] [ 13] [ 14] [ 15] [ 16] [ 17] [ 18] [ 19] [ 20] [ 21]

°@

Journal of Information Science and Engineering, Vol. 31 No. 3, pp. 821-838 (May 2015)


Automatic Singing Performance Evaluation Using Accompanied Vocals as Reference Bases*


WEI-HO TSAI, CIN-HAO MA AND YI-PO HSU
Department of Electronic Engineering
National Taipei University of Technology
Taipei, 106 Taiwan
E-mail: {whtsai; t101419012}@ntut.edu.tw

This work aims to develop an automatic singing evaluation system for general public. Given a CD/mp3 song recording as the reference basis, the proposed system rates a user°¶s singing performance by comparing it with the vocal in the song recording. This modality allows users to not only enjoy listening to and singing with CD/mp3 songs but also know how well or bad they sing. However, as a majority of songs contain background accompaniments during most or all vocal passages, directly comparing a user°¶s singing performance with the signals in a song recording does not make sense. To tackle this problem, we propose methods to extract pitch-, volume-, and rhythm-based features of the original singer in the accompanied vocals. Our experiment shows that the results of automatic singing evaluation are close to the human rating, where the Pearson product- moment correlation coefficient between them is 0.8. The results are also comparable to those in a previous work using Karaoke music as reference bases, where the latter°¶s task is considered to be easier than that of this work.

Keywords: accompanied vocal, pitch, rhythm, singing evaluation, volume

Full Text (•Ģ§Śņ…) Retrieve PDF document (201505_04.pdf)

Received April 9, 2014; revised August 12 & November 10, 2014; accepted December 2, 2014.
Communicated by Chung-Hsien Wu.
* This work was supported in part by the National Science Council under Grants NSC101-2628-E-027-001 and MOST103-2218-E-027-006-MY3.