Articles

A comprehensive system for facial animation of generic 3D head models driven by speech

A comprehensive system for facial animation of generic 3D head models driven by speech is presented in this article. In the training stage, audio-visual information is extracted from audio-visual training data...

Authors: Lucas D Terissi, Mauricio Cerda, Juan C Gómez, Nancy Hitschfeld-Kahler and Bernard Girau

Nonparametric Bayesian sparse factor analysis for frequency domain blind source separation without permutation ambiguity

Blind source separation (BSS) and sound activity detection (SAD) from a sound source mixture with minimum prior information are two major requirements for computational auditory scene analysis that recognizes ...

Authors: Kohei Nagira, Takuma Otsuka and Hiroshi G Okuno

An efficient solution to sparse linear prediction analysis of speech

We propose an efficient solution to the problem of sparse linear prediction analysis of the speech signal. Our method is based on minimization of a weighted l₂-norm of the prediction error. The weighting function...

Authors: Vahid Khanagha and Khalid Daoudi

Improved monaural speech segregation based on computational auditory scene analysis

A lot of effort has been made in Computational Auditory Scene Analysis (CASA) to segregate target speech from monaural mixtures. Based on the principle of CASA, this article proposes an improved algorithm for ...

Authors: Wang Yu, Lin Jiajun, Chen Ning and Yuan Wenhao

Context-dependent sound event detection

The work presented in this article studies how the context information can be used in the automatic sound event detection process, and how the detection system can benefit from such information. Humans are usi...

Authors: Toni Heittola, Annamaria Mesaros, Antti Eronen and Tuomas Virtanen

A perceptual masking approach for noise robust speech recognition

This article describes a modified technique for enhancing noisy speech to improve automatic speech recognition (ASR) performance. The proposed approach improves the widely used spectral subtraction which inher...

Authors: Hari Krishna Maganti and Marco Matassoni

A study on the consistency analysis of energy parameter for Mandarin speech

In this study, a consistency analysis of energy parameter for Mandarin speech is presented. Identified as a result of inspection of the human pronunciation process, the consistency can be interpreted as a high...

Authors: Li-Te Shen, Cheng-Yu Yeh and Shaw-Hwa Hwang

Estimation and quantization of ICC-dependent phase parameters for parametric stereo audio coding

Conventional parametric stereo (PS) audio coding employs inter-channel phase difference and overall phase difference as phase parameters. In this article, it is shown that those parameters cannot correctly rep...

Authors: Dong-il Hyun, Young-cheol Park and Dae Hee Youn

Stereophonic hands-free communication system based on microphone array fixed beamforming: real-time implementation and evaluation

In this article, the authors propose an optimally designed fixed beamformer (BF) for stereophonic acoustic echo cancelation (SAEC) in real hands-free communication applications. Several contributions related t...

Authors: Matteo Pirro, Stefano Squartini, Laura Romoli and Francesco Piazza

Comparative study of digital audio steganography techniques

The rapid spread in digital data usage in many real life applications have urged new and effective ways to ensure their security. Efficient secrecy can be achieved, at least in part, by implementing steganogra...

Authors: Fatiha Djebbar, Beghdad Ayad, Karim Abed Meraim and Habib Hamam

Expressed music mood classification compared with valence and arousal ratings

Mood is an important aspect of music and knowledge of mood can be used as a basic feature in music recommender and retrieval systems. A listening experiment was carried out establishing ratings for various moo...

Authors: Bert den Brinker, Ralph van Dinther and Janto Skowronek

An evolutionary feature synthesis approach for content-based audio retrieval

A vast amount of audio features have been proposed in the literature to characterize the content of audio signals. In order to overcome specific problems related to the existing features (such as lack of discrimi...

Authors: Toni Mäkinen, Serkan Kiranyaz, Jenni Raitoharju and Moncef Gabbouj

Biomimetic multi-resolution analysis for robust speaker recognition

Humans exhibit a remarkable ability to reliably classify sound sources in the environment even in presence of high levels of noise. In contrast, most engineering systems suffer a drastic drop in performance wh...

Authors: Sridhar Krishna Nemala, Dmitry N Zotkin, Ramani Duraiswami and Mounya Elhilali

Speaker-dependent model interpolation for statistical emotional speech synthesis

In this article, we propose a speaker-dependent model interpolation method for statistical emotional speech synthesis. The basic idea is to combine the neutral model set of the target speaker and an emotional ...

Authors: Chih-Yu Hsu and Chia-Ping Chen

Speech steganography using wavelet and Fourier transforms

A new method to secure speech communication using the discrete wavelet transforms (DWT) and the fast Fourier transform is presented in this article. In the first phase of the hiding technique, we separate the ...

Authors: Siwar Rekik, Driss Guerchi, Sid-Ahmed Selouani and Habib Hamam

Speaker diarization of broadcast news in Albayzin 2010 evaluation campaign

In this article, we present the evaluation results for the task of speaker diarization of broadcast news, which was part of the Albayzin 2010 evaluation campaign of language and speech technologies. The evalua...

Authors: Martin Zelenák, Henrik Schulz and Javier Hernando

A parameterizable spatiotemporal representation of popular dance styles for humanoid dancing characters

Dance movements are a complex class of human behavior which convey forms of non-verbal and subjective communication that are performed as cultural vocabularies in all human cultures. The singularity of dance f...

Authors: João Lobato Oliveira, Luiz Naveda, Fabien Gouyon, Luis Paulo Reis, Paulo Sousa and Marc Leman

Multi-candidate missing data imputation for robust speech recognition

The application of Missing Data Techniques (MDT) to increase the noise robustness of HMM/GMM-based large vocabulary speech recognizers is hampered by a large computational burden. The likelihood evaluations im...

Authors: Yujun Wang and Hugo Van hamme

Perceptual audio features for emotion detection

In this article, we propose a new set of acoustic features for automatic emotion recognition from audio. The features are based on the perceptual quality metrics that are given in perceptual evaluation of audi...

Authors: Mehmet Cenk Sezgin, Bilge Gunsel and Gunes Karabulut Kurt

Phone lattice reconstruction for embedded language recognition in LVCSR

An increasing number of multilingual applications require language recognition (LRE) as a frontend, but desire low additional computational cost. This article demonstrates a novel architecture for embedding ph...

Authors: Yuxiang Shan, Yan Deng, Jia Liu and Michael T Johnson

Using information theoretic distance measures for solving the permutation problem of blind source separation of speech signals

The problem of blind source separation (BSS) of convolved acoustic signals is of great interest for many classes of applications. Due to the convolutive mixing process, the source separation is performed in th...

Authors: Eugen Hoffmann, Dorothea Kolossa, Bert-Uwe Köhler and Reinhold Orglmeister

Robust dialogue act detection based on partial sentence tree, derivation rule, and spectral clustering algorithm

A novel approach for robust dialogue act detection in a spoken dialogue system is proposed. Shallow representation named partial sentence trees are employed to represent automatic speech recognition outputs. P...

Authors: Chia-Ping Chen, Chung-Hsien Wu and Wei-Bin Liang

A role of multi-modal rhythms in physical interaction and cooperation

As fundamental research for human-robot interaction, this paper addresses the rhythmic reference of a human while turning a rope with another human. We hypothyzed that when interpreting rhythm cues to make a r...

Authors: Kenta Yonekura, Chyon Hae Kim, Kazuhiro Nakadai, Hiroshi Tsujino and Shigeki Sugano

Transcribing Bach chorales: Limitations and potentials of non-negative matrix factorisation

This article discusses our research on polyphonic music transcription using non-negative matrix factorisation (NMF). The application of NMF in polyphonic transcription offers an alternative approach in which obse...

Authors: Somnuk Phon-Amnuaisuk

Decision tree-based acoustic models for speech recognition

This article proposes a new acoustic model using decision trees (DTs) as replacements for Gaussian mixture models (GMM) to compute the observation likelihoods for a given hidden Markov model state in a speech ...

Authors: Masami Akamine and Jitendra Ajmera

Force-feedback interaction with a neural oscillator model: for shared human-robot control of a virtual percussion instrument

A study on force-feedback interaction with a model of a neural oscillator provides insight into enhanced human-robot interactions for controlling musical sound. We provide differential equations and discrete-t...

Authors: Edgar Berdahl, Claude Cadoz and Nicolas Castagné

Combined perception and control for timing in robotic music performances

Interaction with human musicians is a challenging task for robots as it involves online perception and precise synchronization. In this paper, we present a consistent and theoretically sound framework for comb...

Authors: Umut Şimşekli, Orhan Sönmez, Barış Kurt Kurt and Ali Taylan Cemgil

DWT and LPC based feature extraction methods for isolated word recognition

In this article, new feature extraction methods, which utilize wavelet decomposition and reduced order linear predictive coding (LPC) coefficients, have been proposed for speech recognition. The coefficients h...

Authors: Navnath S Nehe and Raghunath S Holambe

A multimodal tempo and beat-tracking system based on audiovisual information from live guitar performances

The aim of this paper is to improve beat-tracking for live guitar performances. Beat-tracking is a function to estimate musical measurements, for example musical tempo and phase. This method is critical to ach...

Authors: Tatsuhiko Itohara, Takuma Otsuka, Takeshi Mizumoto, Angelica Lim, Tetsuya Ogata and Hiroshi G Okuno

Music-aided affective interaction between human and service robot

This study proposes a music-aided framework for affective interaction of service robots with humans. The framework consists of three systems, respectively, for perception, memory, and expression on the basis o...

Authors: Jeong-Sik Park, Gil-Jin Jang and Yong-Ho Seo

Performance of the audio signals transmission over wireless networks with the channel interleaving considerations

This article studies a vital issue in wireless communications, which is the transmission of audio signals over wireless networks. It presents a novel interleaver scheme for protection against error bursts and ...

Authors: Mohsen Ahmed Mahmoud Mohamed El-Bendary, Atef E Abou-El-azm, Nawal A El-Fishawy, Farid Shawki, Fathi E Abd-ElSamie, Mostafa Ali Refai El-Tokhy and Hassan B Kazemian

Towards expressive musical robots: a cross-modal framework for emotional gesture, voice and music

It has been long speculated that expression of emotions from different modalities have the same underlying 'code', whether it be a dance step, musical phrase, or tone of voice. This is the first attempt to imp...

Authors: Angelica Lim, Tetsuya Ogata and Hiroshi G Okuno

Music expression with a robot manipulator used as a bidirectional tangible interface

The availability of haptic interfaces in music content processing offers interesting possibilities of performer-instrument interaction for musical expression. These new musical instruments can precisely modulate ...

Authors: Victor Zappi, Antonio Pistillo, Sylvain Calinon, Andrea Brogni and Darwin Caldwell

A novel voice activity detection based on phoneme recognition using statistical model

In this article, a novel voice activity detection (VAD) approach based on phoneme recognition using Gaussian Mixture Model based Hidden Markov Model (HMM/GMM) is proposed. Some sophisticated speech features su...

Authors: Xulei Bao and Jie Zhu

Voice activity detection based on conjugate subspace matching pursuit and likelihood ratio test

Most of voice activity detection (VAD) schemes are operated in the discrete Fourier transform (DFT) domain by classifying each sound frame into speech or noise based on the DFT coefficients. These coefficients...

Authors: Shiwen Deng and Jiqing Han

Semantic structures of timbre emerging from social and acoustic descriptions of music

The perceptual attributes of timbre have inspired a considerable amount of multidisciplinary research, but because of the complexity of the phenomena, the approach has traditionally been confined to laboratory...

Authors: Rafael Ferrer and Tuomas Eerola

System for fast lexical and phonetic spoken term detection in a Czech cultural heritage archive

The main objective of the work presented in this paper was to develop a complete system that would accomplish the original visions of the MALACH project. Those goals were to employ automatic speech recognition...

Authors: Josef Psutka, Jan Švec, Josef V Psutka, Jan Vaněk, Aleš Pražák, Luboš Šmídl and Pavel Ircing

Noise-robust speech feature processing with empirical mode decomposition

In this article, a novel technique based on the empirical mode decomposition methodology for processing speech features is proposed and investigated. The empirical mode decomposition generalizes the Fourier an...

Authors: Kuo-Hau Wu, Chia-Ping Chen and Bing-Feng Yeh

Correlation analysis of the speech multiscale product for the open quotient estimation

This article proposes a multiscale product (MP)-based method for estimating the open quotient (OQ) from the speech waveform. The MP is operated by calculating the wavelet transform coefficients of the speech s...

Authors: Wafa Saidi, Aicha Bouzid and Noureddine Ellouze

An improved adaptive gain equalizer for noise reduction with low speech distortion

In high-quality conferencing systems, it is desired to perform noise reduction with as limited speech distortion as possible. Previous work, based on time varying amplification controlled by signal-to-noise ra...

Authors: Markus Borgh, Magnus Berggren, Christian Schüldt, Fredric Lindström and Ingvar Claesson

A large vocabulary continuous speech recognition system for Persian language

The first large vocabulary speech recognition system for the Persian language is introduced in this paper. This continuous speech recognition system uses most standard and state-of-the-art speech and language ...

Authors: Hossein Sameti, Hadi Veisi, Mohammad Bahrani, Bagher Babaali and Khosro Hosseinzadeh

Noise reduction for periodic signals using high-resolution frequency analysis

The spectrum subtraction method is one of the most common methods by which to remove noise from a spectrum. Like many noise reduction methods, the spectrum subtraction method uses discrete Fourier transform (D...

Authors: Toshio Yoshizawa, Shigeki Hirobayashi and Tadanobu Misawa

Multi-label classification of music by emotion

This work studies the task of automatic emotion detection in music. Music may evoke more than one different emotion at the same time. Single-label classification and regression cannot model this multiplicity. ...

Authors: Konstantinos Trohidis, Grigorios Tsoumakas, George Kalliris and Ioannis Vlahavas

Robust time delay estimation for speech signals using information theory: A comparison study

Time delay estimation (TDE) is a fundamental subsystem for a speaker localization and tracking system. Most of the traditional TDE methods are based on second-order statistics (SOS) under Gaussian assumption f...

Authors: Fei Wen and Qun Wan

Semitone frequency mapping to improve music representation for nucleus cochlear implants

The frequency-to-channel mapping for Cochlear implant (CI) signal processors was originally designed to optimize speech perception and generally does not preserve the harmonic structure of music sounds. An alg...

Authors: Sherif Abdellatif Omran, Waikong Lai, Michael Büchler and Norbert Dillier

Audio segmentation of broadcast news in the Albayzin-2010 evaluation: overview, results, and discussion

Recently, audio segmentation has attracted research interest because of its usefulness in several applications like audio indexing and retrieval, subtitling, monitoring of acoustic scenes, etc. Moreover, a pre...

Authors: Taras Butko and Climent Nadeu

Scalable Audio-Content Analysis

Authors: Bhiksha Raj, Paris Smaragdis, Malcolm Slaney, Chung-Hsien Wu, Liming Chen and Hyoung-Gook Kim

Environmental Sound Synthesis, Processing, and Retrieval

Authors: Andrea Valle

Phoneme and Sentence-Level Ensembles for Speech Recognition

We address the question of whether and how boosting and bagging can be used for speech recognition. In order to do this, we compare two different boosting schemes, one at the phoneme level and one at the utter...

Authors: Christos Dimitrakakis and Samy Bengio

Pitch Ranking, Melody Contour and Instrument Recognition Tests Using Two Semitone Frequency Maps for Nucleus Cochlear Implants

To overcome harmonic structure distortions of complex tones in the low frequency range due to the frequency to electrode mapping function used in Nucleus cochlear implants, two modified frequency maps based on...

Authors: Sherif A. Omran, Waikong Lai and Norbert Dillier