Articles

Comparisons of Auditory Impressions and Auditory Imagery Associated with Onomatopoeic Representation for Environmental Sounds

Humans represent sounds to others and receive information about sounds from others using onomatopoeia. Such representation is useful for obtaining and reporting the acoustic features and impressions of actual ...

Authors: Masayuki Takada, Nozomu Fujisawa, Fumino Obata and Shin-ichiro Iwamiya

On the Characterization of Slowly Varying Sinusoids

We give a brief discussion on the amplitude and frequency variation rates of the sinusoid representation of signals. In particular, we derive three inequalities that show that these rates are upper bounded by ...

Authors: Xue Wen and Mark Sandler

Correlation-Based Amplitude Estimation of Coincident Partials in Monaural Musical Signals

This paper presents a method for estimating the amplitude of coincident partials generated by harmonic musical sources (instruments and vocals). It was developed as an alternative to the commonly used interpol...

Authors: JaymeGarciaArnal Barbedo and George Tzanetakis

Efficient Advertisement Discovery for Audio Podcast Content Using Candidate Segmentation

Nowadays, audio podcasting has been widely used by many online sites such as newspapers, web portals, journals, and so forth, to deliver audio content to users through download or subscription. Within 1 to 30 ...

Authors: MN Nguyen, Qi Tian and Ping Xue

Combining Superdirective Beamforming and Frequency-Domain Blind Source Separation for Highly Reverberant Signals

Frequency-domain blind source separation (BSS) performs poorly in high reverberation because the independence assumption collapses at each frequency bins when the number of bins increases. To improve the separ...

Authors: Lin Wang, Heping Ding and Fuliang Yin

Employing Second-Order Circular Suprasegmental Hidden Markov Models to Enhance Speaker Identification Performance in Shouted Talking Environments

Speaker identification performance is almost perfect in neutral talking environments. However, the performance is deteriorated significantly in shouted talking environments. This work is devoted to proposing, ...

Authors: Ismail Shahin

Development of the Database for Environmental Sound Research and Application (DESRA): Design, Functionality, and Retrieval Considerations

Theoretical and applied environmental sounds research is gaining prominence but progress has been hampered by the lack of a comprehensive, high quality, accessible database of environmental sounds. An ongoing ...

Authors: Brian Gygi and Valeriy Shafiro

Adaptive Long-Term Coding of LSF Parameters Trajectories for Large-Delay/Very- to Ultra-Low Bit-Rate Speech Coding

This paper presents a model-based method for coding the LSF parameters of LPC speech coders on a "long-term" basis, that is, beyond the usual 20–30 ms frame duration. The objective is to provide efficient LSF ...

Authors: Laurent Girin

Atypical Speech

Authors: Georg Stemmer, Elmar Nöth and Vijay Parsa

Independent Component Analysis and Time-Frequency Masking for Speech Recognition in Multitalker Conditions

When a number of speakers are simultaneously active, for example in meetings or noisy public places, the sources of interest need to be separated from interfering speakers and from each other in order to be ro...

Authors: Dorothea Kolossa, Ramon Fernandez Astudillo, Eugen Hoffmann and Reinhold Orglmeister

Environmental Sound Perception: Metadescription and Modeling Based on Independent Primary Studies

The aim of the study is to transpose and extend to a set of environmental sounds the notion of sound descriptors usually used for musical sounds. Four separate primary studies dealing with interior car sounds,...

Authors: Nicolas Misdariis, Antoine Minard, Patrick Susini, Guillaume Lemaitre, Stephen McAdams and Etienne Parizet

Determination of Nonprototypical Valence and Arousal in Popular Music: Features and Performances

Mood of Music is among the most relevant and commercially promising, yet challenging attributes for retrieval in large music collections. In this respect this article first provides a short overview on methods...

Authors: Björn Schuller, Johannes Dorfner and Gerhard Rigoll

Exploring the Effect of Differences in the Acoustic Correlates of Adults' and Children's Speech in the Context of Automatic Speech Recognition

This work explores the effect of mismatches between adults' and children's speech due to differences in various acoustic correlates on the automatic speech recognition performance under mismatched conditions. ...

Authors: Shweta Ghai and Rohit Sinha

Animating Virtual Speakers or Singers from Audio: Lip-Synching Facial Animation

Authors: Sascha Fagel, Gérard Bailly and Barry-John Theobald

Semantic Labeling of Nonspeech Audio Clips

Human communication about entities and events is primarily linguistic in nature. While visual representations of information are shown to be highly effective as well, relatively little is known about the commu...

Authors: Xiaojuan Ma, Christiane Fellbaum and Perry Cook

Automatic Recognition of Lyrics in Singing

The paper considers the task of recognizing phonemes and words from a singing input by using a phonetic hidden Markov model recognizer. The system is targeted to both monophonic singing and singing in polyphon...

Authors: Annamaria Mesaros and Tuomas Virtanen

Ageing Voices: The Effect of Changes in Voice Parameters on ASR Performance

With ageing, human voices undergo several changes which are typically characterized by increased hoarseness and changes in articulation patterns. In this study, we have examined the effect on Automatic Speech ...

Authors: Ravichander Vipperla, Steve Renals and Joe Frankel

Wide-Band Audio Coding Based on Frequency-Domain Linear Prediction

We revisit an original concept of speech coding in which the signal is separated into the carrier modulated by the signal envelope. A recently developed technique, called frequency-domain linear prediction (FD...

Authors: Petr Motlicek, Sriram Ganapathy, Hynek Hermansky and Harinath Garudadri

Query-Driven Strategy for On-the-Fly Term Spotting in Spontaneous Speech

Spoken utterance retrieval was largely studied in the last decades, with the purpose of indexing large audio databases or of detecting keywords in continuous speech streams. While the indexing of closed corpor...

Authors: Mickael Rouvier, Georges Linarès and Benjamin Lecouteux

Analysis of the Roles and the Dynamics of Breathy and Whispery Voice Qualities in Dialogue Speech

Breathy and whispery voices are nonmodal phonations produced by an air escape through the glottis and may carry important linguistic or paralinguistic information (intentions, attitudes, and emotions), dependi...

Authors: CarlosToshinori Ishi, Hiroshi Ishiguro and Norihiro Hagita

On the Impact of Children's Emotional Speech on Acoustic and Language Models

The automatic recognition of children's speech is well known to be a challenge, and so is the influence of affect that is believed to downgrade performance of a speech recogniser. In this contribution, we inve...

Authors: Stefan Steidl, Anton Batliner, Dino Seppi and Björn Schuller

Pitch- and Formant-Based Order Adaptation of the Fractional Fourier Transform and Its Application to Speech Recognition

Fractional Fourier transform (FrFT) has been proposed to improve the time-frequency resolution in signal analysis and processing. However, selecting the FrFT transform order for the proper analysis of multicom...

Authors: Hui Yin, Climent Nadeu and Volker Hohmann

Audio Query by Example Using Similarity Measures between Probability Density Functions of Features

This paper proposes a query by example system for generic audio. We estimate the similarity of the example signal and the samples in the queried database by calculating the distance between the probability den...

Authors: Marko Helén and Tuomas Virtanen

Drum Sound Detection in Polyphonic Music with Hidden Markov Models

This paper proposes a method for transcribing drums from polyphonic music using a network of connected hidden Markov models (HMMs). The task is to detect the temporal locations of unpitched percussive sounds (...

Authors: Jouni Paulus and Anssi Klapuri

Automatic Query Generation and Query Relevance Measurement for Unsupervised Language Model Adaptation of Speech Recognition

We are developing a method of Web-based unsupervised language model adaptation for recognition of spoken documents. The proposed method chooses keywords from the preliminary recognition result and retrieves We...

Authors: Akinori Ito, Yasutomo Kajiura, Motoyuki Suzuki and Shozo Makino

Compact Acoustic Models for Embedded Speech Recognition

Speech recognition applications are known to require a significant amount of resources. However, embedded speech recognition only authorizes few KB of memory, few MIPS, and small amount of training data. In or...

Authors: Christophe Lévy, Georges Linarès and Jean-François Bonastre

SynFace—Speech-Driven Facial Animation for Virtual Speech-Reading Support

This paper describes SynFace, a supportive technology that aims at enhancing audio-based spoken communication in adverse acoustic conditions by providing the missing visual information in the form of an animat...

Authors: Giampiero Salvi, Jonas Beskow, Samer Al Moubayed and Björn Granström

Lip-Synching Using Speaker-Specific Articulation, Shape and Appearance Models

We describe here the control, shape and appearance models that are built using an original photogrammetric method to capture characteristics of speaker-specific facial articulation, anatomy, and texture. Two o...

Authors: Gérard Bailly, Oxana Govokhina, Frédéric Elisei and Gaspard Breton

Model-Based Synthesis of Visual Speech Movements from 3D Video

We describe a method for the synthesis of visual speech movements using a hybrid unit selection/model-based approach. Speech lip movements are captured using a 3D stereo face capture system and split up into p...

Authors: JamesD Edge, Adrian Hilton and Philip Jackson

Optimizing Automatic Speech Recognition for Low-Proficient Non-Native Speakers

Computer-Assisted Language Learning (CALL) applications for improving the oral skills of low-proficient learners have to cope with non-native speech that is particularly challenging. Since unconstrained non-na...

Authors: Joost van Doremalen, Catia Cucchiarini and Helmer Strik

An Adaptive Framework for Acoustic Monitoring of Potential Hazards

Robust recognition of general audio events constitutes a topic of intensive research in the signal processing community. This work presents an efficient methodology for acoustic surveillance of atypical situat...

Authors: Stavros Ntalampiras, Ilyas Potamitis and Nikos Fakotakis

Performance Study of Objective Speech Quality Measurement for Modern Wireless-VoIP Communications

Wireless-VoIP communications introduce perceptual degradations that are not present with traditional VoIP communications. This paper investigates the effects of such degradations on the performance of three st...

Authors: TiagoH Falk and Wai-Yip Chan

Optimization of an Image-Based Talking Head System

This paper presents an image-based talking head system, which includes two parts: analysis and synthesis. The audiovisual analysis part creates a face model of a recorded human subject, which is composed of a ...

Authors: Kang Liu and Joern Ostermann

On the Importance of Audiovisual Coherence for the Perceived Quality of Synthesized Visual Speech

Audiovisual text-to-speech systems convert a written text into an audiovisual speech signal. Typically, the visual mode of the synthetic speech is synthesized separately from the audio, the latter being either...

Authors: Wesley Mattheyses, Lukas Latacz and Werner Verhelst

Adaptive V/UV Speech Detection Based on Characterization of Background Noise

The paper presents an adaptive system for Voiced/Unvoiced (V/UV) speech detection in the presence of background noise. Genetic algorithms were used to select the features that offer the best V/UV detection acc...

Authors: F Beritelli, S Casale, A Russo and S Serrano

Signal Processing Implementation and Comparison of Automotive Spatial Sound Rendering Strategies

Design and implementation strategies of spatial sound rendering are investigated in this paper for automotive scenarios. Six design methods are implemented for various rendering modes with different number of ...

Authors: MingsianR Bai and Jhih-Ren Hong

Automatic Speech Recognition Systems for the Evaluation of Voice and Speech Disorders in Head and Neck Cancer

In patients suffering from head and neck cancer, speech intelligibility is often restricted. For assessment and outcome measurements, automatic speech recognition systems have previously been shown to be appro...

Authors: Andreas Maier, Tino Haderlein, Florian Stelzle, Elmar Nöth, Emeka Nkenke, Frank Rosanowski, Anne Schützenberger and Maria Schuster

Musical Sound Separation Based on Binary Time-Frequency Masking

The problem of overlapping harmonics is particularly acute in musical sound separation and has not been addressed adequately. We propose a monaural system based on binary time-frequency masking with an emphasi...

Authors: Yipeng Li and DeLiang Wang

Analysis of Salient Feature Jitter in the Cochlea for Objective Prediction of Temporally Localized Distortion in Synthesized Speech

Temporally localized distortions account for the highest variance in subjective evaluation of coded speech signals (Sen (2001) and Hall (2001). The ability to discern and decompose perceptually relevant tempor...

Authors: Wenliang Lu and D Sen

Tracking Intermittently Speaking Multiple Speakers Using a Particle Filter

The problem of tracking multiple intermittently speaking speakers is difficult as some distinct problems must be addressed. The number of active speakers must be estimated, these active speakers must be identi...

Authors: Angela Quinlan, Mitsuru Kawamoto, Yosuke Matsusaka, Hideki Asoh and Futoshi Asano

A Decision-Tree-Based Algorithm for Speech/Music Classification and Segmentation

We present an efficient algorithm for segmentation of audio signals into speech or music. The central motivation to our study is consumer audio applications, where various real-time enhancements are often appl...

Authors: Yizhar Lavner and Dima Ruinskiy

Integrated Phoneme Subspace Method for Speech Feature Extraction

Speech feature extraction has been a key focus in robust speech recognition research. In this work, we discuss data-driven linear feature transformations applied to feature vectors in the logarithmic mel-frequ...

Authors: Hyunsin Park, Tetsuya Takiguchi and Yasuo Ariki

Analysis of Damped Mass-Spring Systems for Sound Synthesis

There are many ways of synthesizing sound on a computer. The method that we consider, called a mass-spring system, synthesizes sound by simulating the vibrations of a network of interconnected masses, springs, an...

Authors: Don Morgan and Sanzheng Qiao

An Overview of the Coding Standard MPEG-4 Audio Amendments 1 and 2: HE-AAC, SSC, and HE-AAC v2

In 2003 and 2004, the ISO/IEC MPEG standardization committee added two amendments to their MPEG-4 audio coding standard. These amendments concern parametric coding techniques and encompass Spectral Band Replic...

Authors: AC den Brinker, J Breebaart, P Ekstrand, J Engdegård, F Henn, K Kjörling, W Oomen and H Purnhagen

Recognition of Noisy Speech: A Comparative Survey of Robust Model Architecture and Feature Enhancement

Performance of speech recognition systems strongly degrades in the presence of background noise, like the driving noise inside a car. In contrast to existing works, we aim to improve noise robustness focusing ...

Authors: Björn Schuller, Martin Wöllmer, Tobias Moosmayr and Gerhard Rigoll

Analytical Features: A Knowledge-Based Approach to Audio Feature Generation

We present a feature generation system designed to create audio features for supervised classification tasks. The main contribution to feature generation studies is the notion of analytical features (AFs), a cons...

Authors: François Pachet and Pierre Roy

Comparison of Linear Prediction Models for Audio Signals

While linear prediction (LP) has become immensely popular in speech modeling, it does not seem to provide a good approach for modeling audio signals. This is somewhat surprising, since a tonal signal consistin...

Authors: Toon van Waterschoot and Marc Moonen

Language Model Adaptation Using Machine-Translated Text for Resource-Deficient Languages

Text corpus size is an important issue when building a language model (LM). This is a particularly important issue for languages where little data is available. This paper introduces an LM adaptation technique...

Authors: ArnarThor Jensson, Koji Iwano and Sadaoki Furui

Using SVM as Back-End Classifier for Language Identification

Robust automatic language identification (LID) is a task of identifying the language from a short utterance spoken by an unknown speaker. One of the mainstream approaches named parallel phone recognition langu...

Authors: Hongbin Suo, Ming Li, Ping Lu and Yonghong Yan

Intelligent Audio, Speech, and Music Processing Applications

Authors: WoonS Gan, SenM Kuo and JohnHL Hansen