Quantitative neural models of speech acquisition and speech processing are rare. In this paper, we describe a neural model for simulating speech acquisition, speech production, and speech perception. The model is based on two important neural features: associative learning and self-organization. The model describes an SOM-based approach to speech acquisition, i.e. how speech knowledge and speaking skills are learned and stored in the context of self-organizing maps (SOMs). The model elucidates that phonetic features, such as high-low, front-back in the case of vowels, place and manner or articulation in the case of consonants and stressed vs. unstressed for syllables, result from the ordering of syllabic states at the level of a supramodal phonetic self-organizing map. After learning, the speech production and speech perception of speech items results from the co-activation of neural states within different cognitive and sensorimotor neural maps. This quantitative model gives an intuitive understanding of basic neurobiological principles from the viewpoint of speech acquisition and speech processing.

/pdf/associative-learning-and-self-organization-as-basic-wuyi2i4aj5.pdf

Associative learning and self-organization as basic principles for simulating speech acquisition, speech production, and speech perception

Emotions and ICT.- Cross-Fertilization between Studies on ICT Practices of Use and Cross-Modal Analysis of Verbal and Nonverbal Communication.- Theories without Heart.- Prosodic Characteristics and Emotional Meanings of Slovak Hot-Spot Words.- Affiliations, Emotion and the Mobile Phone.- Polish Emotional Speech Database - Recording and Preliminary Validation.- Towards a Framework of Critical Multimodal Analysis: Emotion in a Film Trailer.- Biosignal Based Emotion Analysis of Human-Agent Interactions.- Emotional Aspects in User Experience with Interactive Digital Television: A Case Study on Dyslexia Rehabilitation.- Investigation of Normalised Time of Increasing Vocal Fold Contact as a Discriminator of Emotional Voice Type.- Evaluation of Speech Emotion Classification Based on GMM and Data Fusion.- Spectral Flatness Analysis for Emotional Speech Synthesis and Transformation.- Verbal and Nonverbal Features of Computational Phonetics.- Voice Pleasantness of Female Voices and the Assessment of Physical Characteristics.- Technical and Phonetic Aspects of Speech Quality Assessment: The Case of Prosody Synthesis.- Syntactic Doubling: Some Data on Tuscan Italian.- Perception of Czech in Noise: Stability of Vowels.- Challenges in Segmenting the Czech Lateral Liquid.- Implications of Acoustic Variation for the Segmentation of the Czech Trill /r/.- Voicing in Labial Plosives in Czech.- Normalization of the Vocalic Space.- Algorithmic and Theoretical Analysis of Multimodal Interfaces.- Gaze Behaviors for Virtual Crowd Characters.- Gestural Abstraction and Restatement: From Iconicity to Metaphor.- Preliminary Prosodic and Gestural Characteristics of Instructing Acts in Polish Task-Oriented Dialogues.- Polish Children's Gesticulation in Narrating (Re-telling) a Cartoon.- Prediction of Learning Abilities Based on a Cross-Modal Evaluation of Non-verbal Mental Attributes Using Video-Game-Like Interfaces.- Automatic Sentence Modality Recognition in Children's Speech, and Its Usage Potential in the Speech Therapy.- Supporting Engagement and Floor Control in Hybrid Meetings.- Behavioral Consistency Extraction for Face Verification.- Protecting Face Biometric DCT Templates by Means of Pseudo-random Permutations.- Facial Expressions Recognition from Image Sequences.- Czech Artificial Computerized Talking Head George.- An Investigation into Audiovisual Speech Correlation in Reverberant Noisy Environments.- Articulatory Speech Re-synthesis: Profiting from Natural Acoustic Speech Data.- A Blind Source Separation Based Approach for Speech Enhancement in Noisy and Reverberant Environment.- Quantitative Analysis of the Relative Local Speech Rate.- Czech Spontaneous Speech Collection and Annotation: The Database of Technical Lectures.- BSSGUI - A Package for Interactive Control of Blind Source Separation Algorithms in MATLAB.- Accuracy Analysis of Generalized Pronunciation Variant Selection in ASR Systems.- Analysis of the Possibilities to Adapt the Foreign Language Speech Recognition Engines for the Lithuanian Spoken Commands Recognition.- MLLR Transforms Based Speaker Recognition in Broadcast Streams.

Cross-Modal Analysis of Speech, Gestures, Gaze and Facial Expressions: COST Action 2102 International Conference Prague, Czech Republic, October 15-18, 2008 Revised Selected and Invited Papers

The emergence of phonetic–phonological features in a biologically inspired model of speech processing

While a mental lexicon stores phonological, grammatical and semantic features of words, a vocal tract action repository is assumed to store inner motor and sensory representations of speech items (i.e. the sounds, syllables and words) of the speaker's native language. On the basis of a neural model of speech processing, which comprises important cognitive and sensorimotor aspects of speech production, perception, and acquisition (Speech Commun 51, 793-809, 2009), this paper will outline how a sensorimotor vocal tract action repository can be acquired in a self-organizing neural network structure which is trained using unsupervised associative learning.

http://www.phonetik.phoniatrie.rwth-aachen.de/bkroeger/documents/Kroeger_etal_2011_LNCS_b.pdf

Towards the acquisition of a sensorimotor vocal tract action repository within a neural model of speech processing

The importance of bodily movements in the production and perception of communicative actions has been shown for the spoken language modality and accounted for by a theory of communicative actions (Cogn. Process. 2010;11:187–205). In this study, the theory of communicative actions was adapted to the sign language modality; we tested the hypothesis that in the fluent production of short sign language sentences, strong-hand manual sign actions are continuously ongoing without holds, while co-manual oral expression actions (i.e. sign-related actions of the lips, jaw, and tip of the tongue) and co-manual facial expression actions (i.e. actions of the eyebrows, eyelids, etc.), as well as weak-hand actions, show considerable holds. An American Sign Language (ASL) corpus of 100 sentences was analyzed by visually inspecting each frame-to-frame difference (30 frames/s) for separating movement and hold phases for each manual, oral, and facial action. Excluding fingerspelling and signs in sentence-final position, no manual holds were found for the strong hand (0%; the weak hand is not considered), while oral holds occurred in 22% of all oral expression actions and facial holds occurred for all facial expression actions analyzed (100%). These results support the idea that in each language modality, the dominant articulatory system (vocal tract or manual system) determines the timing of actions. In signed languages, in which manual actions are dominant, holds occur mainly in co-manual oral and co-manual facial actions. Conversely, in spoken language, vocal tract actions (i.e. actions of the lips, tongue, jaw, velum, and vocal folds) are dominant; holds occur primarily in co-verbal manual and co-verbal facial actions.

Movements and Holds in Fluent Sentence Production of American Sign Language: The Action-Based Approach

The quality of static phones (e.g. vowels, fricatives, nasals, laterals) generated by articulatory speech synthesizers has reached a high level in the last years. Our goal is to expand this high quality to dynamic speech, i.e. whole syllables, words, and utterances by re-synthesizing natural acoustic speech data. Re-synthesis means that vocal tract action units or articulatory gestures, describing the succession of speech movements, are adapted spatio-temporally with respect to a natural speech signal produced by a natural "model speaker" of Standard German. This adaptation is performed using the software tool SAGA (Sound and Articulatory Gesture Alignment) that is currently under development in our lab. The resulting action unit scores are stored in a database and serve as input for our articulatory speech synthesizer. This technique is designed to be the basis for a unit selection articulatory speech synthesis in the future.

Articulatory Speech Re-synthesis: Profiting from Natural Acoustic Speech Data

Articulatory Speech Re-synthesis: Profiting from Natural Acoustic Speech Data.

In this study the gesture duration and articulator velocity in con-sonant-vowel-transitions has been analysed using electromagnetic articulography (EMA). The receiver coils where placed on the tongue, lips and teeth. We found onset and offset durations which are statistically significant for a special articulator. The duration of the offset is affected by the degree of opening of the following vowel. The acquired data is intended to tune the control model of an articulatory speech synthesizer to improve the acoustic quality of plosive-vowel-transitions.

http://www.phonetik.phoniatrie.rwth-aachen.de/bkroeger/documents/Bauer_etal_2010_LNCS.pdf

Gesture duration and articulator velocity in plosive-vowel-transitions

Communicative actions are specific movements or gestures which are accomplished by vocal tract articulators (lips, tongue, velum etc.) for speech, by facial articulators (eye brows, eye lids etc.) for co-verbal facial expression and by other bodily articulators (hands, arms etc.) for co-verbal gesturing. While action-based approaches already exist for spoken language processing it is the aim of this paper to adopt action theory for signed language processing (i.e. production and perception of sign language). Method: An action-based method for the phonetic annotation of sign language has been developed and a 100 sentence American Sign Language corpus has been analyzed using this method. Results: Five basic types of sign actions were identified, all indicating the importance of movement phases even if the goal of a gesture is to reach a specific target (e.g. specific hand shape, orientation, location, and/or direction). Conclusion: This study is a starting point for investigating sign language production quantitatively in terms of a unified action theory.

An Action-Based Concept for the Phonetic Annotation of Sign Language Gestures

Handle everyday research tasks with reliable, citation-backed results

Your personal Research Agent to handle research tasks with citation-backed results

Popular Tasks used by Researchers

How can I help with your research?

Meet SciSpace

Get more enhanced response by uploading the PDFs you want me to reference.

No relevant PDFs in your library

SciSpace is the AI research assistant for academics. Run systematic literature reviews on 280M+ papers, and write papers with cited sources. Trusted by 1M+ students, PhDs & researchers.

SciSpace | AI for Research

Analyze PDFs

Code & Manuscripts

Funding & Grants

Literature & Patents

Medical & Clinical Data

Systematic Review

Visualize & Present

Web & Data

Build a Google Scholar-like website for your research.

Build a website

Create charts and images for your research

Create a Chart

Write a paper for submission to a journal

Draft a manuscript

Patent Search

Design eye-catching scientific posters in minutes.

Scientific Poster Generation

Systematic Literature Review

One task is running at the moment. Your messages will be shown right after.

Drag and drop or click here to browse

Loved by <highlight>1 million+</highlight> researchers

Extract a list of specific topics and their sources from unstructured text

Topics

Compare and analyze relevant papers that matches with your search

Papers

Get insights from PDFs and bookmarked papers from your library

My library

Recent searches

Try searching for:

Catch AI-generated content in scholarly and non-scholarly content

{ai} Detector

Ai Writer

Get PDF Summaries, highlighted text explanations 

Chat with PDF

Effortlessly create in-text citations and bibliographies in APA and 2,500 other formats

Citation generator

Get explanations, summaries, and answers on academic papers

Ease up your research workflow with {scispace}'s cohort of exciting AI tools

Elevate your academic writing skills and convey your ideas the way you want

Paraphraser

Explore our range of reading and writing tools

Your file is being prepared and should be ready in a few minutes. If it's a large file, it might take a bit longer. You can close this window, and we'll email you the file when it's done.

You have reached a maximum limit of <strong>{limit}</strong> columns in the table. Remove at least <strong>1</strong> column to add or create another one.

Dominik Bauer

Author Tools

Chat about Author

Papers

Articulatory Speech Re-synthesis: Profiting from Natural Acoustic Speech Data

Articulatory Speech Re-synthesis: Profiting from Natural Acoustic Speech Data.

Gesture duration and articulator velocity in plosive-vowel-transitions

An Action-Based Concept for the Phonetic Annotation of Sign Language Gestures