Introduction. A radical tendency in modern approaches to understanding the mechanisms of the brain is the tendency of some scientists to believe that the brain is a receptor capable of capturing thoughts; the nature of the occurrence of the thoughts themselves, however, is not to be clarified. However, speech expressing thoughts is undoubtedly the result of the work of the brain, so studies of the frequency structure of speech can be the basis for considering the material structure of (...) the brain as a kind of “antenna”. In this approach, the problem of noise protection against the background of the undeniable frequency similarity of speech and music appears to us from somewhat different positions. This study raises the question of how essential the overall height of the musical system is to the perception of music (are there musical systems that are harmful or useful, in terms of their effects on the psyche). This question is also relevant to speech perception.Methodology and sources. The main sources in which the work of the brain and the essence of consciousness are considered from the positions indicated above were for us the work of American and British neurophysiologists and psychiatrists (Sam Parnia, Peter Fenwick). These scientists are studying the phenomena that accompany clinical death, and argue that at these moments the brain functions to the greatest extent as a receiving “antenna”. Assuming that any antenna is to be tuned, we are trying to identify possible ways to “tune” the brain. To do this, we propose to study the frequency characteristics of speech (in the simplest case, when singing vowels in a calm state) for their belonging to a particular musical system, as well as the peculiarities of music perception depending on the musical system (on the height of the note “la”). Varying the frequency characteristics of speech in a particular musical system can be considered, in our opinion, the main way to “tune” the brain. The methodology of the method is based on the use of frequency analysis of sound and the basic provisions of the elementary theory of music.Results and discussion. The main conclusion made by Western psychiatrists is the brain is not an organ of thought, consciousness exists independently from outside, the work of consciousness cannot be explained by the functioning of the brain – it requires a hardware check. If the neural network is an “antenna” that captures thoughts, and its “adjustment” at the physical level can be carried out (and is carried out) through sensory systems (including the hearing organ), the study of the frequency structure of speech will answer a number of important questions, including including related and higher brain functions (insight, creativity). Our experiments (Saint Petersburg Electrotechnical University, FIBS, department of EUT) showed that the influence of the “increased” or “lowered” musical-speech system on brain activity is insignificant. The study revealed the equiprobability of the frequency structure of speech. Since our brain lacks some characteristic set of frequencies – elements of a uniformly temperamental system, it is not necessary to talk about the harmful (or any other noise) effect of the “raised” and “lowered” systems due to deviation from the “internal standard”.Conclusion. In response to the assumptions made by Western experts, we proposed a frequency interpretation of the processes occurring in the brain, which, perhaps, will explain in more detail such phenomena as inspiration, discovery, etc., which occur with minimal activity of consciousness. Despite the limited methods of hardware study of factors that influence the activity of the brain and largely determine its higher functions (for example, creativity), the results of the brain's work in relation to music (both in terms of its creation and in terms of our reaction to it) are quite analyzable, which was shown in this study. The “musicality” of speech is extremely vividly represented in its frequency structure and allows one to reveal, to one degree or another, the features of the brain. (shrink)

In many communities around the world, speech to infants and small children has increased mean pitch, increased pitch range, increased vowel duration, and vowel hyper-articulation when compared to speech directed to adults. Some of these IDS and CDS features are also attested in foreigner-directed speech, which has been studied for a smaller range of languages, generally major national languages, spoken by millions of people. We examined vowel acoustics in CDS, conversational ADS, and monologues directed to a (...) foreigner in the Towet dialect of the Papuan language Nungon, spoken by 300 people in a remote region in northeastern Papua New Guinea. Previous work established that Nungon CDS entails optional use of consonant alteration, special nursery vocabulary, and special morphosyntax. This study shows that Nungon CDS to children aged 2;2–3;10 lacks vowel hyper-articulation, but still displays other common prosodic traits of CDS styles around the world: increased mean pitch and pitch range. A developmental effect was also attested, in that speech to 2-year-olds contained vowels that were significantly longer than those in speech to 3-year-olds, which in turn had vowels of similar duration to those in Nungon ADS. We also found that Nungon FDS vowel triangles, measured from monologues primarily directed to a non-native speaker, were significantly larger than those of either CDS or conversational ADS, indicating vowel hyper-articulation. The Nungon pattern may align with the patterns of vowels in Norwegian IDS, CDS, and FDS, where hyper-articulation is found in FDS, but not CDS or IDS. The languages of the New Guinea area constitute 20% of the world's languages, but neither an acoustic comparison of vowels in CDS and ADS, nor an acoustic study of FDS, has previously been completed for any language of New Guinea. The function of an FDS style in a small, closed community like those of much of New Guinea may differ from that in larger societies, since there are very few non-native speakers of Nungon. Thus, this study uses monologues recorded with a foreign researcher as interlocutor to study Nungon FDS. (shrink)

The production of emotional speech is determined by the movement of the speaker’s tongue, lips, and jaw. In order to combine articulatory data and acoustic data of speakers, articulatory-to-acoustic conversion of emotional speech has been studied. In this paper, parameters of LSSVM model have been optimized using the PSO method, and the optimized PSO-LSSVM model was applied to the articulatory-to-acoustic conversion. The root mean square error and mean Mel-cepstral distortion have been used to evaluate the results of conversion; (...) the evaluated result illustrates that MMCD of MFCC is 1.508 dB, and RMSE of the second formant is 25.10 Hz. The results of this research can be further applied to the feature fusion of emotion speech recognition to improve the accuracy of emotion recognition. (shrink)

Speech perception under adverse conditions is a multistage process involving a dynamic interplay among acoustic, cognitive, and linguistic factors. Nevertheless, prior research has primarily focused on factors within this complex system in isolation. The primary goal of the present study was to examine the interaction between processing depth and the acoustic challenge of noise and its effect on processing effort during speech perception in noise. Two tasks were used to represent different depths of processing. The speech recognition (...) task involved repeating back a sentence after auditory presentation, while the tiredness judgment task entailed a subjective judgment of whether the speaker sounded tired. The secondary goal of the study was to investigate whether pupil response to alteration of dynamic pitch cues stems from difficult linguistic processing of speech content in noise or a perceptual novelty effect due to the unnatural pitch contours. Task-evoked peak pupil response from two groups of younger adult participants with typical hearing was measured in two experiments. Both tasks were implemented in both experiments, and stimuli were presented with background noise in Experiment 1 and without noise in Experiment 2. Increased peak pupil dilation was associated with deeper processing, particularly in the presence of background noise. Importantly, there is a non-additive interaction between noise and task, as demonstrated by the heightened peak pupil dilation to noise in the speech recognition task as compared to in the tiredness judgment task. Additionally, peak pupil dilation data suggest dynamic pitch alteration induced an increased perceptual novelty effect rather than reflecting effortful linguistic processing of the speech content in noise. These findings extend current theories of speech perception under adverse conditions by demonstrating that the level of processing effort expended by a listener is influenced by the interaction between acoustic challenges and depth of linguistic processing. The study also provides a foundation for future work to investigate the effects of this complex interaction in clinical populations who experience both hearing and cognitive challenges. (shrink)

While acoustic analysis methods have become a commodity in voice emotion research, experiments that attempt not only to describe but to computationally manipulate expressive cues in emotional voice...

Locus equations are supposed to capture a perceptual invariant of place of articulation in consonants. Synthetic speech data show that human classification deviates systematically from the predictions of locus equations. The few studies that have contrasted predictions from competing theories yield mixed results, indicating that no current theory adequately characterizes the perceptual mapping from sound to phonetic symbol.

This commentary focuses on the nature of combinatorial properties for speech and the locus equation. The presence of some overlap in locus equation space suggests that this higher order property may not be strictly invariant and may require other cues or properties for the perception of place of articulation. Moreover, combinatorial analysis in two-dimensional space and the resultant linearity appear to have a “special” status in the development of this theoretical framework. However, place of articulation is only one of (...) many phonetic dimensions in language. It is suggested that a multidimensional space including patterns derived in the frequency, amplitude, and time domains will be needed to characterize the phonetic categories of speech, and that although the derived properties ultimately may not meet the conditions of linearity, they will reflect a higher order acoustic invariance. (shrink)

It seems trivial to identify sound sequences as music or speech, particularly when the sequences come from different sound sources, such as an orchestra and a human voice. Can we also easily distinguish these categories when the sequence comes from the same sound source? On the basis of which acoustic features? We investigated these questions by examining listeners’ classification of sound sequences performed by an instrument intertwining both speech and music: the dùndún talking drum. The dùndún is commonly (...) used in south-west Nigeria as a musical instrument but is also perfectly fit for linguistic usage in what has been described as speech surrogates in Africa. One hundred seven participants from diverse geographical locations (15 different mother tongues represented) took part in an online experiment. Fifty-one participants reported being familiar with the dùndún talking drum, 55% of those being speakers of Yorùbá. During the experiment, participants listened to 30 dùndún samples of about 7s long, performed either as music or Yorùbá speech surrogate (n= 15 each) by a professional musician, and were asked to classify each sample as music or speech-like. The classification task revealed the ability of the listeners to identify the samples as intended by the performer, particularly when they were familiar with the dùndún, though even unfamiliar participants performed above chance. A logistic regression predicting participants’ classification of the samples from several acoustic features confirmed the perceptual relevance of intensity, pitch, timbre, and timing measures and their interaction with listener familiarity. In all, this study provides empirical evidence supporting the discriminating role of acoustic features and the modulatory role of familiarity in teasing apart speech and music. (shrink)

The debate on the origin of the locus equation is circular. In this commentary the locus equation is obtained by way of a theoretical model based on acoustics without recourse to articulatory knowledge or perceptual constraints. The proposed model is driven by criteria of minimum energy and maximum simplicity.

This article explores and examines research in the field of human vocalization, proposing an evolutionary sequence for human acoustic perception and productive response. This involves updating and extending Charles Darwin’s 1871 proposal that musical communi­cation predated language, while providing the anatomical and behavioral foundations for the articulacy on which it depends. In presenting evidence on which a new consensus regarding the emergence of human vocal ability may be based, we present and review contributions from a wide range of disciplines, illustrating (...) that the phenomenon of human musicality may have had more of a core function in shaping our anatomy and culture than has hitherto been recognized. Essential to the adaptive sequence on which this depends is human perceptual and productive response to the properties of the Harmonic Series. Both music and language have emerged from the auditory and performative consequences of this relationship. (shrink)

Suprasegmental acoustic patterns in speech can convey meaningful information and affect listeners' interpretation in various ways, including through systematic analog mapping of message‐relevant information onto prosody. We examined whether the effect of analog acoustic variation is governed by the acoustic properties themselves. For example, fast speech may always prime the concept of speed or a faster response. Alternatively, the effect may be modulated by the context‐dependent interpretation of those properties; the effect of rate may depend on how listeners (...) construe its meaning in the immediate linguistic or communicative context. In two experiments, participants read short scenarios that implied, or did not imply, urgency. Scenarios were followed by recorded instructions, spoken at varying rates. The results show that speech rate had an effect on listeners' response speed; however, this effect was modulated by discourse context. Speech rate affected response speed following contexts that emphasized speed, but not without such contextual information. (shrink)

This paper implements the continuous Hindi Automatic Speech Recognition (ASR) system using the proposed integrated features vector with Recurrent Neural Network (RNN) based Language Modeling (LM). The proposed system also implements the speaker adaptation using Maximum-Likelihood Linear Regression (MLLR) and Constrained Maximum likelihood Linear Regression (C-MLLR). This system is discriminatively trained by Maximum Mutual Information (MMI) and Minimum Phone Error (MPE) techniques with 256 Gaussian mixture per Hidden Markov Model(HMM) state. The training of the baseline system has been done (...) using a phonetically rich Hindi dataset. The results show that discriminative training enhances the baseline system performance by up to 3%. Further improvement of ~7% has been recorded by applying RNN LM. The proposed Hindi ASR system shows significant performance improvement over other current state-of-the-art techniques. (shrink)

This investigation examined whether speakers produce reliable prosodic correlates to meaning across semantic domains and whether listeners use these cues to derive word meaning from novel words. Speakers were asked to produce phrases in infant‐directed speech in which novel words were used to convey one of two meanings from a set of antonym pairs (e.g., big/small). Acoustic analyses revealed that some acoustic features were correlated with overall valence of the meaning. However, each word meaning also displayed a unique acoustic (...) signature, and semantically related meanings elicited similar acoustic profiles. In two perceptual tests, listeners either attempted to identify the novel words with a matching meaning dimension (picture pair) or with mismatched meaning dimensions. Listeners inferred the meaning of the novel words significantly more often when prosody matched the word meaning choices than when prosody mismatched. These findings suggest that speech contains reliable prosodic markers to word meaning and that listeners use these prosodic cues to differentiate meanings. That prosody is semantic suggests a reconceptualization of traditional distinctions between linguistic and nonlinguistic properties of spoken language. (shrink)

Although laughter plays an essential part in emotional vocal communication, little is known about the acoustical correlates that encode different emotional dimensions. In this study we examined the acoustical structure of laughter sounds differing along four emotional dimensions: arousal, dominance, sender's valence, and receiver-directed valence. Correlation of 43 acoustic parameters with individual emotional dimensions revealed that each emotional dimension was associated with a number of vocal cues. Common patterns of cues were found with emotional expression in speech, supporting the (...) hypothesis of a common underlying mechanism for the vocal expression of emotions. (shrink)

English second language learners often experience difficulties in producing native-like English lexical stress. It is unknown which acoustic correlates, such as fundamental frequency (F0), duration, and intensity, are the most problematic for Chinese dialect speakers. The present study investigated the prosodic transfer effects of first language (L1) regional dialects on the production of English stress contrasts. Native English speakers (N = 20) and Chinese learners (N = 60) with different dialect backgrounds (Beijing, Changsha, and Guangzhou dialects) produced the same stimulus (...) including both trochaic and iambic patterns. Results showed that (a) all participants produced the stressed syllable with greater values of F0, duration, and intensity; (b) Native speakers of English employed an exquisite combination of F0, duration, and intensity, while the dialect groups transfer their native prosody into their production of English lexical stress, resulting in the deviation or abnormality of acoustic cues. Results suggest that L1 native dialect background is considered as a potentially influential factor which may transfer in L2 speech encoding and decoding process. (shrink)

Neuroethological investigations of mammalian and avian auditory systems have documented species-specific specializations for processing complex acoustic signals that could, if viewed in abstract terms, have an intriguing and striking relevance for human speech sound categorization and representation. Each species forms biologically relevant categories based on combinatorial analysis of information-bearing parameters within the complex input signal. This target article uses known neural models from the mustached bat and barn owl to develop, by analogy, a conceptualization of human processing of consonant (...) plus vowel sequences that offers a partial solution to the noninvariance dilemma the locus equations orderly output constraint”) is hypothesized based on the notion of an evolutionarily conserved auditory-processing strategy. High correlation and linearity between critical parameters in the speech signal that help to cue place of articulation categories might have evolved to satisfy a preadaptation by mammalian auditory systems for representing tightly correlated, linearly related components of acoustic signals. (shrink)

This article concerns sound aesthetic preferences for European foreign languages. We investigated the phonetic-acoustic dimension of the linguistic aesthetic pleasure to describe the “music” found in European languages. The Romance languages, French, Italian, and Spanish, take a lead when people talk about melodious language – the music-like effects in the language (a.k.a., phonetic chill). On the other end of the melodiousness spectrum are German and Arabic that are often considered sounding harsh and un-attractive. Despite the public interest, limited research has (...) been conducted on the topic of phonaesthetics, i.e., the subfield of phonetics that is concerned with the aesthetic properties of speech sounds (Crystal, 2008). Our goal is to fill the existing research gap by identifying the acoustic features that drive the auditory perception of language sound beauty. What is so music-like in the language that makes people say “it is music in my ears”? We had 45 central European participants listening to 16 auditorily presented European languages and rating each language in terms of 22 binary characteristics (e.g., beautiful – ugly and funny – boring) plus indicating their language familiarities, L2 backgrounds, speaker voice liking, demographics, and musicality levels. Findings revealed that all factors in complex interplay explain a certain percentage of variance: familiarity and expertise in foreign languages, speaker voice characteristics, phonetic complexity, musical acoustic properties, and finally musical expertise of the listener. The most important discovery was the trade-off between speech tempo and so-called linguistic melody (pitch variance): the faster the language, the flatter/more atonal it is in terms of the pitch (speech melody), making it highly appealing acoustically (sounding beautiful and sexy), but not so melodious in a “musical” sense. (shrink)

Humans have inherited from their remotest mammalian ancestors an integration of the sensory and motor systems that permits the exchange of signals and information, led by an instinctive response to harmonicity. The transition, from capacity for animal communication involving calls, facial expression and gestures, to modern human culture that embraces language, music, and dance, has resulted from anatomical adaptations such as upright posture, a distinct oro-facial and respiratory tract arrangement, and important changes in neural architecture, connectivity and plasticity. A key (...) development on which modern human vocal abilities depend was the achievement of a feedback loop between the perception and production of voiced sound that allows precise matching, imitation, and meaningful variation, of the acoustic properties: fundamental frequency, duration, amplitude, and timbre; all contributing to the capacity to coordinate simultaneous participation. These are the four specific properties that influence our sensations of sound. They play parallel and complementary roles in both language and vocal music, represented in blended synchrony such as unison song and collective speech as well as temporally organised and coordinated sequences such as call-and-response and polyphony. In turn, responding especially to the properties of the Harmonic Series, such features inform the musical employment of tools – musical instruments – that make use of materials available in the local environment (skin, bone, stone, bamboo, wood, etc.) to provide increased range and loudness as well as alternative timbres to those produced by the voice. We propose a framework by which the adaptations essential to such universal behaviours may have arisen, drawing on an extensive and varied literature to explore the potential of this position for illuminating the nature of human musicality and its relationship to language development. (shrink)

The overall goal of speech perception research is to explain how spoken language is recognized and understood. In the current research framework it is assumed that the key to achieving this overall goal is to solve the lack of invariance problem. But nearly half a century of sustained effort in a variety of theoretical perspectives has failed to solve this problem. Indeed, not only has the problem not been solved, virtually no empirical candidates for solving the problem have been (...) produced. One explanation for this lack of progress is simply that no theory has yet hit upon the correct set of invariant properties. Another explanation is that the goal of solving the lack of invariance problem is itself misguided. The most basic claim of this dissertation is that the latter explanation is correct. ;The lack of progress in explaining speech perception exhibited by the current research framework, I argue, is not, in the first instance, due to the failure of individual theories to solve the lack of invariance problem, but rather to the common background assumption that doing so is in fact the key to explaining speech perception. ;My overall argument in support of this basic claim has three main components: criticism of the empirical results of research in the current framework; criticism of the formulation of theories generated in the current research framework; and the availability of an alternative account of phonetic structure. ;The heart of my argument is an analysis of the character of the theoretical weaknesses of three theories of speech perception: the motor theory of speech perception, the ecological theory of speech perception, and the theory of acoustic invariance. I show that, in each case, the particular theoretical problems result from trying to satisfy the common goal of identifying invariant properties of phonetic percepts. ;I analyze the methodological error embodied in the current approach to explaining speech perception as, in general, one of abstracting the wrong kinds of properties from the detail of the speech event, and, in particular, of abstracting away from dynamic and context-dependent properties. (shrink)

Any account of “what is special about the human brain” (Passingham 2008) must specify the neural basis of our unique ability to produce speech and delineate how these remarkable motor capabilities could have emerged in our hominin ancestors. Clinical data suggest that the basal ganglia provide a platform for the integration of primate-general mechanisms of acoustic communication with the faculty of articulate speech in humans. Furthermore, neurobiological and paleoanthropological data point at a two-stage model of the phylogenetic evolution (...) of this crucial prerequisite of spoken language: (i) monosynaptic refinement of the projections of motor cortex to the brainstem nuclei that steer laryngeal muscles, presumably, as part of a “phylogenetic trend” associated with increasing brain size during hominin evolution; (ii) subsequent vocal-laryngeal elaboration of cortico-basal ganglia circuitries, driven by human-specificFOXP2mutations.;>This concept implies vocal continuity of spoken language evolution at the motor level, elucidating the deep entrenchment of articulate speech into a “nonverbal matrix” (Ingold 1994), which is not accounted for by gestural-origin theories. Moreover, it provides a solution to the question for the adaptive value of the “first word” (Bickerton 2009) since even the earliest and most simple verbal utterances must have increased the versatility of vocal displays afforded by the preceding elaboration of monosynaptic corticobulbar tracts, giving rise to enhanced social cooperation and prestige. At the ontogenetic level, the proposed model assumes age-dependent interactions between the basal ganglia and their cortical targets, similar to vocal learning in some songbirds. In this view, the emergence of articulate speech builds on the “renaissance” of an ancient organizational principle and, hence, may represent an example of “evolutionary tinkering” (Jacob 1977). (shrink)

To a first-order approximation we can place most worship services on a continuum between clarity and mystery, depending on the setting and content of the service. This liturgical space can be thought of as a combination of the physical acoustics of the worship space and the qualities of the sound created during the worship service. A very clear acoustic channel emphasizes semantic content, especially speech intelligibility. An immersive, reverberant acoustic emphasizes mystery and music. One of the chief challenges (...) in acoustical design is the fact that both clarity and immersion are subjectively preferred by audiences, yet these two goals are almost mutually exclusive of one another. The movement along this continuum in liturgical space can also be seen in the religious contexts for many of the worship spaces constructed in the West in the last two millennia. In the case of religious ceremony, a free field acoustic environment provides more clarity and precision in the spoken word received from God and given to the congregation. Yet a diffuse field environment provides an embodied, otherworldly sense of the supernatural: the mystery of the faith received which cannot merely be put into words. This tension is perceptible in many of the religious controversies in the West during this time period. This article examines the history of the spaces used by early Western Catholic Christians as well as those of the traditions—Lutheran and Calvinist—that left the Catholic faith during the 16th century Reformation. By considering the stated goals of these traditions alongside the architectural and liturgical innovations they created, it can be seen that emergent liturgical spaces mirror the assumptions of their respective traditions regarding the proper balance between semantic and aesthetic communication during the worship service. The Reformed faiths' emphasis on the power of the Word is reflected in the liturgical space of their services, while the Catholic faith gave greater priority to the role of Mystery, in their liturgical space as well as their explicit theology. Once constructed, these spaces also aid the cultural transmission of the sung or spoken liturgy of each tradition to future generations. (shrink)

Aim: The present work proposes the study of the neuromotor activity of the masseter-jaw-tongue articulation during diadochokinetic exercising to establish functional statistical relationships between surface Electromyography, 3D Accelerometry, and acoustic features extracted from the speech signal, with the aim of characterizing Hypokinetic Dysarthria. A database of multi-trait signals of recordings from an age-matched control and PD participants are used in the experimental study. Hypothesis: The main assumption is that information between sEMG and 3D acceleration, and acoustic features may be (...) quantified using linear regression methods. Methods: Recordings from a cohort of eight age-matched control participants and eight PD participants were collected during the utterance of a diadochokinetic exercise. The dynamic and acoustic absolute kinematic velocities produced during the exercises were estimated by acoustic filter inversion and numerical integration and differentiation of the speech signal. The amplitude distributions of the absolute kinematic and acoustic velocities are estimated to allow comparisons in terms of Mutual Information. Results: The regression results show the relationships between sEMG and dynamic and acoustic estimates. The projection methodology may help in understanding the basic neuromotor muscle activity regarding neurodegenerative speech in remote monitoring neuromotor and neurocognitive diseases using speech as the vehicular tool, and in the study of other speech-related disorders. The study also showed strong and significant cross-correlations between articulation kinematics, both for the control and the PD cohorts. The absolute kinematic variables presents an observable difference for the PD participants compared to the control group. Conclusion: Kinematic distributions derived from acoustic analysis may be useful biomarkers toward characterizing HD in neuromotor disorders providing new insights into PD. (shrink)

It is well known that the unpredictable speech production brought on by stress from the task at hand has a significant negative impact on the performance of speech processing algorithms. Speech therapy benefits from being able to detect stress in speech. Speech processing performance suffers noticeably when perceptually produced stress causes variations in speech production. Using the acoustic speech signal to objectively characterize speaker stress is one method for assessing production variances brought on (...) by stress. Real-world complexity and ambiguity make it difficult for decision-makers to express their conclusions with clarity in their speech. In particular, the Neutrosophic speech algorithm is used to encode the language variables because they cannot be computed directly. Neutrosophic sets are used to manage indeterminacy in a practical situation. Existing algorithms are used except for stress on Neutrosophic speech recognition. The creation of algorithms that calculate, categorize, or differentiate between different stress circumstances. Understanding stress and developing strategies to combat its effects on speech recognition and human-computer interaction system are the goals of this recognition. (shrink)

The effort to understand speech perception on the basis of relationships between acoustic parameters of speech sounds is to be recommended. Neural specializations (combination-sensitivity) for echolocation, communication, and sound localization probably constitute the common mechanisms of vertebrate auditory processing and may be essential for speech production as well as perception. There is, however, no need for meaningful maps.

An explicit feature of the World Health Organisation’s response to the COVID-19 pandemic has been to ensure that naming conventions, both for the disease itself and for the variants of its underlying virus, should not have a stigmatising effect on any one population or region. An implicit feature of this undertaking is the recognition that the relation between ‘what is said’ and ‘what is heard’ involves an ongoing and even generative tension that cannot be mapped following a defined set of (...) coordinates. The reason for this, the following paper claims, employing the work of Barbara Cassin, is that there is a uniquely performative (epideictic) aspect to language – one that takes place in a uniquely non-globalised space whose extension remains unscripted or extemporised, a space that is often distended and sometimes localisable but ultimately indivisible. Such a space, this paper shows, is one oriented by an understanding of rhetoric whereby utterances obtain according to the actual use [chreia] or decisive moment [kairos] – as opposed to any definitive place [topos] – of what is said. (shrink)

Inner speech has been shown to vary in form along several dimensions. Along condensation, condensed inner speech forms have been described, that are supposed to be deprived of acoustic, phonological and even syntactic qualities. Expanded forms, on the other extreme, display articulatory and auditory properties. Along dialogality, inner speech can be monologal, when we engage in internal soliloquy, or dialogal, when we recall past conversations or imagine future dialogs involving our own voice as well as that of (...) others addressing us. Along intentionality, it can be intentional (when we deliberately rehearse material in short-term memory) or it can arise unintentionally (during mind wandering). We introduce the ConDialInt model, a neurocognitive predictive control model of inner speech that accounts for its varieties along these three dimensions. ConDialInt spells out the condensation dimension by including inhibitory control at the conceptualization, formulation or articulatory planning stage. It accounts for dialogality, by assuming internal model adaptations and by speculating on neural processes underlying perspective switching. It explains the differences between intentional and spontaneous varieties in terms of monitoring. We present an fMRI study in which we probed varieties of inner speech along dialogality and intentionality, to examine the validity of the neuroanatomical correlates posited in ConDialInt. Condensation was also informally tackled. Our data support the hypothesis that expanded inner speech recruits speech production processes down to articulatory planning, resulting in a predicted signal, the inner voice, with auditory qualities. Along dialogality, covertly using an avatar’s voice resulted in the activation of right hemisphere homologs of the regions involved in internal own-voice soliloquy and in reduced cerebellar activation, consistent with internal model adaptation. Switching from first-person to third-person perspective resulted in activations in precuneus and parietal lobules. Along intentionality, compared with intentional inner speech, mind wandering with inner speech episodes was associated with greater bilateral inferior frontal activation and decreased activation in left temporal regions. This is consistent with the reported subjective evanescence and presumably reflects condensation processes. Our results provide neuroanatomical evidence compatible with predictive control and in favor of the assumptions made in the ConDialInt model. (shrink)

Two computer simulations are investigated that model interaction of cultural evolution of language and biological evolution of adaptations to language. Both are agent‐based models in which a population of agents imitates each other using realistic vowels. The agents evolve under selective pressure for good imitation. In one model, the evolution of the vocal tract is modeled; in the other, a cognitive mechanism for perceiving speech accurately is modeled. In both cases, biological adaptations to using and learning speech evolve, (...) even though the system of speech sounds itself changes at a more rapid time scale than biological evolution. However, the fact that the available acoustic space is used maximally (a self‐organized result of cultural evolution) is constant, and therefore biological evolution does have a stable target. This work shows that when cultural and biological traits are continuous, their co‐evolution may lead to cognitive adaptations that are strong enough to detect empirically. (shrink)

Developmental dyslexia is considered to be most effectively addressed with preventive phonics-based interventions, including grapheme-phoneme coupling and blending exercises. These intervention types require intact speech perception abilities, given their large focus on exercises with auditorily presented phonemes. Yet some children with dyslexia experience problems in this domain due to a poorer sensitivity to rise times, i.e., rhythmic acoustic cues present in the speech envelope. As a result, the often subtle speech perception problems could potentially constrain an optimal (...) response to phonics-based interventions in at-risk children. The current study therefore aimed to extend existing research by examining the presence of potential speech perception deficits in pre-readers at cognitive risk for dyslexia when compared to typically developing peers and to explore the added value of a preventive auditory intervention for at-risk pre-readers, targeting rise time sensitivity, on speech perception and other reading-related skills. To obtain the first research objective, we longitudinally compared speech-in-noise perception between 28 5-year-old pre-readers with and 30 peers without a cognitive risk for dyslexia during the second half of the third year of kindergarten. The second research objective was addressed by exploring growth in speech perception and other reading-related skills in an independent sample of 62 at-risk 5-year-old pre-readers who all combined a 12-week preventive phonics-based intervention with an auditory story listening intervention. In half of the sample, story recordings contained artificially enhanced rise times, while in the other half, stories remained unprocessed. Results revealed a slower speech-in-noise perception growth in the at-risk compared to the non-at-risk group, due to an emerged deficit at the end of kindergarten. Concerning the auditory intervention effects, both intervention groups showed equal growth in speech-in-noise perception and other reading-related skills, suggesting no boost of envelope-enhanced story listening on top of the effect of combining GraphoGame-Flemish with listening to unprocessed stories. These findings thus provide evidence for a link between speech perception problems and dyslexia, yet do not support the potential of the auditory intervention in its current form. (shrink)

Two computer simulations are investigated that model interaction of cultural evolution of language and biological evolution of adaptations to language. Both are agent-based models in which a population of agents imitates each other using realistic vowels. The agents evolve under selective pressure for good imitation. In one model, the evolution of the vocal tract is modeled; in the other, a cognitive mechanism for perceiving speech accurately is modeled. In both cases, biological adaptations to using and learning speech evolve, (...) even though the system of speech sounds itself changes at a more rapid time scale than biological evolution. However, the fact that the available acoustic space is used maximally is constant, and therefore biological evolution does have a stable target. This work shows that when cultural and biological traits are continuous, their co-evolution may lead to cognitive adaptations that are strong enough to detect empirically. (shrink)

Speech recognition technology has played an indispensable role in realizing human-computer intelligent interaction. However, most of the current Chinese speech recognition systems are provided online or offline models with low accuracy and poor performance. To improve the performance of offline Chinese speech recognition, we propose a hybrid acoustic model of deep convolutional neural network, long short-term memory, and deep neural network. This model utilizes DCNN to reduce frequency variation and adds a batch normalization layer after its convolutional (...) layer to ensure the stability of data distribution, and then use LSTM to effectively solve the gradient vanishing problem. Finally, the fully connected structure of DNN is utilized to efficiently map the input features into a separable space, which is helpful for data classification. Therefore, leveraging the strengths of DCNN, LSTM, and DNN by combining them into a unified architecture can effectively improve speech recognition performance. Our model was tested on the open Chinese speech database THCHS-30 released by the Center for Speech and Language Technology of Tsinghua University, and it was concluded that the DLD model with 3 layers of LSTM and 3 layers of DNN had the best performance, reaching 13.49% of words error rate. (shrink)

Spoken word recognition involves a perceptual tradeoff between the reliance on the incoming acoustic signal and knowledge about likely sound categories and their co-occurrences as words. This study examined how adult second language (L2) learners navigate between acoustic-based and knowledge-based spoken word recognition when listening to highly variable, multi-talker truncated speech, and whether this perceptual tradeoff changes as L2 listeners gradually become more proficient in their L2 after multiple months of structured classroom learning. First language (L1) Mandarin Chinese listeners (...) and L1 English-L2 Mandarin adult listeners took part in a gating experiment. The L2 listeners were tested twice—once at the start of their intermediate/advanced L2 language class and again two months later. L1 listeners were only tested once. Participants were asked to identify syllable-tone words that varied in syllable token frequency (high/low according to a spoken word corpus) and syllable-conditioned tonal probability (most probable/least probable in speech given the syllable). The stimuli were recorded by 16 different talkers and presented at eight gates ranging from onset-only (gate 1) through onset+40 ms increments (gates 2 through 7) to the full word (gate 8). Mixed-effects regression modeling was used to compare performance to our previous study which used single-talker stimuli (Wiener, Lee, & Tao, 2019). The results indicated that multi-talker speech caused both L1 and L2 listeners to rely greater on knowledge-based processing of tone. L1 listeners were able to draw on distributional knowledge of syllable-tone probabilities in early gates and switch to predominantly acoustic-based processing when more of the signal was available. In contrast, L2 listeners, with their limited experience with talker range normalization, were less able to effectively transition from probability-based to acoustic-based processing. Moreover, for the L2 listeners, the reliance on such distributional information for spoken word recognition appeared to be conditioned by the nature of the acoustic signal. Single-talker speech did not result in the same pattern of probability-based tone processing, suggesting that knowledge-based processing of L2 speech may only occur under certain acoustic conditions, such as multi-talker speech. (shrink)

Acoustic speech output results from coordinated articulation of dozens of muscles, bones and cartilages of the vocal mechanism. While we commonly take the fluency and speed of our speech productions for granted, the neural mechanisms facilitating the requisite muscular control are not completely understood. Previous neuroimaging and electrophysiology studies of speech sensorimotor control has typically concentrated on speech sounds (i.e., phonemes, syllables and words) in isolation; sentence-length investigations have largely been used to inform coincident linguistic processing. (...) In this study, we examined the neural representations of segmental features (place and manner of articulation, and voicing status) in the context of fluent, continuous speech production. We used recordings from the cortical surface (electrocorticography (ECoG)) to simultaneously evaluate the spatial topography and temporal dynamics of the neural correlates of speech articulation that may mediate the generation of hypothesized gestural or articulatory scores. We found that the representation of place of articulation involved broad networks of brain regions during all phases of speech production: preparation, execution and monitoring. In contrast, manner of articulation and voicing status were dominated by auditory cortical responses after speech had been initiated. These results provide a new insight into the articulatory and auditory processes underlying speech production in terms of their motor requirements and acoustic correlates. (shrink)

Locus equations contain an economical set of hidden (i.e., not directly observable in the data) parameters of speech that provide an elegant way of characterizing the ubiquitous context-dependent behaviors exhibited in speech acoustics. These hidden parameters can be effectively exploited to constrain the huge set of context-dependent speech model parameters currently in use in modern, mainstream speech recognition technology.

What are the factors that contribute to (or inhibit) diachronic sound change? While acoustically motivated sound changes are well documented, research on the articulatory and audiovisual-perceptual aspects of sound change is limited. This paper investigates the interaction of articulatory variation and audiovisual speech perception in the Northern Cities Vowel Shift (NCVS), a pattern of sound change observed in the Great Lakes region of the United States. We focus specifically on the maintenance of the contrast between the vowels /ɑ/ and (...) /ɔ/, both of which are fronted as a result of the NCVS. We present results from two experiments designed to test how the NCVS is produced and perceived. In the first experiment, we present data from an articulatory and acoustic analysis of the production of fronted /ɑ/ and /ɔ/. We find that some speakers distinguish /ɔ/ from /ɑ/ with a combination of both tongue position and lip rounding, while others do so using either tongue position or lip rounding alone. For speakers who distinguish /ɔ/ from /ɑ/ along only one articulatory dimension, /ɑ/ and /ɔ/ are acoustically more similar than for speakers who produce multiple articulatory distinctions. While all three groups of speakers maintain some degree of acoustic contrast between the vowels, the question is raised as to whether these articulatory strategies differ in their perceptibility. In the perception experiment, we test the hypothesis that visual speech cues play a role in maintaining contrast between the two sounds. The results of this experiment suggest that articulatory configurations in which /ɔ/ is produced with unround lips are perceptually weaker than those in which /ɔ/ is produced with rounding, even though these configurations result in acoustically similar output. We argue that these findings have implications for theories of sound change and variation in at least two respects: 1) visual cues can shape phonological systems through misperception-based sound change, and 2) phonological systems may be optimized not only for auditory but also for visual perceptibility. (shrink)

We assessed how synchronous speech listening and lipreading affects speech recognition in acoustic noise. In simple audiovisual perceptual tasks, inverse effectiveness is often observed, which holds that the weaker the unimodal stimuli, or the poorer their signal-to-noise ratio, the stronger the audiovisual benefit. So far, however, inverse effectiveness has not been demonstrated for complex audiovisual speech stimuli. Here we assess whether this multisensory integration effect can also be observed for the recognizability of spoken words. To that end, (...) we presented audiovisual sentences to 18 native-Dutch normal-hearing participants, who had to identify the spoken words from a finite list. Speech-recognition performance was determined for auditory-only, visual-only (lipreading) and auditory-visual conditions. To modulate acoustic task difficulty, we systematically varied the auditory signal-to-noise ratio. In line with a commonly-observed multisensory enhancement on speech recognition, audiovisual words were more easily recognized than auditory-only words (recognition thresholds of -15 dB and -12 dB, respectively). We here show that the difficulty of recognizing a particular word, either acoustically or visually, determines the occurrence of inverse effectiveness in audiovisual word integration. Thus, words that are better heard or recognized through lipreading, benefit less from bimodal presentation. Audiovisual performance at the lowest acoustic signal-to-noise ratios (45%) fell below the visual recognition rates (60%), reflecting an actual deterioration of lipreading in the presence of excessive acoustic noise. This suggests that the brain may adopt a strategy in which attention has to be divided between listening and lipreading. (shrink)

Although speech categories are defined by multiple acoustic dimensions, some are perceptually weighted more than others and there are residual effects of native-language weightings in non-native speech perception. Recent research on nonlinguistic sound category learning suggests that the distribution characteristics of experienced sounds influence perceptual cue weights: Increasing variability across a dimension leads listeners to rely upon it less in subsequent category learning (Holt & Lotto, 2006). The present experiment investigated the implications of this among native Japanese learning (...) English /r/-/l/ categories. Training was accomplished using a videogame paradigm that emphasizes associations among sound categories, visual information, and players’ responses to videogame characters rather than overt categorization or explicit feedback. Subjects who played the game for 2.5 h across 5 days exhibited improvements in /r/-/l/ perception on par with 2–4 weeks of explicit categorization training in previous research and exhibited a shift toward more native-like perceptual cue weights. (shrink)