August 16, 2015

August 16, 2015

Written by Maximus Peperkamp, M.S. Verbal Engineer

Dear Reader, 

This writing is my sixteenth response to “Talker-specific learning in speech perception” by Nygaard and Pisoni (1998). In the general discussion of their paper the researchers conclude that the “listeners who learned to attend to talker-specific attributes of the speech signal were able to use that information to aid in the recovery of the linguistic content in the acoustic speech signal.” What does it mean for listeners to be “able to attend to talker-specific attributes of the speech signal?” When we consider the fact that the listener most often must simply suck it up, we are taking a Noxious Verbal Behavior (NVB) perspective, but if we bring in the possibility that the listener can become a speaker, then the listener can let the speaker know how he or she is affecting him or her with his or her sound and the speaker can then adjust the sound of his or her voice in such a way that he or she is only positively affecting the listener. This would be an example of Sound Verbal Behavior (SVB). Thus, “attending to the talker-specific attributes of the speech signal” requires SVB, but is impossible with NVB. 

In NVB there is no feedback from the listener to the speaker in the sense that the listener can become the speaker. In NVB, there is unidirectional, hierarchical interaction in which the speaker talks at, not with the listener. In NVB there is an absence of turn-taking. The NVB speaker always demands the attention from the listener, but in SVB the speaker doesn’t demand the attention at all, because he or she generates and shares the attention with the listener, who can also become a speaker. Moreover, in SVB, the speaker is his or her own listener, but in NVB others than the listener within the skin of the speaker are the only listeners. During NVB the listener within the speaker's skin is not home, that is, the speaker is not connecting with this listener within. The reason that this occurs is because in NVB speaking and listening are happening at different rates. Only when speaking and listening are happening simultaneously and at the same rate, the speaker has SVB. 

These findings only become clear during SVB because only SVB can we address matters “at the broadest level.” In NVB we cannot, we have not and we will not be able to accurately address these matters, because NVB is based on the bias of the speaker. “This finding suggests at the broadest level that the perception of indexical or personal properties in the speech signal and the perception of linguistic properties are not independent, but rather are fundamentally linked in the perception of spoken language.” However, it is a characteristic of SVB that “indexical or personal properties in the speech signal” are “fundamentally linked” with “the perception of linguistic properties” as in NVB they are disjointed and seemingly “independent.”

This research is important, but it needs the SVB/NVB distinction to make more sense. Since this research is about the fundamental link between “perception of linguistic properties” and “indexical or personal properties”, we must explore this while we speak. Only when we verify this link while we speak will we be able to realize how different writing about talking is from talking. “This demonstration of the influence of perceptual learning of talker identity on linguistic processing has implications not only for current theories of speech perception and spoken language processing, but also more generally for theories of perceptual learning and perception.” The SVB/NVB distinction sheds light on the distortion which occurs in NVB. 

“Different kinds of talker-specific information are available in different kinds of utterances and that all levels of talker-specific information are susceptible to the effects of perceptual learning.” It's typical for NVB to dismiss the common explicit or implicit identity of the “talkers’ voice in speech perception as a source of noise that must be discarded or separated from the linguistic content.” We  accept as normal a way of talking, which, because we remain stressed is abnormal and detrimental to our relationship and health. Only by taking the time to talk about talking and by exploring while we are talking, can we “take linguistic representations out of the domain of abstract, symbolic units and into the domain of representation and memory for natural events and specific instances of these events." 

The contribution these researchers make is captured in the following sentence: “given the present findings, however, it appears that the phonetic module does “know” something about the talker’s voice.” Of course, it is all a matter of conditioning. Only to the extent that listeners have experienced SVB, do they know and can they know when they are dominated, exploited, silenced, ignored and marginalized by NVB speakers. However, the sad fact is that, by and large, people don’t receive enough SVB reinforcement to be able to withdraw from NVB. In other words, they keep being engaged in NVB and are consequently negatively affected by it.  

“Talker-specific perceptual operations are retained or developed during the course of training, and listeners find speech from familiar talkers to be more intelligible than speech from unfamiliar talkers because they are better able to disentangle talker from linguistic information." This seems to reflect what is happening in the normal course of development: “The perceptual operations that are specifically associated with unraveling the variations introduced by particular talkers could be modified to become more efficient.” Ideally, those who raise us don’t require us to “disentangle talker from linguistic information.” Ideally, we are brought up with mostly SVB.

August 15, 2015

August 15, 2015

Written by Maximus Peperkamp, M.S. Verbal Engineer

This writing is my fifteenth response to “Talker-specific learning in speech perception” by Nygaard and Pisoni (1998).  The problem with Noxious Verbal Behavior (NVB) is that it is disembodied communication. During NVB communicators become like talking heads which have no awareness at about their body. Not surprisingly, we get stuck with “abstract, symbolic units” whenever “talker-specific sensitivity” supersedes “linguistic content.” It is important to realize that this is done by the threatening speaker, who exploits the fact that the listener can be imprisoned by and consequently controlled by words. Another way of explaining this is that in NVB the listeners fail to acknowledge that the speaker’s descriptions are not the described; they don’t realize  that the speaker speaks with what Native Americans have called ‘a forked tongue.’

People who are not in touch with their feelings are always troubled by that. They long to be in touch with what they feel, but can be deluded by those who pretend to be in touch with what they feel. We describe our emotions inaccurately and get easily trapped by words which take us away from instead of get us in closer to our feelings. Such words may be part of some song, ceremony or text that was presented by some singer, poet, writer, actor, priest or guru, who supposedly knows better than the listener how to express him or herself. NVB is the kind of talking in which we can’t help but fake our emotions. When we don’t really feel our emotions, that is, when we have no awareness of our body, we cannot describe our emotions. When the speaker attains Sound Verbal Behavior (SVB), however, because he or she listens to him or herself while he or she speaks, although he or she may still have to look for the right words, he or she is quite capable of accurately expressing what he or she feels. Stated differently, the NVB speaker is constantly putting words into the mouth of the listener, but in SVB the speaker has his or her unique way of expressing him or herself. 

The authors write in the discussion part of their paper that “as overall intelligibility of the stimulus set deteriorated, listeners were more likely to bring to bear talker-specific information to aid in their transcription performance.” The authors focused on how the listener deals with the speaker, but how the speaker deals with listener was not mentioned by them. The above example describes NVB, because “talker-specific” variables deteriorate the “overall intelligibility of the stimulus” due to the hierarchical differences between the speaker and the listener. When the speaker exerts power over the listener he or she expresses NVB. Under such circumstances the listener is coerced, while he or she is experiencing a fight, flight or freeze response. Such involuntary responses take the attention away from what is being said. As a result, the NVB speaker can get away with superficiality, mediocrity, lack of knowledge and unaccountability and they can continue to brag, intimidate and be insincere.

 

Consequently, “listeners may use talker information to a greater extent in listening situations that are degraded” because they are forced and have no other choice. The “vocal attributes” of the speaker that are most familiar to the listener are those to which the listener responds innately. To recognize the sound of danger or safety in the speaker’s voice is not a cognitive, but an innate pre-verbal behavior. Although often overruled by language, this phylogenetic mechanism is still there in humans and widespread across many species. A listener’s “familiarity with a talker’s voice” is a nonverbal phenomenon. The “cocktail party” effect, which occurs when a listener is able to focus his or her auditory attention on the voice of one particular speaker, while filtering out a range of other stimuli, such as the voices of others who are also talking, is a mostly a nonverbal phenomenon. 


As the example makes clear, understanding a speaker in a noisy room depends on the listener’s familiarity with a talker’s sound. If my hypothesis is correct, listeners will be able to understand SVB speakers in a noisy room much better than NVB speakers, because the SVB speaker focuses on his or her own sound while he or she speaks. In NVB the attention of the speaker is not going to his or her sound, but to what he or she is saying. It has been  the experience of those who are familiar with the distinction between SVB and NVB that one can have SVB in noisy environment just as easily as in a silent environment. Noise in itself is not the point, but threat is. Noise can  facilitate the stimuli (Establishing Operation) which make it more likely that we will listen to ourselves while we speak.

The SVB/NVB distinction predicts that sentences will be "a rich source of talker-specific information” and “that learners are sensitive to the additional talker information in sentence-length utterances.” However, the distinction between SVB and NVB brings our attention to the kind of “talker-specific information” which only the listener deals with. Whether the listener knows it or not, is aware of it or not, recognizes it or not, he or she will always respond differently to a SVB speaker than to a NVB speaker. The NVB speaker, because of his or her demands is bound to speak shorter sentences and give orders than the SVB speaker. As the NVB speaker provides less “talker-specific information”, he or she is more difficult to understand. “Sentences appear to provide information about talker-specific acoustic–phonetic implementation strategies in addition to higher order information about idiosyncratic prosody, rhythm, and meter. During training, listeners apparently exploit all sources of information to help them learn the set of voices in this task.”

This research provides straightforward evidence for the distinction between SVB and NVB as the “results confirm the importance of the role of talker information in spoken language processing.” Listeners cannot afford to become “familiar” with a NVB speaker, as they have to remain on guard. They can and they will only be able to relax with a SVB speaker. Thus, the negative or positive affect induced in the listener by the speaker always either hinders or enhances the listener’s ability to understand what the speaker is saying. “Familiarity with talker-specific information not only aids speech perception when higher level, top-down strategies are limited, but also when several sources of linguistic information are available to the listener.” This interpretation is in my opinion incorrect because the authors are not aware about the distinction between SVB and NVB. These “higher level, top-down strategies are limited” only in NVB, but they are always stimulated and enhanced by the SVB speaker. Indeed, the NVB speaker elicits bottom-up processes, which impair and diminish the listener’s ability to make use of “top-down strategies.” Thus, only in SVB are “several sources of linguistic information available to the listener.” Stated more bluntly, the NVB speaker forces the listener into a sense of dissociation.  

“These findings suggest that the use of talker-specific information is

important in general in the perception and comprehension of spoken language and is used in conjunction with other sources of information to derive a linguistic interpretation of a talker’s utterance.” Only the SVB speaker can facilitate interaction, because only the SVB speaker continues to induce and maintain positive emotions in the listener. Amazingly, we haven’t yet gotten clear on the simple fact that as long as speakers induce negative emotions in listeners they undermine interaction. It is important to recognize that although the NVB speaker induces negative emotions in the listener, he or she isn’t experiencing negative emotions in him or herself. 


The NVB speaker is only capable of feeling his or her own negative emotions once he or she is no longer capable of dominating others. As long as he or she is able to dominate others, the NVB speaker is totally unaware about his or her own feelings, but comes across as guarded, pretentious and predetermined. The “other sources of information to derive a linguistic interpretation of a talker’s utterance” are only available with a SVB speaker, who allows for a fair amount of spontaneity. The NVB speaker always narrows down the conversation, while the SVB speaker broadens it. This is not to say that the SVB speaker prevents the listener from focusing. To the contrary, the SVB speaker creates a better, effortless focus in the listener.

August 14, 2015

August 14, 2015

Written by Maximus Peperkamp, M.S. Verbal Engineer

This writing is my fourteenth response to “Talker-specific learning in speech perception” by Nygaard and Pisoni (1998).  The authors conclude in the discussion section of their paper with “Although lexical and indexical information are arguably higher order aspects of spoken language, they may nevertheless behave like lower level perceptual dimensions” This finding supports this writer’s SVB/NVB distinction, which makes us realize that when we talk, our sound is congruent with and supporting what we say or incongruent with and therefore distracting from what we say. We  have SVB in the case of the former and NVB in the case of the latter. 

It is important that the speaker pays attention to how he or she sounds. If the distinction between SVB and NVB is not made by the speaker, as is always the case in NVB, it can only be made by the listener in response to the speaker. If this listener becomes the new speaker and is also not listening to him or herself, as is always the case in NVB, the previous speaker is not going to be convinced by someone who is not listening to him or herself, to listen to him or herself. Consequently, communicators in NVB struggle to get each other’s attention, but they are not paying attention to themselves. 

By focusing on the speaker and the listener separately, the researchers omit what is the most important aspect of verbal behavior: the speaker-as-own-listener. The SVB/NVB distinction only makes sense in the light of the speaker-as-own-listener. As long as listening to others is over-emphasized, listening to ourselves is not getting the attention. Listening to ourselves while we speak requires our attention, as the speaker who makes others listen to him or to her, but who is not listening to himself, will be talking at others, but not with them and will therefore still not feel listened to.

We only feel listened to when we listened to ourselves while we speak.

“Although all listeners received the same amount of training, only listeners who could successfully identify the talkers’ voices explicitly showed a benefit in the word recognition test.” These researchers did not think of training the talkers in identifying their own voices. The speaker, who listens to him or herself while he or she speaks, who is responsive to the listener within his or her own skin, has a very different effect on the listener outside of his or her skin. Such a SVB speaker is easier to listen to as the listener doesn’t need to differentiate between “talker-specific” and “listener-specific” variables, because the talker has already done that.

“Detailed representations of linguistic events appear to be retained in longterm memory, and linguistic categories may consist of collections of instance-specific exemplars rather than some type of abstract prototypical summary representation in which aspects of spoken language such as talker’s voice (and speaking rate, vocal effort, etc., for that matter)

are eliminated.” Only during NVB the listener is forced by the speaker to “eliminate” certain “aspects of spoken language such as talker’s voice.” And, even if the listener, who became a speaker, listens to him or herself while he or she speaks, as in SVB, and tries to explain to the former speaker that he or she was not listening to him or herself, this seldom will actually result in this speaker beginning to listen to him or herself. Most likely this listener, who became a speaker, looses his or her SVB and switches back to NVB, while trying to talk with the other NVB speaker.

The NVB speaker is hardly ever really in the position to give up his or her dominance, which is exerted and maintained by his or her NVB, as he or she is only capable of listening to him or herself if the situation is created in which he or she can do that. In other words, only when he or she is given the adequate kind of environmental support will he or she be able to shift from NVB to SVB. The fact that an annoyed listener may experience a NVB speaker as aversive and then tries to change this speaker’s behavior by talking with him or her, doesn’t mean this listener is capable of providing the speaker with what he or she needs to be able to listen to him or herself while he or she speaks and produce SVB.  

The following statement is made by a SVB speaker, because only such a speaker is capable of expressing him or herself in such a fashion that the listener is not forced to separate “talker information” from “lexical information.” The SVB speaker possesses a skill which the NVB speaker simply doesn’t have, because the NVB speaker was never reinforced on previous occasions for listening to him or herself while he or she spoke. Thus, the NVB speaker is incapable of producing the behavior which was never taught to him or her to begin with. Now read the following statement: “Not only is talker information retained along with lexical information, but these two dimensions do not appear to be separable or independent in perception and attention.” Stated more accurately, listening and speaking behaviors “are two dimensions” which are inseparable as in “perception and attention” they occur simultaneously. The “memory” of a listener is a function of the extent to which his or her listening and speaking and also his reading and writing behaviors became joined. In NVB there is a separation between the speaker and the listener and between the writer and the reader.

“There are important processing consequences for a shared or detailed representation of linguistic events. One of these consequences is that perceptual learning of voice identity can result in talker-specific sensitivity to linguistic content.” If we like how a speaker sounds, we are more likely to learn from him or her, but if we are repulsed by the speaker’s voice, our attention will be drawn to how he or she sounds instead of to what he or she says. This has nothing to do with “processing”, but with whether the listener experiences the speaker's voice as reinforcing or punishing. 

Our nervous systems respond phylogenetically, that is, we respond in the only way that is biologically possible, and ontogenetically, how we have been conditioned during our lifetime. Based on our behavioral history the speaker-as-own-listener is our worst enemy or our best friend. Writing something without reading it makes absolutely no sense and saying something and without listening to it is a symptom of insanity. All insanity is based on the separation of the speaker from the listener and all of our problems with perception and attention can be reduced to this.

August 13, 2015

August 13, 2015

Written by Maximus Peperkamp, M.S. Verbal Engineer

Dear Reader,

This writing is my thirteenth response to the paper “Talker-specific learning in speech perception” by Nygaard and Pisoni (1998).  The researchers are unknowingly honing in on what I call Sound Verbal Behavior (SVB), when they state “The crucial research question then becomes whether, given experience with the particular aspects of the speech signal relating to talker identity, it follows that listeners also become sensitive to talker-specific linguistic properties.” What is said in SVB is easier understood because of how it is said and how the speaker sounds determines whether what the speaker says makes sense to the listener. However, the opposite is also true for Noxious Verbal Behavior (NVB), in which “particular aspects of the speech signal relating to talker identity”, the sound of the speaker’s voice, because of its aversive nature, gets more attention than the “talker-specific linguistic properties.” It requires the listener's effort to relate these “aspects of talker identity” with “talker-specific linguistic properties”, if the speaker expresses NVB, but if the speaker has SVB, no such effort is needed. 

Unaware of the SVB/NVB distinction, the researchers interpret various investigations done by others by stating “Taken together, these practice effects with synthetic and compressed speech suggest that the speech processing system is capable of adjusting to a variety of distortions, both synthetic and natural, that occur in the acoustic signal.” Only in NVB there is, because of the aversive-sounding voice of the speaker, a need for the listener to adjust “to a variety of distortions”, but in SVB there is no need to adjust to the speaker’s “acoustic signal” as there is no aversive stimulation. 

In SVB the speaker’s voice only has an appetitive effect on the listener. Not capturing this affective quality of the speaker’s vocalization, these authors believe that “Each talker’s vocal style shapes the acoustic realization of linguistic constituents in different but systematic and predictable ways.” With knowledge about the SVB/NVB distinction, however, is is clear that  SVB speakers shape in a SVB way and NVB speakers shape in a NVB way. How the speaker sounds influences the negative or positive emotional experiences of the listener and indeed shape “the acoustic realization of linguistic constituents in different but systematic and predictable ways.”

Tossing out the emotional influence of how we talk is characteristic for NVB. In SVB, listeners can recognize this influence, because they can, as speakers, articulate and explore the positive or the negative emotions, which they experience because of how the speaker sounds. In other words, in SVB there is feedback from the listener to the speaker. Rather than the listener making an effort to adjust to the speaker, the SVB speaker effortlessly adjusts to the listener. Effortless adjustment of the speaker to the listener occurs because the speaker listens to him or herself while he or she speaks. 

As the speaker listens to him or herself and experiences him or herself, he or she estimates how listeners other than the speaker are experiencing him or her. As the speaker listens to him or herself more often, his or her ability to accurately assess whether his voice is having a positive or a negative effect on the experience of other listeners reaches increasingly higher levels of accuracy. As a consequence, SVB is continued, even under the worst circumstances. This writer has reached this point and believes that others can reach it too.  What used to be a big problem turned around and made his life enjoyable. He used to feel very troubled and upset by how others were sounding, but as he now recognizes NVB as NVB and SVB as SVB, he is able to withdraw from NVB and approach and attract SVB. The problems of NVB can be avoided only if we recognize NVB as NVB. For most of us  this is not the case since we also don’t recognize SVB as SVB. Once we discriminate this distinction, NVB will decrease and SVB will increase. Our ignorance about this distinction prevents SVB and perpetuates NVB.  

  

These researchers don’t know the SVB/NVB distinction and their reasoning is by default based on NVB. Since they are scientists, they find some pieces of the puzzle. “Nevertheless, perceptual adaptation to individual talkers’ voices, as mentioned previously, has traditionally been cast as a problem of eliminating variation due to individual differences in speakers’ voices from underlying linguistic constants, rather than as a perceptual learning process in which listeners become attuned to properties of the speech signal which subserve both talker identification and linguistic processing". This “perceptual learning process in which listeners become attuned” describes SVB. Note that the “problem of eliminating variation due to individual differences in speaker’s voices” is not the speaker’s problem, but the listener’s problem. It is, of course, also the speaker’s problem, but it doesn't seem that way as long as he or she can get away with forcing others to listen to him or her and not listening to him or herself. The speaker’s problem becomes the listener’s problem in NVB. When the speaker recognizes his or her own NVB, he or she changes his or her sound and influences the listener who is him or her self and other listeners positively. 

We keep going around in circles as long as we treat speakers and listeners as separate entities. In SVB, in which the speaker listens to himself while he or she speaks, the speaker is the listener. When the listener within the same skin is not listening to the speaker, the speaker produces NVB. It is not the listener outside of the skin of the speaker, who needs to become “attuned to properties of the speech signal which subserve both talker identification and linguistic processing,” but it is the listener within the same skin as the speaker, who needs to become “attuned.”

In the discussion section of the paper, the authors mention that “Individual listener performance across training groups ranged from 28% correct for the poorest learner to 97% correct for the best learner, after 9 days of training. This finding suggests that simple exposure to the set of voices over the 9-day period was not sufficient for perceptual learning of talkers’ voices to occur.” Much more is involved in real life when we the listener adjust to how the speaker sounds. Generally speaking, someone who has experienced more SVB in his or her behavioral history adjusts to someone with NVB less easily than someone with more NVB. However, someone with more NVB in his or her behavioral history will more easily adjust to someone who has more SVB in his or her behavioral history. The authors clearly have no clue about this. “Given that these listeners differed in their ability to learn the voices, it was possible to characterize some of the listeners as “good” voice learners and others as “poor” voice learners.” 

What is a “good” or a “poor” voice learner, depends from whether one reasons from a SVB or a NVB perspective. From a SVB perspective, the “poor” voice learner, although he or she may be impaired by the speaker, recognizes NVB as NVB and is therefore a “good” voice learner. In other words, failure in NVB implies success in SVB. Many things are upside down because of how we talk. Only from a NVB perspective, the person who is distracted by the NVB speaker is called a “poor” voice learner. 

Without the SVB/NVB distinction we are bound to draw many wrong conclusions. ““Good” learners improved to a much greater extent than did “poor” learners. This divergence suggests that through practice in categorizing and explicitly identifying voices, “good” learners become “attuned” to the fine acoustic–phonetic details that distinguish each talker’s voice.” From a SVB perspective, however, the fact that “poor” learners improved to a much lesser extent indicates that they were “attuned” to and upset about, distracted by and therefore negatively affected by the not-so-fine aversive acoustic-phonetic details of the NVB speaker’s voice. Such a distraction would never occur with a SVB speaker. 

Many people are classified as “poor” learners simply because they respond with fear, anxiety and stress to a NVB speaker. ““Poor” learners do not seem to acquire the same kind of perceptual sensitivity using these voice dimensions during this type of laboratory training task.” However, the NVB speaker doesn’t acquire “perceptual sensitivity” to the listener as long as or she can continue to force others listen to him or to her. Thus, the conclusion that““Poor” learners do not seem to acquire the same kind of perceptual sensitivity” is confounded by poor NVB speakers. Yet, there is hope, as the authors found “it appears that both talker-specific and listener-specific variables contribute to the eventual identification of a talker’s voice.”  

Moreover, the finding that “Perceptual learning of a set of novel talkers’ voices caused listeners to be better able to recover the linguistic content of the signal” experimentally demonstrates that “the perceptual mechanisms responsible for analyzing talker identity are not independent from the mechanisms responsible for extracting the lexical content of an utterance from the speech wave form.” Can we finally admit that how the speaker sounds always affects the listener’s ability to understand the speaker?

  

As SVB and NVB are universal subclasses of vocal verbal behavior within each language, the authors inadvertently make indirect references to this distinction. “One explanation of these results is that the “poor” learners did not receive sufficient training to “fine tune” or adjust their attentional mechanisms to the relevant talker-specific information in the signal.” This not receiving "sufficient training to fine tune" of course means they didn't engage often enough in SVB to be able to recognize NVB. Furthermore, the insufficient training also indicates that something is wrong on the speaker’s side and not on the listener’s side. In NVB, however, it is always the listener who is blamed for not understanding the speaker. Interestingly, the authors add “It should be noted that the “poor” learners did not necessarily have difficulty processing speech from a variety of talkers, but rather, when the perceptual system was taxed, as when words were presented in noise, they were unable to utilize their prior knowledge of each talkers’ idiosyncratic style of speech to help recover the phonetic content and lexical information in the signal.” They seem to be saying that in NVB speakers produce some kind of voice-noise, which taxes the listeners’ perceptual system with their “idiosyncratic style of speech.”