Prosodic facilitation and interference while judging on the veracity of synthesized statements

Two primary sources of information are provided in human speech. On the one hand, the verbal channel encodes linguistic content, while on the other hand, the vocal channel transmits paralinguistic information, mainly through prosody. In line with several studies that induce a conflict between these...

Descripción completa

Guardado en:
Detalles Bibliográficos
Publicado: 2017
Materias:
Acceso en línea:https://bibliotecadigital.exactas.uba.ar/collection/paper/document/paper_2308457X_v2017-August_n_p2331_Galvez
http://hdl.handle.net/20.500.12110/paper_2308457X_v2017-August_n_p2331_Galvez
Aporte de:
id paper:paper_2308457X_v2017-August_n_p2331_Galvez
record_format dspace
spelling paper:paper_2308457X_v2017-August_n_p2331_Galvez2023-06-08T16:35:32Z Prosodic facilitation and interference while judging on the veracity of synthesized statements Entrainment Prosodic interference/facilitation Text to speech Trustworthiness Air entrainment Linguistics Speech Cognitive loads Human speech Paralinguistic information Primary sources Prosodic interference/facilitation Synthesized speech Text to speech Trustworthiness Speech communication Two primary sources of information are provided in human speech. On the one hand, the verbal channel encodes linguistic content, while on the other hand, the vocal channel transmits paralinguistic information, mainly through prosody. In line with several studies that induce a conflict between these two channels to better understand the role of prosody, we conducted an experiment in which subjects had to listen to a series of statements synthesized with varying prosody and indicate if they believed them to be true or false. We find evidence suggesting that acoustic/prosodic (a/p) features of the synthesized statements affect response times (a well-known proxy for cognitive load). Our results suggest that prosody in synthesized speech may play a role of either facilitation or interference when subjects judge the truthfulness of a statement. Furthermore, we find that this pattern is amplified when the a/p features of the synthesized statements are analyzed relative to the subjects' own a/p features. This suggests that the entrainment of TTS voices has serious implications in the perceived trustworthiness of the system's skills. Copyright © 2017 ISCA. 2017 https://bibliotecadigital.exactas.uba.ar/collection/paper/document/paper_2308457X_v2017-August_n_p2331_Galvez http://hdl.handle.net/20.500.12110/paper_2308457X_v2017-August_n_p2331_Galvez
institution Universidad de Buenos Aires
institution_str I-28
repository_str R-134
collection Biblioteca Digital - Facultad de Ciencias Exactas y Naturales (UBA)
topic Entrainment
Prosodic interference/facilitation
Text to speech
Trustworthiness
Air entrainment
Linguistics
Speech
Cognitive loads
Human speech
Paralinguistic information
Primary sources
Prosodic interference/facilitation
Synthesized speech
Text to speech
Trustworthiness
Speech communication
spellingShingle Entrainment
Prosodic interference/facilitation
Text to speech
Trustworthiness
Air entrainment
Linguistics
Speech
Cognitive loads
Human speech
Paralinguistic information
Primary sources
Prosodic interference/facilitation
Synthesized speech
Text to speech
Trustworthiness
Speech communication
Prosodic facilitation and interference while judging on the veracity of synthesized statements
topic_facet Entrainment
Prosodic interference/facilitation
Text to speech
Trustworthiness
Air entrainment
Linguistics
Speech
Cognitive loads
Human speech
Paralinguistic information
Primary sources
Prosodic interference/facilitation
Synthesized speech
Text to speech
Trustworthiness
Speech communication
description Two primary sources of information are provided in human speech. On the one hand, the verbal channel encodes linguistic content, while on the other hand, the vocal channel transmits paralinguistic information, mainly through prosody. In line with several studies that induce a conflict between these two channels to better understand the role of prosody, we conducted an experiment in which subjects had to listen to a series of statements synthesized with varying prosody and indicate if they believed them to be true or false. We find evidence suggesting that acoustic/prosodic (a/p) features of the synthesized statements affect response times (a well-known proxy for cognitive load). Our results suggest that prosody in synthesized speech may play a role of either facilitation or interference when subjects judge the truthfulness of a statement. Furthermore, we find that this pattern is amplified when the a/p features of the synthesized statements are analyzed relative to the subjects' own a/p features. This suggests that the entrainment of TTS voices has serious implications in the perceived trustworthiness of the system's skills. Copyright © 2017 ISCA.
title Prosodic facilitation and interference while judging on the veracity of synthesized statements
title_short Prosodic facilitation and interference while judging on the veracity of synthesized statements
title_full Prosodic facilitation and interference while judging on the veracity of synthesized statements
title_fullStr Prosodic facilitation and interference while judging on the veracity of synthesized statements
title_full_unstemmed Prosodic facilitation and interference while judging on the veracity of synthesized statements
title_sort prosodic facilitation and interference while judging on the veracity of synthesized statements
publishDate 2017
url https://bibliotecadigital.exactas.uba.ar/collection/paper/document/paper_2308457X_v2017-August_n_p2331_Galvez
http://hdl.handle.net/20.500.12110/paper_2308457X_v2017-August_n_p2331_Galvez
_version_ 1768544062078451712