A composition algorithm based on cross modal taste-music correspondences
While there is broad consensus about the structural similarities between language and music, comparably less attention has been devoted to semantic correspondences between these two ubiquitous manifestations of human culture. We have investigated the relations between music and a narrow and bounded...
Guardado en:
| Autores principales: | , , |
|---|---|
| Publicado: |
2012
|
| Materias: | |
| Acceso en línea: | https://bibliotecadigital.exactas.uba.ar/collection/paper/document/paper_16625161_v_nAPRIL2012_p_Mesz http://hdl.handle.net/20.500.12110/paper_16625161_v_nAPRIL2012_p_Mesz |
| Aporte de: |
| id |
paper:paper_16625161_v_nAPRIL2012_p_Mesz |
|---|---|
| record_format |
dspace |
| spelling |
paper:paper_16625161_v_nAPRIL2012_p_Mesz2023-06-08T16:25:52Z A composition algorithm based on cross modal taste-music correspondences Mesz, Bruno Sigman, Mariano Trevisan, Marcos Alberto Cross-modal associations Music Musical algorithm Semantics Taste adult algorithm article auditory discrimination auditory memory auditory response female human human experiment language ability male Monte Carlo method music semantics sensory analysis sensory feedback sound analysis stimulus response task performance taste discrimination While there is broad consensus about the structural similarities between language and music, comparably less attention has been devoted to semantic correspondences between these two ubiquitous manifestations of human culture. We have investigated the relations between music and a narrow and bounded domain of semantics: the words and concepts referring to taste sensations. In a recent work, we found that taste words were consistently mapped to musical parameters. Bitter is associated with low-pitched and continuous music (legato), salty is characterized by silences between notes (staccato), sour is high pitched, dissonant and fast and sweet is consonant, slow and soft (Mesz et al., 2011). Here we extended these ideas, in a synergistic dialog between music and science, investigating whether music can be algorithmically generated from taste-words. We developed and implemented an algorithm that exploits a large corpus of classic and popular songs. New musical pieces were produced by choosing fragments from the corpus and modifying them to minimize their distance to the region in musical space that characterizes each taste. In order to test the capability of the produced music to elicit significant associations with the different tastes, musical pieces were produced and judged by a group of non-musicians. Results showed that participants could decode well above chance the taste-word of the composition. We also discuss how our findings can be expressed in a performance bridging music and cognitive science. © 2012 Mesz, Sigman and Trevisan. Fil:Mesz, B. Universidad de Buenos Aires. Facultad de Ciencias Exactas y Naturales; Argentina. Fil:Sigman, M. Universidad de Buenos Aires. Facultad de Ciencias Exactas y Naturales; Argentina. Fil:Trevisan, M.A. Universidad de Buenos Aires. Facultad de Ciencias Exactas y Naturales; Argentina. 2012 https://bibliotecadigital.exactas.uba.ar/collection/paper/document/paper_16625161_v_nAPRIL2012_p_Mesz http://hdl.handle.net/20.500.12110/paper_16625161_v_nAPRIL2012_p_Mesz |
| institution |
Universidad de Buenos Aires |
| institution_str |
I-28 |
| repository_str |
R-134 |
| collection |
Biblioteca Digital - Facultad de Ciencias Exactas y Naturales (UBA) |
| topic |
Cross-modal associations Music Musical algorithm Semantics Taste adult algorithm article auditory discrimination auditory memory auditory response female human human experiment language ability male Monte Carlo method music semantics sensory analysis sensory feedback sound analysis stimulus response task performance taste discrimination |
| spellingShingle |
Cross-modal associations Music Musical algorithm Semantics Taste adult algorithm article auditory discrimination auditory memory auditory response female human human experiment language ability male Monte Carlo method music semantics sensory analysis sensory feedback sound analysis stimulus response task performance taste discrimination Mesz, Bruno Sigman, Mariano Trevisan, Marcos Alberto A composition algorithm based on cross modal taste-music correspondences |
| topic_facet |
Cross-modal associations Music Musical algorithm Semantics Taste adult algorithm article auditory discrimination auditory memory auditory response female human human experiment language ability male Monte Carlo method music semantics sensory analysis sensory feedback sound analysis stimulus response task performance taste discrimination |
| description |
While there is broad consensus about the structural similarities between language and music, comparably less attention has been devoted to semantic correspondences between these two ubiquitous manifestations of human culture. We have investigated the relations between music and a narrow and bounded domain of semantics: the words and concepts referring to taste sensations. In a recent work, we found that taste words were consistently mapped to musical parameters. Bitter is associated with low-pitched and continuous music (legato), salty is characterized by silences between notes (staccato), sour is high pitched, dissonant and fast and sweet is consonant, slow and soft (Mesz et al., 2011). Here we extended these ideas, in a synergistic dialog between music and science, investigating whether music can be algorithmically generated from taste-words. We developed and implemented an algorithm that exploits a large corpus of classic and popular songs. New musical pieces were produced by choosing fragments from the corpus and modifying them to minimize their distance to the region in musical space that characterizes each taste. In order to test the capability of the produced music to elicit significant associations with the different tastes, musical pieces were produced and judged by a group of non-musicians. Results showed that participants could decode well above chance the taste-word of the composition. We also discuss how our findings can be expressed in a performance bridging music and cognitive science. © 2012 Mesz, Sigman and Trevisan. |
| author |
Mesz, Bruno Sigman, Mariano Trevisan, Marcos Alberto |
| author_facet |
Mesz, Bruno Sigman, Mariano Trevisan, Marcos Alberto |
| author_sort |
Mesz, Bruno |
| title |
A composition algorithm based on cross modal taste-music correspondences |
| title_short |
A composition algorithm based on cross modal taste-music correspondences |
| title_full |
A composition algorithm based on cross modal taste-music correspondences |
| title_fullStr |
A composition algorithm based on cross modal taste-music correspondences |
| title_full_unstemmed |
A composition algorithm based on cross modal taste-music correspondences |
| title_sort |
composition algorithm based on cross modal taste-music correspondences |
| publishDate |
2012 |
| url |
https://bibliotecadigital.exactas.uba.ar/collection/paper/document/paper_16625161_v_nAPRIL2012_p_Mesz http://hdl.handle.net/20.500.12110/paper_16625161_v_nAPRIL2012_p_Mesz |
| work_keys_str_mv |
AT meszbruno acompositionalgorithmbasedoncrossmodaltastemusiccorrespondences AT sigmanmariano acompositionalgorithmbasedoncrossmodaltastemusiccorrespondences AT trevisanmarcosalberto acompositionalgorithmbasedoncrossmodaltastemusiccorrespondences AT meszbruno compositionalgorithmbasedoncrossmodaltastemusiccorrespondences AT sigmanmariano compositionalgorithmbasedoncrossmodaltastemusiccorrespondences AT trevisanmarcosalberto compositionalgorithmbasedoncrossmodaltastemusiccorrespondences |
| _version_ |
1768542005127806976 |