A composition algorithm based on cross modal taste-music correspondences

While there is broad consensus about the structural similarities between language and music, comparably less attention has been devoted to semantic correspondences between these two ubiquitous manifestations of human culture. We have investigated the relations between music and a narrow and bounded...

Descripción completa

Guardado en:
Detalles Bibliográficos
Autor principal: Mesz, B.
Otros Autores: Sigman, M., Trevisan, M.A
Formato: Capítulo de libro
Lenguaje:Inglés
Publicado: Frontiers Media S. A. 2012
Acceso en línea:Registro en Scopus
Handle
Registro en la Biblioteca Digital
Aporte de:Registro referencial: Solicitar el recurso aquí
LEADER 09982caa a22010097a 4500
001 PAPER-13045
003 AR-BaUEN
005 20230518204318.0
008 190411s2012 xx ||||fo|||| 00| 0 eng|d
024 7 |2 scopus  |a 2-s2.0-84933676840 
040 |a Scopus  |b spa  |c AR-BaUEN  |d AR-BaUEN 
100 1 |a Mesz, B. 
245 1 2 |a A composition algorithm based on cross modal taste-music correspondences 
260 |b Frontiers Media S. A.  |c 2012 
270 1 0 |m Trevisan, M. A.; Laboratory of Dynamical Systems, IFIBA-Physics Department, FCEN, University of Buenos Aires, Pabellón I, Ciudad Universitaria, 1428EGA, Buenos Aires, Argentina; email: marcos@df.uba.ar 
506 |2 openaire  |e Política editorial 
504 |a http://www.speech.kth.se/music/5_lectures/askenflt/askenflt.html, Askenfelt; http://zztt.org/en/onkimi, Azzigotti; Beeli, G., Esslen, M., Jänke, L., Synaesthesia: When coloured sounds taste sweet (2005) Nature, 434, p. 38 
504 |a Bradley, M.M., Lang, P.J., (1999) Affective Norms For English Words (ANEW): Instruction Manual and Affective Ratings, Technical Report C-1, , The Center for Research in Psychophysiology, University of Florida 
504 |a http://homepage.mac.com/cariani/CarianiNewWebsite/Publications_files/Car iani-ICMPC-8-2004-Proceedings.pdf, Cariani; Chomsky, N., (1988) Language and Problems of Language, , Cambridge, MA: MIT Press 
504 |a Crisinel, A.-S., Cosser, S., King, S., Jones, R., Petrie, J., Spence, C., A bittersweet symphony: Systematically modulating the taste of food by changing the sonic properties of the soundtrack playing in the background (2011) Food Qual. Prefer, 24, pp. 201-204 
504 |a Crisinel, A.S., Spence, C., Implicit association between basic tastes and pitch (2009) Neurosci. Lett, 464, pp. 39-42 
504 |a Crisinel, A.S., Spence, C., As bitter as a trombone: Synesthetic correspondences in nonsynesthetes between tastes/flavors and musical notes (2010) Atten. Percept. Psychophys, 72, pp. 1994-2002 
504 |a Crisinel, A.S., Spence, C., A sweet sound? Food names reveal implicit associations between taste and pitch (2010) Perception, 39, pp. 417-425 
504 |a Debussy, C., (1913) Préludes, , http://imslp.org/wiki/Preludes_(Book_2)_(Debussy,_Claude, Book 2: III 
504 |a Driver, J., Spence, C., Multisensory perception: Beyond modularity and convergence (2000) Curr. Biol, 10, pp. R731-R735 
504 |a http://www.peachnote.com, Engine; Evans, K.K., Treisman, A., Natural cross-modal mappings between visual and auditory features (2010) J. Vis, 10 (6), pp. 1-12 
504 |a Fastl, H., Zwicker, E., (2007) Psychoacoustics. Facts and Models, , Berlin: Springer 
504 |a Fraisse, P., Rhythm and tempo (1982) Psychology of Music, pp. 149-180. , ed D. Deutsch (New York, NY: Academic 
504 |a Hänggi, J., Beeli, G., Oechslin, M.S., Jaencke, L., The multiple synaesthete E.S.: Neuroanatomi-cal basis of interval-taste and tone-colour synaesthesia (2008) Neuroimage, 43, pp. 192-203 
504 |a Jackendoff, R., Lerdahl, F., The capacity for music: What is it, and what's special about it? (2006) Cognition, 100, pp. 33-72 
504 |a Jentschke, S., Koelsch, S., Friederici, A.D., Investigating the relationship of music and language in children: Influences of musical training and language impairment (2005) Ann. N.Y. Acad. Sci, 1060, pp. 231-242 
504 |a Jentschke, S., Koelsch, S.S., Sallat, S., Friederici, A.D., Children with specific language impairment also show impairment of music-syntactic processing (2008) J. Cogn. Neurosci, 20, pp. 1940-1951 
504 |a Koelsch, S., Kasper, E., Sammler, D., Schulze, K., Gunter, T., Friederici, A.D., Music, language and meaning: Brain signatures of semantic processing (2004) Nat. Neurosci, 7, pp. 302-307 
504 |a Luck, G., Toiviainen, P., Erkkilä, J., Lartillot, O., Riikkilä, K., Mäkelä, A., Pyhäluoto, K., Värri, J., Modelling the relationships between emotional responses to, and musical content of, music therapy improvisations (2008) Psychol. Music, 36, pp. 25-45 
504 |a Mesz, B., Trevisan, M.A., Sigman, M., The taste of music (2011) Perception, 40, pp. 209-219 
504 |a Parise, C., Spence, C., Synaesthetic congruency modulates the temporal ventriloquism effect (2008) Neurosci. Lett, 442, pp. 257-261 
504 |a Patel, A.D., Language, music, syntax and the brain (2003) Nat. Neurosci, 6, pp. 674-681 
504 |a http://imslp.org/wiki; Plomp, R., Levelt, W.J.M., Tonal consonance and critical band-widths (1965) J. Acoust. Soc. Am, 38, pp. 548-560 
504 |a Ramachandran, V.S., Hubbard, E.M., Hearing colors, tasting shapes (2003) Sci. Am, 288, pp. 52-59 
504 |a Scherer, K.R., Vocal affect expression: A review and a model for future research (1986) Psychol. Bull, 99, pp. 143-165 
504 |a Shukla, M., Nespor, M., Mehler, J., An interaction between prosody and statistics in the segmentation of fluent speech (2007) Cogn. Psychol, 54, pp. 1-32 
504 |a Simner, J., Synaesthetic visuo-spatial forms: Viewing sequences in space (2009) Cortex, 45, pp. 1138-1147 
504 |a Simner, J., Cuskley, C., Kirby, S., What sound does that taste? Cross-modal mappings across gustation and audition (2010) Perception, 39, pp. 553-569 
504 |a Spence, C., Crossmodal correspondences: A tutorial review (2011) Atten. Percept. Psychophys, 73, pp. 971-995 
504 |a Steiner, J.E., Human facial expressions in response to taste and smell stimulation (1979) Advances In Child Development and Behavior, 13, pp. 257-295. , eds H. W. Reese and L. P. Lipsitt (New York, NY: Academic Press 
504 |a https://www.jyu.fi/hum/laitokset/musiikki/en/research/coe/materials/midi toolbox, Toolbox; Traunmüller, H., Eriksson, A., Acoustic effects of variation in vocal effort by men, women, and children (2010) J. Acoust. Soc. Am, 107, pp. 3438-3451 
504 |a Walsh, V., A theory of magnitude: Common cortical metrics of time, space and quantity (2003) Tre Nd S Cogn. Sci, 7, pp. 483-488 
504 |a Zatorre, R.J., Chen, J.L., Penhune, V.B., When the brain plays music: Auditory-motor interactions in music perception and production (2007) Nat. Rev. Neurosci, 8, pp. 547-558 
504 |a Mesz, B., Sigman, M., Trevisan, M.A., A composition algorithm based on crossmodal taste-music correspondences (2012) Front. Hum. Neurosci, 6, p. 71. , doi: 10.3389/fnhum.2012.00071 
520 3 |a While there is broad consensus about the structural similarities between language and music, comparably less attention has been devoted to semantic correspondences between these two ubiquitous manifestations of human culture. We have investigated the relations between music and a narrow and bounded domain of semantics: the words and concepts referring to taste sensations. In a recent work, we found that taste words were consistently mapped to musical parameters. Bitter is associated with low-pitched and continuous music (legato), salty is characterized by silences between notes (staccato), sour is high pitched, dissonant and fast and sweet is consonant, slow and soft (Mesz et al., 2011). Here we extended these ideas, in a synergistic dialog between music and science, investigating whether music can be algorithmically generated from taste-words. We developed and implemented an algorithm that exploits a large corpus of classic and popular songs. New musical pieces were produced by choosing fragments from the corpus and modifying them to minimize their distance to the region in musical space that characterizes each taste. In order to test the capability of the produced music to elicit significant associations with the different tastes, musical pieces were produced and judged by a group of non-musicians. Results showed that participants could decode well above chance the taste-word of the composition. We also discuss how our findings can be expressed in a performance bridging music and cognitive science. © 2012 Mesz, Sigman and Trevisan.  |l eng 
593 |a Departamento de Ciencia y Tecnología, Universidad Nacional de Quilmes, Bernal, Buenos Aires, Argentina 
593 |a Laboratory of Integrative Neuroscience, Physics Department, FCEN, University of Buenos Aires, Ciudad Universitaria, Buenos Aires, Argentina 
593 |a Laboratory of Dynamical Systems, IFIBA-Physics Department, FCEN, University of Buenos Aires, Ciudad Universitaria, Buenos Aires, Argentina 
690 1 0 |a CROSS-MODAL ASSOCIATIONS 
690 1 0 |a MUSIC 
690 1 0 |a MUSICAL ALGORITHM 
690 1 0 |a SEMANTICS 
690 1 0 |a TASTE 
690 1 0 |a ADULT 
690 1 0 |a ALGORITHM 
690 1 0 |a ARTICLE 
690 1 0 |a AUDITORY DISCRIMINATION 
690 1 0 |a AUDITORY MEMORY 
690 1 0 |a AUDITORY RESPONSE 
690 1 0 |a FEMALE 
690 1 0 |a HUMAN 
690 1 0 |a HUMAN EXPERIMENT 
690 1 0 |a LANGUAGE ABILITY 
690 1 0 |a MALE 
690 1 0 |a MONTE CARLO METHOD 
690 1 0 |a MUSIC 
690 1 0 |a SEMANTICS 
690 1 0 |a SENSORY ANALYSIS 
690 1 0 |a SENSORY FEEDBACK 
690 1 0 |a SOUND ANALYSIS 
690 1 0 |a STIMULUS RESPONSE 
690 1 0 |a TASK PERFORMANCE 
690 1 0 |a TASTE DISCRIMINATION 
700 1 |a Sigman, M. 
700 1 |a Trevisan, M.A. 
773 0 |d Frontiers Media S. A., 2012  |k n. APRIL 2012  |p Front. Human Neurosci.  |x 16625161  |w (AR-BaUEN)CENRE-7999  |t Frontiers in Human Neuroscience 
856 4 1 |u https://www.scopus.com/inward/record.uri?eid=2-s2.0-84933676840&partnerID=40&md5=cfe7002af158ef3b1eba1fc66c644882  |y Registro en Scopus 
856 4 0 |u https://hdl.handle.net/20.500.12110/paper_16625161_v_nAPRIL2012_p_Mesz  |y Handle 
856 4 0 |u https://bibliotecadigital.exactas.uba.ar/collection/paper/document/paper_16625161_v_nAPRIL2012_p_Mesz  |y Registro en la Biblioteca Digital 
961 |a paper_16625161_v_nAPRIL2012_p_Mesz  |b paper  |c PE 
962 |a info:eu-repo/semantics/article  |a info:ar-repo/semantics/artículo  |b info:eu-repo/semantics/publishedVersion 
999 |c 73998