Andreas Aristidou, Ariel Shamir, Yiorgos Chrysanthou
ACM Journal on Computing and Cultural Heritage, 2019.
This paper presents a method for contextually motion analysis that organizes dance data semantically, to form the first digital dance ethnography. The method is capable of exploiting the contextual correlation between dances, and distinguishing fine-grained difference between semantically similar motions. It illustrates a number of different organization trees, and portray the chronological and geographical evolution of dances.
Folk dances often reflect the socio-cultural influences prevailing in different periods and nations; each dance produces a meaning, a story with the help of music, costumes and dance moves. However, dances have no borders; they have been transmitted from generation to generation, along different countries, mainly due to movements of people carrying and disseminating their civilization. Studying the contextual correlation of dances along neighboring countries, unveils the evolution of this unique intangible heritage in time, and helps in understanding potential cultural similarities. In this work we present a method for contextually motion analysis that organizes dance data semantically, to form the first digital dance ethnography. Firstly, we break dance motion sequences into some narrow temporal overlapping feature descriptors, named motion and style words, and then cluster them in a high-dimensional features space to define motifs. The distribution of those motion and style motifs creates motion and style signatures, in the content of a bag-of-motifs representation, that implies for a succinct but descriptive portrayal of motions sequences. Signatures are time-scale and temporal-order invariant, capable of exploiting the contextual correlation between dances, and distinguishing fine-grained difference between semantically similar motions. We then use quartet-based analysis to organize dance data into a categorization tree, while inferred information from dance metadata descriptions are then used to set parent-child relationships. We illustrate a number of different organization trees, and portray the evolution of dances over time. The efficiency of our method is also demonstrated in retrieving contextually similar dances from a database.
This figure demonstrates, in a circular partition, the degree of similarity of the Salsa (left) and Hasaposerviko (right) dances to other dances in the collection. Similar dances to the query dance are placed closer to the center circle. The similarity is also illustrated by different shades of green (for Salsa) and blue (for Hasaposerviko); the numbers in red indicate the degree of dissimilarity for that partition. Refer to the supplementary video for an animated visualization of this demonstration.
The main contributions of this work are:
The authors would like to thank the Cyprus Folklore Research Association, the dancers and actors (in alphabetical order) Fanie Alexandrou, Vaso Aristeidou, Anna Charalambous, Anna Cortesi, Andreas de la Vara, Clio de la Vara, Maritsa Elia, Stefanos Koullapis, Olivia Kyriakides, Nicos Michael, Ioanna Tacha, Stefanos Theodorou, and Theodora Tsiakka who performed in our lab. This work has been supported by the RESTART 2016-2020 Programmes for Technological Development and Innovation, through the Cyprus Research Promotion Foundation, with protocol number P2P/JPICH_DH/0417/0052. It has also been partly supported by the project that has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No 739578. This project has received funding from the Government of the Republic of Cyprus through the Directorate General for European Programmes, Coordination and Development We gratefully acknowledge the support of NVIDIA Corporation with the donation of the Titan Xp GPU used for this research.
© 2017 Andreas Aristidou