Elements of Style: Learning Perceptual Shape Style Similarity
Zhaoliang Lun, Evangelos Kalogerakis, Alla Sheffer
ACM Transactions on Graphics (Proc. ACM SIGGRAPH 2015)
Preprint: [PDF]
Abstract
The human perception of stylistic similarity transcends structure and function - for instance, a bed and a dresser may share a common style. An algorithmically computed style similarity measure that mimics human perception, can benefit a range of computer graphics applications. Previous work in style analysis focused on shapes within the same class, and leveraged structural similarity between these shapes to facilitate analysis. In contrast, we introduce and successfully validate the first structure-transcending style similarity measure, one closely aligned with the human perception of style similarity. Our measure is inspired by observations about style-similarity in art history literature, which point to the presence of similarly shaped, salient, geometric elements as a key indicator of stylistic similarity between structurally different objects. We translate these observations into an algorithmic measure by quantifying in geometric terms what makes geometric elements be perceived as similarly shaped, employing this quantification to detect similar style elements on the analyzed shapes, and finally collating the element-level geometric similarity measurements into an object-level style measure consistent with human perception. To achieve this consistency we employ crowd-sourcing to quantify the different components of our measure and learn the relative perceptual importance of a range of elementary shape distances and other parameters used in our measurement from 50K responses to cross-structure style similarity queries provided by over 2500 participants. We train and validate our method on this dataset, showing it to successfully predict relative style similarity with 90% accuracy based on 10-fold cross-validation.
Paper
|
►StyleSimilarity.pdf, 30 MB
Zhaoliang Lun, Evangelos Kalogerakis, Alla Sheffer, |
Video
Supplementary Material
The following archive contains queries generated for our data sets and learned weights for elementary distances and saliences.
►Supplementary.7z, 142 MB
Code
The following archive contains source codes for our algorithm. Please read the readme file within the archive for more details.
►Code.7z, 4 MB (Updated: 2015 / 12 / 29)
Data
The following archives contain data set used in our algorithm. Archive Data-all.7z contains all data used in our experiments including shape models and user study responses. Archive Data-demo.7z contains minimum data to run our pipeline. Please read the readme file within the archives for more details.
►Data-all.7z, 179 MB
►Data-demo.7z, 0.7 MB
Presentation
The following files contain the slides presented in SIGGRAPH 2015 at Los Angeles.
►Presentation.pptx, 40 MB
►Presentation.pdf, 2 MB
Copyright
All 3D shape models are downloaded from the Internet and the original authors hold the copyright of the models. The user study data was obtained by us via Amazon Mechanical Turk service and it is provided freely. This data set is provided for the convenience of academic research only
Acknowledgments
Kalogerakis gratefully acknowledges support from NSF (CHS-1422441). Sheffer gratefully acknowledges support from NSERC and GRAND NCE. We thank Nicholas Vining and Mikhail Bessmeltsev for their valuable help in editing the paper and the video. We thank the anonymous reviewers for their comments.