Project information
Centrum pro multi-modální interpretaci dat velkého rozsahu
- Project Identification
- GBP103/12/G084 (kod CEP: GBP103/12/G084)
- Project Period
- 1/2012 - 12/2018
- Investor / Pogramme / Project type
-
Czech Science Foundation
- Projects to promote excellence in basic research
- MU Faculty or unit
-
Faculty of Informatics
- prof. Ing. Pavel Zezula, CSc.
- RNDr. Michal Batko, Ph.D.
- doc. RNDr. Vlastislav Dohnal, Ph.D.
- RNDr. David Novák, Ph.D.
- Cooperating Organization
-
Charles University
- Responsible person RNDr. Pavel Pecina, Ph.D.
- Responsible person prof. Ing. Josef Psutka, CSc.
- Responsible person prof. Ing. Jiří Matas, Ph.D.
The project aims at exploiting large collections of unlabeled multi-modal data, mainly video footage, to further state-of-the-art in video, audio and natural language understanding, interpretation, annotation and retrieval by combining unsupervised and semi-supervised learning. It will address problems that are very difficult (some probably impossible) to solve in a single modality by adopting an interdisciplinary approach. Progress in individual research areas - vision, natural language processing and speech will be achieved by co-training and by exploiting results of other modalities as cross-training data. For efficient processing of large data collections appearing in all modalities, the project will also concern generic problems of organization, indexing, and searching based on similarity that is fundamental for building real-life applications.
Publications
Total number of publications: 49
2017
-
Speeding up the multimedia feature extraction: a comparative study on the big data approach
Multimedia Tools and Applications, year: 2017, volume: 76, edition: 5, DOI
-
Visual Descriptors in Methods for Video Hyperlinking
Proceedings of the 2017 ACM on International Conference on Multimedia Retrieval, year: 2017
2016
-
Assessing similarity models for human-motion retrieval applications
Computer Animation and Virtual Worlds, year: 2016, volume: 27, edition: 5, DOI
-
Designing Sketches for Similarity Filtering
2016 IEEE 16th International Conference on Data Mining Workshops (ICDMW), year: 2016
-
Inherent Fusion: Towards Scalable Multi-Modal Similarity Search
Journal of Database Management, year: 2016, volume: 27, edition: 4, DOI
-
Off the Beaten Path: Let's Replace Term-Based Retrieval with k-NN Search
CIKM'16: PROCEEDINGS OF THE 2016 ACM CONFERENCE ON INFORMATION AND KNOWLEDGE MANAGEMENT, year: 2016
-
Performance Analysis of Distributed Stream Processing Applications Through Colored Petri Nets
Mathematical and Engineering Methods in Computer Science: 10th International Doctoral Workshop, MEMICS 2015, Telč, Czech Republic, October 23-25, 2015, Revised Selected Papers, year: 2016
-
PPP-Codes for Large-Scale Similarity Searching
Transactions on Large-Scale Data- and Knowledge-Centered Systems XXIV, year: 2016
-
Similarity searching for Database Applications
Advances in Databases and Information Systems, year: 2016
-
Similarity Searching in Long Sequences of Motion Capture Data
Proceedings of 9th International Conference on Similarity Search and Applications (SISAP 2016), LNCS 9939, year: 2016