Crowdsourcing [1]} can be used for large-scale evaluations or creating datasets under limited periods [2]}. However, special care needs to be taken to ensure the reliability of crowd data [3]} as the seriousness with which volunteers take their interactions with the system can be limited.
These complexities demand to devise an effective strategy to build a real-world dataset that considers including the micro-, meso-, and macro-structure, different sources, and modalities.
