The volumetric representation of human interactions is one of the fundamental domains in the development of immersive media productions and telecommunication applications. Particularly in the context of the rapid advancement of Extended Reality (XR) applications, this volumetric data has proven to be an essential technology for future XR elaboration. In this work, we present a new multimodal database to help advance the development of immersive technologies. Our proposed database provides ethically compliant and diverse volumetric data, in particular 27 participants displaying posed facial expressions and subtle body movements while speaking, plus 11 participants wearing head-mounted displays (HMDs). The recording system consists of a volumetric capture (VoCap) studio, including 31 synchronized modules with 62 RGB cameras and 31 depth cameras. In addition to textured meshes, point clouds, and multi-view RGB-D data, we use one Lytro Illum camera for providing light field (LF) data simultaneously. Finally, we also provide an evaluation of our dataset employment with regard to the tasks of facial expression classification, HMDs removal, and point cloud reconstruction. The dataset can be helpful in the evaluation and performance testing of various XR algorithms, including but not limited to facial expression recognition and reconstruction, facial reenactment, and volumetric video. HEADSET and its all associated raw data and license agreement will be publicly available for research purposes. By downloading any data segments, you implicitly consent to our licensing agreement, which is as follows: License Agreement Licensor: Tampere University Dataset: HEADSET: Human Emotion Awareness under Partial Occlusions Multimodal DataSET Warranties: No warranty. The Dataset is given “as is” without warranty of any type, and any and all express or implied warranties, including implied warranties of non-infringement, merchantability, fitness for a particular purpose, and non-infringement of third-party rights are disclaimed. The licensee agrees that in no event will the Licensor be liable to the recipient or any other party for any risks caused by any way whatever from the dataset usage. The licensee agrees and acknowledges that the use of the Dataset is at the licensee’s exclusive damage. Terms: The Dataset is the exclusive property of Tampere University. This content of the data cannot be disclosed either in total or in part to any third parties without the written consent of the Licensor. The Dataset can only be used for non-commercial research purposes. The Dataset cannot be used for the construction, adjustment, promotion of, or the production of works of an erotic, pornographic, racist, or discriminatory nature and also for studies that cause any damage to the image or reputation of a person, to a business or generally risks to human dignity. On using this Dataset for the purposes mentioned above, you agree to mention the Tampere University for any public announcement or of presentation the Dataset. Assignment: The licensee may not assign its claims and responsibilities under this Agreement in whole or in part without the previous written consent of the Licensor. The Licensor may assign any of its rights or obligations under this Agreement without the consent of the licensee being compulsory. Law: This Agreement will be governed and interpreted in accordance with the laws of Finland, and the Parties hereby submit to the exclusive jurisdiction of the Finish courts.

2022