Filters and Search 🔍
  • MTGAT: Multimodal Temporal Graph Attention Networks for Unaligned Human Multimodal Language Sequences

    Open AccessCarnegie Mellon University22/10/2020

    Human communication is multimodal in nature; it is through multiple modalities, i.e., language, voice, and facial expressions, that opinions and emotions are expressed. Data in this domain exhibits complex multi-relational and temporal interactions. Learning from this data is a fundamentally challenging research problem. In this paper, we propose Multimodal Temporal Graph Attention Networks (MTGAT). MTGAT […]

  • Desired Content versus Digital Advertisements: An Eye-Tracking User Experience Study

    Gated

    Advertisement repetition is known to enhance recall and awareness towards a certain stimulus. However, overexposure is also recognized to negatively impact user experience (UX). Little is understood on how many repetitions are required to achieve a tolerable balance between user experience and advertising. Likewise, the number of displayed advertisements versus seen advertisements is also unclear. […]

  • Social attention to activities in children and adults with autism spectrum disorder: effects of context and age

    Gated

    Diminished visual monitoring of faces and activities of others is an early feature of autism spectrum disorder (ASD). It is uncertain whether deficits in activity monitoring, identified using a homogeneous set of stimuli, persist throughout the lifespan in ASD, and thus, whether they could serve as a biological indicator (“biomarker”) of ASD. We investigated differences […]

  • Muscle Movements for Non-Invasive Thermal Discomfort Detection via Bio-Sensing Technology

    Open AccessNorwegian University of Science and Technology19/10/2020

    In the time of climate change, as heat waves become a more regular occurrence, indoor thermal comfort is an important factor in day to day life. Due to such circumstances, many researchers have focused their studies on finding an effective solution that will not only enable thermal comfort, but also increase satisfaction within the indoor […]

  • How online advertising competes with user-generated content in TripAdvisor. A neuroscientific approach

    Gated

    Drawing on cognitive load theory, congruence research, and dual processing models, the purpose of this study is to determine the effectiveness of online advertising in social media. To this end, three separate studies were conducted. First, using eye-tracking and electroencephalography, we examine the differences, based on whether or not an ad is embedded, in subjects’ […]

  • How Soundtracks Shape What We See: Analyzing the Influence of Music on Visual Scenes Through Self-Assessment, Eye Tracking, and Pupillometry

    Gated

    This article presents two studies that deepen the theme of how soundtracks shape our interpretation of audiovisuals. Embracing a multivariate perspective, Study 1 (N = 118) demonstrated, through an online between-subjects experiment, that two different music scores (melancholic vs. anxious) deeply affected the interpretations of an unknown movie scene in terms of empathy felt toward […]

  • Effects of sustained attention and video lecture types on learning performances

    Gated

    Video lectures are one of the primary learning resources embedded in e-learning environments. Many universities prepare video lectures and share them as open course materials with students. In order to make the learning process more efficient and effective, it is very important to design and personalize those learning resources for learners, taking into their needs […]

  • Psychophysiological responses to takeover requests in conditionally automated driving

    Gated

    In SAE Level 3 automated driving, taking over control from automation raises significant safety concerns because drivers out of the vehicle control loop have difficulty negotiating takeover transitions. Existing studies on takeover transitions have focused on drivers’ behavioral responses to takeover requests (TORs). As a complement, this exploratory study aimed to examine drivers’ psychophysiological responses […]

  • Exploring the Relationship between Speech and Skin Conductance for Real-Time Arousal Monitoring

    Gated

    Monitoring human emotions through wearable systems has become an important area of research. Electrodermal activity (EDA) has proven to be a good indicator of emotional arousal, and numerous works have focused on using EDA data to predict emotional states. However, to successfully integrate EDA data into real-time wearable emotion recognition systems, several challenges of practical […]

  • Attraction comes from many sources: Attentional and comparative processes in decoy effects

    Gated

    The attraction effect emerges when adding a seemingly irrelevant option (decoy) to a binary choice shifts preference towards a target option. This suggests that choice behaviour is dynamic, i.e., choice values are developed during deliberation, rather than manifesting some pre-existing preference set. Whereas several models of multi alternative and multiattribute decision making consider dynamic choice […]

Publications

Read publications made possible with iMotions

Blog

Get inspired and learn more from our expert content writers

Newsletter

A monthly close up of latest product and research news