Filters and Search 🔍
  • Multi-modal Sentiment Analysis using Deep Canonical Correlation Analysis

    Gated

    Abstract: This paper learns multi-modal embeddings from text, audio, and video views/modes of data in order to improve upon downstream sentiment classification. The experimental framework also allows investigation of the relative contributions of the individual views in the final multi-modal embedding. Individual features derived from the three views are combined into a multi-modal embedding using […]

  • Eye-Tracking Boston City Hall to Better Understand Human Perception and the Architectural Experience

    Gated

    Abstract: Learning how architecture impacts human perception can help us understand how civic monuments bring us together or drive us apart, create community cohesion and identity or the reverse: anomie, placelessness and the fragmentation of the public realm. Boston City Hall and Plaza, an urban renewal project from the 1960s, intended to revitalize a historic […]

  • The dualistic regulatory effect of passion on the relationship between fear of failure and negative affect: Insights from facial expression analysis

    Gated

    Abstract: Across two studies, we theorize and empirically investigate passion as a moderator of the negative affective consequences of fear of failure in early-stage entrepreneurship. We test our hypotheses in two field studies of naturally occurring affective events—namely, pitching competitions—and we complement self-reported measures of negative affect with physio-psychological measures obtained from analyzing entrepreneurs’ facial […]

  • Learning Representations from Imperfect Time Series Data via Tensor Rank Regularization

    Gated

    Abstract: There has been an increased interest in multimodal language processing including multimodal dialog, question answering, sentiment analysis, and speech recognition. However, naturally occurring multimodal data is often imperfect as a result of imperfect modalities, missing entries or noise corruption. To address these concerns, we present a regularization method based on tensor rank minimization. Our […]

  • Emotional domotics: a system and experimental model development for UX implementations

    Gated

    Abstract: The Emotional Domotics (home automation) is a concept that has been one of the main focus of our research team seeks to integrate the subject or user of an inhabitable space as central element for the modulation and control of the environmental variables in a house automation implementation for the life quality improvement and […]

  • Eye-tracking Retrospective Think-aloud as a Novel Approach for a Usability Evaluation

    Gated

    Abstract: Objective To report on the use of an eye-tracking retrospective think-aloud for usability evaluation and to describe its application in assessing the usability of a mobile health app. Materials and Methods We used an eye-tracking retrospective think-aloud to evaluate the usability of a HIV prevention mobile app among 20 young men (15-18 years) in […]

  • Human-virtual character interaction: Toward understanding the influence of haptic feedback

    Gated

    Abstract: In this study, we compare haptic feedback and nonhaptic feedback conditions in which virtual characters bump into the participant who is immersed in a virtual environment. A questionnaire was developed to determine the influence of haptic feedback on a number of concepts (presence, embodiment, positive and negative affect, interaction realism with virtual character, and […]

  • Human, Virtual Human, Bump! A Preliminary Study on Haptic Feedback

    Gated

    Abstract: How does haptic feedback during a human-virtual human interaction affect emotional arousal in virtual reality? In this between-subjects study, we compare haptic feedback and no haptic feedback conditions in which a virtual human “bumps” into the participant in order to determine the influence of haptic feedback on emotional arousal, sense of presence, and embodiment […]

  • The Effect of Taboo Content on Incidental Vocabulary Acquisition in a Foreign Language: A Facial Expression Analysis Study

    Gated

    Abstract: This study aims to examine how taboo content affects language learner psychology and language learning gains in a multi-modal learning environment by using facial expression analysis. 40 Muslim language learners were initially asked about their opinions on pork and watched a subtitled cooking video including pork visuals and their facial expressions were recorded. Before […]

  • Mimicking and sharing emotions: a re-examination of the link between facial mimicry and emotional contagion

    Gated

    Abstract: Facial mimicry has long been considered a main mechanism underlying emotional contagion (i.e. the transfer of emotions between people). A closer look at the empirical evidence, however, reveals that although these two phenomena often co-occur, the changes in emotional expressions may not necessarily be causally linked to the changes in subjective emotional experience. Here, […]

Publications

Read publications made possible with iMotions

Blog

Get inspired and learn more from our expert content writers

Newsletter

A monthly close up of latest product and research news