Skip to content

This research project develops and tests a data-driven and time-resolved machine-learning approach that predicts the intensity of amusement while participants watched videos.

Notifications You must be signed in to change notification settings

annelisesaive/Decoding_amusement_ML

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

17 Commits
 
 
 
 
 
 
 
 

Repository files navigation

A Time-Resolved ML Model to Predict the Intensity of Amusement during Video Viewing

Code for the paper "Wait for it! Predicting the intensity of amusement during humorous video viewing using a time-resolved machine learning approach"

Abstract and goal of the research paper

The present study aims to implement and validate a machine learning approach to predict the intensity of amusement evoked by viewing humorous video clips. We used a supervised Random Forest (RF) algorithm to predict 1) amusement intensity over time using participants' facial expressions and features of the viewed videos, 2) track its temporal dynamics, and 3) explore its long-term impact on subsequent trials. We found that viewing videos that were perceived as being amusing was associated with a higher propensity to smile (% Smile) - a combination of raising cheek (AU6) and pulling corner (AU12) - and that movement and saliency of humorous videos - known to reflect movies' genre (ex: action, romance, horror) - was significantly different than neutral videos. We also found that participants' tendency to smile was the most significant contribution to a successful prediction (R=0.522, p.001), and peaked toward the end of the videos with significant carry-over effects from one video over to the next. Our results highlight methodological avenues for refining basic and clinical humour research protocols by identifying the best time window for measuring and tracking amusement and characterizing the duration of the potentiating effect of humor across trials.

Technologies, libraries and frameworks used

  • Language: Python (Jupyter Notebook)
  • Data Manipulation: Pandas, Numpy
  • Visualization: Seaborn, Matplotlib
  • Machine-Learning & Stats: Scikit-Learn, Scipy, Statsmodels
  • Task Creation: Psychopy3
  • Features Creation: OpenFace2, OpenCV, Natural Language Toolkit (NLTK)

Project Folder

  • Behavioral Task : The task created in Psychopy3 to collect behavioral data and record facial expressions of the participant

  • Features Creation : Features extraction from video-recordings

  • ML Pipeline : ML model to predict the intensity of amusement during watching humorous videos

Contributors

The code was primarily wrote by Gabrielle Toupin and was reviewed by Anne-Lise Saive, Arthur Deghan and Karim Jerbi

About

This research project develops and tests a data-driven and time-resolved machine-learning approach that predicts the intensity of amusement while participants watched videos.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Jupyter Notebook 90.1%
  • Python 9.9%