Is Fidgety Philip's ground truth also ours? The creation and application of a machine learning algorithm.

Abstract

BACKGROUND:

Behavioral observations support clinical in-depth phenotyping but phenotyping and pattern recognition are affected by training background. As Attention Deficit Hyperactivity Disorder, Restless Legs syndrome/Willis Ekbom disease and medication induced activation syndromes (including increased irritability and/or akathisia), present with hyperactive-behaviors with hyper-arousability and/or hypermotor-restlessness (H-behaviors), we first developed a non-interpretative, neutral pictogram-guided phenotyping language (PG-PL) for describing body-segment movements during sitting.

METHODOLOGY & RESULTS:

The PG-PL was applied for annotating 12 1-min sitting-videos (inter-observer agreements >85%->97%) and these manual annotations were used as a ground truth to develop an automated algorithm using OpenPose, which locates skeletal landmarks in 2D video. We evaluated the algorithm's performance against the ground truth by computing the area under the receiver operator curve (>0.79 for the legs, arms, and feet, but 0.65 for the head). While our pixel displacement algorithm performed well for the legs, arms, and feet, it predicted head motion less well, indicating the need for further investigations.

CONCLUSION:

This first automated analysis algorithm allows to start the discussion about distinct phenotypical characteristics of H-behaviors during structured behavioral observations and may support differential diagnostic considerations via in-depth phenotyping of sitting behaviors and, in consequence, of better treatment concepts.

• Authors: Nadia Beyzaei, Seraph Bao, Yanyun Bu, Linus Hung, Hebah Hussaina, Khaola Safia Maher, Melvin Chan, Heinrich Garn, Gerhard Kloesch, Bernhard Kohn, Boris Kuzeljevic, Scout McWilliams, Karen Spruyt, Emmanuel Tse, Hendrik F Machiel Van der Loos, Calvin Kuo, Osman S Ipsiroglu
• Journal: Journal of psychiatric research (J Psychiatr Res) Vol. 131 Pg. 144-151 (12 2020) ISSN: 1879-1379 [Electronic] England
• PMID: 32971358 (Publication Type: Journal Article, Research Support, Non-U.S. Gov't)
• Copyright: Copyright © 2020. Published by Elsevier Ltd.

Topics

• Algorithms
• Attention Deficit Disorder with Hyperactivity
• Humans
• Machine Learning
• Movement
• Restless Legs Syndrome