Smartphone-Derived Multidomain Biometrics and Machine Learning Aid Parkinson's Disease Identification

National Taiwan University Hospital

Analysing Speech


In the voice analysis, participants were asked to read a short paragraph from "The North Wind and the Sun," which contains approximately 500 words. The distance between the voice recorder and the participants was about 35 cm.

Key Voice Features:

  1. Reading Time: Duration taken to read the paragraph
  2. Phonetic Score: Assessment of pronunciation accuracy
  3. Pause Percentage: Proportion of pauses during reading
  4. Voice Volume Variance: Variability in the loudness of the voice
  5. Average Pitch: Mean pitch of the voice signal
  6. Pitch Variance: Variability in the pitch of the voice



Analysing Finger Tapping


In finger tapping analysis, participants were instructed to perform finger tapping as quickly as possible for a duration of 30 seconds in front of a camera. Participants were asked to raise their hands as close to the camera as possible for optimal visibility. We used Google MediaPipe to detect the finger gestures and identified a total of 21 landmarks of hand gestures.

Key Finger Tapping Features:

  1. Finger Tapping Duration: Measures the time it takes for the index finger to touch the thumb
  2. Finger Tapping Duration Change: Observes the variation in the duration of the index-to-thumb touches
  3. Finger Tapping Distance: Calculates the distance between the index finger and thumb
  4. Finger Tapping Frequency: Calculates the frequency of finger tapping



Analysing 1 minute Walking Gait


In our gait analysis, we utilized a human pose estimation model to accurately estimate body poses. This model was pre-trained and used for both pose analysis and 2D-to-3D landmark prediction.

Key Gait Features:

  1. Walking Duration: Measures the total time taken to walk a certain distance
  2. Step Length: Calculates the distance covered in one step
  3. Turning Duration: Records the time taken to complete a turn
  4. Percentage of Foot on Ground: Analyzes how long each foot stays in contact with the ground



Understanding Your Results

"Normal" indicates no signs of neurological abnormalities, while "At Risk" suggests potential neurological concerns. It is recommended to consult a neurologist for further evaluation if you fall into the latter category.

Recommendations

If any of your results indicate a moderate or high risk, please do not be overly alarmed. We recommend visiting a neurologist for a detailed examination and further assistance.