MemoCare: An Interactive Multimodal Mobile System for Automated Cognitive Screening

Key points

• A React Native application combines spoken responses, temporal and spatial orientation, touchscreen actions, and visuoconstruction in complete English and Vietnamese workflows.1
• Speech is transcribed by Google Speech-to-Text and scored locally with deterministic task-specific natural language processing rules; GPS coordinates are resolved by the MemoCare spatial module before answer matching; touch tasks are scored from interaction events; and the drawing task uses a three-model convolutional neural network consensus with separate visual interpretation.1
• Software tests pass 151/151 predefined cases across speech/language, spatial-answer, and touch-interaction scoring, while spatial regression passes 48/48 four-country coordinate-resolution cases.1
• For the drawing module, validation-selected ShuffleNetV2 x1.5 achieved 91.33% mean balanced accuracy and 78.87% exact three-criterion accuracy on a locked 71-image test set.1

Sources (1)

• [1]MemoCare: An Interactive Multimodal Mobile System for Automated Cognitive Screening
  arXiv (AI, ML, NLP, CV, robotics, multi-agent) · Oct 7, 05:19 PM

  MemoCare is an interactive mobile system for automated multimodal cognitive screening.

  A React Native application combines spoken responses, temporal and spatial orientation, touchscreen actions, and visuoconstruction in complete English and Vietnamese workflows.

Extractive summary: sentences quoted from the sources.