SYSTEM AND METHOD FOR AUTOMATIC RECOGNITION FOR HAND ACTIVITY DEFINED IN UNIFIED PARKINSON DISEASE RATING SCALE

20210150718

16/683358

November 14, 2019

There is included an apparatus and system including image segmentation code, configured to cause at least one hardware processor to segment an image of a person's hand from an input image, and classification code configured to cause the at least one processor to classify the segmented image of the person's hand according to at least one predefined pose.

TENCENT AMERICA LLC (Palo Alto, CA, US)

1. An apparatus comprising: at least one memory configured to store computer program code; and at least one hardware processor configured to access said computer program code and operate as instructed by said computer program code, said computer program code including: image segmentation code configured to cause the at least one hardware processor to segment an image of a person's hand from an input image; and classification code configured to cause the at least one processor to classify the segmented image of the person's hand according to at least one predefined pose.

2. The apparatus according to claim 1, wherein the at least one predefined pose comprises any of a hand tremor, a finger tapping, and a pronation-supination movement of the person's hand.

3. The apparatus according to claim 1, wherein the image segmentation code is further configured to cause the at least one hardware processor to segment the image of the person's hand by extracting the person's hand from the input image such that a background, other than the person's hand, is removed from the input image.

4. The apparatus according to claim 1, wherein the image segmentation code is further configured to cause the at least one hardware processor to segment the input image of the person's hand by extracting the person's hand from the input image such that an illuminance removed from the input image.

5. The apparatus according to claim 1, wherein the segmented image comprises a mask of the person's hand from the input image such that a background of the input image and an illuminance of the input image are removed from the input image.

6. The apparatus according to claim 1, wherein the computer program code further includes post processing code configured to cause the at least one hardware processor to smooth at least one edge of the person's hand in the segmented image, and wherein the classification code is further configured to cause the at least one hardware processor to classify the segmented image in which the at least one edge has been smoothed according to the post processing code.

7. The apparatus according to claim 1, wherein the image segmentation code is further configured to cause the at least one hardware processor to segment the image according to a UNet segmentation network.

8. The apparatus according to claim 7, wherein the UNet segmentation network comprises data trained by manually labeled masks and at least one set of data augmentation techniques including any of histogram equalization, Gaussian blurring, rotation, and zoom techniques.

9. The apparatus according to claim 7, wherein the classification code is further configured to cause the at least one hardware processor to classify the segmented image according to a convolutional neural network (CNN).

10. The apparatus according to claim 1, wherein the classification code is further configured to cause the at least one hardware processor to classify the segmented image according to a convolutional neural network (CNN).

11. A method performed by at least one hardware processor, the method comprising: segmenting an image of a person's hand from an input image; and classifying the segmented image of the person's hand according to at least one predefined pose.

12. The method according to claim 11, wherein the at least one predefined pose comprises any of a hand tremor, a finger tapping, and a pronation-supination movement of the person's hand.

13. The method according to claim 11, wherein segmenting the image of the person's hand comprises extracting the person's hand from the input image such that a background, other than the person's hand, is removed from the input image.

14. The method according to claim 11, wherein segmenting the image of the person's hand comprises extracting the person's hand from the input image such that an illuminance removed from the input image.

15. The method according to claim 11, wherein the segmented image comprises a mask of the person's hand from the input image such that a background of the input image and an illuminance of the input image are removed from the input image.

16. The method according to claim 11, further comprising: smoothing at least one edge of the person's hand in the segmented image; and classifying the segmented image in which the at least one edge is smoothed according to the post processing code.

17. The method according to claim 11, wherein segmenting the image comprises segmenting the image according to a UNet segmentation network.

18. The method according to claim 17, wherein the UNet segmentation network comprises data trained by manually labeled masks and at least one set of data augmentation techniques including any of histogram equalization, Gaussian blurring, rotation, and zoom techniques.

19. The method according to claim 17, wherein classifying the segmented image comprises classifying the segmented image according to a convolutional neural network (CNN).

20. A non-transitory computer readable medium storing a program causing a computer to execute a process, the process comprising: segmenting an image of a person's hand from an input image; and classifying the segmented image of the person's hand according to at least one predefined pose.

06; 06; 06; 06; 06; 61; 61

edspap.20210150718