Ultrasound 3D gesture recognition

dc.contributor.advisorNiesler, T. R.en_ZA
dc.contributor.authorKim, Hankyuen_ZA
dc.contributor.otherStellenbosch University. Faculty of Engineering. Dept. of Electrical and Electronic Engineering.en_ZA
dc.date.accessioned2018-02-28T08:47:52Z
dc.date.accessioned2018-04-09T07:06:32Z
dc.date.available2018-02-28T08:47:52Z
dc.date.available2018-04-09T07:06:32Z
dc.date.issued2018-03
dc.descriptionThesis (MEng)--Stellenbosch University, 2018.en_ZA
dc.description.abstractENGLISH ABSTRACT: Interest in gesture recognition systems have grown with the recent advancements in the field of virtual and augmented reality. Gesture recognition provides a flexible interface that is not bound by the hardware as traditional mouse and keyboard combination do. This flexibility is important in virtual environments where the user has to interact with 3 dimensional objects. Having a reliable gesture recognition system will allow development of an intuitive user interface where the user can work with virtual objects as they would do in the real life. This research presents the development of a 2D beamforming microphone array for capturing 3D images, and the processing of the captured images for gesture recognition. The developed hardware consists of an 8x8 square array of MEMS microphones that capture pulsed sinusoids emitted by an ultrasonic transducer. The data from the microphone array is demodulated, filtered, and beamformed using appropriate methods to produce 3D images of the scene. The captured data is then processed, extracting only the relevant features, to a set of time-series vectors that represents the movement of a hand - i.e. a gesture. Using dynamic time warping (DTW) and k-nearest neighbours, the presented gestures are matched with previously captured templates, thereby recognising the type of gesture that was presented. The result showed very promising outcome with 97.5% accuracy in identifying correct gestures when the gestures are presented using a reflector, and 88.2% when the gestures are presented with a bare hand.en_ZA
dc.description.abstractAFRIKAANSE OPSOMMING: Geen opsomming beskikbaaraf_ZA
dc.format.extent116 pages : illustrationsen_ZA
dc.identifier.urihttp://hdl.handle.net/10019.1/103697
dc.language.isoen_ZAen_ZA
dc.publisherStellenbosch : Stellenbosch Universityen_ZA
dc.rights.holderStellenbosch Universityen_ZA
dc.subjectGesture Recognitionen_ZA
dc.subjectUCTDen_ZA
dc.subjectUltrasonic imagingen_ZA
dc.subjectThree-dimensional imagingen_ZA
dc.subjectMicrophone arraysen_ZA
dc.titleUltrasound 3D gesture recognitionen_ZA
dc.typeThesisen_ZA
Files
Original bundle
Now showing 1 - 1 of 1
Loading...
Thumbnail Image
Name:
kim_ultrasound_2018.pdf
Size:
14.27 MB
Format:
Adobe Portable Document Format
Description:
License bundle
Now showing 1 - 1 of 1
Loading...
Thumbnail Image
Name:
license.txt
Size:
1.71 KB
Format:
Plain Text
Description: