A group of Nara Institute of Science and Technology, Tokai University, and Arizona State University has developed a technology that can operate the image projected by a projector on the floor or wall by "touch sensing".
In order to touch-operate the surface virtually displayed by projector projection like a smartphone, an additional touch sensing function must be implemented.However, there are still problems with conventional technology, such as the fact that the image is projected on the hand trying to touch and the detection of the hand is hindered, and it is difficult to determine the presence or absence of touch and the position with only one camera. rice field.
Therefore, in this research, we aimed to develop a touch sensing technology that is not affected by the image of the projector and can be realized with one camera.By using a camera called a rolling shutter, it is possible to shoot only the part slightly above the projected plane with a thickness of several cm.A part of the finger is photographed when it is touched, and the finger is not photographed when it is not touched, so that it can be determined from one camera whether or not the finger is touching the surface.The position information touched by the finger was reflected in the projected image by computer processing, which was connected to the touch operation.
By using this technology, even if the projector image contains a realistic hand, the camera does not mistakenly recognize the hand on the image as in the conventional method.Also, if the sensing area is set to a position slightly away from the plane, it can be applied to touchless "aerial operation" that detects the approach of a finger without directly touching the screen.
By combining a projector and a camera, it can be made into a touch display on any flat surface, and it is expected to be widely used as a relatively inexpensive and simple device.
Paper information:[IEEE ACCESS] Touch Sensing for a Projected Screen Using Slope Disparity Gating
