Augmented Reality: Fujitsu touch and gesture video interface

*Basically an entry in the Kinect and LeapMotion sweepstakes. The video mechanism has nothing to do with the paper, but when you project on something and people touch it, they never look up to see the camera lens and projector. It always comes across to the user as "magic paper."

*People wonder where the Personal Computer is going... If you had this installed in homes and offices, users would look back in pity at yesterday's desktop-jockeys. They'd be like cramped victims of industrial malfeasance, blowing out their backs and wrists while peering through plastic portholes.

http://www.diginfo.tv/v/13-0025-r-en.php

(...)

"This technology measures the shape of real-world objects, and automatically adjusts the coordinate systems for the camera, projector, and real world. In this way, it can coordinate the display with touching, not only for flat surfaces like tables and paper, but also for the curved surfaces of objects such as books.

" "Until now, gesturing has often been used to operate PCs and other devices. But with this interface, we're not operating a PC, but touching actual objects directly, and combining them with ICT equipment."

" "The system is designed not to react when you make ordinary motions on a table. It can be operated when you point with one finger. What this means is, the system serves as an interface combining analog operations and digital devices."

"To detect touch accurately, the system needs to detect fingertip height accurately. In particular, with the low-resolution camera used here (320 x 180), if fingertip detection is off by a single pixel, the height changes by 1 cm. So, the system requires technology for recognizing fingertips with high precision...."

"Using a low-res webcam gives a fuzzy picture, but the system calculates 3D positions with high precision, by compensating through image processing."

"This system also includes technology for controlling color and brightness, in line with the ambient light, and correcting for individual differences in hand color. In this way, it can identify fingertips consistently, with little influence from the environment or individual differences...."