Phonecam-based Interactions for Large Public Displays

Researchers:
Rafael "Tico" Ballagas RWTH Aachen Univeristy

Michael Rohs ETH Zurich

Jennifer G. Sheridan Lancaster University



Overview:
We are interested in finding mechanisms for users to use their mobile phones as ubiquitous pointing devices for public and situated displays.

Point & Shoot:
The point & shoot technique allows users to aim the mobile phone camera to select objects on a situated display using a cursor on the live camera image of the mobile phone. This technique uses Visual Codes to establish a coordinate system on the situated display independent of the viewing perspective.

Sweep:
The sweep technique allows the phonecam to be used like an
optical mouse. Using optical flow image processing, the phonecam
samples successive images and then sequentially compares them to
determine relative motion in the (x, y, theta) dimensions thus
allowing the camera to be used as a three degrees of freedom input
device.


Designing for Serendipity:
To allow serendipitous interactions with displays in public, people must have a way to fluidly establish the communications relationships. In our implementation, we are using Visual Codes to encode the bluetooth address of the public display. Users merely need to take a picture of the display (along with its visual code) to begin interacting with it.



Related Publications:

    2006

  • Rafael Ballagas, Michael Rohs, Jennifer Sheridan and Jan Borchers. The Smart Phone: A Ubiquitous Input Device. In IEEE Pervasive Computing, pages 70–77, number 1, Jan-Mar 2006.
    PDF DocumentBibTeX Entry
  • 2005

  • Rafael Ballagas, Michael Rohs and Jennifer Sheridan. Mobile Phones as Pointing Devices.  In Pervasive 2005 Workshop on Pervasive Mobile Interaction Devices (PERMID),Munich, Germany, May 2005.
    HomepagePDF DocumentBibTeX Entry
  • Rafael Ballagas, Michael Rohs and Jennifer Sheridan. Sweep and Point & Shoot: Phonecam-Based Interactions for Large Public Displays.  In CHI '05: CHI '05 extended abstracts on Human factors in computing systems, pages 1200–1203, ACM Press, New York, NY, USA, April 2005.
    MoviePDF DocumentBibTeX Entry




We use cookies on our website. Some of them are essential for the operation of the site, while others help us to improve this site and the user experience (tracking cookies). You can decide for yourself whether you want to allow cookies or not. Please note that if you reject them, you may not be able to use all the functionalities of the site.