← Personal Photonics Project

 ARPen: In-Situ 3-D Modeling

 

We recently released the ARPen iOS app to the App Store. Check it out!

 


Ever wanted to 3d print a dock for your phone? Or maybe a coffee cup holder that can be attached next to your car dashboard? If so, you probably need to measure the dimensions of your phone and dashboard, construct 3d models using software, and then convert them to correct format before 3d printing them. Even then, it might happen that your 3d objects do not look as well as you had expected.

In this project, we investigate techniques that allow you to construct 3d models by using a pen to sketch around existing objects. Yes—3d modeling is now as simple as doodling! Your 3d model snaps to the dimensions of existing objects and you can even view your design in-place using a smartphone to make sure you are happy with your model. Then, you can export the model to 3d print it at your local FabLab!

News

  • ARPen will be presented as a full paper at ACM CHI, the premier international conference on Human-Computer Interaction. (Feb 22, 2019)
  • You can now track a pen in 3D using just your smartphone! We have built an ARKit-based iOS app that can track a pen. For instructions, head over to the GitHub repo. (Feb. 20, 2018)

Sources

  • Feb., 2018: ARKit-based 3D tracking of a custom pen via an iOS app. Source code for the iOS app, and instructions to run the iOS app and build the custom ARPen can be found here: Source code and documentation (GitHub).
  • Dec., 2017: Kinect-based 3D tracking of a 3d printed custom pen (or any object). The algorithm is able to track the 3D coordinates and orientation of an object using a single Kinect 2.0: Source code and documentation (GitHub).

Team

Prof. Jan Borchers: Project Manager
Dr. Simon Voelker: Project Manager
Philipp Wacker, M.Sc.: Computer Vision foundations
Krishna Subramanian, M.Sc.: Community Manager 

Publications

    2019

  • Oliver Nowak. ARMenus: An Evaluation of Menu Interfaces in Pen-based AR Applications on Smartphones. Masters's Thesis, RWTH Aachen University, Aachen, February 2019.
    PDF DocumentBibTeX Entry
  • Philipp Wacker, Oliver Nowak, Simon Voelker and Jan Borchers. ARPen: Mid-Air Object Manipulation Techniques for a Bimanual AR System with Pen & Smartphone.  In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems, CHI '19, pages 619:1–619:10, ACM, New York, NY, USA, May 2019.
    HomepageMoviePDF DocumentBibTeX Entry
  • 2018

  • Philipp Wacker, Adrian Wagner, Simon Voelker and Jan Borchers. Physical Guides: An Analysis of 3D Sketching Performance on Physical Objects in Augmented Reality.  In Proceedings of the 6th Symposium on Spatial User Interaction, SUI '18, pages 10, ACM, New York, NY, USA, October 2018.
    HomepageMoviePDF DocumentBibTeX Entry
  • Adrian Wagner. Analyzing 3D Sketching Performance on Physical Objects in Augmented Reality. Masters's Thesis, RWTH Aachen University, Aachen, April 2018.
    PDF DocumentBibTeX Entry
  • Philipp Wacker, Adrian Wagner, Simon Voelker and Jan Borchers. Physical Guides: An Analysis of 3D Sketching Performance on Physical Objects in Augmented Reality.  In Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems, CHI EA '18, pages LBW626:1–LBW626:6, ACM, New York, NY, USA, April 2018.
    HomepageMoviePDF DocumentBibTeX Entry
  • Felix Wehnert. Pen-based Drawing in Augmented Reality on Mobile Phones. Bachelor's Thesis, RWTH Aachen University, Aachen, April 2018.
    PDF DocumentBibTeX Entry
  • 2017

  • Luisa Hoffmann. Eliciting User Gestures for the Interaction with a Pen-Based 3D Modeling Device. Bachelor's Thesis, RWTH Aachen University, Aachen, March 2017.
    PDF DocumentBibTeX Entry

Funding

ARPen is part of the Personal Photonics project, which is funded by the German Federal Ministry of Education and Research (BMBF) as part of their Open Photonics call (project ID 13N14065).

image.pngMake_Light_BMBF.png.jpeg

Internal project pages (registered users only)


← Personal Photonics Project 

Cookies make it easier for us to provide you with our services. With the usage of our services you permit us to use cookies.
More information Ok