Using the ARPen iOS App

ARPen iOS App


The ARPen iOS app allows you to perform freehand sketching, create simple 3d geometries like cubes, and explore interaction techniques for menu selection and mid-air object translation. ARPen also allows you to export the created model or sketch as an *.STL file. Interested in trying it out? Follow these instructions

  1. Download the app on iOS App Store using the above ARPen iOS App.
  2. To try out the ARPen app, please print this document (without scaling) and fold it to create a paper ARPen. ARPen can detect the marker on this document and you can use this for sketching or modeling. To use all of the app's features, you need to make a fully-functional ARPen. This can be 3d printed at your local Fab Lab using simple electronics and machines. It contains physical buttons that can be used for sketching. For detailed instructions on making the fully-functional ARPen, see the ARPen GitHub repository
  3. Open the app on your phone. In the splash screen shown below, the ARPen app will calibrate the scene and try to detect an ARPen. If you are using the ARPen card or paper ARPen, don't worry if it cannot detect an ARPen—this is meant to happen. 
    splash-screen.jpg 
  4. Once the main screen loads, you can begin sketching in AR! Hold the paper ARPen or the Bluetooth ARPen in front of your camera so that the marker is visible. 
    Holding the ARPen card
  5. The red circle, shown at the top-left corner for the ARPen card, indicates your pen tip. To sketch, make sure the paint button (B) is selected, and move the ARPen in mid-air! If you are using the ARPen card or paper ARPen, you need to press and hold the software button (A) while sketching. If you are using a fully-functional ARPen, you can use the push button on the side near the pen tip. 
    Sketching with ARPen cardboard
  6. You can try other features of the ARPen app by clicking on the corresponding buttons on the main screen: Use button C to create a cube, button D to try out various designs for AR menus, and button E to try out different interaction techniques for mid-air object translation! Remember that, for all features, the red circle can be used to point in mid-air and either the software button (A) (in case of ARPen card or paper ARPen) or the push buttons (in case of fully-functional ARPen) to initiate action (e.g., place an object, select an object).
    ARmenu and object translation

Useful links

  • ARPen project page, which includes details of the project, deliverables, and related publications. 
  • ARPen GitHub repository, which includes the source code and instructions to build a fully-functional ARPen.
Attachments:
FileDescriptionFile sizeDownloadsLast modified
Download this file (aruco-marker.pdf)arUco marker for paper ARPenarUco marker for paper ARPen12 kB782019-04-23 17:09
Cookies make it easier for us to provide you with our services. With the usage of our services you permit us to use cookies.
More information Ok