IsoClear.JPG
FrontClear.JPG
EmbeddedImage (2).jpg

XRC Toolkit

The XRC Toolkit is a collection of tools and 3D interaction techniques, developed by the XR Collaboratory, to accelerate AR/VR prototyping. These modular, reusable packages are used across all our prototyping activities, including research explorations, collaborations, and student projects.

SELECTED PACKAGES

  • XRC Alignment Tool

    This package provides a tool for aligning object to user-defined planes and coordinate systems.

    Documentation

  • XRC Mesh Tool

    This package provides a tool for manipulating the vertices of a 3D mesh.

    Documentation

  • XRC Go-Go

    This package is an implementation of the Go-Go interaction technique.

    Documentation

  • XRC Color Tool

    This package provides a tool for modifying the color properties of a selected object.

    Documentation

  • XRC Scale Tool

    This package provides a tool for manipulating the scale of a selected object.

    Documentation

  • XRC Line Tool

    This package provides a tool for creating a simple line in 3D space.

    Documentation

  • XRC Create Tool

    This package provides a tool for creating, deleting, and duplicating 3D objects.

    Documentation

  • XRC Grab Move

    This package is an implementation of the Grab Move locomotion technique.

    Documentation

  • XRC Sphere Select

    This package is an implementation of the Sphere Select interaction technique.

    Documentation

Explorations

We study different themes and 3D interaction challenges through project activities called Explorations. These projects are frequently used to test XRC Toolkit components in specific application contexts.

SELECTED EXPLORATIONS

  • Campus Designer

    The Campus Designer project enables members of the XR Collaboratory to deploy their interaction techniques in the context of a 3D design tool, as well as for iteration and evaluation of XRC Toolkit packages.

  • Marble Run

    The Marble Run project allows XR Collaboratory members to quickly iterate on system control techniques for controlling motors and robot prototypes. Student contributors: Vikram Pandian, Grant Hinkle

  • Campus Walker

    Campus Walker explores how we might navigate and interact with virtual environments using real-time volumetric avatars

Collaborations

We collaborate with Cornell faculty on AR/VR-related projects in fields such as computer vision, computer graphics, and human-computer interaction, as well as application domains such as healthcare and architecture.

SELECTED COLLABORATIONS

  • ReRun: Enabling Multi-Perspective Analysis of Driving Interaction in VR

    David Goedicke, Harald Haraldsson, Navit Klein, Lunshi Zhou, Avi Parush, Wendy Ju

    In Companion of the 2023 ACM/IEEE International Conference on Human-Robot Interaction (HRI '23). Association for Computing Machinery, New York, NY, USA, 889–890.

    PDF

  • Designing Extended Reality Guidance for Physical Caregiving Tasks

    Nicola Dell, Deborah Estrin, Harald Haraldsson, Wendy Ju

    2022 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW), Christchurch, New Zealand, 2022, pp. 419-422, doi: 10.1109/VRW55335.2022.00091.

    PDF | Video

  • Continuous Travel In Virtual Reality Using a 3D Portal

    Andrew Atkins, Serge Belongie, and Harald Haraldsson

    In Adjunct Proceedings of the 34th Annual ACM Symposium on User Interface Software and Technology (UIST '21 Adjunct). Association for Computing Machinery, New York, NY, USA, 51–54.

    PDF

  • Stay Positive: Non-Negative Image Synthesis for Augmented Reality

    Katie Luo, Guandao Yang, Wenqi Xian, Harald Haraldsson, Bharath Hariharan, Serge Belongie

    IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2021 (Oral)

    Website | Paper | Video

  • Residual Aligned: Gradient Optimization for Non-Negative Image Synthesis

    Yu Shen, Katie Z Luo, Guandao Yang, Harald Haraldsson, Serge Belongie

    ICCV Workshop on Computer Vision for Augmented and Virtual Reality, 2021

    PDF | Video | Code

  • Head-mounted Augmented Reality for Guided Surface Reflectance Capture

    Harald Haraldsson, Søren Skovsen, Ser-Nam Lim, Steve Marschner, Serge Belongie, Abe Davis

    CVPR Workshop on Computer Vision for Augmented and Virtual Reality, 2020

    PDF | Video

  • Decoupled Localization and Sensing with HMD-based AR for Interactive Scene Acquisition

    Søren K. Skovsen, Harald Haraldsson, Abe Davis, Henrik Karstoft, Serge Belongie

    2020 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct)

    PDF

  • Generating Spatial Attention Cues via Illusory Motion

    Janus Nortoft Jensen, Morten Hannemose, Jakob Wilm, Anders Bjorholm Dahl, Jeppe Refall Frisvad, Serge Belongie

    CVPR Workshop on Computer Vision for Augmented and Virtual Reality, Long Beach, CA, 2019

    PDF

Student Projects

We provide mentorship for several student projects each semester at Cornell Tech. See also course projects.

SELECTED STUDENT PROJECTS