Recent developments in AR & VR hardware have resulted in a range of nascent commercial products, e.g. the Microsoft Hololens and DAQRI smart helmet (augmented reality), Occulus Rift and HTC Vive (virtual reality). Laboratory use is an obvious application of current tether-free AR technology, which could enable new experimental methodologies as well as offer basic procedural, efficiency, training and health and safety benefits. VR technology, which typically requires tethering to a high-performance PC, provides a complementary platform, more suited to fully immersive computational uses such as multi-dimensional data visualization and big data applications.
Early work with the Hololens, investigating 3D visualization and basic lab usage, has already begun in the group; this project would further work to explore and develop these capabilities. See also the related project on heterogenous computing.
We’ve just finished a manuscript summarising our early work with the Hololens, including data visualization and interdisciplinary work. This is a little different in flavour to our usual work, but will provide a solid foundation for more advanced work with the Hololens, including lab uses and more advanced data visualization.
Paul Hockett & Tim Ingleby
Early hands-on experiences with the Microsoft Hololens augmented/mixed reality device are reported and discussed, with a general aim of exploring basic 3D visualization. A range of usage cases are tested, including data visualization and immersive data spaces, in-situ visualization of 3D models and full scale architectural form visualization. Ultimately, the Hololens is found to provide a remarkable tool for moving from traditional visualization of 3D objects on a 2D screen, to fully experiential 3D visualizations embedded in the real world.
The manuscript is currently available on Authorea, and the arxiv.
The hololens (microsoft.com/microsoft-hololens/) is here! Welcome to week 3* of the future, with augmented/mixed reality.
This week, some large scale basic 3D visualization as we begin to explore the power of the Hololens…
* Original video, July 2016; not uploaded until Sept. 2016 due to embargo on the cabin design.
A full manuscript on this work is now available.
The hololens is here! Welcome to week 4 of the future, with augmented/mixed reality.
This week, a bit of basic use in the laser lab, using Hololens for a remote desktop feed and rapid reference data snapshots. These are the first steps towards a more sophisticated and interactive use in the lab, which could bring together data from multiple discrete instruments around the lab, and present them to the user in either a spatially fixed form (as in the video), or a HUD which tracks and is always visible as the user moves around.
Some additional notes & links:
The hololens is here! Welcome to week 2 of the future, with augmented/mixed reality.
This week, a bit of basic 3D data visualization as we begin to explore the power of the Hololens…
Some additional notes:
- More details of the data shown in part (1) can be found in Time-resolved imaging of purely valence-electron dynamics during a chemical reaction, P. Hockett, C. Z. Bisgaard, O. J. Clarkin, A. Stolow, Nature Physics 7, 612-615 (2011)
(See, in particular, the Supplementary Material)
- More details of the data shown in part (2) can be found in Maximum Information Photoelectron Metrology, Hockett, P., Lux, C., Wollenhaupt, M. & Baumert, T., Phys. Rev. A, 92, 013412 (2015) – also available on the arXiv.
- Figure2xhtml for converting Matlab figures to 3D xml can be found here.
- 3D data for part (1) and part (2), in .fbx format.
The hololens is here! Welcome to week 1 of the future, with augmented/mixed reality. Ultimately there are going to be some amazing scientific uses for this new tool – e.g. basic HUD in the lab, multi-dimensional data visualization, 3D design with real-world interaction and interactive collaboration etc. etc. – but first, we need to learn the tool, understand it, and develop methods.
Here’s a very brief demo of the spatial mapping capabilities of the Hololens (development edition), in a relatively cluttered environment, visualized using the LSrD application. It’s impressive, and was even better in real life!