Developing a Virtual Reality Environment for Mining Research

DISCLAIMER The findings and conclusions in this paper are those of the authors and do not necessarily represent the official position of the National Institute for Occupational Safety and Health, Centers for Disease Control and Prevention. Mention of company names or products does not constitute endorsement by NIOSH. ABSTRACT Recent advances in computing, rendering, and display technologies have generated increased accessibility for virtual reality (VR). VR allows the creation of dynamic, high-fidelity environments to simulate dangerous situations, test conditions, and visualize concepts. Consequently, numerous products have been developed, but many of these are limited in scope. Therefore, National Institute for Occupational Safety and Health researchers developed a VR framework, called VR Mine, to rapidly create an underground mine for human data collection, simulation, visualization, and training. This paper describes the features of VR Mine using self-escape and proximity detection as case studies. Features include mine generation, simulated networks, proximity detection systems, and the integration and visualization of real-time ventilation models. INTRODUCTION There are many definitions of virtual reality (VR) that include various levels of immersion and features [1]. Some definitions refer to specific technologies [2], while others are limited to visualization [3]. For this paper, a more general definition of VR will be adopted. VR is defined as the collection of hardware and software that interactively engages users and stimulates their senses within a synthetic or virtual environment. From a hardware standpoint, this can include anything from a phone to a head-mounted display (HMD) to a large-scale theater as well as speakers, microphones, haptic sensors, and interaction devices. The software used to create virtual environments (VEs) generally includes a game engine, custom software components and libraries, and two-dimensional and three-dimensional graphical assets. Recent hardware and software advances have increased the fidelity and availability of VR. New and improved technologies including HMDs and high-resolution monitors and projectors can display sharper, more detailed visualizations. For example, in the past five years between the release of the Oculus Rift DK1 (2013) and the HTC Vive Pro (2018), there was a three-fold increase in resolution along with a 50% increase in the refresh rate. Furthermore, despite early claims that low-cost VR technology was readily available [4], computational power has not been sufficient to handle the large amount of data generated by these systems [5]. In the past five years, however, rendering speeds have more than doubled and memory has more than tripled [6], allowing these visualizations to be incorporated into higher-complexity and -fidelity VEs that more closely mirror the real world. Similarly, software capabilities have also significantly improved through game engine advancements and feature development. In the past several years, game engines have added and improved features such as physics, lighting, platform support (e.g. Android), and asset development integration. Some of the current leading commercial game engines are Amazon Lumberyard, CryEngine, Unreal, and Unity, but this can quickly change as is evident in the literature [7, 8].