The general concept of virtual reality system supported by data gathered by means of optical 3D shape measurement system is presented. The methodology of data filtering, coding and streaming in order to perform real-time transmission of 3D data into virtual reality is given. The concept of a virtual camera, as the mean for interactive object visualization in VR environment is introduced. The details of data coding and filtering methods are given and their algorithmic implementation is described. The directions of future works focused on full implementation of the concept of hybrid experimental-numerical VR systems are discussed.