Το work with title Virtual video synthesis for personalized training by Markolefas Filippos, Moirogiorgou Konstantia, Giakos George C., Zervakis Michail is licensed under Creative Commons Attribution 4.0 International
Bibliographic Citation
F. Markolefas, K. Moirogiorgou, G. Giakos and M. Zervakis, "Virtual video synthesis for personalized training," in IEEE International Conference on Imaging Systems and Techniques, 2018. doi: 10.1109/IST.2018.8577097
https://doi.org/10.1109/IST.2018.8577097
Online personal training allows users to work out from the comfort of their own homes using workout videos designed by fitness instructors. Users of such applications can use their device (PC, laptop, smart TV, etc.) camera and work out with others in a group setting, enabling plethora of intertwined benefits. In order to enhance training efficiency, it could be helpful for the trainee to superimpose his/her human silhouette, giving the opportunity to easily detect the differences of his/her exercise over the trainer's movements. One way to proceed towards this direction is to have a camera recording the video of the trainee during the exercise, which should be presented in contrast to the instructor's video on the device screen. In this work, we explore this direction and present traditional background estimation approaches in combination with foreground extraction techniques using videos recorded with static cameras. It is shown that none of the presented methods is able to efficiently face all possible challenges, like slow moving object (foreground) or presence of the moving object at the phase of background initialization, problems that mainly appear in in yoga exercise. As an alternative, we propose a series of techniques including an initial background reconstruction method followed by a selective updating scheme. In this way, the background image adaptively converges to the ground truth data enabled by the merging of information from detected moving regions (temporal processing) and color-based regions (spatial processing) of the video segment. Finally, we also apply the proposed method in space surveillance applications, using surveillance cameras, in order to evaluate the generality and efficiency of the proposed approach.