TL;DR: In this article, the authors propose a contents generating apparatus that can support functions of moving object substitution, depth-based object insertion, background image substitution, and view offering upon a user request and provide realistic image by applying lighting information applied to a real image to computer graphics object.
Abstract: Provided are a contents generating apparatus that can support functions of moving object substitution, depth-based object insertion, background image substitution, and view offering upon a user request and provide realistic image by applying lighting information applied to a real image to computer graphics object when a real image is composited with computer graphics object, and a contents generating method thereof. The apparatus includes: a preprocessing block, a camera calibration block, a scene model generating block, an object extracting/tracing block, a real image/computer graphics object compositing block, an image generating block, and the user interface block. The present invention can provide diverse production methods such as testing for the optimal camera viewpoint and scenic structure before contents are actually authored and compositing two different scenes taken in different places into one scene based on a concept of a three-dimensional virtual studio in the respect of a contents producer.
TL;DR: The Virtual Studio concept replaces real background sets with computer-generated synthetic scenes, and image sequences combine real foreground action, shot in the studio, with computer generated backgrounds.
Abstract: The Virtual Studio concept replaces real background sets with computer-generated synthetic scenes. Image sequences combine real foreground action, shot in the studio, with computer generated backgrounds. The Mona Lisa project seeks to develop and integrate technologies (algorithms, software, and hardware) needed to construct, handle, and render 3D models in real time.
TL;DR: This article reports its initial experience in the domain of pervasive healthcare with producing virtual video prototypes and using them in a design workshop, and experienced how it enabled users to relate to the practicalities and context of applied technology.
Abstract: Virtual studio technology enables the mixing of physical and digital 3D objects and thus expands the way of representing design ideas in terms of virtual video prototypes, which offers new possibilities for designers by combining elements of prototypes, mock-ups, scenarios, and conventional video. In this article we report our initial experience in the domain of pervasive healthcare with producing virtual video prototypes and using them in a design workshop. Our experience has been predominantly favourable. The production of a virtual video prototype forces the designers to decide very concrete design issues, since one cannot avoid paying attention to the physical, real-world constraints and to details in the usage-interaction between users and technology. From the users' perspective, during our evaluation of the virtual video prototype, we experienced how it enabled users to relate to the practicalities and context of applied technology. One of the main limitations experienced in the creation of the virtual video prototypes is the lack of user-involvement.
TL;DR: In this article, a multifunctional integrated studio system consisting of a computer which is connected with an external video signal source and an external audio signal source was presented. And the computer also provided with a touch panel displayer, an external switcher, a control and operation analysis unit connected with the mouse and the keyboard, a central processing device, an output buffer, a multipicture separator and a screen signal converter.
Abstract: The invention relates to a multifunctional integrated studio system and a method for producing radio and television programmers or films. The multifunctional integrated studio system comprises a computer which is connected with an external video signal source and an external audio signal source and ahs a mouse and a keyboard, wherein a multi-channel video input circuit, a multi-channel audio capture buffer, a multi-channel capture and recording encoder, a memory, a sound console device, a built-in video signal source and a virtual studio device are configured in the computer; and the computer also provided with a touch panel displayer, an external switcher, a control and operation analysis unit connected with the mouse and the keyboard, a central processing device, an output buffer, a multipicture separator and a screen signal converter. In the invention, the switcher, a sound console, a recorder, a player, a caption machine, editing, broadcasting, the virtual studio, a TALLY system, a television wall and other system equipment are subjected to software modularization, and the modules are seamlessly integrated.
TL;DR: In this article, a method of providing a visual representation of a scene to a participant in a studio is provided, wherein the studio is arranged to be viewed by a camera to provide a camera image and has at least a portion of a background object arranged in a keyed manner.
Abstract: A method of providing a visual representation of a scene to a participant in a studio is provided, wherein the studio is arranged to be viewed by a camera to provide a camera image and has at least a portion of a background object arranged to be keyed out of the camera image by a keying process. The method includes obtaining an estimate of the viewpoint of the participant; rendering an image of the scene based on the viewpoint of the participant; and projecting at least a portion of the rendered image onto the background object to provide a projected image portion visible to the participant. The projected image portion is projected so as to be keyed out of the camera image by the keying process.