CLOUD AUDIO RENDERING SERVER BASED ON 360-DEGREE IMAGE
The present invention refers to 360 also relates to Image-based audio rendering technology, more particularly clouds server 360 360 also Image reflecting user input can be also based on Image processing audio rendering server 360 also audio performing rendering clouds are disclosed. The audio rendering (Rendering) objects are collected in the reservoir unit transmits sound scene object and the second character only can reconstruct the again in a preset substrate. Audio rendering a user's movement is provided is a sound travels along US on the amount of calculation becomes modified door since the pin is point number. I.e., audio rendering audio quality while reducing the operation amount can be [...] user number should allow other. Korean registration patent number 10 - 1614790 call camera driving space and relates to, audio packets being rendered on headphone by a processor-based system relative latency or relative amplitude by altering the techniques of space support disclosure as follows. Korean publicized patent number 10 - 2015 - 0100721 audio call method relates to ball number and audio device ball number, object objects to orbit information of the audio signal renders audio signal, audio signal having a number of channels can be optimized to number 1 number 2 rendering audio signal at a rendered object having audio signal and audio signal mixing techniques can be optimized to number 2 having disclosure as follows. In the embodiment of the present invention is user input Image server 360 360 also indicated one clouds can be also based on Image processing audio rendering server 360 also performing rendering audio broadcast receiver number [...] clouds. In the embodiment of the present invention store the voltages based on one user input view, viewing directions for tracking multiple discrete pixel number can be also based on Image processing audio rendering server 360 [...] direction information broadcast receiver number [...] clouds. In the embodiment of the present invention is also space 360 through the first viewing range one tracking number can be also based on Image rendering server 360 [...] clouds audio broadcast receiver. In the embodiment among, audio rendering server 360 360 also based on Image processing user input to the number on the pixel electrode also Image clouds (FOV, Field of View) [...] range determining viewing range determining section, said 360 degree Image associated with said viewing range current produced current Image generation unit, 360 also audio based on said user input and the signal receiving unit and generating a current audio render said current Image a current audio synchronization between said performing a current audio AV (Audio Video & ) synchronization section without using a tool. Said viewing range the determination portion determines said 360 spherical head motion or 4 Image (sphere) is also key in said inner surface of said center hole during hole receiving input from the panel viewing directions for tracking multiple discrete pixel number can be [...] direction information. Said at least a portion of said current Image generating unit generates a plurality of discrete pixel direction information of the corresponding spherical plane video input information based on the converted current can be said to generate images. Said current Image generating unit generates said hole restores said at least a portion of a plurality of discrete pixel direction information on the basis of the moving speed can be selected. A current audio generating unit generates said pixel direction information determined through said multiple discrete directional audio sound reflecting said 360 also may render a disclosed. Detecting a current audio generator generates said current Image said basic viewing range associated with said plurality of discrete pixel direction information determined through said directional audio sound by applying basic viewing range also said 360 may render a disclosed. Said AV synchronous U1 said error signal from said current audio synchronization between said current Image of user input capable of cease receiving. Said AV synchronization section based on the most recently synchronized with the viewing range can be said current Image and said audio digital Image. Disclosure techniques may have the following effect. But, in the embodiment should contain specific next effect should contain all of the meanings that then only inner side thereof, the number of rights range the disclosure techniques one don't be understood to not be dubbed inlater. Also in the embodiment according to 360 based on Image processing of the present invention audio rendering server one user input indicated 360 360 clouds clouds server also Image can be also performing audio rendering. One in the embodiment according to 360 based on Image processing of the present invention also store the voltages based on user inputs clouds audio rendering server view, viewing directions for tracking multiple discrete pixel number can be [...] direction information. Also in the embodiment according to 360 based on Image processing of the present invention audio rendering server view 360 in accordance with changes in the range of one clouds can also track space. Figure 1 shows a one in the embodiment according to 360 of the present invention also based on Image processing audio rendering server describing each of the clouds also are disclosed. Figure 2 shows a 1 360 may also set up the surface based on Image processing audio rendering server of clouds also are disclosed. Figure 3 shows a 1 based on Image processing is carried out in a 360 360 also also to audio rendering method based on Image processing audio rendering server also clouds also describing order disclosed. In the embodiment for the present invention is formed vertically on a structural functional disclosure and the output, the one in the embodiment of the present invention herein described by rights range in number are not interpreted. I.e., in different in the embodiment of the present invention scope of the invention is capable of changing in various forms and may have a technical idea should understood to the configurational including equalization can be realized. In addition, in the embodiment in the present invention number [...] should contain all compressed air from destination or to keep it in such effect should contain only the meanings that inner side thereof, of the present invention is understood to be not in the number range the one rights are disclosed. On the other hand, the meaning of the term will be understand as follows are described within the application. "Number 1", "number 2" to distinguish from other components such as components for the one term, these terms in rights by time is not with each other. For example, components can be termed component number 2 number 1, number 2 of the elements can be similarly designated number 1 component. Any component that when other components referred to as "connected", but may be directly connected to the other components, other components might lead to intermediate is present it will will be. While, any component and other components referred to as "directly connected" when that intermediate will be understood to does not exist in other components. On the other hand, other representations describing a relationship between the components, i.e. "- between" on "between immediately -" or "- of the adjacent" and "directly - neighboring" should likewise be interpreted like. It is apparent that a single representation of the differently in order to providing language translators must be understood to not including a plurality of representation, such as "comprising" or the term "having disclosed" embodiment feature, number, step, operation, component, piece or be present which specify a combination, and it is one or more other features, steps, operation, component, piece or a combination of pre-times the number should not understood to presence or additional possibility. Each identification code (e.g., a, b, c or the like) in steps is utilized for facilitating description into a second ID code sequence but is described, it is apparent that providing language translators each steps are not specified or more are described in a particular order can be in a different place. I.e., each step is substantially equal to the specified order may occur may be performed as reverse order to simultaneously perform a disapproval. All other terms not thus defined, in the present invention by the same person with skill in the art and flawless generally will have the meanings. The terms providing language translators associated technology typically used a pre-defined semantics and having a match must be interpreted, the application manifest in excessively with the meanings defined not ideal or formal interprets to satisfy 0. Figure 1 shows a one in the embodiment according to 360 of the present invention also based on Image processing audio rendering server describing each of the clouds also are disclosed. Here, the audio rendering server 360 also 1a also based on Image processing based on the e-performing audio rendering server clouds clouds have, 1b also based on Image processing based on the 360 also assumes when the performing audio rendering audio rendering server to set top boxes that clouds, 360 also 1c also based on Image processing based on the user terminal performing audio rendering clouds audio rendering server assumes his. The reference also 1a, also based on Image 360 clouds audio rendering server (10) includes a content server (100), clouds server (200), set-top box (300), content reproduction device (400) and input device (500) having a predetermined wavelength. Content server (100) can be capable of storing particular content is corresponding to the server. More specifically, content server (100) is also images photographed video contents and the corresponding 360 360 road can be audio content. In one in the embodiment, content server (100) is stored content clouds server (200) can be [...] to number. In the embodiment in another, content server (100) includes a content set-top box (300) can be [...] to number. In one another in the embodiment, content server (100) is clouds server (200) on the set-top box (300) corresponding to the user terminal device of a non-number 3 (600) can be [...] to number. Clouds server (200) (Virtual Machine, VM) virtual machine is connected to the content reproduction device (400) number computing [...] clouds to virtual private server, one physical server several virtual private server divides a virtual techniques can be implemented. More specifically, clouds server (200) comprises a plurality of virtual machine that implements can be, a plurality of virtual machines based on Image processing audio rendering can be performed also through 360. In one in the embodiment, clouds server (200) includes a content server (100) can receive the content from the, 360 based on Image processing audio rendering the program content also can be performed. Hereinafter, clouds server (200) also 360 in performing a more detailed description is based on Image processing audio rendering also 2 through a browser substrate. Set-top box (300) includes a content reproduction device (400) can be electrically connected, input device (500) and at least one can be connected via a short-range wireless communication. Here, infrared (infrared) short-range wireless communication approach, ultra-wideband communication (Ultra-a Wideband), Bluetooth (Bluetooth), ZigBee (Ziegbee), at least one wireless LAN (Wireless LAN) corresponds to one other. In one in the embodiment, set-top box (300) input device (500) to receive a user through clouds server (200) can be the number [...], clouds server (200) is based on user input number [...] be audio rendering it received ball number. In addition, set-top box (300) is clouds server (200) the received content from content reproduction device (400) between the embodiment can be transmitted. Content reproduction device (400) includes a set-top box (300) are connected to a server clouds (200) can be generated and received from the device corresponding to each other. In one in the embodiment, content reproduction device (400) for imaging is content can be expressed simultaneously the device and corresponds to audio content, television (TV, Television) can be implemented. In the embodiment in another, content reproduction device (400) is represented visually content can be video playback device or Image reproducing device and corresponds to, monitor can be implemented. In one another in the embodiment, content reproduction device (400) auditory presentation content is audio reproducing device and corresponds to, speaker can be implemented. Input device (500) corresponding to a computing device can be operated by a user. For example, input device (500) composite includes but not limited to, corresponding to the remote controller can be. Input device (500) includes a set-top box (300) to infrared (infrared), ultra-wideband communication (Ultra-a Wideband), Bluetooth (Bluetooth), ZigBee (Ziegbee), selected from at least one wireless LAN (Wireless LAN) can be connected via a short-range wireless communication. In one in the embodiment, input device (500) includes a set-top box (300) can be [...] user input to the number, the user input may be clouds server (200) is used executed by rendering the number can be used. For example, input device (500) moves the cursor in a specified direction [on, the, left, shadow] moving rudder design using a set top box (300) can be [...] user input to the number. For example another example, input device (500) includes a head of the user to motion direction information as input information user set-top box (300) can be [...] to number. The 1b also reference, also based on Image 360 clouds audio rendering server (10) includes a content server (100), set-top box (300), content reproduction device (400) and input device (500) having a predetermined wavelength. 1B such as also in the field of view, also based on Image 360 clouds audio rendering server (10) is clouds server (200) does not include a. More specifically, also based on Image processing of audio rendering server 360 also 1b clouds (10) includes a content server (100) content stored in the set-top box (300) to [...] number can be, set-top box (300) includes a content server (100) can be ball number it received from performing rendering audio content. I.e., also 1b of set top boxes (300) input device (500) receives user input from audio rendering can be performed. The 1c also reference, also based on Image 360 clouds audio rendering server (10) includes a content server (100) and user terminal (600) comprises. User terminal (600) can be owned by the user, content server (100) can be connected with a corresponding computing device. For example, user terminal (600) is desktop, notebook, tablet PC (Tablet PC) or smart phone may correspond to be. User terminal (600) the content server (100) can be transferred from the video or audio information. Also in the field of view such as 1c, also based on Image 360 clouds audio rendering server (10) is clouds server (200), set-top box (300), content reproduction device (400) and input device (500) does not include a. More specifically, also based on Image processing of 360 also 1c clouds audio rendering server (10) includes a content server (100) content stored in the user terminal (600) can be [...] number to, user terminal (600) the content server (100) can be ball number it received from performing rendering audio content. Figure 2 shows a 1 360 may also set up the surface based on Image processing audio rendering server of clouds also are disclosed. More specifically, Figure 2 shows a also 1a also the clouds server (200) based on Image processing audio rendering assume 360 in carrying out and described as follows. The reference 2 also, also based on Image 360 clouds audio rendering server (10) includes a viewing range determining section (210), current Image generation unit (220), a current audio generation unit (230) and AV synchronization section (240) having a predetermined wavelength. Viewing range determining section (210) input device (500) or user terminal (600) also Image information input from a user through 360 can be [...] number. More specifically, viewing range determining section (210) has a ball (sphere) is also 360 Image receiving key input (RC Key data) can be head motion or 4. For example, viewing range determining section (210) is when of a remote control, direction of buttons can be input through the opening 4. For example another example, viewing range determining section (210) includes identifying eye Image lens when, through movement of the head of a user can be opening to receiving input. Viewing range determining section (210) based on user input 360 also determine at least one of the viewing range (FOV, Field of View) can be. Viewing range determining section (210) has a center hole for receiving a user input to the spherical inner hole in tracking the user viewing directions can be watching. In one in the embodiment, operation by a user view direction is 4 or sensing a change in direction of a rudder blade can be based on the location of a cursor moves up and down by between embodiment. For example, viewing range determining section (210) is also Image 360 is positioned a cursor on a top right field of view direction and located on top right if user can track the 360 degree Image. More specifically, viewing range determining section (210) is also reflected in the Image view direction can be inserted to determine movement information 360. Viewing range determining section (210) includes a plurality of discrete pixel direction information based on viewing direction information 360 can be configured to also Image [...] box number. For example, multiple discrete buying direction information can be associated with a playback speed of the Image, Image information can be smoothly changed corresponding to keys Image is [...]. In one in the embodiment, viewing range determining section (210) is clouds server (200) based on the current amount of calculation can be discrete interval. [Mathematical equation 1] can be adjusted by the discrete interval is below. [Mathematical equation 1] (Here, said S is current CPU occupancy (%) components, said a and b is the maximum value (constant)) Viewing range determining section (210) is clouds server (200) by considering the amount of computations of the user input can also Image 360 [...] interval number. For example, viewing range determining section (210) is a specific time clouds server (200) having a short period number process user interface input are received when the activity of many discrete receives user input to adjust the distance also Image a playback speed of be [...] number 360. Current Image generation unit (220) to current audio generation unit (230) can be user input flag is Image, generating a current audio also can be produced with current images. Hereinafter, current Image generation unit (220) is described as follows. Current Image generation unit (220) is also Image 360 of a user viewing range can be associated with current Image. More specifically, current Image generation unit (220) comprises a plurality of discrete pixel direction information based on input information into at least a portion of the corresponding spherical plane can be. I.e., current Image generation unit (220) includes a spherical inner surface has a surface hole Image be composed of the [we it will be dizzily. Here, Image warping (Warping) picture resampling the specific rules (Resampling) big task. In one in the embodiment, current Image generation unit (220) is also Image according to user input 360 is rotated and spherical Image visualizing rolls can be. More specifically, current Image generation unit (220) is also 360 from the panel enables the user to Image the Image model can be a plane for performing inner surface hole, current Image generation unit (220) can be current Image generating a transformation plane Image. I.e., current Image generation unit (220) cursor key 4 or the sight line of the user corresponding to the user composed of spherical Image by warping the visibility of (Visibility) can be improve. Current Image generation unit (220) includes a hole which is based upon the mobile restores at least a portion of a plurality of discrete pixel direction information can be selected. In one in the embodiment, current Image generation unit (220) is moving slowly restores the moving speed is fast hole can be selected view direction information. In the embodiment in another, current Image generation unit (220) is moved past the moving speed is slow restores the hole can be selected view direction information. For example, current Image generation unit (220) includes a user had to multivalent finally stops moving in different directions corresponding to the spherical plane video Image user direction can be generating the converted voltage to the current Image. Hereinafter, a current audio generation unit (230) is described as follows. A current audio generation unit (230) based on user input audio 360 also may render a disclosed. More specifically, a current audio generation unit (230) is the current video generation unit (220) received through input and the same of motion or 4 side from the head of the user can be receives user inputs, user input information corresponding to the program current 360 360 also Image fidelity audio rendering can be performed. In one in the embodiment, a current audio generation unit (230) comprises a plurality of discrete pixel direction information for determining the orientation can be through sound. For example, a current audio generation unit (230) also includes at least one of the user view 360 right direction can be moved right audio outputs. In another example, a current audio generation unit (230) also includes at least one of the user view 360 left direction can be moved left audio outputs. More specifically, a current audio generation unit (230) also Image 360 360 audio sound is determined directional reflecting also may render a disclosed. In the embodiment in another, a current audio generation unit (230) associated with the current Image can be detecting basic viewing range. Here, basic view range 360 also Image number user input not ball direct transfer of the range body. For example, user field of view corresponding to the upper right direction but can be left lower basic viewing range are picked. I.e., the user's line of sight direction facing basic viewing range can be unrelated to the range. More specifically, a current audio generation unit (230) comprises a plurality of discrete pixel direction information determined through a directional audio sound based viewing range by applying said 360 also may render a disclosed. For example, a current audio generation unit (230) is associated with current Image basic viewing range field of view direction away if the user is or can be closer tracking. For example another example, current audio generation unit (230) includes a basic view range identifies located on top right, left or is positioned at the lower end can be located at different places or if the tracking number 3. A current audio generation unit (230) includes a basic viewing range is right top and corresponds to sound directivity numbers left top basic viewing range basic viewing range audio to be output to a sound a forensic audio 360 also may render a disclosed. AV synchronization section (240) is a current audio synchronization between a current Image can be performed. More specifically, AV synchronization section (240) according to user input current Image generation unit (220) current Image generated through a current audio generation unit (230) can be generated through synchronizing current audio. For example, AV synchronization section (240) is left at the lower end of corresponding relative to current Image Image corresponding to audio rendering can be performed. The molten left at the lower end of a current audio output corresponding to the current Image can be. In one in the embodiment, AV synchronization section (240) is a current audio synchronization between which it makes sense to abnormal current Image can. AV synchronization section (240) is the reproduction of the video speed can compare a current audio playback speed of current and, electric can be synchronized rotational information. More specifically, AV synchronization section (240) viewing subsystem or more of user input can cease receiving the event. For example, AV synchronization section (240) is currently cease receiving the Image of user input can be adjusting a current audio between sink. I.e., AV synchronization section (240) than images includes at least one of a current audio delay time existing playback audio slowly can be adjusted. In the embodiment in another, AV synchronization section (240) is based on the most recent synchronized with the viewing range for playing video and audio current Image can be. More specifically, AV synchronization section (240) viewing subsystem or more before generating current Image audio visual content reproducing device normally synchronization (400) can be via. Figure 3 shows a 1 based on Image processing is carried out in a 360 360 also also to audio rendering method based on Image processing audio rendering server also clouds also describing order disclosed. In Figure 3, viewing range determining section (210) is also Image 360 [...] number can be user input. Viewing range determining section (210) input device (500) information entered by a user through 360 can be [...] also Image number. More specifically, viewing range determining section (210) based on at least one of the user input (step S310) can also determine the extent 360 view. Current Image generation unit (220) can be associated with the viewing range current Image. More specifically, current Image generation unit (220) includes a user input ranges can be determined based on the current view (step S320) Image. A current audio generation unit (230) includes a current Image generation unit (220) user input can be received the same information. A current audio generation unit (230) based on user input audio 360 also may render a disclosed. More specifically, a current audio generation unit (230) is currently Image corresponding to 360 360 also audio rendering can be performed. AV synchronization section (240) is a current audio synchronization between a current Image can be performed. AV synchronization section (240) corresponding to the area of current Image is output can be synchronized to audio. For example, AV synchronization section (240) corresponding to the current Image is other than Image corresponding to audio volume is greater than the current Image can be adjusted so as to audible audio volume. More specifically, AV synchronization section (240) current is also capable of 360 360 Image current according fidelity audio variation. I.e., also based on Image 360 clouds audio rendering server (10) can be based on a current audio Image generating user input current, generated current Image audio may render a disclosed. In a of the present invention preferred embodiment said through a browser but, a corresponding splicing one skilled art poriae idea of the present invention within a range that the present invention not patent the following is claimed and area away from varying the modification and changes may be understand it will rain. 10:360 Also based on Image clouds audio rendering server 100: Content server 200: Clouds server 210: Viewing range determining section 220: Current Image generation unit 230: A current audio generation unit 240: AV synchronization section 300: Set-top box 400: Content reproduction device 500: Input device 600: User terminal The present invention relates to a cloud audio rendering technique based on a 360-degree image, which includes a field-of-view determining unit for determining a field of view (FOV) by providing a user input to the 360-degree image, a current image generating unit for generating a current image associated with the FOV in the 360-degree image, a current audio generating unit for generating a current audio by rendering a 360-degree audio based on the user input, and an audio and video (AV) synchronization unit for performing synchronization between the current image and the current audio. Accordingly, the present invention can render the 360-degree audio by reflecting the user input on the 360-degree image in a cloud server. COPYRIGHT KIPO 2018 360 Degree visibility range determining user input Image number [...] (FOV, Field of View) viewing range determining section; said 360 degree Image associated with said viewing range current produced current Image generation unit; said user input based on a current audio generation unit generating a current audio render 360 also audio; and said current Image and a current audio synchronization between said performing a synchronization section also including 360 AV (Audio Video & ) based on Image clouds audio rendering server. According to Claim 1, said viewing range the determination portion determines said 360 spherical head motion or 4 Image (sphere) is also key in said inner surface of said center hole during hole receiving input from the panel viewing directions for tracking multiple discrete pixel direction information based on Image 360 the number [...] characterized also clouds audio rendering server. According to Claim 2, said at least a portion of said current Image generating unit generates a plurality of discrete pixel direction information of the corresponding spherical plane video input information based on the converted voltage to the current Image generating clouds 360 also characterized based on Image processing audio rendering server. According to Claim 3, upstream of said current Image generating unit generates a plurality of discrete pixel direction information based on said moving speed restores said at least a portion of the selection also characterized based on Image 360 clouds audio rendering server. According to Claim 1, a current audio generating unit generates said pixel direction information determined through said multiple discrete sound directional audio rendering said 360 360 also indicated also characterized based on Image clouds audio rendering server. According to Claim 1, a current audio generator generates said current Image said detecting said basic viewing range associated with a plurality of discrete pixel direction information determined through a directional sound fidelity audio rendering said basic viewing range characterized also by applying said 360 360 based on Image clouds audio rendering server. According to Claim 1, said AV synchronous U1 said error signal from said current audio synchronization between said current Image of user input to cease receiving 360 also characterized based on Image clouds audio rendering server. According to Claim 7, said AV synchronous anger it blows, recently synchronized viewing range characterized based on said current Image and said audio visual reproducing a 360 also based on Image clouds audio rendering server.
