Настройки

Укажите год
-

Небесная энциклопедия

Космические корабли и станции, автоматические КА и методы их проектирования, бортовые комплексы управления, системы и средства жизнеобеспечения, особенности технологии производства ракетно-космических систем

Подробнее
-

Мониторинг СМИ

Мониторинг СМИ и социальных сетей. Сканирование интернета, новостных сайтов, специализированных контентных площадок на базе мессенджеров. Гибкие настройки фильтров и первоначальных источников.

Подробнее

Форма поиска

Поддерживает ввод нескольких поисковых фраз (по одной на строку). При поиске обеспечивает поддержку морфологии русского и английского языка
Ведите корректный номера.
Ведите корректный номера.
Ведите корректный номера.
Ведите корректный номера.
Укажите год
Укажите год
Применить Всего найдено 2990. Отображено 100.
26-01-2012 дата публикации

Image receiver

Номер: US20120019629A1
Автор: Hidetoshi Nagano
Принадлежит: Sony Corp

An image receiver according to the present invention includes a receiving unit that receives an integrated image in which a first image and a second image are arranged in one frame and an reception unit that receives region information indicating a region of the first image transmitted along with the integrated image is provided, wherein a non-stereoscopic video display mode in which only the first image is displayed based on the region information and/or a stereoscopic video display mode in which the first image and the second image are displayed as stereoscopic video are included.

Подробнее
Номер записи: 1
26-01-2012 дата публикации

Coding method, decoding method, coding apparatus, decoding apparatus, program, and integrated circuit

Номер: US20120020414A1
Автор: Chong Soon Lim, Takahiro Nishi, Youji Shibahara
Принадлежит: Chong Soon Lim, Takahiro Nishi, Youji Shibahara

A coding method includes: defining an access unit; and coding each of the pictures included in the access unit, for each access unit. The defining includes: determining a unit of coding for determining whether the pictures included in the access unit are to be uniformly coded on a per-field basis or on a per-frame basis; and determining a field type for determining whether the pictures are to be uniformly coded as top fields or bottom fields when it is determined that the pictures included in the access unit are to be coded on a per-field basis. In the coding, each of the pictures is coded for each access unit in a format determined in the determining of a unit of coding and in the determining of a field type.

Подробнее
Номер записи: 2
09-02-2012 дата публикации

Video displaying system and reproducing apparatus

Номер: US20120033934A1
Автор: Nobuaki Kabuto
Принадлежит: Hitachi Consumer Electronics Co Ltd

When reproducing 3D contents, a video signal reproducing apparatus connected to a 3D display device of various 3D display schemes provides a guide display or a guide voice conformed to each of the 3D display schemes. Viewing requirements concerning the 3D display scheme of the 3D display device are transmitted to the video signal reproducing apparatus. When reproducing contents, the video signal reproducing apparatus is configured to conduct suitable guide display or voice guide on the basis of viewing requirements concerning the 3D display scheme.

Подробнее
Номер записи: 3
01-03-2012 дата публикации

Display control device, display control method, image generation device, and image generation method

Номер: US20120050468A1
Автор: Takuya Kitamura, Teruhiko Suzuki, Yoshitomo Takahashi
Принадлежит: Sony Corp

A display control device includes a separation unit that separates a multiplex image into a left eye image after decimation and a right eye image after decimation, interpolates a predetermined phase of the left eye image after the decimation with 0, and interpolates a phase reverse to the predetermined phase of the right eye image after the decimation with 0, a display control unit that uses an interpolated left eye image as a left eye display image, uses an interpolated right eye image as a right eye display image, and alternately displays the left eye display image and the right eye display image, and a glasses control unit that controls glasses such that a left eye shutter and a right eye shutter of the glasses are both opened, in a case where an image including the left eye image and the right eye image is a 2D image.

Подробнее
Номер записи: 4
01-03-2012 дата публикации

Method and system for creating a 3d video from a monoscopic 2d video and corresponding depth information

Номер: US20120050481A1
Автор: Chris Boross, Jeyhan Karaoguz, Nambi Seshadri, Xuemin Chen
Принадлежит: Broadcom Corp

Image sensors and a depth sensor of a monoscopic video sensing device are utilized to capture a 2D video and corresponding depth information. Regions of interest (ROIs) for the captured 2D video are selected based on the captured corresponding depth information. The monoscopic video sensing device selectively processes the captured 2D video and the captured corresponding depth information based on the selected ROIs. A 3D video is composed from the processed 2D video for display. The captured depth information that is synchronized to the captured 2D video is stored as metadata, and may be interpolated to match video resolution of the captured 2D video. The captured 2D video and the captured corresponding depth information are enhanced through scalable video coding. With 3D video rendering, relevant image/video components of the captured 2D video are selected based on the selected ROIs to compose the 3D video together with the corresponding depth information.

Подробнее
Номер записи: 5
15-03-2012 дата публикации

Entry points for 3d trickplay

Номер: US20120063742A1
Автор: Francesco Scalori, Philip S. Newton
Принадлежит: KONINKLIJKE PHILIPS ELECTRONICS NV

Providing entry points for 3D video data is described. An entry point unit ( 18 ) generates an entry point table by defining entry points in an incoming 3D video data stream and storing entry point addresses giving the location of the defined entry points. The video data stream comprises a multitude of sub-streams, which multitude encodes one stream of 3D video data and comprises at least one 2D sub-stream that independently encodes a 2D version of the 3D video data and at least one auxiliary sub-stream that dependently encodes part of the 3D video data. The entry points include main entry points in the 2D sub-stream and auxiliary entry points in the auxiliary sub-stream for enabling 3D trickplay of the 3D video data by retrieving and decoding nonadjacent fragments of the 2D sub-stream and retrieving and dependently decoding corresponding fragments of the auxiliary sub-stream.

Подробнее
Номер записи: 6
22-03-2012 дата публикации

Transferring of 3d image data

Номер: US20120069154A1
Автор: Gerardus Wilheimus Van Der Heijden, Joop Cornelis Talstra, Philip Steven Newton
Принадлежит: KONINKLIJKE PHILIPS ELECTRONICS NV

A system of transferring of three dimensional (3D) image data is described. A 3D source device ( 10 ) provides 3D display signal ( 56 ) for a display ( 13 ) via a high speed digital interface like HDMI. The 3D display signal comprises a sequence of frames. The sequence of frames comprises units, each unit corresponding to frames comprising video information intended to be composited and displayed as a 3D image. The 3D source device includes 3D transfer information comprising at least information about the video frames in the unit. The display detects the 3D transfer information, and generates the display control signals based in dependence on the 3D transfer information. The 3D transfer information in an additional info frame packet comprises information about the multiplexing scheme for multiplexing frames into the 3D display signal, the multiplexing scheme being selected of group of multiplexing schemes including frame alternating multiplexing, the frame alternating indicating said number of frames being sequentially arranged within said video data period.

Подробнее
Номер записи: 7
12-04-2012 дата публикации

Method and apparatus for providing and processing 3d image

Номер: US20120086773A1
Автор: Dae-Jong Lee, Hong-Seok Park, Houng-sog Min, Jae-Jun Lee
Принадлежит: SAMSUNG ELECTRONICS CO LTD

A method and apparatus for providing a three-dimensional (3D) image is provided. In the method, first-viewpoint image data and second-viewpoint image data that provide a 3D image are obtained. Time information that represents points of time that the first-viewpoint image data and the second-viewpoint image data are to be processed is produced, based on relation information to indicate that the first-viewpoint image data and the second-viewpoint image data are a pair of pieces of image data. The first-viewpoint image data, the second-viewpoint image data, and the time information are transmitted. The first-viewpoint image data is transmitted in a first stream, and the second-viewpoint image data is transmitted in a second stream.

Подробнее
Номер записи: 8
03-05-2012 дата публикации

Encoding method, display apparatus, and decoding method

Номер: US20120106921A1
Автор: Taiji Sasaki, Takahiro Nishi, Toru Kawaguchi
Принадлежит: Panasonic Corp

An encoding method is provided, according to which video streams obtained by compression-coding original images are contained in one transport stream. The video streams contained in the transport stream include a video stream that constitutes 2D video and video streams that constitute 3D video. When containing such video streams in the transport stream, a descriptor specifying the video streams constituting the 3D video is contained in a PMT (Programmable Map Table) of the transport stream.

Подробнее
Номер записи: 9
07-06-2012 дата публикации

Encoding apparatus, encoding method, and program

Номер: US20120140030A1
Автор: Koji Togita
Принадлежит: Canon Inc

An encoding apparatus for inputting a first image signal and a second image signal from an input source different from an input source of the first image signal adaptively decides a first bit rate and a second bit rate which are respectively assigned to a first encoding unit for encoding the input first image signal and a second encoding unit for encoding the input second image signal on the basis of the first image signal, on the basis of photographing mode information or distortion ratios of encoding by the encoding units.

Подробнее
Номер записи: 10
14-06-2012 дата публикации

Stereoscopic Video Signal Processing Apparatus and Method Thereof

Номер: US20120146997A1
Автор: Dai Ishimaru, Hidehito Izawa, Takero Kobayashi
Принадлежит: Individual

According to one embodiment, a basic format for a 3D signal having a first area to arrange main video data, a second area to arrange graphic data, a third area to arrange depth information of pixels of the main video data, and a fourth area to arrange depth information of pixels of the graphic data are defined. When depth information of pixels of the main video data is generated, a 3D processing module can select whether to use a first pattern obtained by inserting the graphic data into the main video data and a second pattern obtained by not inserting the graphic data into the main video data. A 3D related controller decides on the first or second pattern to be used by the 3D processing module.

Подробнее
Номер записи: 11
28-06-2012 дата публикации

Video telephone system

Номер: US20120162352A1
Автор: Tomotaka Ida
Принадлежит: Individual

According to one exemplary embodiment, a video telephone system includes: a digital broadcast receiver which receives a digital broadcast signal and reproduces a 2D or 3D video signal and an audio signal; a display unit and speakers which output the signals; a camera unit and a microphone unit for a TV phone call; a communication unit which transmits a 2D or 3D image data taken by the camera unit and an audio data picked up by the microphone unit to the outside, and which receives a 2D or 3D image data and an audio data from the outside; and a controller which receives meta-information indicating whether a counterpart TV receiver is in a 3D video displayable state, and transmits at least one of the 2D or 3D image data, the audio data, and a message to the counterpart TV receiver depending on a condition of the counterpart TV receiver.

Подробнее
Номер записи: 12
26-07-2012 дата публикации

Content distribution system, playback apparatus, distribution server, playback method, and distribution method

Номер: US20120188340A1
Автор: Hiroki Shinohara, Toru Kawaguchi
Принадлежит: Panasonic Corp

A content distribution system capable of playing back a stream without missing out an initial frame. The content distribution system includes a distribution server and a playback apparatus. The distribution server transmits a video stream and an initial frame state flag indicating whether an initial frame of the video stream is a 3D video frame or a 2D video frame. Receiving the video stream and the initial frame state flag, the playback apparatus determines whether the initial frame is a 3D video frame or a 2D video frame by using the initial frame state flag and sets, prior to decoding the video stream, an output mode to be applied to the initial frame to a 3D output mode when the initial frame is a 3D video frame and to a 2D output mode when the initial frame is a 2D video frame.

Подробнее
Номер записи: 13
26-07-2012 дата публикации

Optical disk for high resolution and general video recording, optical disk reproduction apparatus, optical disk recording apparatus, and reproduction control information generation apparatus

Номер: US20120189278A1
Автор: Hideki Fukuda, Hideshi Ishihara, Hiromu Kitaura, Mitsuaki Oshima
Принадлежит: Panasonic Corp

A high resolution video signal is divided by video division means into a main signal and a sub signal, and the main signal and the sub signal are MPEG-encoded. The stream of the main signal and the stream of the sub signal are divided into 1 GPO or more of frames. First interleave blocks each including 1 GOP or more of the stream of the main signal and second interleave blocks each including 1 GOP or more of the stream of the sub signal are recorded on an optical disk. A high resolution reproduction apparatus reproduces both the first and second interleave blocks to obtain a high resolution video output. A non-high quality picture reproduction apparatus reproduces only the first or second interleave blocks to obtain a standard resolution video output.

Подробнее
Номер записи: 14
16-08-2012 дата публикации

3d screen size compensation

Номер: US20120206453A1
Автор: Age Jochem Van Dalfsen, Philip Steven Newton, Reinier Bernardus Maria Klein Gunnewiek, Wilhelmus Hendrikus Alfonsus Bruls
Принадлежит: KONINKLIJKE PHILIPS ELECTRONICS NV

A device converts three dimensional [3D] image data arranged for a source spatial viewing configuration to a 3D display signal ( 56 ) for a 3D display in a target spatial viewing configuration. 3D display metadata has target width data indicative of a target width W t of the 3D display in the target spatial viewing configuration. A processor ( 52,18 ) changes the mutual horizontal position of images L and R by an offset O to compensate differences between the source spatial viewing configuration and the target spatial viewing configuration. The processor ( 52 ) retrieves source offset data provided for the 3D image data for calculating the offset O, and determines the offset O in dependence of the source offset data. Advantageously the 3D perception for the viewer is automatically adapted based on the source offset data as retrieved to be substantially equal irrespective of the screen size.

Подробнее
Номер записи: 15
23-08-2012 дата публикации

Method and Arrangement for Multi-View Video Compression

Номер: US20120212579A1
Автор: Clinton Priddle, Per FRÖJDH, Thomas Rusert
Принадлежит: Telefonaktiebolaget LM Ericsson AB

Methods and arrangements for compression and de-compression of N-stream multi-view 3D video in data handling entities, e.g. a data providing node and a data presenting node. The methods and arrangements involve multiplexing ( 802 ) of at least some of the N streams of the N-stream multi-view 3D video into one pseudo 2D stream, which appears as a 2D video stream to a 2D encoder. Further, the pseudo 2D stream is provided ( 804 ) to a replaceable 2D encoder, for encoding of the pseudo 2D stream, resulting in encoded data having a 2D codec format. This codec-agnostic modular approach to 3D compression and de-compression ensures a fast and convenient access to flexible virtual 3D codecs for handling of N-stream multi-view 3D video.

Подробнее
Номер записи: 16
04-10-2012 дата публикации

Electronic apparatus and display control method

Номер: US20120249734A1
Автор: Miku Hamada, Shunsuke Takayama, Yuuichiro Aso
Принадлежит: Individual

According to one embodiment, an electronic apparatus, which is capable of setting areas in a screen in either a 3D mode or a 2D mode, includes a 3D video display module, a candidate area calculation module, a 2D area determination module, and a 2D video display module. The 3D video display module displays 3D video on a 3D area in the 3D mode. The candidate area calculation module calculates, upon receiving a request for displaying 2D video, a first candidate area for displaying the 2D video, based on a position of the 3D area. The 2D area determination module determines the first candidate area to be a 2D area for displaying the 2D video if the first candidate area falls within the screen and is in the 3D mode. The 2D video display module displays the 2D video on the 2D area set in the 2D mode.

Подробнее
Номер записи: 17
01-11-2012 дата публикации

Recording medium, playback device, system lsi, playback method, glasses, and display device for 3d images

Номер: US20120275765A1
Автор: Tomoki Ogawa, Wataru Ikeda
Принадлежит: Individual

A recording medium in which a left-view video stream and a right-view video stream are recorded in an interleaved transport stream file. The interleaved transport stream file is identified by a combination of (i) an equivalent identification number being equivalent with the file reference information and (ii) a file extension indicating that video streams are stored in the interleaved manner, the equivalent identification number. Among Extents that constitute the interleaved transport stream file, Extents constituting the left-view or right-view video stream are identified as a normal-format transport stream file by a combination of (i) the equivalent identification number being equivalent with the file reference information and (ii) a file extension indicating that video streams are stored in a normal manner.

Подробнее
Номер записи: 18
08-11-2012 дата публикации

Digital Video Signal Output Device and Display Device, and Digital Video Signal Output Method and Reception Method

Номер: US20120281069A1
Автор: Toshiro Nishio
Принадлежит: Panasonic Corp

Provided is a digital video signal output device for outputting digital video signals to a display device for displaying pictures. The digital video signal output device captures display capability data having described therein video-data structure such as a 3D format and the like from the digital video display device. The digital video signal output device is configured to select one video-data structure from at least one video-data structure, superimpose packet data including structural information that designates the selected video-data structure, during a blanking period of a digital video signal including video data based on the selected video-data structure, and transmits, as a digital video output signal, a signal obtained as a result of the superimposing.

Подробнее
Номер записи: 19
29-11-2012 дата публикации

Block-based interleaving

Номер: US20120300843A1
Автор: Brian Joseph Dorini, Thomas Edward Horlander
Принадлежит: Thomson Licensing SAS

At least one implementation interleaves blocks from a stereo-image pair and enables intra-coding of the interleaved image using corresponding blocks as references. One particular implementation accesses a first image that includes multiple blocks, one of which is a first-image block. A second image is accessed that includes multiple blocks, one of which is a second-image block that has overlapping content with the first-image block. The multiple blocks of the first and second images are interleaved on a block basis to form an interleaved image. At least a portion of the interleaved image is encoded by encoding the first-image block using the second-image block as a reference. Another implementation provides the encoded portion in signal. Yet another implementation accesses the encoded image and decodes the portion by using the second-image block as a reference.

Подробнее
Номер записи: 20
20-12-2012 дата публикации

Apparatus and method for controlling display of information

Номер: US20120320035A1
Автор: Jonghwan KIM
Принадлежит: LG ELECTRONICS INC

A terminal includes a storage area to store a reference value, a screen to display a plurality of objects, and a controller to assign values to the objects based on the reference value and to control display of the objects on the screen using a three-dimensional (3D) effect. The objects are displayed in 3D differently based on the assigned values, and an area adjacent at least one of the objects on the screen is not displayed in 3D.

Подробнее
Номер записи: 21
10-01-2013 дата публикации

Information processing apparatus, information recording medium, information processing method, and program

Номер: US20130011117A1
Автор: Toshiya Hamada
Принадлежит: Sony Corp

In processing of recording data on a recording medium, three-dimensional image discrimination data representing whether or not there is a possibility of a three-dimensional image being included in recorded data is recorded as management information. The three-dimensional image discrimination data is recorded in a clip information file set in association with a stream file as a storage file of image data, a playlist file including reproduction section designating information for the clip information file, a disc management file which directly or indirectly designates the playlist file, or the like. A reproducing apparatus can thereby easily determine the presence/absence of a three-dimensional image without performing analysis on reproduction target data.

Подробнее
Номер записи: 22
14-02-2013 дата публикации

Image data transmission apparatus, image data transmission method, image data receiving apparatus and image data receiving method

Номер: US20130038683A1
Автор: Ikuo Tsukagoshi
Принадлежит: Sony Corp

Service compatibility with respect to a 2D TV is realized when transmitting frame compatible type stereoscopic image data. When the image data is frame compatible type stereoscopic image data, image region information for cropping image data for 2D display from the image data after decoding is inserted into a compressed video stream. In the 2D television receiving device (2D TV) of the receiving side, it is possible to crop image data for 2D display from the image data after decoding and to obtain 2D image data based on the image region information.

Подробнее
Номер записи: 23
21-02-2013 дата публикации

Stereoscopic image reproduction device and method, stereoscopic image capturing device, and stereoscopic display device

Номер: US20130044188A1
Автор: Satoshi Nakamura
Принадлежит: Fujifilm Corp

A stereoscopic image is displayed with an appropriate amount of parallax based on auxiliary information recorded in a three-dimensional-image file. The size of a display which performs 3D display is acquired (Step S 31 ), and a 3D image file is read (Step S 32 ). The maximum display size capable of appropriately performing 3D display of each viewpoint image is acquired from metadata of the read 3D image file (Step S 33 ), and the size acquired in Step S 31 is compared with the maximum display size acquired in Step S 33 (Step S 34 ). Viewpoint numbers of images in which the maximum display size is larger are acquired (Step S 35 ), the most appropriate image is selected from the images of the acquired viewpoint numbers (Step S 37 ), and 3D display is performed using the selected image (Step S 38 ). Therefore, an appropriate image can be selected based on the maximum display size and 3D display can be performed.

Подробнее
Номер записи: 24
28-02-2013 дата публикации

Temporal cadence perturbation for time-division stereoscopic displays

Номер: US20130050182A1
Автор: Dominic GLYNN, Rod Bogart
Принадлежит: PIXAR ANIMATION STUDIOS

One or more techniques to reduce or eliminate the false depth of objects that move along the axis of ocular separation when displayed using time division multiplexing. Experiments can be performed to determine a perceived depth of an object moving with known velocity. Then, when rendering stereoscopic image pairs, the location of the object can be modified to change the perceived stereoscopic depth of the object to compensate for the false depth. In one technique, the images can be displayed with alternating left- and right-precedence to reduce the perception of false depth.

Подробнее
Номер записи: 25
28-02-2013 дата публикации

Temporal cadence perturbation for time-division stereoscopic displays

Номер: US20130050450A1
Автор: Dominic GLYNN, Rod Bogart
Принадлежит: PIXAR ANIMATION STUDIOS

One or more techniques to reduce or eliminate the false depth of objects that move along the axis of ocular separation when displayed using time division multiplexing. Experiments can be performed to determine a perceived depth of an object moving with known velocity. Then, when rendering stereoscopic image pairs, the location of the object can be modified to change the perceived stereoscopic depth of the object to compensate for the false depth. In one technique, the images can be displayed with alternating left- and right-precedence to reduce the perception of false depth.

Подробнее
Номер записи: 26
28-03-2013 дата публикации

Systems and methods for encoding light field image files

Номер: US20130077880A1
Автор: Kartik Venkataraman, Semyon Nisenzon
Принадлежит: Pelican Imaging Corp

Systems and methods configured to store images synthesized from light field image data and metadata describing the images in electronic files and render images using the stored image and the metadata in accordance with embodiments of the invention are disclosed. One embodiment includes a processor and memory containing an encoding application and light field image data, where the light field image data comprises a plurality of low resolution images of a scene captured from different viewpoints. In addition, the encoding application configures the processor to: synthesize a higher resolution image of the scene from a reference viewpoint using the low resolution images, where synthesizing the higher resolution image involves creating a depth map that specifies depths from the reference viewpoint for pixels in the higher resolution image; encode the higher resolution image; and create a light field image file including the encoded image and metadata including the depth map.

Подробнее
Номер записи: 27
11-04-2013 дата публикации

Digital receiver and method for processing caption data in the digital receiver

Номер: US20130088571A1
Автор: Jong Yeul Suh, Nagaraj Nandhakumar, Timothy Laud
Принадлежит: LG ELECTRONICS INC

The present description provides a digital receiver which provides 3D caption data and a method for processing 3D caption data in the digital receiver of the present invention. A method for transmitting a broadcast signal for 3D service according to one aspect of the present invention comprises the following steps: encoding 3D video ES including a 3D caption service; generating signaling information for signaling a 3D video service including the encoded 3D video ES; and transmitting a digital broadcast signal including the 3D video service and the signaling information, wherein said 3D caption service includes a first command code for generating left caption data and a second command code for indicating a disparity value for a caption window, and generates right caption data on the basis of the first command code and second command code.

Подробнее
Номер записи: 28
11-04-2013 дата публикации

Image data transmission device, image data transmission method, image data reception device, and image data reception method

Номер: US20130088572A1
Автор: Ikuo Tsukagoshi
Принадлежит: Sony Corp

In a receiving side, to make it possible to correctly respond to a change in configuration of elementary streams. Stream association information indicating an association between each of the elementary streams (ES) included in a transport stream (TS) is inserted in the ES. The stream association information indicates the association between a first ES containing first image data and a predetermined number of second ESs respectively containing a predetermined number of second image data and/or metadata associated with the first image data. The stream association information indicates the association between each of the ESs, for example, using identifiers for respectively identifying the ESs. For example, a descriptor is inserted in the TS in which the descriptor indicates a correspondence between each of the identifiers of the ESs and each of packet identifiers or component tags of the respective ESs, so that a link between a registration state in a TS layer of each ES and the stream association information is achieved.

Подробнее
Номер записи: 29
11-04-2013 дата публикации

Apparatus and method for correcting stereoscopic image using matching information

Номер: US20130089254A1
Автор: Hae Dong Kim, Ho Wook Jang, JUNG Jae Yu, Kyung Ho JANG, Myung Ha Kim, Seung Woo Nam
Принадлежит: Electronics and Telecommunications Research Institute ETRI

An apparatus for correcting a stereoscopic image using matching information, includes: a matching information visualizer receiving input of original stereoscopic images and intuitive matching information and visualizing a pair of stereoscopic images based on the intuitive matching information; a correction information processor obtaining a statistical camera parameter based on the intuitive matching information and correcting the received stereoscopic image using the statistical camera parameter; and an error allowable controller providing allowable error information to the correction information processor in consideration of an error allowable degree according to a selected time from the received intuitive matching information and preset human factor guide information, to extract a correlation between stereoscopic images using a stereoscopic image and provided information, thereby helping such that an erroneously photographed image is correctly photographed or correcting the image such that the erroneously photographed image is correctly interpreted, which leads to minimization of visual fatigue.

Подробнее
Номер записи: 30
25-04-2013 дата публикации

System and method for processing sensory effects

Номер: US20130103703A1
Автор: Do Kyoon Kim, Jae Joon Han, Sang Kyun Kim, Seung Ju Han, Won Chul Bang
Принадлежит: Industry Academy Cooperation Foundation of Myongji University, SAMSUNG ELECTRONICS CO LTD

A system and method for processing sensory effects. According to an embodiment of the present disclosure, sensory effects included in content may be implemented in the real world by generating command data for controlling a sensory device based on sensory effect information and specific information about the sensory device. In addition, the data transmission rate is high and a low bandwidth may be used by encoding metadata as binary before transmission, or encoding as XML before transmission, or encoding as XML and then further encoding as binary before transmission.

Подробнее
Номер записи: 31
30-05-2013 дата публикации

Image reproducer, image reproduction method, and data structure

Номер: US20130135311A1
Автор: Mikiko Karasawa, Yuki Kaneko
Принадлежит: Toshiba Corp

According to one embodiment, an image reproducer includes: a viewpoint position acquisition module configured to acquire a viewpoint of a viewer with respect to a display surface of a display; an image data acquisition module configured to acquire image data including an image to be displayed and disposition information indicating a three-dimensional position of the image with respect to the viewer when the image is displayed to the viewer; a pixel value calculator configured to calculate a pixel value on the display surface corresponding to a pixel of the acquired image such that the acquired image is displayed at the acquired position based on the acquired viewpoint of the viewer and the acquired position; and a display controller configured to control the display to display the acquired image based on the calculated pixel value.

Подробнее
Номер записи: 32
06-06-2013 дата публикации

Property Alteration of a Three Dimensional Stereoscopic System

Номер: US20130141422A1
Автор: Gunjan Porwal
Принадлежит: Autodesk Inc

A system and method for altering a property associated with a three dimensional stereoscopic system that has a display are disclosed. The method includes determining that a portion of a virtual object in a three dimensional image generated by the display resides at a predetermined position along a first axis relative to the display based on a difference between a left eye image of the portion of the virtual object and a right eye image of the portion of the virtual object. The first axis is perpendicular to a plane of the display. The method further includes altering a property associated with the portion of the virtual object based on the predetermined position without referring to any perceived overlap between the virtual object and the tangible environment.

Подробнее
Номер записи: 33
06-06-2013 дата публикации

Encoding device, encoding method, decoding device, and decoding method

Номер: US20130142247A1
Автор: Jun Yonemitsu, Shinobu Hattori, Yoshitomo Takahashi
Принадлежит: Sony Corp

An encoding device and method, and a decoding device and method, capable of encoding and decoding a multi-viewpoint image in accordance with a mode having compatibility with an existing mode. A compatible encoder generates a compatible stream by encoding an image that is a compatible image. An image converting unit converts the resolution of images that are auxiliary images. An auxiliary encoder generates an encoded stream of the auxiliary image by encoding the auxiliary image of which the resolution is converted. A compatibility information generating unit generates, as compatibility information, information that designates the image as a compatible image. A multiplexing unit transmits the compatible stream, the encoded stream of the auxiliary image, and the compatibility information. The encoding device can encode a 3D image of the multi-viewpoint mode.

Подробнее
Номер записи: 34
13-06-2013 дата публикации

Display apparatus and method for displaying using the same

Номер: US20130148026A1
Автор: Hyok-Sang Kwon, Ju-sun JEONG, Kyung-chul Nam
Принадлежит: SAMSUNG ELECTRONICS CO LTD

A display apparatus and a displaying method using the display apparatus are provided. The display apparatus includes: a receiver which receives a broadcasting signal via at least one of a plurality of channels; a display unit which outputs the received broadcasting signal; and a controller which controls the display unit to detect an identifier included in the received broadcasting signal and to display information relating to a channel receiving a broadcasting signal having the same identifier as the detected identifier.

Подробнее
Номер записи: 35
01-08-2013 дата публикации

Playback device, playback method, program, and recording medium

Номер: US20130195430A1
Автор: Kouichi Uchimura
Принадлежит: Sony Corp

The present invention relates to a playback device, a playback method, a program, and a recording medium that enable 3D playback in accordance with the capabilities of the playback device. A storage unit 24 stores a one-plane offset capability flag indicating whether or not 3D playback is possible in a one-plane offset mode, which is a mode in which one of two images obtained by shifting an image recorded on a disc 11 in a horizontal direction is output as a left-eye image and the other is output as a right-eye image, and a two-plane capability flag indicating whether or not 3D playback is possible in a two-plane mode, which is a mode in which a left-eye image and a right-eye image that are recorded on the disc are output as they are. A control unit 22 sets a playback mode for 3D playback in accordance with the one-plane offset capability flag and the two-plane capability flag stored in the storage unit 24 . The present invention can be applied to, for example, a playback device.

Подробнее
Номер записи: 36
08-08-2013 дата публикации

Method for generating and rebuilding a stereoscopic-compatible video stream and related coding and decoding devices

Номер: US20130201282A1
Автор: Giovanni Ballocca, Paolo D'amato
Принадлежит: Sisvel Technology SRL

A method for generating a digital stereoscopic video stream ( 101 ) includes container frames (C), having information about a right image (R) and a left image (L), wherein, when coding the digital stereoscopic video stream ( 101 ), at least one metadatum (M) is entered which is adapted to identify a region of a container frame (C) containing only one of the two images (L,R).

Подробнее
Номер записи: 37
29-08-2013 дата публикации

Receiver apparatus and method for receiving a three-dimensional broadcast signal in a mobile environment

Номер: US20130222541A1
Автор: Gomer Thomas, Jongyeul Suh, Joonhui Lee
Принадлежит: LG ELECTRONICS INC

The invention relates to a method and apparatus for receiving a three-dimensional broadcast image in a mobile environment. The method for receiving a three-dimensional broadcast image according to one embodiment of the present invention comprises the following steps: receiving a broadcast signal including a left-view image and aright-view image for a three-dimensional broadcast image, and a service signaling channel for signaling the three-dimensional broadcast image; parsing a service map table (SMT) contained in the service signaling channel, parsing, from the parsed SMT, component-type information for indicating whether or not a three-dimensional video stream including the left-view image and the right-view image is contained in the broadcast signal, and parsing, from the SMT, left/right-view image information for indicating whether the left-view image or right-view image is transmitted through a specific region of a single video frame, if the component-type information indicates that the three-dimensional video stream containing the left-view image and the right-view image is contained in the broadcast signal; formatting the left-view image and the right-view image into a three-dimensional image on the basis of the parsed left/right-view image information; and displaying the three-dimensional image.

Подробнее
Номер записи: 38
05-09-2013 дата публикации

Method and system for rfid-assisted imaging

Номер: US20130228620A1
Автор: Bernd Schoner, Brian Ahern
Принадлежит: TRIMBLE NAVIGATION LTD

A method includes acquiring imaging data of a scene using an imaging tool. The method also includes extracting radio frequency identification (RFID) data stored in an RFID tag associated with the scene. The method further includes associating the RFID data with the imaging data.

Подробнее
Номер записи: 39
26-09-2013 дата публикации

Image data transmitting apparatus, image data transmitting method, image data receiving apparatus, and image data receiving method

Номер: US20130250054A1
Автор: Ikuo Tsukagoshi
Принадлежит: Sony Corp

[Object] To enable a reception side (3DTV) to correctly generate left-eye and right-eye display image data by suitably performing cropping processing using cropping information. [Solution] “Stereo_Video_Cropping SEI” including 3D display cropping information is inserted, together with 2D display cropping information, into a header of a video data stream. A 3DTV at a reception side is able to perform image data cropping processing on the basis of this cropping information. Flag information “stereo_video_cropping_SEI_Not_present_flag” indicating whether or not 3D display cropping information is present is inserted into a higher layer of a data stream. The 3DTV at the reception side is able to identify the presence or absence of 3D display cropping information without analyzing the header of the video data stream.

Подробнее
Номер записи: 40
26-09-2013 дата публикации

Method and apparatus for transmitting stereoscopic video information

Номер: US20130250059A1
Автор: Bong Ho Lee, Eung Don Lee, Jin Soo Choi, Jin Woong Kim, Kug Jin Yun, Nam Ho Hur, Se Yoon Jeong, Soo In Lee, Won Sik Cheong
Принадлежит: Electronics and Telecommunications Research Institute ETRI

Provided are a method and an apparatus for transmitting stereoscopic video information capable of providing a stereoscopic video service. The method for transmitting stereoscopic video information comprises the steps of: creating a signaling table including video-related information; and transmitting the signaling table and the video, wherein the signaling table can include stream type information, a stereoscopic program information descriptor and/or a stereoscopic additional video stream descriptor, of the image

Подробнее
Номер записи: 41
03-10-2013 дата публикации

Transmitter and receiver for transmitting and receiving multimedia content, and reproduction method therefor

Номер: US20130258054A1
Автор: Dae-Jong Lee, Hee-Jean Kim, Hong-Seok Park, Jae-Jun Lee, Moon-Seok Jang, Yong-Seok Jang, Yong-Tae Kim, Yu-sung Joo
Принадлежит: SAMSUNG ELECTRONICS CO LTD

The present invention comprises: a receiving unit for receiving, through different paths, a first signal including a left-side image and a first synchronization information item, and a second signal including a right-side image and a second synchronization information item; and a signal processing unit for synchronizing and reproducing the left-side image and the right-side image using the first synchronization information item and the second synchronization information item. At least one information item, from among a content start information item, a timestamp difference between a first data item and a second data item, a frame index, a time code information item, a UTC information item, and a frame count information item, can be used as the first and second synchronization information items. Accordingly, different data can be effectively synchronized.

Подробнее
Номер записи: 42
17-10-2013 дата публикации

Transmitting system and receiving apparatus for providing hybrid service, and service providing method thereof

Номер: US20130271568A1
Автор: Gwang-Soon Lee, Hee-Jean Kim, Hong-Seok Park, Hyoung-Jin Kwon, Hyun-jeong YIM, Jae-Jun Lee, Jin-Young Lee, Kug-Jin Yun, Nam-Ho Hur, Seong-Sin Joo, Sung-Oh Hwang, Won-Sik Cheong, Yong-Seok Jang, Yu-sung Joo
Принадлежит: Electronics and Telecommunications Research Institute ETRI, SAMSUNG ELECTRONICS CO LTD

A receiving apparatus includes a first receiving unit that receives a first signal comprising an information descriptor to describe service characteristics, reference data, and additional data reference information through a RF communication network; a second receiving unit that can be connected to an IP network; a demux unit that detects the information descriptor from the first signal; a first signal processing unit that processes the reference data; a control unit that, if it is determined as a hybrid service depending on the information descriptor, controls the second receiving unit to access a source apparatus corresponding to the additional data reference information; a second signal process unit that, if a second signal comprising additional data is received through the IP communication network, processes the additional data; and an output unit that synchronizes and outputs the reference data and the additional data.

Подробнее
Номер записи: 43
14-11-2013 дата публикации

Method of Acquisition, Storage and Use of Data Relating to a Three-Dimensional Video Stream, and Video Processing Apparatus Thereof

Номер: US20130302015A1
Автор: Roberto Dini, Saverio Celia
Принадлежит: Sisvel SpA

A method for acquiring and storing data relating to video streams selectable on a video processing apparatus adapted to select a video stream reproducible on an associated reproduction device includes: identifying the source of the video stream by identification data, the video stream having a coding and transport configuration adapted to produce a three-dimensional display; verifying if, for the identified video stream, any data relating to the coding and transport configuration of the video stream are stored by the video processing apparatus in storage of the video processing apparatus including associations between video stream identification data and video stream coding and transport configurations; when affirmative, acquiring from the storage the coding and transport configuration associated with the video stream identified by the identification data, and using the data for a following selection of the video stream in order to reproduce the selected video stream on an associated video reproduction device.

Подробнее
Номер записи: 44
19-12-2013 дата публикации

Recording device/method/medium and replaying device/method

Номер: US20130336632A1
Автор: Akinobu Watanabe
Принадлежит: Hitachi Consumer Electronics Co Ltd

The present invention is to provide a play list in which information with which 3D contents can be displayed in a display correctly is recorded, a recording/reproducing device/method/medium and a reproducing device/method of the play list. For example, the present invention is to provide the recording/reproducing device/method/medium and the reproducing device/method in which a 3D system is recorded/reproduced in the play list. The recording method of recording information in the recording medium, includes a step of recording AV streams and a step of recording the play list in which reproduce order of the AV streams is prescribed and the play list includes user interface application information, the interface application information including 3D type information representing the 3D system of 3D contents in the play list.

Подробнее
Номер записи: 45
26-12-2013 дата публикации

Method and device for transmitting/receiving digital broadcast signal

Номер: US20130342646A1
Автор: Jeehyun Choe, Jinpil Kim, Jongyeul Suh
Принадлежит: LG ELECTRONICS INC

The present invention relates to a device and a method for transmitting/receiving a digital broadcast signal having a three-dimensional image. According to one embodiment of the present invention, a device for receiving a digital broadcast signal comprises: a tuner which receives a digital broadcast signal of a transport packet that contains signaling data and a video stream for implementing a three-dimensional image; a demodulation unit which demodulates said received digital broadcast signal; a decoding module which extracts mode conversion information from said demodulated digital broadcast signal; and an output formatter which outputs a decoded image signal on the basis of said mode conversion information.

Подробнее
Номер записи: 46
26-12-2013 дата публикации

3d video decoding apparatus and 3d video decoding method

Номер: US20130343469A1
Автор: Kengo Nishimura, Shoji Kawamura, Yohei Ikeuchi
Принадлежит: Panasonic Corp

A 3D decoding apparatus according to the present invention includes: a decoding unit which decodes left-eye and right-eye code signals to generate left-eye and right-eye decode signals; an error determining unit which determines an error of the left-eye and the right-eye code signals; an output determining unit which determines, when there is an error in one of the left-eye and the right-eye code signals, whether the one of the code signals that is determined as including an error has an error data mount equal to or greater than a first threshold; and an output unit which outputs neither the left-eye nor the right-eye code signal when the error data amount is smaller than the first threshold, and outputs only the decode signal obtained by decoding the other of the code signals when the error data amount is equal to or greater than the first threshold.

Подробнее
Номер записи: 47
02-01-2014 дата публикации

Image transfer apparatus

Номер: US20140002748A1
Автор: Nobuaki Kabuto, Yasutaka Tsuru, Yuya Ogi
Принадлежит: HITACHI LTD

A video transmitting apparatus including: a first register that is set when receiving a CEC (Consumer Electronics Control) message which is transmitted by a video signal source and is reset in response to a leading edge of a predetermined voltage that is supplied from said video signal source; and a second register which reads an EDID (Extended Display Identification Data) of a video displaying apparatus, is set when a decision is made that said video displaying apparatus is a predetermined video displaying apparatus, and is reset when a state where an HPD (Hot Plug Detect) is in a state of low has continued for a predetermined period of time or longer, wherein when both of said first and second registers have been set, a determination is made that said video signal source, said video transmitting apparatus, and said video displaying apparatus have been connected.

Подробнее
Номер записи: 48
02-01-2014 дата публикации

Information processing device, information processing method, and program

Номер: US20140003793A1
Автор: Yoshiyuki Kobayashi
Принадлежит: Sony Corp

The present invention relates to an information processing device, an information processing method, and a program, whereby playback of PG and TextST images can be controlled from a BD-J application. There are defined a mono PG/TextST stream of a PG/TextST image that is a mono image serving as a 2D image, a stereo PG/TextST stream of a PG/TextST image that is a stereo image serving as a 3D image, and a PG/TextST stream for offset of a PG/TextST image that is a mono image to be used fro generating a stereo image along with an offset value for giving disparity to the mono image, as a PG/TextST stream of a PG/TextST image. An stream selecting API selects a mono PG/TextST stream, a stereo PG/TextST stream, or a PG/TextST stream for offset. The present invention may be applied to a BD player configured to play a BD, or the like.

Подробнее
Номер записи: 49
20-03-2014 дата публикации

Indication of frame-packed stereoscopic 3d video data for video coding

Номер: US20140078249A1
Автор: Ye-Kui Wang
Принадлежит: Qualcomm Inc

This disclosure describes techniques for signaling and using an indication that video data is in a frame-packed stereoscopic 3D video data format. In one example of the disclosure, a method for decoding video data comprises receiving video data, receiving an indication that indicates whether any pictures in the received video data contain frame-packed stereoscopic 3D video data, and decoding the received video data in accordance with the received indication. The received video data may be rejected if the video decoder is unable to decode frame-packed stereoscopic 3D video data.

Подробнее
Номер записи: 50
20-03-2014 дата публикации

Reproduction device, reproduction method, and program

Номер: US20140078255A1
Автор: Atsushi Mae, Kenichiro Aridome, Toshiya Hamada
Принадлежит: Sony Corp

The present technology relates to a reproduction device, a reproduction method, and a program, which are able to control the processing of H.264/MPEG-4 MVC encoded data in accordance with the value of a flag. A reproduction device of one aspect of the present technology is provided with: a setting unit which sets a value to a flag that indicates whether or not the reproduction device itself is a device that is capable of decoding H.264/MPEG-4 MVC encoded data; and a reproduction control unit which controls reproduction of H.264/MPEG-4 MVC encoded data in accordance with the value of the flag, and outputs, to a display device, images obtained by reproduction.

Подробнее
Номер записи: 51
27-03-2014 дата публикации

Image playback device, image playback method, image playback program, image transmission device, image transmission method and image transmission program

Номер: US20140089962A1
Автор: Hiroshi Yahata, Tomoki Ogawa
Принадлежит: Panasonic Corp

Video playback device for performing realtime playback of 3D video by playing back first view-point video and second view-point video in combination, first view-point video being received via broadcasting in real time over broadcast waves, second view-point video being stored in advance before broadcasting of first view-point video, video playback device comprising: storage storing second view-point video; video receiving unit receiving first view-point video; information obtaining unit obtaining inhibition/permission information that indicates, for each video frame, whether displaying video frame before current time reaches scheduled presentation time is inhibited or permitted, scheduled presentation time being time at which video frame is scheduled to be broadcast for realtime playback; playback unit playing back second view-point video; and control unit inhibiting second view-point video from being played back when scheduled presentation time of next video frame is later than current time and inhibition/permission information indicates that displaying next video frame is inhibited.

Подробнее
Номер записи: 52
06-01-2022 дата публикации

METHOD FOR PROCESSING IMMERSIVE VIDEO AND METHOD FOR PRODUCING IMMVERSIVE VIDEO

Номер: US20220007000A1
Автор: DOMANSKI Marek, Dziembowski Adrian, JEONG Jun Young, LEE Gwang Soon, Mieloch Dawid
Принадлежит:

An immersive video processing method according to the present invention includes: classifying view videos into a base video and an additional video; performing pruning for the view videos by referring to a result of the classification; generating an atlas based on a result of the pruning; determining a depth parameter of each view in the atlas; and encoding information indicating whether or not updating of the depth parameter is needed, based on whether or not the depth parameter of each view in the atlas is identical as in a previous atlas. 1. A method for processing an immersive video , the method comprising:classifying view videos into a base video and an additional video;performing pruning for the view videos by referring to a result of the classification;generating an atlas based on a result of the pruning;determining a depth parameter of each view in the atlas; andencoding information indicating whether or not updating of the depth parameter is needed, based on whether or not the depth parameter of each view in the atlas is identical as in a previous atlas.2. The method of claim 1 , further comprising:when the depth parameter is updated, encoding information on a number of views of which the depth parameter is updated; andencoding index information of each of the views.3. The method of claim 2 , further comprising encoding claim 2 , for a view indicated by the view index information claim 2 , information indicating a minimum normalized disparity value and information indicating a maximum normalized disparity value.4. The method of claim 1 , further comprising scaling depth values in the atlas to a value within a predefined depth range.5. The method of claim 4 , wherein the depth range is set differently according to a type of a content.6. A method for synthesizing an immersive video claim 4 , the method comprising:decoding an atlas;obtaining a depth parameter of each view in the atlas; anddetermining a synthesis position of a restored pixel by using the depth ...

Подробнее
Номер записи: 53
07-01-2021 дата публикации

APPARATUS AND METHODS FOR NON-UNIFORM PROCESSING OF IMAGE DATA

Номер: US20210004932A1
Автор: Douady César, Newman David
Принадлежит:

Methods and apparatus for processing of high resolution content so as to obey desired encoder constraints. In one embodiment, the method includes capturing high resolution imaging spherical content; mapping the spherical content to another frame of reference (e.g., a non-uniform mapping and scaling) splitting up the mapped and scaled content into respective portions; feeding the split up portions to respective imaging encoders; packing encoded content from the respective imaging encoders into an A/V container; and storing and/or transmitting the A/V container. In one variant, the mapping and scaling are chosen to enable rendering of 1080P content in a desired scope or range (e.g., 360 degrees) using commodity encoder hardware and software. 112.-. (canceled)13. A camera apparatus , comprising:a plurality of image capture components;one or more encoding logic;a data interface;an image signal processor in data communication with the plurality of image capture components; and cause the plurality of image capture components to capture a plurality of images;', 'stitch the plurality of images into a spherical projection;', 'map the spherical projection into a second projection using at least one non-uniform mapping algorithm;', 'split the second projection into a plurality of image segments;', 'encode each of the plurality of image segments via the one or more encoding logic to produce output data having an encoded format;', 'insert the output data into one or more data containers; and', 'transmit the one or more data containers via the data interface., 'a non-transitory computer readable medium in data communication with the image signal processor, the medium comprising one or more instructions configured to, when executed by the image signal processor, cause the camera apparatus to1411. The camera apparatus of claim , wherein the plurality of image capture components comprise a first fisheye lens camera and a second fisheye lens camera , the first and second fisheye lens ...

Подробнее
Номер записи: 54
03-01-2019 дата публикации

SCENE AND ACTIVITY IDENTIFICATION IN VIDEO SUMMARY GENERATION

Номер: US20190005333A1
Автор: Newman David A., Silver Adam
Принадлежит:

Video and corresponding metadata is accessed. Events of interest within the video are identified based on the corresponding metadata, and best scenes are identified based on the identified events of interest. A video summary can be generated including one or more of the identified best scenes. The video summary can be generated using a video summary template with slots corresponding to video clips selected from among sets of candidate video clips. Best scenes can also be identified by receiving an indication of an event of interest within video from a user during the capture of the video. Metadata patterns representing activities identified within video clips can be identified within other videos, which can subsequently be associated with the identified activities. 1. A method for identifying video scenes , the method comprising:accessing a video of an activity, the activity including an event at a moment within the video;obtaining an identification of a type of the activity;obtaining an identification of a type of the event; the length is a first length based on the type of the activity being of a first activity type and the type of the event being of a first event type;', 'the length is a second length based on the type of the activity being of the first activity type and the type of the event being of a second event type;', 'the length is a third length based on the type of the activity being of a second activity type and the type of the event being of the first event type; and', 'the length is a fourth length based on the type of the activity being of the second activity type and the type of the event being of the second event type,', the first length is different from the second length, the third length, and the fourth length;', 'the second length is different from the third length and the fourth length; and', 'the third length is different from the fourth length; and, 'wherein], 'identifying a scene of the video for the event, the scene including a length of ...

Подробнее
Номер записи: 55
13-01-2022 дата публикации

OBJECT DISPLAY

Номер: US20220014726A1
Автор: Lehtiniemi Arto, Mate Sujeet Shyamsundar, Vilermo Miikka
Принадлежит:

An apparatus comprising means for: 1. An apparatus comprising:at least one processor; andat least one memory including computer program code, display at least one world-locked volumetric object having at least one non-viewable region;', "determine a change in a user's viewing position relative to the at least one world-locked volumetric object;", "determine if the change in the user's viewing position relative to the at least one world-locked volumetric object cause display of at least a portion of the at least one non-viewable region of the at least one world-locked volumetric object; and", "if it is determined that the change in the user's viewing position causes display of at least a portion of the at least one non-viewable region, cause the at least one world-locked volumetric object to be user-locked."], 'the at least one memory and the computer program code configured to, with the at least one processor, cause the apparatus to perform at least the following2. The apparatus as claimed in claim 1 , wherein the non-viewable region comprises at least one of a static or animated non-viewable region.3. The apparatus as claimed in claim 1 , wherein the at least one world-locked volumetric object comprises at least one of missing static display data claim 1 , missing animated display data claim 1 , static display data at sufficient quality or animated display data at sufficient quality.4. An apparatus as claimed in claim 3 , wherein at least one of the missing static display data or missing animated display data has not been captured or has not been synthesized; or at least one of the missing static display data or missing animated display data has not been received or has not been retrieved.5. The apparatus as claimed in claim 1 , wherein the at least one user-locked volumetric object has at least one animated non-viewable region and the apparatus is configured to:determine that an animation of the at least one user-locked volumetric object has finished; andin ...

Подробнее
Номер записи: 56
13-01-2022 дата публикации

VIDEO DATA PROCESSING METHOD AND DEVICE, RELATED APPARATUSES AND STORAGE MEDIUM

Номер: US20220014786A1
Автор: Huang Cheng
Принадлежит:

The present application provides a video data processing method and device, a server, a terminal, and a storage medium. The method includes: determining a sphere region of an omnidirectional video, and one or more zoom regions of the sphere region on a projected picture of the omnidirectional video; and decoding and playing video data of the one or more zoom regions of the sphere region on the projected picture of the omnidirectional video, in response to a zoom operation on the sphere region of the omnidirectional video. 1. A video data processing method applied to a server , the method comprising:determining a sphere region of an omnidirectional video, encoding and generating video data of a projection region of the sphere region on a projected picture of the omnidirectional video, and video data of one or more zoom regions of the sphere region on the projected picture of the omnidirectional video; andstoring the encoded video data, information on the sphere region of the omnidirectional video, and information on the one or more zoom regions of the sphere region on the projected picture of the omnidirectional video, ordetermining a two-dimensional (2D) region on a projected picture of an omnidirectional video, encoding and generating video data of the 2D region, and video data of one or more zoom regions of the 2D region on the projected picture of the omnidirectional video; and storing the encoded video data, information on the 2D region on the projected picture of the omnidirectional video, and information on the one or more zoom regions of the 2D region on the projected picture of the omnidirectional video.23-. (canceled)4. The method according to claim 1 , wherein the step of storing the encoded video data comprises:storing the video data of the projection region of the sphere region on the projected picture of the omnidirectional video and the video data of the one or more zoom regions of the sphere region on the projected picture of the omnidirectional video ...

Подробнее
Номер записи: 57
07-01-2021 дата публикации

METHOD FOR PROCESSING IMMERSIVE VIDEO AND METHOD FOR PRODUCING IMMVERSIVE VIDEO

Номер: US20210006764A1
Автор: EUM Ho Min, JEONG Jun Young, LEE Gwang Soon, Park Jong Il, SHIN Hong Chang, Yun Jun Young
Принадлежит:

An immersive video processing method according to the present disclosure includes determining a priority order of pruning for source view videos, generating a residual video for an additional view video based on the priority order of pruning, packing a patch generated based on the residual video into an atlas video, and encoding the atlas video. 1. An immersive video processing method , the method comprising:determining a priority order of pruning for source view videos;generating a residual video for an additional view video based on the priority order of pruning;packing a patch generated based on the residual video into an atlas video; andencoding the atlas video,wherein the determining of the priority order of pruning comprisesdetermining a basic view video among the source view videos; anddetermining a priority order of pruning for additional view videos except the basic view video.2. The immersive video processing method of claim 1 ,wherein the basic view video is highest in the priority order of pruning.3. The immersive video processing method of claim 2 ,wherein a priority order of pruning for the additional view videos is determined based on a size of an overlapping area with the basic view video.4. The immersive video processing method of claim 2 ,wherein, when a pruning priority for at least one of the additional view videos is determined,pruning priorities for the remaining additional view videos are determined based on a size of an overlapping area with higher-priority view videos, andwherein the higher-priority view videos comprise the basic view video and at least one additional view video with a determined pruning priority.5. The immersive video processing method of claim 4 ,wherein a priority order of pruning for the remaining additional view videos is determined based on a size of an area that is obtained by summing overlapping areas for each of the higher-priority view videos.6. The immersive video processing method of claim 1 ,wherein the priority ...

Подробнее
Номер записи: 58
07-01-2021 дата публикации

RECEPTION DEVICE, RECEPTION METHOD, TRANSMISSION DEVICE, AND TRANSMISSION METHOD

Номер: US20210006769A1
Автор: Tsukagoshi Ikuo
Принадлежит: SONY CORPORATION

Depth control when superimposing and displaying superimposition information by using depth information transmitted efficiently is easily implemented. 1. A reception device comprising:a reception unit configured to receive a video stream obtained by encoding image data of a wide viewing angle image for each of left-eye and right-eye pictures, and depth meta information including position information and a representative depth value of a predetermined number of angle areas in the wide viewing angle image for each of the pictures; anda processing unit configured to extract left-eye and right-eye display area image data from the image data of the wide viewing angle image for each of the left-eye and right-eye pictures obtained by decoding the video stream and to superimpose superimposition information data on the left-eye and right-eye display area image data for output,wherein when superimposing the superimposition information data on the left-eye and right-eye display area image data, the processing unit gives parallax to the superimposition information data to be superimposed on each of the left-eye and right-eye display area image data on a basis of the depth meta information.2. The reception device according to claim 1 , whereinthe reception unit receives the depth meta information for each of the pictures by using a timed metadata stream associated with the video stream.3. The reception device according to claim 1 , whereinthe reception unit receives the depth meta information for each of the pictures in a state of being inserted into the video stream.4. The reception device according to claim 1 , whereinwhen superimposing the superimposition information data on the left-eye and right-eye display area image data, the processing unit gives the parallax on a basis of a minimum value of the representative depth value of the predetermined number of angle areas corresponding to a superimposition range, the representative depth value being included in the depth meta ...

Подробнее
Номер записи: 59
07-01-2021 дата публикации

METHOD FOR PROCESSING IMMERSIVE VIDEO AND METHOD FOR PRODUCING IMMERSIVE VIDEO

Номер: US20210006830A1
Автор: EUM Ho Min, JEONG Jun Young, KWAK Sang Woon, LEE Gwang Soon, SHIN Hong Chang, YUN Kug Jin
Принадлежит: Electronics and Telecommunications Research Institute

Disclosed herein is an immersive video processing method. The immersive video processing method may include classifying a multiplicity of source view videos into base view videos and additional view videos, generating residual data for the additional view videos, packing a patch, which is generated based on the residual data, into an altas video, and generating metadata for the patch. 1. An immersive video processing method , the method comprising:classifying a multiplicity of source view videos into base view videos and additional view videos;generating residual data for the additional view videos;packing a patch, which is generated based on the residual data, into an atlas video, andgenerating metadata for the patch,wherein the metadata comprise information for identifying a source view, which is a source of the patch, or information indicating a position of the patch in the atlas video.2. The method of claim 1 ,wherein the metadata further comprise a flag indicating whether or not the patch is a ROI (Region of Interest) patch.3. The method of claim 1 ,wherein the metadata comprises index information of cameras capturing the multiplicity of source view videos, anddifferent indexes are allocated to each of the cameras.4. The method of claim 1 ,wherein, when a multiplicity of atlas videos is generated, the metadata comprise priority information of the atlas videos.5. The method of claim 1 ,wherein the metadata comprise information indicating positions where ROI patches in the atlas videos are packed.6. The method of claim 1 ,wherein the metadata further comprise at least one of a flag indicating whether or not the atlas videos are scaled or information indicating the size of the atlas videos.7. The method of claim 6 ,wherein, when a multiplicity of atlas videos is encoded, the flag is encoded for each of the atlas videos.8. An immersive video synthesizing method claim 6 , the method comprising:parsing video data and metadata from a bit stream;decoding the video data ...

Подробнее
Номер записи: 60
07-01-2021 дата публикации

METHOD AND APPARATUS FOR ENCODING/DECODING IMAGE FOR VIRTUAL VIEW SYNTHESIS

Номер: US20210006831A1
Автор: DOMANSKI Marek, Dziembowski Adrian, Grzelka Adam, JEONG Jun Young, LEE Gwang Soon, Mieloch Dawid, SHIN Hong Chang, STANKIEWICZ Olgierd, STANKOWSKI Jakub, YUN Kug Jin
Принадлежит:

Disclosed herein is an image encoding/decoding method and apparatus for virtual view synthesis. The image decoding for virtual view synthesis may include decoding texture information and depth information of at least one or more basic view images and at least one or more additional view images from a bit stream and synthesizing a virtual view on the basis of the texture information and the depth information, wherein the basic view image and the additional view image comprise a non-empty region and an empty region, and wherein the synthesizing of the virtual view comprises determining the non-empty region through a specific value in the depth information and a threshold and synthesizing the virtual view by using the determined non-empty region. 1. An image encoding method for virtual view synthesis , the method comprising:generating at least one or more basic view images and at least one or more additional view images by using input images comprising at least one or more view images;encoding texture information and depth information of the basic view images and the additional view images; andsending a threshold,wherein the sum of the number of the basic view images and the number of the additional view images is less than the number of the input images,wherein the basic view images and the additional view images comprise a non-empty region indicating a region that is to be used for virtual view synthesis at a decoding step and an empty region indicating a region that is not to be used for virtual view synthesis at the decoding step,wherein the depth information of either the basic view images or the additional view images comprises a specific value for indicating the empty region and the non-empty region, andwherein the threshold is used for determining the empty region and the non-empty region at the decoding step.2. The method of claim 1 ,wherein the non-empty region and the empty region are divided in CUs (Coding Units).3. The method of claim 1 ,wherein the ...

Подробнее
Номер записи: 61
07-01-2021 дата публикации

TECHNIQUES FOR ENCODING AND DECODING IMMERSIVE VIDEO

Номер: US20210006834A1
Автор: Boyce Jill M., Salahieh Basel
Принадлежит: Intel Corporation

An example apparatus for encoding immersive video includes a view optimizer to receive a plurality of input views from a source camera and select basic views and additional views from the plurality of input views. The apparatus also includes a view pruner to prune the additional views based on a comparison with the basic views. The apparatus further includes a patch packer to generate atlases based on the pruned additional views and the basic views. The apparatus includes a metadata composer to generate metadata including additional metadata. The apparatus also further includes a bitstream generator to generate a bitstream including the encoded video and the metadata. 116.-. (canceled)17. An apparatus for decoding immersive video , comprising: receive a bitstream comprising encoded video and metadata comprising additional metadata that includes metadata related to views pruned during encoding;', 'extract the additional metadata from the metadata; and, 'a decoder toa view renderer to render a view based on the extracted additional metadata.18. The apparatus of claim 17 , wherein the additional metadata comprises an atlas grouping parameter.19. The apparatus of claim 17 , wherein the additional metadata comprises a group index per atlas parameter.20. The apparatus of claim 19 , wherein the group index per atlas parameter indicates a related group of an atlas.21. The apparatus of claim 17 , wherein the additional metadata comprises a per patch visibility list.22. The apparatus of claim 17 , wherein the additional metadata comprises visibility parameters and view ID information.23. The apparatus of claim 22 , wherein the additional metadata comprises a visibility list indicating a set of views in which each patch is visible.24. A method for decoding immersive video bitstreams claim 22 , comprising:receiving, via a processor, a bitstream comprising encoded video and metadata comprising additional metadata that includes metadata related to views pruned during encoding; ...

Подробнее
Номер записи: 62
03-01-2019 дата публикации

FILE GENERATION APPARATUS AND FILE GENERATION METHOD AS WELL AS REPRODUCTION APPARATUS AND REPRODUCTION METHOD

Номер: US20190007676A1
Автор: Hamada Toshiya, Hirabayashi Mitsuhiro, KATSUMATA Mitsuru
Принадлежит: SONY CORPORATION

There is provided a file generation apparatus and a file generation method as well as a reproduction apparatus and a reproduction method by which a file for efficiently storing quality information of a depth-related image at least including a depth image can be generated. A segment file generation unit generates a file in which quality information representative of quality of a depth-related image including at least a depth image is disposed in a form divided for each kind. The present disclosure can be applied to a file generation apparatus of an information processing system or the like by which a segment file and an MPD file of a video content are distributed, for example, in a method that complies with MPEG-DASH. 1. A file generation apparatus comprising:a file generation unit configured to generate a file in which quality information representative of quality of a depth-related image including at least a depth image is disposed in a form divided for each kind.2. The file generation apparatus according to claim 1 , whereinthe file generation apparatus is configured such thatthe file generation unit divides the quality information for each kind and disposes the divisional quality information into different files.3. The file generation apparatus according to claim 2 , whereinthe file generation apparatus is configured such thatthe depth-related image includes an occlusion image that is a texture image of an occlusion region corresponding to the depth image.4. The file generation apparatus according to claim 3 , whereinthe file generation apparatus is configured such thatthe quality information of the occlusion image is information representative of a ratio of the occlusion region to a screen of the texture image or a noise amount of the occlusion image.5. The file generation apparatus according to claim 3 , whereinthe file generation apparatus is configured such thatthe kind is a kind of the depth-related image.6. The file generation apparatus according to claim 2 ...

Подробнее
Номер записи: 63
02-01-2020 дата публикации

IMAGE PROCESSING APPARATUS AND IMAGE PROCESSING METHOD

Номер: US20200007845A1
Автор: FUKUYASU TETSUYA
Принадлежит:

The present disclosure relates to an image processing apparatus and an image processing method capable of storing auxiliary information in CbCr components in a YCbCr format so as to prevent deterioration by a codec distortion. The image processing apparatus includes a receiving section that receives depth image data in which a depth image transmitted together with a texture image is stored in a Y component in a YCbCr format and auxiliary information is stored in CbCr components in the YCbCr format, and an auxiliary information utilization section that executes a predetermined image process using the auxiliary information on at least one of the texture image or the depth image. A value that can be taken on by the auxiliary information for each pixel of the texture image has N patterns, and a gradation value out of N×N gradation values into which a combination of the auxiliary information regarding two pixels is converted is stored in the CbCr components. The present technique is applicable to, for example, a home server that generates a display image at a predetermined viewpoint from an omnidirectional image. 1. An image processing apparatus comprising:a receiving section that receives depth image data in which a depth image transmitted together with a texture image is stored in a Y component in a YCbCr format and auxiliary information is stored in CbCr components in the YCbCr format; andan auxiliary information utilization section that executes a predetermined image process using the auxiliary information on at least one of the texture image or the depth image, whereina value that can be taken on by the auxiliary information for each pixel of the texture image has N patterns, anda gradation value out of N×N gradation values into which a combination of the auxiliary information regarding two pixels is converted is stored in the CbCr components.2. The image processing apparatus according to claim 1 , whereinthe receiving section receives texture image data regarding ...

Подробнее
Номер записи: 64
02-01-2020 дата публикации

Mmt apparatus and mmt method for processing stereoscopic video data

Номер: US20200007846A1
Автор: Jin Young Lee, Kug Jin Yun, Won Sik Cheong
Принадлежит: Electronics and Telecommunications Research Institute ETRI

An MPEG media transport (MMT) apparatus and method for processing stereoscopic video data are provided. The MMT apparatus includes an asset file generator configured to generate a single asset file that contains an entire or part of the stereoscopic video data; and a signaling message generator configured to generate a signaling message for delivery or consumption of the stereoscopic video data. At least one of the generated single asset file and the generated signaling message contains stereoscopic video information related to the stereoscopic video data.

Подробнее
Номер записи: 65
10-01-2019 дата публикации

IMAGE PROCESSING APPARATUS, IMAGE PROCESSING METHOD THEREOF AND STORAGE MEDIUM

Номер: US20190014301A1
Автор: Ota Yuya
Принадлежит:

An image processing apparatus, which executes image processing for generating a virtual viewpoint image using a plurality of images captured by a plurality of imaging units that image an imaging space from different viewpoints, identifies a specific object among a plurality of objects inside the imaging space, and carries out image processing for generating the virtual viewpoint image on the plurality of objects inside the imaging space. The image processing apparatus executes the image processing on the identified specific object using images captured by more imaging units than in the image processing executed on other objects. 1. An image processing apparatus that executes image processing for generating a virtual viewpoint image using a plurality of images captured by a plurality of imaging units that image an imaging space from different viewpoints , the apparatus comprising:an identification unit configured to identify a specific object among a plurality of objects inside the imaging space; anda processing unit configured to carry out image processing for generating the virtual viewpoint image on the plurality of objects inside the imaging space,wherein the processing unit executes the image processing on the specific object identified by the identification unit using images captured by more imaging units than in the image processing executed on other objects.2. The image processing apparatus according to claim 1 ,wherein the image processing executed by the processing unit is processing for generating a three-dimensional model of an object.3. The image processing apparatus according to claim 1 ,wherein the image processing executed by the processing unit is processing for rendering an image of an object from an arbitrary viewpoint.4. The image processing apparatus according to claim 1 , further comprising:a selecting unit configured to select the imaging units providing the images used in the image processing on the specific object and the imaging units ...

Подробнее
Номер записи: 66
14-01-2021 дата публикации

SUGGESTED VIEWPORT INDICATION FOR PANORAMIC VIDEO

Номер: US20210014467A1
Автор: Boyce Jill M.
Принадлежит: Intel Corporation

A suggested viewport indication is generated and sent for use in a panoramic video. In one example, a method includes receiving encoded video including viewport metadata, decoding the video, extracting the viewport metadata, generating a viewport of the decoded video based on the viewport metadata, and buffering the generated viewport for display. 1. A method comprising:decoding encoded video of a planar projection of a wide angle video and viewport metadata of multiple alternative viewports associated with the planar projection;selecting one of the viewports; andgenerating a viewport of a decoded version of the video based on the selected viewport.2. The method of claim 1 , wherein the viewport metadata includes a center of a region of interest.3. The method of claim 2 , wherein the center is indicated as a latitude and longitude of a viewport representation.4. The method of claim 2 , wherein the viewport metadata includes a field of view of the region of interest based on distance from the center.5. The method of claim 4 , wherein the field of view is indicated as a horizontal angle and a vertical angle.6. The method of claim 1 , further comprising determining whether a user has indicated using a user-selected viewport and if so claim 1 , then generating a viewport using the user-selected viewport instead of generating a viewport using the viewport metadata.7. The method of claim 1 , wherein selecting one of the multiple viewports comprises receiving a user selection of one of the multiple viewports.8. At least one non-transitory machine-readable medium comprising instructions stored thereon that when executed cause the machine to perform operations comprising:receiving a wide field of view video;mapping the video into a planar projection;generating viewport metadata comprising multiple alternative viewports so that a selected one of the multiple viewports can be used to generate a viewport after decoding of the viewport metadata; andencoding the planar projection ...

Подробнее
Номер записи: 67
14-01-2021 дата публикации

OVERLAY PROCESSING METHOD IN 360 VIDEO SYSTEM, AND DEVICE THEREOF

Номер: US20210014469A1
Автор: Hur Hyejung, HWANG Soojin, Lee Jangwon, Oh Sejin
Принадлежит: LG ELECTRONICS INC.

A 360 image data processing method performed by a 360 video receiving device, according to the present invention, comprises the steps of: receiving 360 image data; acquiring information and metadata on an encoded picture from the 360 image data; decoding the picture on the basis of the information on the encoded picture; and rendering the decoded picture and an overlay on the basis of the metadata, wherein the metadata includes overlay-related metadata, the overlay is rendered on the basis of the overlay-related metadata, and the overlay-related metadata includes information on a region of the overlay. 1. A 360-degree video data processing method performed by a 360-degree video receiving device , the method comprising:receiving 360-degree video data including encoded pictures;acquiring metadata;decoding pictures; andrendering the decoded pictures and an overlay based on the metadata,wherein:the metadata includes overlay related metadata,the overlay related metadata includes distance information indicating a distance from a center of a unit sphere for representing the 360-degree video,the overlay related metadata includes information of the overlay,the information of the overlay includes a rendering type of overlay in 3D space of the 360-degree video, andthe overlay is rendered based on the overlay related metadata.2. The method of claim 1 , wherein:the distance is identical as a radius of the unit sphere.3. The method of claim 1 , wherein:the overlay related metadata includes information on azimuth and elevation that indicates the azimuth and elevation angles of the center of the overlay region respectively.4. The method of claim 1 , wherein:the overlay related metadata includes range information on azimuth and elevation which indicates an azimuth range and an elevation range through a center point of a sphere region.5. The method of claim 4 , wherein:{'sup': 16', '16, 'the azimuth range is in the range of 0 to 360*2and the elevation range is in the range of 0 to ...

Подробнее
Номер записи: 68
09-01-2020 дата публикации

Display processing circuitry

Номер: US20200014904A1
Автор: Andrew Victor JONES, Gordon Wetzstein, Kari Pulli, Ryan Phillip SPICER, Tomi Petteri MAILA
Принадлежит: Raxium Inc

The disclosure describes aspects of a display processing circuitry. In an aspect, one or more displays that support multiple views include one or more arrays of pixels, one or more backplanes, and a processing circuitry configured to receive one or more data streams, control processing of the data streams based on policies from which to select a mode of operation, each mode of operation defining which rays of light the arrays of pixels in the displays are to contribute to generate a particular view or views and the tasks to be performed by the processing circuitry to modify the data streams accordingly. The processing circuitry further provides signaling representative of the modified data streams to the arrays of pixels through a circuit configuration of the backplanes for the arrays of pixels to contribute the rays that will to generate the particular view or views. A corresponding method is also described.

Подробнее
Номер записи: 69
09-01-2020 дата публикации

METHOD AND APPARATUS FOR TRANSMITTING AND RECEIVING METADATA FOR COORDINATE SYSTEM OF DYNAMIC VIEWPOINT

Номер: US20200014905A1
Автор: Oh Sejin
Принадлежит:

A 360-degree video data processing method performed by a 360-degree video reception apparatus according to an embodiment of the present invention includes: receiving information on 360-degree video data; obtaining information on an encoded picture and metadata from the information on the 360-degree video data; decoding the encoded picture based on the information on the encoded picture; and rendering the decoded picture based on the metadata, wherein the metadata comprises a dynamic global coordinate system rotation flag representing whether relative rotation angles between a common reference coordinate system of a dynamic viewpoint and a global coordinate system are changed. 1. A 360-degree video data processing method performed by a 360-degree video reception apparatus , the method comprising:receiving information on 360-degree video data;obtaining information on an encoded picture and metadata from the information on the 360-degree video data;decoding the encoded picture based on the information on the encoded picture; andrendering the decoded picture based on the metadata,wherein the metadata comprises a dynamic global coordinate system rotation flag representing whether relative rotation angles between a common reference coordinate system of a dynamic viewpoint and a global coordinate system are changed.2. The method of claim 1 , wherein the dynamic global coordinate system rotation flag is fora sample entry claim 1 , andwherein when a value of the dynamic global coordinate system rotation flag is 0, the relative rotation angles between the common reference coordinate system of the dynamic viewpoint and the global coordinate system remain unchanged in samples referring to the sample entry.3. The method of claim 2 , wherein when the value of the dynamic global coordinate system rotation flag is 0 claim 2 , the metadata comprises information on yaw claim 2 , pitch and roll rotation angles of x-axis claim 2 , y-axis claim 2 , and z-axis claim 2 , respectively ...

Подробнее
Номер записи: 70
09-01-2020 дата публикации

METHODS AND APPARATUS FOR IMMERSIVE MEDIA CONTENT OVERLAYS

Номер: US20200014906A1
Автор: Chen Lulin, WANG Xin
Принадлежит: MEDIATEK SINGAPORE PTE. LTD.

The techniques described herein relate to methods, apparatus, and computer readable media configured to decode video data. Video data includes video content, overlay content, and overlay metadata that is specified separate from the video content and overlay content. The overlay content is determined to be associated with the video content based on the overlay metadata. The overlay content is overlaid onto the video content in the region of the video content. 1. A decoding method for decoding video data , the method comprising: video content;', 'overlay content; and', 'overlay metadata that is specified separate from the video content and overlay content, wherein the overlay metadata specifies a region of the video content;, 'receiving video data comprisingdetermining the overlay content is associated with the video content based on the overlay metadata; andoverlaying the overlay content onto the video content in the region of the video content.2. The decoding method of claim 1 , wherein receiving the video data comprises receiving a timed metadata track comprising the overlay metadata.3. The decoding method of claim 2 ,wherein the overlay content comprises first overlay content and second overlay content that is different than the first overlay content; and determining, based on the overlay metadata, first overlay content is associated with a first time period and second overlay content is associated with a second time period after the first time period;', 'overlaying the first overlay content on the video content in the region during the first time period; and', 'overlaying the second overlay content on the video content in the region during the second time period., 'the method comprising4. The decoding method of claim 2 , wherein:the overlay content comprises first overlay content and second overlay content that is different than the first overlay content; andthe overlay metadata does not specify whether to overlay the first overlay content or the second overlay ...

Подробнее
Номер записи: 71
09-01-2020 дата публикации

SUB-PICTURE-BASED PROCESSING METHOD OF 360-DEGREE VIDEO DATA AND APPARATUS THEREFOR

Номер: US20200014907A1
Автор: Lee Jangwon, Oh Sejin
Принадлежит:

The present invention relates to a 360-degree video data processing method performed by a 360-degree video reception apparatus, the method comprising: receiving 360-degree video data, obtaining information on an encoded picture and metadata from the 360-degree video data, decoding at least a part of a picture based on the information on the encoded picture and rendering at least a part of the decoded picture based on the metadata, and the decoded picture is a composition picture and the metadata includes indication information related to whether the composition picture is identical to a projected picture. 1. A 360-degree video data processing method performed by a 360-degree video reception apparatus , the method comprising:receiving 360-degree video data;obtaining information on an encoded picture and metadata from the 360-degree video data;decoding sub-pictures based on the information on the encoded picture;constructing a composition picture based on the decoded sub-pictures;deriving a projected picture from the composition picture; andrendering the projected picture based on the metadata,wherein the metadata includes indication information related to whether the composition picture is identical to a projected picture.2. The method of claim 1 , when the indication information indicates that the composition picture is not identical to the projected picture claim 1 , RegionWisePackingBox is parsed claim 1 , and the projected picture is derived based on a region-wise unpacking process for the composition picture.3. The method of claim 1 , wherein the projected picture is derived from the composition picture without parsing for RegionWisePackingBox when the indication information includes information representing that the composition picture is identical to the projected picture.4. The method of claim 1 , wherein the metadata includes a SpatialRelationship2DDescriptionBox claim 1 , andwherein the indication information is included in the ...

Подробнее
Номер записи: 72
16-01-2020 дата публикации

METHOD AND APPARATUS FOR OVERLAY PROCESSING IN 360 VIDEO SYSTEM

Номер: US20200021791A1
Автор: Hur Hyejung, Lee Jangwon, Oh Sejin
Принадлежит: LG ELECTRONICS INC.

Provided is a 360-degree image data processing method performed by a 360-degree video reception apparatus. The method includes receiving 360-degree image data, obtaining information on an encoded picture and metadata from the 360-degree image data, decoding a picture based on the information on the encoded picture, and rendering the decoded picture and an overlay based on the metadata, in which the metadata includes overlay related metadata, the overlay is rendered based on the overlay related metadata, and the overlay related metadata include group information of the overlay. 1. A 360-degree image data processing method performed by a 360-degree video reception apparatus , the method comprising:receiving 360-degree image data;obtaining information on an encoded picture and metadata from the 360-degree image data;decoding a picture based on the information on the encoded picture; andrendering the decoded picture and an overlay based on the metadata,wherein the metadata includes overlay related metadata,wherein the overlay is rendered based on the overlay related metadata, and wherein the overlay related metadata include group information of the overlay.2. The method of claim 1 , wherein the group information of the overlay includes information on overlays switchable to each other.3. The method of claim 2 , wherein the information on overlays switchable to each other includes identification information for the overlays indicated by ref_overlay_IDs field.4. The method of claim 1 , wherein the overlay related metadata includes identification information for an overlay that is currently active.5. The method of claim 1 , wherein the group information of the overlay includes information indicating a main media to be rendered with the overlay claim 1 , andwherein the decoded picture comprise the main media.6. The method of claim 5 , wherein the information indicating the main media to be rendered with the overlay is indicated by EntityToGroupBox with grouping_type field.7. ...

Подробнее
Номер записи: 73
21-01-2021 дата публикации

METHOD AND DEVICE FOR TRANSMITTING INFORMATION ON THREE-DIMENSIONAL CONTENT INCLUDING MULTIPLE VIEW POINTS

Номер: US20210021798A1
Автор: BAE Jaehyeon, SO Youngwan, YANG Hyunkoo, YIP Eric
Принадлежит:

Provided is a method for transmitting metadata for omnidirectional content including a plurality of veiwpoints. The method comprises identifying the metadata for the omnidirectional content including the plurality of viewpoints; and transmitting the identified metadata, wherein the metadata includes information about an identifier (ID) of a viewpoint group including at least one viewpoint of the plurality of viewpoints, and wherein the at least one viewpoint in the viewpoint group shares a common reference coordinate system.. 1. A method for transmitting metadata for omnidirectional content including a plurality of viewpoints , the method comprising:identifying the metadata for the omnidirectional content including the plurality of viewpoints; andtransmitting the identified metadata,wherein the metadata includes information about an identifier (ID) of a viewpoint group including at least one viewpoint of the plurality of viewpoints, andwherein the at least one viewpoint in the viewpoint group shares a common reference coordinate system.2. The method of claim 1 , wherein the metadata further includes information about a description of the viewpoint group.3. The method of claim 1 , wherein the metadata further includes information indicating yaw claim 1 , pitch claim 1 , and roll rotation angles of X claim 1 , Y claim 1 , and Z axes of one or more viewpoint of the plurality of viewpoints in the common reference coordinate system.4. The method of claim 1 , wherein the metadata further includes information indicating position of one or more viewpoint of the plurality of viewpoints in the common reference coordinate system.5. The method of claim 1 , wherein the metadata includes information indicating a viewpoint switching mode for a viewpoint to be switched claim 1 , when switching occurs between viewpoints in the viewpoint group claim 1 , andwherein the information indicating the viewpoint switching mode indicates one of a forward line of sight (LoS) mode, a backward ...

Подробнее
Номер записи: 74
28-01-2016 дата публикации

Activity identification in video

Номер: US20160026874A1
Автор: Jonathan Taylor, Nick Hodulik
Принадлежит: GoPro Inc

Video and corresponding metadata is accessed. Events of interest within the video are identified based on the corresponding metadata, and best scenes are identified based on the identified events of interest. A video summary can be generated including one or more of the identified best scenes. The video summary can be generated using a video summary template with slots corresponding to video clips selected from among sets of candidate video clips. Best scenes can also be identified by receiving an indication of an event of interest within video from a user during the capture of the video. Metadata patterns representing activities identified within video clips can be identified within other videos, which can subsequently be associated with the identified activities.

Подробнее
Номер записи: 75
23-01-2020 дата публикации

MODULAR LADAR SENSOR

Номер: US20200025895A1
Автор: Gilliland Patrick, Heughebaert Laurent, Short Brad, Spagnolia Joseph, STETTNER Roger
Принадлежит: Continental Advanced Lidar Solutions US, LLC.

A lightweight, inexpensive LADAR sensor incorporating 3-D focal plane arrays is adapted specifically for modular manufacture and rapid field configurability and provisioning. The sensor generates, at high speed, 3-D image maps and object data at short to medium ranges. The techniques and structures described may be used to extend the range of long range systems as well, though the focus is on compact, short to medium range ladar sensors suitable for use in multi-sensor television production systems and 3-D graphics capture and moviemaking. 3-D focal plane arrays are used in a variety of physical configurations to provide useful new capabilities. 1. A mobile ladar platform comprising:a first electrically conductive housing having an interior wall;a ladar sensor mounted to said interior wall of said first electrically conductive housing;a first connector mounted to said first electrically conductive housing and electrically connected to said ladar sensor;a cable extending between a first end and a second end;a second connector disposed at said second end of said cable and adapted to mate with said first connector;a third connector disposed at said first end of said cable;a second electrically conductive enclosure;a digital processor disposed within said second electrically conductive enclosure; anda fourth connector coupled to said second electrically conductive enclosure and coupled to said digital processor;said third connector connected to said fourth connector such that said cable connects said ladar sensor to said digital processor;said digital processor adapted to perform analysis of a scene in a field of view of said ladar sensor; a laser transmitter with a modulated laser light output and a diffusing optic for illuminating a scene in the field of view,', 'a zero range reference circuit having a zero range reference output adapted to signal the initiation of said modulated laser light output,', 'a clock driver circuit having a clock output and having a ...

Подробнее
Номер записи: 76
10-02-2022 дата публикации

MULTI-APERTURE RANGING DEVICES AND METHODS

Номер: US20220046219A1
Автор: Chintha Akash, CUSACK, Gershman Charles F., JR. Francis J., Obla Srinath, Petilli Eugene M.
Принадлежит: OWL AUTONOMOUS IMAGING, INC.

Embodiments of systems and methods for multi-aperture ranging are disclosed. An embodiment of a device includes a main lens, configured to receive an image from the field of view of the main lens, a multi-aperture optical component having optical elements optically coupled to the main lens and configured to create a multi-aperture image set that includes a plurality of subaperture images, wherein at least one point in the field of view is captured by at least two of the subaperture images, an array of sensing elements, a ROIC configured to receive the signals, to convert the signals to digital data, and to output the digital data, and an image processing system, responsive to the digital data that is output from the ROIC, which is configured to generate disparity values that correspond to at least one point in common between the at least two subaperture images. 1. A device comprising:a main lens, configured to receive an image from the field of view of the main lens;a multi-aperture optical component having optical elements optically coupled to the main lens and configured to create a multi-aperture image set that includes a plurality of subaperture images, wherein at least one point in the field of view is captured by at least two of the subaperture images;an array of sensing elements, the array of sensing elements being optically coupled to the multi-aperture optical component and configured to generate signals that correspond to the at least two subaperture images;a read-out integrated circuit (ROIC) communicatively coupled to the array of sensing elements and configured to receive the signals, which correspond to the at least two subaperture images, from the array of sensing elements, to convert the signals to digital data, and to output the digital data; andan image processing system, responsive to the digital data that is output from the ROIC, which is configured to generate disparity values that correspond to at least one point in common between the at least ...

Подробнее
Номер записи: 77
28-01-2021 дата публикации

METHODS, SYSTEMS, AND MEDIA FOR RENDERING IMMERSIVE VIDEO CONTENT WITH FOVEATED MESHES

Номер: US20210029340A1
Автор: Janatra Ivan, KVAALEN Samuel, Wu Changchang, Wu Wanmin
Принадлежит:

Methods, systems, and media for rendering immersive video content with foveated meshes are provided. In some embodiments, the method comprises: receiving a video content item; determining, using a hardware processor, whether the video content item meets at least one criterion; in response to determining that the video content item meets the at least one criterion, generating, using the hardware processor, a foveated mesh in accordance with a foveation ratio parameter on which frames of the video content item are to be projected, wherein the foveated mesh has a non-uniform position map that increases pixel density in a central portion of each frame of the video content item in comparison with peripheral portions of each frame of the video content item; and storing the video content item in a file format that includes the generated foveated mesh, wherein the immersive video content is rendered by applying the video content item as a texture to the generated foveated mesh. 1. A method for generating immersive video content , the method comprising:receiving a video content item;determining, using a hardware processor, whether the video content item meets at least one criterion;in response to determining that the video content item meets the at least one criterion, generating, using the hardware processor, a foveated mesh in accordance with a foveation ratio parameter on which frames of the video content item are to be projected, wherein the foveated mesh has a non-uniform position map that increases pixel density in a central portion of each frame of the video content item in comparison with peripheral portions of each frame of the video content item; andstoring the video content item in a file format that includes the generated foveated mesh, wherein the immersive video content is rendered by applying the video content item as a texture to the generated foveated mesh.2. The method of claim 1 , wherein the at least one criterion includes determining whether the received ...

Подробнее
Номер записи: 78
28-01-2021 дата публикации

INFORMATION PROCESSING DEVICE, METHOD, AND PROGRAM

Номер: US20210029343A1
Автор: Hamada Toshiya, KANAI KENICHI
Принадлежит:

[Problem] To provide an image processing device, an image processing method, and a program. [Solution] An information processing device that includes a metadata file generating unit that generates a metadata file including viewpoint switch information to perform a position correction of an audio object at a viewpoint switch among plural viewpoints. 1. An information processing device comprisinga metadata-file generating unit that generates a metadata file including viewpoint switch information to perform a position correction of an audio object at a viewpoint switch among a plurality of viewpoints.2. The information processing device according to claim 1 , whereinthe metadata file is a media presentation description (MPD) file.3. The information processing device according to claim 2 , whereinthe viewpoint switch information is stored in AdaptationSet in the MPD file.4. The information processing device according to claim 2 , whereinthe viewpoint switch information is stored in Period in the MPD file, associated with AdaptationSet in the MPD file.5. The information processing device according to claim 1 , whereinthe metadata-file generating unit further generates a media presentation description (MPD) file including access information to access the metadata file.6. The information processing device according to claim 5 , whereinthe access information is stored in AdaptationSet in the MPD file.7. The information processing device according to claim 5 , whereinthe access information is stored in Period in the MPD file, associated with AdaptationSet in the MPD file.8. The information processing device according to claim 1 , whereinthe viewpoint switch information is stored in the metadata file, associated with each viewpoint included in the plurality of viewpoints.9. The information processing device according to claim 8 , whereinthe viewpoint switch information includes switch-destination viewpoint information related to a switch destination viewpoint switchable from ...

Подробнее
Номер записи: 79
28-01-2021 дата публикации

METHOD FOR TRANSMITTING 360 VIDEO, METHOD FOR RECEIVING 360 VIDEO, APPARATUS FOR TRANSMITTING 360 VIDEO, AND APPARATUS FOR RECEIVING 360 VIDEO

Номер: US20210029344A1
Автор: OH Hyunmook, Oh Sejin
Принадлежит: LG ELECTRONICS INC.

According to one aspect of the present invention, the present invention may relate to a method for transmitting a 360 video. The method for transmitting a 360 video may include processing a plurality of circular images captured by a camera having at least one fisheye lens; encoding a picture to which the circular images are mapped; generating signaling information about the 360 video data; encapsulating the encoded picture and the signaling information into a file, and transmitting the file. 1. A method for transmitting omnidirectional media content in a digital transmitter , the method comprising:mapping at least one circular image onto a picture in a video format;encoding the picture as a coded video bitstream;generating metadata which assists in rendering the picture,wherein the metadata includes rectangular region top/left information, rectangular region width information, rectangular region height information, circular image centre information and circular image radius information,wherein the rectangular region top/left information is used to represent a coordinate of a top-left corner of a rectangular region that contains the at least one circular image,wherein the rectangular region width information is used to represent a coordinate of an width of the rectangular region that contains the at least one circular image,wherein the rectangular region height information is used to represent a coordinate of a height of the rectangular region that contains the at least one circular image,wherein the circular image radius information is used to represent a radius of the at least one circular image that is defined as a length from the centre of the at least one circular image specified by the circular image centre information to the outermost boundary of the at least one circular image; andtransmitting a signal including a coded audio stream, the coded video bitstream and the generated metadata.2. The method of claim 1 , wherein the at least one circular image is ...

Подробнее
Номер записи: 80
17-02-2022 дата публикации

INTERACTIVE OVERLAY HANDLING FOR IMMERSIVE TELECONFERENCING AND TELEPRESENCE FOR REMOTE TERMINALS

Номер: US20220053176A1
Автор: Abhishek Rohit, SODAGAR Iraj
Принадлежит: Tencent America LLC

A method, a non-transitory computer readable medium, and a computer system is provided for handling video streams. The method may include: receiving a 360° video stream, the 360° video stream including a multiple overlay parameter; when the multiple overlay parameter is a first value, determining that overlaying the 360° video stream with two or more overlays is permissible by the user terminal, and displaying, by the user terminal, the 360° video stream with the two or more overlays; and when the multiple overlay parameter is a second value, determining that overlaying the 360° video stream with two or more overlays is not permissible and displaying the 360° video stream with zero overlays or one overlay. 1. A method comprising:receiving, by a user terminal, from an electronic device or a server, a 360° video stream, wherein the 360° video stream includes a multiple overlay parameter that indicates whether overlaying the 360° video stream with two or more overlays is permissible by the user terminal;displaying, by the user terminal, the 360° video stream;when the multiple overlay parameter is a first value, determining, by the user terminal, that overlaying the 360° video stream with two or more overlays is permissible by the user terminal, and displaying, by the user terminal, the 360° video stream with the two or more overlays; andwhen the multiple overlay parameter is a second value, determining, by the user terminal, that overlaying the 360° video stream with two or more overlays is not permissible by the user terminal, and displaying, by the user terminal, the 360° video stream with zero overlays or one overlay,wherein the first value is different from the second value, andwherein the overlay or overlays include one or more of: another video stream, or an image.2. The method of claim 1 , whereinthe 360° video stream includes an overlap overlays parameter that indicates whether overlapping one of the two or more overlays with a first overlay is permissible, and ...

Подробнее
Номер записи: 81
17-02-2022 дата публикации

INFORMATION PROCESSING APPARATUS, INFORMATION PROCESSING METHOD, AND PROGRAM

Номер: US20220053179A1
Автор: GOHARA Hiroki
Принадлежит:

An information processing apparatus according to an embodiment of the present technology includes a processor. The processor switches between display of a first real space image and display of a second real space image by performing switching processing on the basis of metadata related to the switching between the display of the first real space image and the display of the second real space image, the switching processing corresponding to an angle of view of the first real space image, the first real space image being displayed on a virtual space, the second real space image being displayed on a region including a region, in the virtual space, on which the first real space image is displayed, the region on which the second real space image is displayed being larger than the region on which the first real space image is displayed. 1. An information processing apparatus , comprisinga processor that switches between display of a first real space image and display of a second real space image by performing switching processing on a basis of metadata related to the switching between the display of the first real space image and the display of the second real space image, the switching processing corresponding to an angle of view of the first real space image, the first real space image being displayed on a virtual space, the second real space image being displayed on a region including a region, in the virtual space, on which the first real space image is displayed, the region on which the second real space image is displayed being larger than the region on which the first real space image is displayed.2. The information processing apparatus according to claim 1 , whereinon the basis of the metadata, the processor determines whether the time has come to perform the switching processing, andthe processor performs the switching processing when the time has come to perform the switching processing.3. The information processing apparatus according to claim 1 , whereinon the ...

Подробнее
Номер записи: 82
17-02-2022 дата публикации

Method and apparatus for generating media file comprising 3-dimensional video content, and method and apparatus for replaying 3-dimensional video content

Номер: US20220053216A1
Автор: Eric Yip, Hyunkoo YANG, Jaehyeon BAE
Принадлежит: SAMSUNG ELECTRONICS CO LTD

The present disclosure relates to a method and a device for generating and transmitting a media file containing three-dimensional (3D) video content. The present disclosure also relates to a method and a device for reconstructing and reproducing three-dimensional video content from a received media file. According to an aspect of an embodiment of the present disclosure, a method of generating a media file containing three-dimensional video content may include inserting, into a media data box in the media file, a plurality of components contained in a two-dimensional video frame in which the three-dimensional video content is compressed; inserting, into a metadata box in the media file, first tracks respectively corresponding to the components and a second track containing metadata; and inserting, into the second track, information about an entry point for each of the plurality of components.

Подробнее
Номер записи: 83
24-02-2022 дата публикации

VIDEO REPRODUCTION APPARATUS, REPRODUCTION METHOD, AND PROGRAM

Номер: US20220060672A1
Автор: ARAKI Yuichi, HASEGAWA YUICHI, Izumi Nobuaki
Принадлежит: SONY CORPORATION

There is provided a video reproduction apparatus, a reproduction method, and a program that can suppress a decline in the degree of immersion of a viewer. A video generation apparatus of the present disclosure acquires a first 3D shape video generated from a plurality of viewpoint videos obtained by capturing images of a subject from different viewpoints, and a second 3D shape video being a video different from the first 3D shape video, and switches a frame to be reproduced, from a frame of the first 3D shape video to a frame of the second 3D shape video on the basis of a state of a viewer viewing the first 3D shape video. The present disclosure may be applied, for example, to a video generation apparatus, a video processing apparatus, a video reproduction apparatus, or the like. 1. A video reproduction apparatus comprising:an acquisition unit configured to acquire a first 3D shape video generated from a plurality of viewpoint videos obtained by capturing images of a subject from different viewpoints, and a second 3D shape video being a video independent of the first 3D shape video; anda switching processing unit configured to switch a frame to be reproduced, from a frame of the first 3D shape video to a frame of the second 3D shape video on a basis of a state of a viewer viewing the first 3D shape video.2. The video reproduction apparatus according to claim 1 , whereina subject targeted by the second 3D shape video is a same subject as a subject targeted by the first 3D shape video, and the first 3D shape video and the second 3D shape video are videos representing different motions of the same subject.3. The video reproduction apparatus according to claim 1 , whereinthe switching processing unit switches a frame on a basis of a positional relationship between a viewpoint position of the viewer within a viewing space that serves as the state of the viewer, and a 3D shape of a subject in the first 3D shape video.4. The video reproduction apparatus according to claim ...

Подробнее
Номер записи: 84
06-02-2020 дата публикации

SUGGESTED VIEWPORT INDICATION FOR PANORAMIC VIDEO

Номер: US20200045286A1
Автор: Boyce Jill M.
Принадлежит: Intel Corporation

A suggested viewport indication is generated and sent for use in a panoramic video. In one example, a method includes receiving encoded video including viewport metadata, decoding the video, extracting the viewport metadata, generating a viewport of the decoded video based on the viewport metadata, and buffering the generated viewport for display. 120.-. (canceled)21. A method comprising:receiving encoded video including viewport metadata;decoding the video;extracting the viewport metadata;generating a viewport of the decoded video based on the viewport metadata; andbuffering the generated viewport for display.22. The method of claim 21 , wherein the viewport metadata includes a center of the region of interest.23. The method of claim 22 , wherein the center is indicated as a latitude and longitude of a viewport representation.24. The method of claim 21 , wherein the viewport metadata includes a field of view of the region interest based on distance from the center.25. The method of claim 24 , wherein the field of view is indicated as a horizontal angle and a vertical angle.26. The method of claim 21 , wherein the viewport metadata is encoded as a Supplemental Enhancement Information message.27. The method of claim 21 , wherein the received encoded video is a planar projection of a wide field of view.28. The method of claim 27 , wherein the planar projection is an equi-rectangular projection and the wide field of view is panoramic.29. The method of claim 21 , wherein the viewport metadata is associated with a frame of the received encoded video claim 21 , the method comprising receiving additional viewport metadata for additional frames of the encoded video.30. The method of claim 21 , further comprising determining whether a user has indicated using a user-selected viewport and if so claim 21 , then generating a viewport using the user-selected viewport instead of generating a viewport using the viewport metadata.31. The method of claim 21 , wherein the viewport ...

Подробнее
Номер записи: 85
06-02-2020 дата публикации

SIX DEGREE OF FREEDOM VIDEO TRANSCODING MECHANISM

Номер: US20200045288A1
Автор: BOYCE Jill
Принадлежит: Intel Corporation

An apparatus to facilitate a six degrees of freedom (6 DoF) conversion is disclosed. The apparatus includes a transcoder to convert 6 DoF point cloud data to video data having a second video data format, the transcoder including conversion logic to receive the point cloud data from an external source, receive position and orientation parameter data received from a client and render a component of the point cloud data into the video data based on the position and orientation parameter data and an encoder to encode the video data for transmission to the client. 1. An apparatus to facilitate a six degrees of freedom (6 DoF) conversion , comprising:a transcoder to receive 6 DoF point cloud data from a server and convert the 6 DoF point cloud data to video data having a second video data format, the transcoder including:one or more processors to receive the point cloud data from the server via a first network, receive position and orientation parameter data received from a client via a second network, render a component of the point cloud data into the video data based on the position and orientation parameter data and encoding the video data for transmission to the client.2. The apparatus of claim 1 , wherein the second video format comprises two-dimensional (2D) video.3. The apparatus of claim 2 , wherein the one or more processors render the component of the point cloud data into a 2D rectilinear view.4. The apparatus of claim 1 , wherein the encoded video data includes syntax for each coded frame to indicate the component of the point cloud data included in the coded frame.5. The apparatus of claim 3 , wherein the rendered component comprises a wider field of view than is supported by the client.6. The apparatus of claim 2 , wherein the one or more processors render the component of the point cloud data into two 2D rectilinear views for 2D to three-dimension (3D) conversion.7. The apparatus of claim 5 , wherein the one or more processors render the component of the ...

Подробнее
Номер записи: 86
06-02-2020 дата публикации

REDUCED RENDERING OF SIX-DEGREE OF FREEDOM VIDEO

Номер: US20200045292A1
Автор: BOYCE Jill
Принадлежит: Intel Corporation

Embodiments described herein provide for techniques to reduce the complexity of rendering immersive 3D video content. One embodiment provides for an apparatus comprising one or more processors to receive a data set that represents a two-dimensional encoding of planar projections of a frame of a three-dimensional video, decode the two-dimensional encoding into texture data, geometry data, and metadata, determine, based on the metadata, a visibility status and an occupancy status for a sample position in the three-dimensional video, and render video data for the sample position when the sample position is visible and occupied. 1. An apparatus comprising: receive a data set that represents a two-dimensional encoding of planar projections of a frame of a three-dimensional video;', 'decode the two-dimensional encoding into texture data, geometry data, and metadata;', 'determine, based on the metadata, a visibility status and an occupancy status for a sample position in the three-dimensional video; and', 'render video data for the sample position when the sample position is visible and occupied., 'one or more processors to2. The apparatus as in claim 1 , wherein the planar projections are planar projections of a point cloud representation of the three-dimensional video.3. The apparatus as in claim 2 , the one or more processors to render video data for the sample position without reconstruction of the point cloud representation of the three-dimensional video.4. The apparatus as in claim 1 , wherein the data set is a bitstream to be received from a remote device.5. The apparatus as in claim 1 , the one or more processors additionally to:determine the visibility status from a first unit of metadata; anddetermine the occupancy status from a second unit of metadata.6. The apparatus as in claim 5 , wherein to determine the visibility status claim 5 , the one or more processors are to:receive a position and orientation associated with a display device;determine a projection ...

Подробнее
Номер записи: 87
03-03-2022 дата публикации

Methods and apparatus for selecting and switching input video tracks using track derivations

Номер: US20220070429A1
Автор: Lulin Chen, XIN Wang
Принадлежит: Mediatek Singapore Pte Ltd

The techniques described herein relate to methods, apparatus, and computer readable media configured to accessing multimedia data that includes a plurality of media tracks that each include an associated series of samples of media data, and a derived track comprising a set of derivation operations to perform to generate a series of samples of media data for the derived track. A derivation operation of the set is performed to generate a portion of media data for the derived track, which includes: determining, based on the derivation operation, a group of media tracks from the plurality by determining each media track in the group meets a grouping criteria, selecting one media track from the group of media tracks, and adding a sample from the one media track to the derived track to generate the portion of the derived track.

Подробнее
Номер записи: 88
14-02-2019 дата публикации

Method and apparatus for processing 360-degree image

Номер: US20190052858A1
Автор: Byeong-Doo Choi, Eric Yip, Jae-Yeon Song
Принадлежит: SAMSUNG ELECTRONICS CO LTD

A communication technique for merging, with an IoT technology, a 5G communication system for supporting a data transmission rate higher than that of a 4G system is provided. The communication technique can be applied to an intelligent service (for example, smart home, smart building, smart city, smart car or connected car, health care, digital education, retail business, and security and safety-related services, and the like) on the basis of a 5G communication technology and an IoT-related technology. A method for processing a 360-degree image is provided. The method includes determining a three-dimensional (3D) model for mapping a 360-degree image; determining a partition size for the 360-degree image; determining a rotational angle for each of the x, y, and z axes of the 360-degree image; determining an interpolation method to be applied when mapping the 360-degree image to a two-dimensional (2D) image; and converting the 360-degree image into the 2D image.

Подробнее
Номер записи: 89
25-02-2021 дата публикации

SYSTEMS AND METHODS FOR SIGNALING SUB-PICTURE COMPOSITION INFORMATION FOR VIRTUAL REALITY APPLICATIONS

Номер: US20210058600A1
Автор: Deshpande Sachin G.
Принадлежит:

A method of signaling and parsing and determining information associated with an omnidirectional video is disclosed. In one embodiment, “track group identifier” indicates whether each sub-picture track corresponding to the track group identifier includes content for one of: a left view only; a right view only; or both of left view and right view. (See claims and paragraphs []-[].) In another embodiment, another identifier (SubPicCompId or SpatialSetId) identifies that an adaptation set corresponds to a sub-picture, wherein the adaptation set may corresponds to more than one sub-picture composition grouping. (See claims and paragraphs []-[].) 1. (canceled)2. (canceled)3. A method of signaling information associated with an omnidirectional video , the method comprising:signaling an identifier, wherein the identifier identifies that an adaptation set corresponds to a sub-picture, wherein all adaptation sets in a period having the same identifier value together form a sub-picture composition grouping; andsignaling a boolean type element specifying whether the adaptation set is intended to be selected alone for a presentation.4. A method of determining information associated with an omnidirectional video , the method comprising:parsing an identifier,wherein the identifier identifies that an adaptation set corresponds to a sub-picture, wherein all adaptation sets in a period having the same identifier value together form a sub-picture composition grouping; andparsing a boolean type element specifying whether the adaptation set is intended to be selected alone for a presentation.5. (canceled)6. (canceled)7. (canceled)8. The method of claim 4 , wherein the identifier has a data type of unsigned short.9. The method of claim 4 , wherein claim 4 , in a case a value of the boolean type element is true claim 4 , the adaptation set is not intended to be selected alone for a presentation.10. The method of claim 4 , wherein claim 4 , in a case a value of the boolean type element is ...

Подробнее
Номер записи: 90
25-02-2021 дата публикации

COMMUNICATION APPARATUS, GENERATED DATA SIZE CONTROL METHOD, COMMUNICATION METHOD, AND PROGRAM

Номер: US20210058601A1
Автор: TANIKAWA Masakazu
Принадлежит: Sony Interactive Entertainment Inc.

A video data transmission unit transmits data generated by a video data generation unit to an HMD. A sensing data reception unit receives data transmitted from the HMD, the data including size data indicating a size of the data successfully received by the HMD. A required time specification unit specifies time it took for a round-trip communication in half-duplex wireless communication between a relay apparatus and the HMD. A generation control unit controls a size of the data generated by the video data generation unit per unit time based on the specified time, the size indicated in the size data, and a given target time regarding the round-trip communication. 1. A communication apparatus that performs half-duplex wireless communication with a communication partner apparatus , the communication apparatus comprising:a transmission unit that transmits data generated by a data generation unit to the communication partner apparatus;a reception unit that receives data transmitted from the communication partner apparatus, the data including size data indicating a size of the data successfully received by the communication partner apparatus;a time specification unit that specifies time it took for a round-trip communication in the half-duplex wireless communication with the communication partner apparatus; anda generation control unit that controls a size of the data generated by the data generation unit per unit time based on the specified time, the size indicated in the size data, and a given target time regarding the round-trip communication.2. The communication apparatus according to claim 1 , whereinthe time specification unit specifies the time it took for the round-trip communication corresponding to time from the start of the transmission of the data to the communication partner apparatus in a first period to the end of the reception of the data transmitted by the communication partner apparatus in a second period following the first period, andthe reception unit ...

Подробнее
Номер записи: 91
23-02-2017 дата публикации

Method and electronic device for playing subtitles of a 3d video, and storage medium

Номер: US20170054964A1
Автор: Xuan Shi
Принадлежит: Le Holdings Beijing Co Ltd, Leshi Zhixin Electronic Technology Tianjin Co Ltd

The disclosure provides a method and electronic device for playing subtitles of a 3D video, and a storage medium. The method includes: obtaining subtitles in at least one timestamp of the 3D video; determining whether subtitle contents in the same timestamp among the obtained subtitles are duplicated; if so, then playing the 3D video by playing the subtitle of the 3D video as 3D subtitles; and otherwise, playing the 3D video by processing the subtitles of the 3D video into 3D subtitles, and then playing the 3D subtitles. With the technical solution according to the disclosure, a display effect of the 3D video can be improved.

Подробнее
Номер записи: 92
13-02-2020 дата публикации

METHOD AND APPARATUS FOR SIGNALING SPHERICAL REGION INFORMATION IN ISOBMFF

Номер: US20200053282A1
Автор: Chen Lulin, LAI Wang Lin, WANG Xin
Принадлежит:

A video processing method includes receiving a virtual reality (VR) content, encoding visual data obtained from the VR content to generate a part of a coded bitstream, and encapsulating the part of the coded bitstream into ISO Base Media File Format (ISOBMFF) file (s). In one exemplary implementation, the ISOBMFF file (s) may include a timed metadata track associated with a sphere visual track, where the timed metadata track is set to signal that the associated sphere visual track contains at least one spherical region contributed from at least one region visual track. In another exemplary implementation, the ISOBMFF file (s) may include a timed metadata track associated with a region visual track, where the timed metadata track is set to signal that the associated region visual track contributes to at least one spherical region carried in at least one sphere visual track. Further, an associated video processing apparatus is provided. 1. A video processing method comprising:receiving a virtual reality (VR) content;encoding visual data obtained from the VR content to generate a part of a coded bitstream; andencapsulating, by a file encapsulation circuit, the part of the coded bitstream into at least one ISO Base Media File Format (ISOBMFF) file, wherein said at least one ISOBMFF file comprises a timed metadata track associated with a sphere visual track, and the timed metadata track is set to signal that the associated sphere visual track contains at least one spherical region contributed from at least one region visual track.2. The video processing method of claim 16 , wherein the timed metadata track is set to further signal a spherical region identifier of each of said at least one spherical region and a track identifier of each of said at least one region visual track.3. The video processing method of claim 16 , wherein the timed metadata track is set to further signal spherical coordinates and sizes of each of said at least one spherical region.4. The video ...

Подробнее
Номер записи: 93
21-02-2019 дата публикации

Capturing and displaying a video in an immersive reality environment

Номер: US20190058863A1
Автор: Nishant SAMEER, Praneet Khare, Sachin Kanodia
Принадлежит: Rizort Inc

A method of capturing and displaying a video in an immersive reality environment is disclosed. Each scene in the video file is constructed by joining an action segment and a static segment, wherein each of the action segment and the static segment in the scene are captured separately using a video production system. The video production system further conjoins each of the scenes together to construct the video file. A viewer may view each of the scenes in the video file on a playback device. The playback device may adaptively reconstruct each of the scenes in the video file based on the viewer's action. More specifically, the playback device adjusts the playback duration of each of the scenes based on the viewer's head movements. Further, the playback device also repositions the subsequent scenes based on a direction of gaze of the viewer.

Подробнее
Номер записи: 94
21-02-2019 дата публикации

3D Camera Calibration for Adjustable Camera Settings

Номер: US20190058870A1
Автор: Fernandes Sheldon, jin han, Rowell Adam
Принадлежит:

Described are calibration and rectification systems and methods for 3D cameras. The calibration methods described herein derive calibration parameters in real time for multiple camera settings. Calibration parameters are used to rectify stereo images as part of a process for creating 3D images, videos, and VR or AR experiences. Additionally multi-camera systems for implementing the calibration and rectification methods are disclosed. 3D camera calibration methods involving a limited number of calibration points reduce the cost and complexity of conventional calibration methods while also allowing for higher performing 3D cameras having many possible configurations of camera settings. 1. A method of interpolating camera calibration parameters comprising:providing a calibration file having a plurality of calibration points, each calibration point associated with unique camera setting values and mapped to unique calibration metadata, the calibration metadata arranged as a matrix of calibration parameters;detecting real time camera settings at a real time camera position and locating, within the calibration file, calibration points having camera setting values most proximate to the real time camera settings;storing calibration metadata for the calibration points having camera settings most proximate to the real time camera settings in memory as proximate calibration metadata and extracting, from proximate calibration metadata, intrinsic calibration parameters and extrinsic calibration parameters; andapplying an interpolation process to the intrinsic calibration parameters and extrinsic calibration parameters to calculate real time intrinsic calibration parameters and real time extrinsic calibration parameters.2. The method of claim 1 , wherein the interpolation process is a one dimensional interpolation process comprising:applying an interpolation function to the intrinsic calibration parameters to generate the real time intrinsic calibration parameters for a first ...

Подробнее
Номер записи: 95
10-03-2022 дата публикации

IMAGE PROCESSING APPARATUS THAT PERFORMS PROCESSING CONCERNING DISPLAY OF STEREOSCOPIC IMAGE, IMAGE PROCESSING METHOD, AND STORAGE MEDIUM

Номер: US20220078394A1
Автор: Atobe Hiroshi, Ito Hiroki, Mikawa Takuma, Shirai Kunihiro, UEHARA Takumi, Yoshida Takehiro
Принадлежит:

An image processing apparatus that performs processing concerning the display of a stereoscopic image so as to improve the convenience of a user in viewing a stereoscopic image. A head mount display displays a stereoscopic image using image data including a plurality of images having different viewpoints. The image data is processed based on metadata attached to the image data. In a case where information indicating that the image data is associated with a file format which cannot cause the head mount display to perform display is included in the metadata, the image data is converted into a file format which can cause the head mount display to perform display. 1. An image processing apparatus , comprising:at least one processor; anda memory coupled to the at least one processor, the memory having instructions that, when executed by the processor, perform the operations as:a display control unit configured to cause a display unit to display a stereoscopic image, using image data including a plurality of images having different viewpoints; andan image processing unit configured to process the image data based on metadata attached to the image data,wherein in a case where information indicating that the image data is associated with a file format which cannot cause the display unit to perform display is included in the metadata, the image processing unit performs processing for converting the image data into a file format which can cause the display unit to perform display.2. The image processing apparatus according to claim 1 , wherein in a case where the image data has been converted to a file format which can cause the display unit to perform display claim 1 , the image processing unit changes the metadata into information associated with the file format after conversion.3. The image processing apparatus according to claim 1 , wherein the at least one processor is configured to further perform the operations as:a control unit configured to upgrade, in a case where ...

Подробнее
Номер записи: 96
10-03-2022 дата публикации

IMMERSIVE MEDIA CONTENT PRESENTATION AND INTERACTIVE 360° VIDEO COMMUNICATION

Номер: US20220078396A1
Автор: GÜL Serhan, HELLGE Cornelius, SANCHEZ DE LA FUENTE Yago, SCHIERL Thomas, SKUPIN Robert, WIEGAND Thomas
Принадлежит:

An apparatus for presenting immersive media content is described. The apparatus obtains from a sender video data representing immersive content for a certain viewing direction and/or for a certain viewpoint, and displays the video data representing the immersive content for the certain viewing direction and/or for the certain viewpoint. 1. An apparatus for a 360° video communication with a sender , wherein{'claim-text': ['acquire from the sender video data dependent on a certain viewing direction of a 360° video, and', 'display the video data representing the certain viewing direction of the 360° video,'], '#text': 'the apparatus is to'}wherein the video data comprises a margin area around the viewport.2. The apparatus of claim 1 , wherein claim 1 , to acquire the video data from the sender claim 1 , the apparatus is tosignal to the sender the certain viewing direction of the 360° video, andreceive from the sender the video data for the certain viewing direction of the 360° video.3. The apparatus of claim 1 , wherein the apparatus comprisesa display device, e.g., a HMD, to display to a user the video data for the certain viewing direction of the 360° video,a sensor to detect the viewing direction of the user, anda processor to signal the detected viewing direction to the sender and to process the received video data for display on the display device.4. The apparatus of claim 1 , wherein the apparatus is to request from the sender for the certain viewing direction of the 360° video (i) first video data rendered by the sender and representing a 2D viewport version of the certain viewing direction of the 360° video or (ii) second video data not rendered by the sender and representing at least a part of the 360° video to be transmitted by the sender using a certain projection.5. The apparatus of claim 4 , wherein claim 4 , during the session of the 360° video communication claim 4 , the apparatus is to request from the sender the first video data or the second video ...

Подробнее
Номер записи: 97
22-05-2014 дата публикации

Image processing apparatus and image processing method

Номер: US20140139650A1
Автор: Nobuyuki Ikeda, Takashi Kumagai, Tamotsu Hasegawa
Принадлежит: Toshiba Corp

According to one embodiment, an image processing apparatus including a background image generator which generates a background image, a receiver which receives additional information, a depth memory which stores in advance a depth for each of types of the additional information, a depth decide module which determines a type of the additional information received by the receiver, and reads a depth which is associated with the determined type from the depth memory, a three-dimensional image generator which generates an object image based on the additional information, and generates a three-dimensional image based on the object image and the depth which is read by the depth decide module, an image composite module which generates a video signal by displaying the background image and displaying the three-dimensional image in front of the displayed background image, and an output module which outputs the video signal generated by the image composite module.

Подробнее
Номер записи: 98
02-03-2017 дата публикации

Method and device for transforming 2d image into 3d

Номер: US20170061247A1
Автор: Kwang Hoon Sohn, Sun Ok Kim
Принадлежит: Industry Academic Cooperation Foundation of Yonsei University

A method and device for transforming 2D images into 3D are disclosed. The disclosed device includes a dictionary storage unit configured to store a word-depth gradient dictionary; a color patch obtainer unit configured to obtain color patches from an input image; a matching word search unit configured to transform each of the color patches obtained by the color patch obtainer unit into a SIFT descriptor form and search for words closest to the SIFT descriptors of the obtained color patches from among the words of the word-depth gradient dictionary; a matching depth gradient obtainer unit configured to obtain depth gradient information of the words matching the obtained color patches from the word-depth gradient dictionary; and a depth map generation unit configured to compute a depth from the obtained matching depth gradient for each of the obtained color patches and generate a depth map.

Подробнее
Номер записи: 99
03-03-2016 дата публикации

Subtitling for stereoscopic images

Номер: US20160065929A1
Автор: Jesus Barcons-Palau, Joan Llach, Louai Marwan AL-KHANJI
Принадлежит: Thomson Licensing SAS

A method, apparatus and system of the present invention enable the location of subtitles for a stereoscopic image and a selection of the disparity of stereo subtitles to ensure proper display of the subtitles within frames of the stereoscopic content. In one embodiment, the functionality of the concepts of the present invention is based on a player capable of displaying stereo content by reading two streams (one for the left view, one for the right view) and mixing the streams in real time using a mode supported on a 3D display (i.e. line interleaved, checkerboard pattern) based on received file information and inserting the subtitle in the frames by rendering the values in the received file information.

Подробнее
Номер записи: 100