СПОСОБ И УСТРОЙСТВО ДЛЯ АДАПТИВНОГО К МАКРОБЛОКУ МЕЖСЛОЙНОГО ПРЕДСКАЗАНИЯ ВНУТРЕННЕЙ ТЕКСТУРЫ

... 1. Устройство, содержащее кодировщик (100) для избирательного использования пространственного внутреннего предсказания для кодирования, на адаптивной к макроблоку основе разностного сигнала слоя оптимизации, сформированного между макроблоком слоя оптимизации и соответствующим макроблоком подвергнутого повышающей дискретизации базового слоя. ! 2. Устройство по п.1, в котором пространственное внутреннее предсказание, используемое для кодирования разностного сигнала слоя оптимизации, совместимо с технологиями пространственного внутреннего предсказания по стандарту H.264 Международного союза электросвязи, сектора телекоммуникаций (ITU-T). ! 3. Устройство по п.1, в котором упомянутый кодировщик (100) добавляет поле синтаксической структуры в заголовок макроблока, чтобы указывать, какой режим предсказания используется для разностного сигнала слоя оптимизации. ! 4. Устройство по п.1, в котором кодировщик (100) модифицирует синтаксическую структуру по стандарту H.264 Международного союза электросвязи ...

VIDEO KOMPRESSION FÜR MEHRFACHSENDEVERTEILUNGEN UNTER VERWENDUNG VON RÄUMLICHER SKALIERBARKEIT UND GLEICHWELLENFUNKKODIERUNG

Synchronisation mehrerer Videoobjektebenen

Wireless Transmission Using First and Second Radiation Beam Patterns

A video stream is wirelessly transmitted robustly and uses minimum energy. A base stream and at least one enhancement stream is obtained representing the video stream, the enhancement stream(s) including additional information that, when combined with the base stream, enhances the video stream rendering. First and second radiation beam patterns of an antenna are determined such that radiated signals resulting from the first radiation beam pattern (e.g. omni-directional or wide beam pattern) have greater or equal spatial robustness than radiated signals resulting from the second radiation beam pattern (e.g. narrow beam pattern). The base and enhancement streams are transmitted through the antenna using, respectively, the first and the second radiation beam patterns. Feedback from the receiving device may indicate that transmission quality is above or below a threshold. Such an indication may control transmission path direction. The base stream may be obtained by sub-sampling the video stream ...

Method and apparatus for video encoding

Improved recognition of a pre-defined region on a transmitted image

A method to display an image comprising the steps of: partitioning an image into a series of row, column partitions; locating at least one focus point on the image; displaying a first partition in the region defined by at least one focus point; and displaying successive partitions in a substantially spiral pattern around the first partition. In accordance with another embodiment of the present invention, a method to create an image for subsequent display comprising the steps of; partitioning an image into a series of row, column partitions; locating at least one focus point on the image; and reordering the partitions so that a first partition in the region defined by at least one focus point is displayed first and partitions that form a spiral pattern around the first partition are displayed subsequently therefrom. Compression algorithms and profile compression may be applied to the reordered partitions. In accordance with another embodiment of the present invention, an information processing ...

Cross-layer video quality manager

Encoding and decoding methods and devices that select pixel transform coefficients based on image frame and block merits

A method for encoding a video sequence, comprising at least one frame having plural blocks of pixels, comprises: determining a frame merit (e.g. determined based on a fixed relationship between luminance frame and colour frame distortions) and a distortion at the frame level such that a video merit (e.g. using peak-signal-to-noise ratio), computed based on the distortion and frame merit, corresponds to a target video merit; determining, for each block of the plurality, a block merit for the concerned block based on the frame merit; transforming, pixel values for the block into a set of coefficients each having a coefficient type; selecting coefficient types based, for each coefficient, on an initial coefficient type encoding merit and on the block merit for the concerned block (e.g., if the coefficient type merit is greater than the block merit); quantizing the selected coefficients into quantized symbols; and encoding the quantized symbols. A broadly equivalent decoding method is also ...

VIDEO DECODING PROCEDURE AND APPROPRIATE DECODER

VIDEO CODING WITH HYBRID TEMPORELLER AND SNR OF RELATIONSHIPS OF FINEGRANULAR SCALE-BARNESS

METHOD OF REPRESENTING A SEQUENCE OF PICTURES USING 3D MODELS, AND CORRESPONDING DEVICES AND SIGNAL

L'invention concerne un procédé de représentation d'une séquence d'images regroupées en ensembles d'au moins deux images successives, appelés GOPs, un modèle tridimensionnel maillé texturé étant associé à chacun desdits GOPs. Selon l'invention, le modèle tridimensionnel associé au GOP de niveau n est représenté à l'aide d'un maillage irrégulier tenant compte d'au moins un sommet d'au moins le maillage irrégulier représentant le modèle tridimensionnel associé au GOP de niveau n-1, ledit sommet étant appelé sommet commun.

WATER RING SCANNING APPARATUS AND METHOD, AND APPARATUS AND METHOD FOR ENCODING/DECODING VIDEO SEQUENCES USING THE SAME

A water ring scanning apparatus and method, and an apparatus and method for encoding/decoding video sequences using the same are disclosed. A water ring scanning apparatus includes: a preferential scan unit for scanning information on a water ring origin point (water-ring (0)) in an image frame, which is a most significant bit of the image frame to be preferentially scanned; a scan location decision unit for deciding a location of i th generated water ring (waterring(i)), which is a rectangular-shape ring surrounding the water ring origin point; and a scan unit for scanning information on the location of the i th generated water ring.

Encoding method and device for cartoonizing natural video, corresponding video signal comprising cartoonized natural video and decoding method and device therefore

The invention is related to an encoding method and device which allows for providing cartoonized video. The invention is further related to corresponding decoding methods and devices. The invention is also related to corresponding video signals. An encoding method, which allows for providing a cartoonization of the source video and for recombining the source video from the cartoonization of the source video and a residual video, comprises the following steps: Cartoonizing the source video, encoding a first video, reconstructing the first video, determining a first residual video between a second video and the reconstructed first video, encoding the first residual video and combining the encoded first video and the encoded first residual video wherein one of the first video and the second video is the source video and the other is the cartoonized source video.

Water ring scanning appts. and method, and appts. and method for encoding/decoding wideo sequences using same

Picture encoding and/or decoding apparatus and method

PROCESSES AND DEVICES OF CODING AND DECODING Of a SEQUENCE Of IMAGES REPRESENTEE USING TUBES OF MOVEMENT, PRODUCTS COMPUTER PROGRAM AND CORRESPONDING SIGNAL.

L'invention concerne un procédé de décodage d'un signal représentatif d'une séquence d'images. Selon l'invention, un tel procédé comprend les étapes suivantes : - extraction dudit signal de tubes de mouvement, chacun desdits tubes étant défini par au moins les informations suivantes : - un bloc de pixels de référence comprenant des informations de texture de référence ; - des instants de début de tube et de fin de tube ; - des informations de transition ; - traitement desdites informations de transition ; - combinaison des informations associées aux blocs courants d'au moins deux desdits tubes se chevauchant dans une zone de chevauchement de ladite image courante.

Video image sequence compressing method for e.g. video coder, involves estimating movement vector between portion of image to be compressed and portion of reference image reconstructed at selected quality level, and coding image portion

Le procédé de compression d'images comporte, pour au moins une partie d'une image à compresser : - une étape d'obtention d'au moins une valeur de paramètre représentative du fonctionnement d'au moins un dispositif de décompression d'image compressée ; - une étape de sélection d'un niveau de qualité en fonction d'au moins une dite valeur de paramètre ; - une étape d'estimation d'au moins un vecteur de mouvement entre une partie de l'image à compresser et une partie d'une image de référence reconstruite au niveau de qualité sélectionné et - une étape de codage d'au moins ladite partie d'image à compresser en mettant en oeuvre chaque vecteur de mouvement estimé. Dans des modes de réalisation, au cours de l'étape d'obtention, un paramètre pour est représentatif d'un débit utilisé et, au cours de l'étape de sélection, on détermine, parmi une pluralité de plages de valeurs du débit, celle dans laquelle se trouve la majorité, au moins relative, des valeurs du débit utilisées et on sélectionne ...

Method and apparatus for a encoding/decoding video signal

Image encoder, image encoding method, image decoder, image decoding method, and distribution media

A TESSELLATOR WHOSE TESSELLATION TIME GROWS LINEARLY WITH THE AMOUNT OF TESSELLATION

SYSTEM AND METHOD FOR ENCODING AND DECODING ENHANCEMENT LAYER DATA USING DESCRIPTIVE MODEL PARAMETERS

There is provided an image encoding system (300, 400) including an encoder (300) for receiving input image data and generating corresponding encoded image output data. The encoder includes image processing features (310, 320, 330, 360) for processing said input image data to generate for each input image therein a plurality of corresponding image layers including at least one basic layer BLOP and at least one enhancement layer ELOP. Moreover, the encoder (300) further includes encoding features (350) for receiving said image layers and generating therefrom the encoded image output data. The encoding features further comprising block selecting features (340) for selecting one or more sub-regions of said at least one enhancement layer and modelling said one or more sub-regions for representation thereof in the image output data by way of descriptive model parameters. © KIPO & WIPO 2007 ...

A TESSELLATOR WHOSE TESSELLATION TIME GROWS LINEARLY WITH THE AMOUNT OF TESSELLATION

método e dispositivo para decodificar dados de vídeo de múltiplas camadas mediante determinação do núcleo de processamento do decodificador com base em partição contendo uma ou mais camadas

VIDEO ENCODING DECODING METHOD AND DEVICE AND VIDEO CODEC

A video encoding decoding method and device and a video codec are provided. The video encoding method includes: the first view picture is basic layer encoded as a reference view picture, the predication information is extracted in combination with the second view picture and the second view picture is re-created; the residual value is calculated based on the re-created view picture and original second view picture; when the residual value is larger than a threshold, both residual value and predication information are enhanced layer encoded simultaneously, otherwise, only the predication information is enhanced layer encoded; the encoded information is obtained by multiplexing the enhanced layer encoding with the basic layer encoding of the first video picture. The video decoding method includes: after de-multiplex, the basic layer encoded information and the enhanced layer encoded information are decoded respectively to obtain the first view picture, prediction information and residual ...

HIGH QUALITY WIDE-RANGE MULTI-LAYER COMPRESSION CODING SYSTEM

Systems, methods, and computer programs for high quality wide-range multi-layer image compression coding, including consistent ubiquitous use of floating point values in essentially all computations; an adjustable floating-point deadband; use of an optimal band-split filter; use of entire SNR layers at lower resolution levels; targeting of specific SNR layers to specific quality improvements; concentration of coding bits in regions of interest in targeted band-split and SNR layers; use of statically-assigned targets for high-pass and/or for SNR layers; improved SNR by using a lower quantization value for regions of an image showing a higher compression coding error; application of non-linear functions of color when computing difference values when creating an SNR layer; use of finer overall quantization at lower resolution levels with regional quantization scaling; removal of source image noise before motion-compensated compression or film steadying; use of one or more full-range low bands ...

VIDEOCODING METHOD AND CORRESPONDING ENCODER

The MPEG-4 video standard includes a predictive coding scheme. When a scene-cut occurs in the sequence processed by said coding scheme, the first video object plane (VOP) which follows it is coded as an I-VOP, instead of predicting it from the previous VOP, completely different. In case of temporal scalability, when the scene-cut occurs between two VOPs of the enhancement layer, specific rules for selecting the temporal reference(s) during the prediction operations in said enhancement layer are defined.

METHOD AND DEVICE FOR ENCODING IMAGE

An image is first divided into image objects. The dividing is done by using segmentation surfaces when the image is not compressed, while a demultiplexer is used for the dividing when it is compressed. Shape features are extracted from respective divided objects in terms of time elapsed. The extracted shape features are combined and time resolutions are time-wise determined for respective objects. Then, time resolutions are used for encoding or trans-coding various image objects as compressed output images.

DIGITAL IMAGE CODING METHOD AND DIGITAL IMAGE CODER, AND DIGITAL IMAGE DECODING METHOD AND DIGITAL IMAGE DECODER, AND DATA STORAGE MEDIUM

A digital image coder which has a coder (1100b) for differentially coding a low-resolution texture signal (Std) and a coder (1100a) for differentially coding a high-resolution texture signal (Sth), performs the supplementary processing to replace the non-significant sample value of the low-resolution texture signal reproduced by the above coder (1100b) with the pseudo sample value obtained from its significant sample value by means of the supplementer (138) in the above coder (1100b) when differentially coding the high-resolution texture signal (Sth), using its prediction signal, and produces the prediction signal for the above high-resolution texture signal (Sth), based on the reproduced low-resolution texture signal to which the above supplementary processing is applied, as shown in the Figure. In such constitution of image coder, since the prediction signal of the high-resolution texture signal (Sth) is produced based on the reproduced low-resolution texture signal to which supplementary ...

Video-signal layered coding and decoding methods, apparatuses, and programs with spatial-resolution enhancement

An input video signal is encoded at a plurality of coding layers exhibiting different spatial resolutions. The input video signal is spatially scaled down to a resolution-lowered video signal that exhibits a resolution lower than the video signal. The resolution-lowered video signal is encoded by using a quantization parameter, with a decoding procedure, thus obtaining first coded data and a decoded signal. The decoded signal is spatially scaled up through a high-resolution procedure for controlling high-frequency components estimation depending on the quantization parameter, thus obtaining a high-resolution scaled-up video signal. The input video signal is encoded through inter-spatial resolution prediction using the high-resolution scaled-up video signal as a predictive signal, thus obtaining second coded data that exhibits a resolution higher than the resolution-lowered video signal.

Generalized scalability for video coder based on video objects

A video coding system that codes video objects as scalable video object layers. Data of each video object may be segregated into one or more layers. A base layer contains sufficient information to decode a basic representation of the video object. Enhancement layers contain supplementary data regarding the video object that, if decoded, enhance the basic representation obtained from the base layer. The present invention thus provides a coding scheme suitable for use with decoders of varying processing power. A simple decoder may decode only the base layer of video objects to obtain the basic representation. However, more powerful decoders may decode the base layer data of video objects and additional enhancement layer data to obtain improved decoded output. The coding scheme supports enhancement of both the spatial resolution and the temporal resolution of video objects.

Partial frame utilization in video codecs

Embodiments of the present invention provide techniques for efficiently coding/decoding video data during circumstances where a decoder only requires or utilizes a portion of coded frames. A coder may exchange signaling with a decoder to identify unused areas of frames and prediction modes for the unused areas. An input frame may be parsed into a used area and an unused area based on the exchanged signaling. If motion vectors of the input frame are not limited to the used areas of the reference frames, the unused area of the input frame may be coded using low complexity. If the motion vectors of the input frame are limited to the used areas of the reference frames, the pixel blocks in the unused area of the input frame may not be coded, or the unused area of the input frame may be filled with gray, white, or black pixel blocks.

COMPRESSION OF DIGITAL IMAGES OF SCANNED DOCUMENTS

A first aspect of the invention relates to a method for creating a binary mask image from an a inputted digital image of a scanned document, comprising the steps of creating a binarized image by binarizing the inputted digital image, detecting first text regions representing light text on a dark background, and inverting the first text regions, such that the inverted first text regions are interpretable in the same way as dark text on a light background. A second aspect of the invention relates to a method for comparing in a binary image a first pixel blob with a second pixel blob to determine whether they represent matching symbols, comprising the steps of detecting a line in one blob not present in the other and/or determining if one of the blobs represents an italicized symbol where the other does not.

IMAGE PROCESSING APPARATUS, IMAGE PROCESSING METHOD AND COMPUTER READABLE MEDIUM

An image processing apparatus includes a characteristic region detecting section that detects a plurality of characteristic regions in an image, a condition storing section that stores thereon assignment conditions differing in accordance with characters of characteristic regions, so that different compression strengths are assigned in accordance with the characters of the characteristic regions, a compressing section that respectively compresses a plurality of characteristic region images which are images of the plurality of characteristic regions, and a compression control section that controls compression strengths at which the compressing section respectively compresses the plurality of characteristic region images in accordance with characters of the plurality of characteristic regions, with reference to the conditions stored on the condition storing section. Also provided is an image processing apparatus that includes an encoding manner storing section that stores encoding manners in association with quantities of characteristics of objects, a characteristic region detecting section that detects a plurality of characteristic regions from an image, and a compressing section that compresses the images of the plurality of characteristic regions by encoding manners stored in the encoding manner storing section in association with the quantities of characteristics of objects included in the plurality of characteristic regions respectively.

METHOD, DEVICE AND SYSTEM FOR PRODUCING A MERGED DIGITAL VIDEO SEQUENCE

A video processing device for producing a frame of a merged digital video sequence. A memory storing a first and a second digital video sequence depicting the same scene. The first digital video sequence has a higher pixel density than the second digital video sequence. A scaler generating an up-scaled version having the same pixel density as the first video sequence. A decoder decoding a frame of the first digital video sequence and a skip block identifying a position for a skip block and a non-skip block in the frame of the first digital video sequence. A block extractor extracting a block of pixels from the frame of the second digital video sequence based on the skip block and a block of pixels from the frame of the first digital video sequence based on the non-skip block. A merging unit merging both extracted blocks to produce the merged video sequence.

Video coding and video decoding apparatus

A video encoding apparatus is provided with a resolution converting section, an encoding section, and a transmitting section. The resolution converting section enlarges or reduces a binary picture which represents the shape of an object. The encoding section encodes a binary picture reduced by the resolution converting section. The reduction ratio used by the resolution converting section is encoded, and the transmitting section transmits this encoded reduction ratio along with encoded data on the binary picture. The amount of encoded data produced from the encoding section is controlled by changing the enlargement/reduction ratio used by the resolution converting section.

SYSTEM AND METHOD FOR PROVIDING ERROR RESILIENCE, RANDOM ACCESS AND RATE CONTROL IN SCALABLE VIDEO COMMUNICATIONS

Systems and methods for error resilient transmission, rate control, and random access in video communication systems that use scalable video coding are provided. Error resilience is obtained by using information from low resolution layers to conceal or compensate loss of high resolution layer information. The same mechanism is used for rate control by selectively eliminating high resolution layer information from transmitted signals, which elimination can be compensated at the receiver using information from low resolution layers. Further, random access or switching between low and high resolutions is also achieved by using information from low resolution layers to compensate for high resolution spatial layer packets that may have not been received prior to the switching time.

Method for neighboring block data management for advanced video decoder

An embodiment improves the operation of a H.264 and Joint Scalable Video Codec (e.g., JSVC/H.264 Amendment 3) video decoder by managing neighboring block data during the decoding process. An embodiment pre-computes neighboring block tables to efficiently locate the neighboring block data required to decode a current macroblock. In particular, the pre-computed most probable joint neighboring block tables disclosed herein handle both macroblock adaptive frame field (MBAFF) coding and non-MBAFF coding. An embodiment is further capable of managing variable block sizes. Other embodiments are described and claimed.

INFORMATION RECORDING MEDIUM, DATA SORTING DEVICE, AND DATA REPRODUCTION DEVICE

Method for display time stamping and synchronization of multiple video object planes

КОДИРОВАНИЕ И ДЕКОДИРОВАНИЕ ИЗОБРАЖЕНИЙ

FIELD: image coding and decoding facilities. SUBSTANCE: method and device for scaling video images whose position and/or size vary with time are meant to convert these images by their appropriate coding. Position of upperlayer image and that of lower-layer image in absolute coordinate system are defined so that respective pixels in enlarged image and in upper-level image could be placed in same positions in absolute coordinate system. EFFECT: reduced amount of data in image transmission over communication channels. 4 cl, 52 dwg оОосгезс пы сэ РОССИЙСКОЕ АГЕНТСТВО ПО ПАТЕНТАМ И ТОВАРНЫМ ЗНАКАМ (19) ВИ "” 2 189 120 ^^ С2 ОМК” Н 04 М 7/26 12) ОПИСАНИЕ ИЗОБРЕТЕНИЯ К ПАТЕНТУ РОССИЙСКОЙ ФЕДЕРАЦИИ (21), (22) Заявка: 98111206/09, 09.09.1997 (24) Дата начала действия патента: 09.09.1997 (30) Приоритет: 09.09.1996 /Р 8/260312 20.09.1996 УР 8/271512 (43) Дата публикации заявки: 20.04.2000 (46) Дата публикации: 10.09.2002 (56) Ссылки: ЕР 0588411 А, 23.03.1994. КУ 94034781 АЛ, 20.07.1996. ЕР 0643535 А, 15.03.1995. ЕР 0650298 А, 26.04.1995. ЕР 0719049 А, 26.06.1996. ЕР 0711018 А, 08.05.1996. РЕ 4138517 А, 27.05.1993. 4$ 5384849 А, 24.06.1995. Ц$ 5392036 А, 21.02.1995. (85) Дата перевода заявки РСТ на национальную фазу: 09.06.1998 (86) Заявка РСТ: УР 97/03178 (09.09.1997) (87) Публикация РСТ: \М/О 98/10593 (12.03.1998) (98) Адрес для переписки: 103735, Москва, ул.Ильинка, 5/2, ООО "Союзпатент", пат.пов. Л.И.Ятровой (71) Заявитель: . СОНИ КОРПОРЕИШН (Р) (72) Изобретатель: СУЗУКИ Терухико (/Р), ЯГАСАКИ Иоити (.Р) (73) Патентообладатель: СОНИ КОРПОРЕЙШН (.Р) (74) Патентный поверенный: Ятрова Лариса Ивановна (54) КОДИРОВАНИЕ И ДЕКОДИРОВАНИЕ ИЗОБРАЖЕНИЙ (57) Изобретение относится к средствам кодирования и декодирования изображений. Техническим результатом является сокращение объема данных при передаче изображений по каналам связи. Способ и устройство получения масштабируемости видеообъекта, чье положение и/или размер изменяются во времени, преобразуются путем их соответствующего ...

Methode und Vorrichtung zur Bildübertragung

Verfahren zum Anzeigezeitstempeln und zur Synchronisation mehrerer Videoobjektebenen

Verfahren und Anordnung zur Codierung bzw. Decodierung einer Zahlenfolge

The invention relates to a method for coding a series of numbers consisting of figures, whereby each number is represented by digits from a group of digits comprising a non-significant digit and at least one significant digit. Each number has sequential information 1 assigned to it. A series of numbers is split into m series of digits. The k-th digit in the i-th series of digits corresponds to the i-th digit of the k-th number. The first of the series of digits is coded in such a way that each identified significant digit has a position determined for it by using sequential information 1 of the corresponding number. Each subsequent series of digits is coded in such a way that the digits of all registered positions are registered and the position is determinedfor each significant number in an unregistered position, using information 1 of the corresponding number. The determined position and the significant digits are registered.

Recording apparatus,method and program

Improved recognition of pre-defined region on a transmitted image

Communication of a data stream over a wireless communication system

Scalable video transmissions

PROCEDURE AND DEVICE FOR THE PICTURE CODING AND - DECODING AS WELL AS DISTRIBUTION MEDIA IN ADDITION

FGS DECODING UNDER CONTROL IN OF A DEKODER CALCULATED IMAGE QUALITY PARAMETER

VIDEO COMPRESSION FOR MULTICAST ENVIRONMENTS USING SPATIAL SCALABILITY AND SIMULCAST CODING

An optimal system for determining whether simulcast coding (400) or spatial scalability coding (100) should be used to encode video for clients with a specific communication link. Operating points (A', B', C') for both simulcast coding and spatial scalability are also determined. Adaptive switching (3130, 3140) is provided, with the operating points and decision boundaries being used to guide the switching to optimize the quality of the higher-resolution data based on a bit allocation to the associated lower-resolution data. A system for determining the point (A', C') of equal quality in both layers of simulcast and spatial scalability coding is also disclosed. The proportion of bits allocated to the base layer to achieve equal quality is essentially independent of the total bit rate for both simulcast and spatial scalability.

WATER RING SCANNING APPARATUS AND METHOD, AND APPARATUS AND METHOD FOR ENCODING/DECODING VIDEO SEQUENCES USING THE SAME

A water ring scanning apparatus and method, and an apparatus and method for encoding/decoding video sequences using the same are disclosed. A water ring scanning apparatus includes: a preferential scan unit for scanning informati on on a water ring origin point (water-ring (0)) in an image frame, which is a most significant bit of the image frame to be preferentially scanned; a scan location decision unit for deciding a location of i-th generated water ring (water-ring(i)), which is a rectangular-shape ring surrounding the water rin g origin point; and a scan unit for scanning information on the location of th e i-th generated water ring.

VIDEO PROCESSING WITH SCALABILITY

TEMPORAL AND SPATIAL SCALEABLE CODING FOR VIDEO OBJECT PLANES

Temporal and spatial scaling of video images including video object planes (VOPs) (117, 118, 119, 405, 415, 420, 430, 520, 522, 524, 526, 532, 542, 705, 730, 750, 760, 780, 790, 805, 815, 820, 830, 850, 860, 880, 890) in an input digital video sequence is provided. Coding efficiency is improved by adaptively compressing scaled field mode video. Upsampled VOPs (450, 490, 522, 542, 750, 790) in the enhancement layer are reordered to provide a greater correlation with the input video sequence based on a linear criteria. The resulting residue is coded using a spatial transformation such as the DCT. A motion compensation scheme is used for coding enhancement layer VOPs (450, 460, 480, 490, 522, 524, 526, 542, 750, 760, 780, 790, 850, 860, 880, 890) by scaling motion vectors which have already been determined for the base layer VOPs (405, 415, 420, 430, 520, 532, 705, 730, 805, 815, 820, 830). A reduced search area whose center is defined by the scaled motion vectors is provided. The motion compensation ...

PICTURE CODING DEVICE, PICTURE CODING METHOD, PICTURE DECODING DEVICE, PICTURE DECODING METHOD, AND PROVIDING MEDIUM

To make an efficient random access possible, by providing, as a hierarchy of a coded bit stream, a GOV (Group of Video Object Plane) layer on which an absolute coding start time accurate to a second is arranged. The GOV layer can be inserted not only at the leading end of the coded bit stream but also at other arbitrary positions. In addition, a display time of each VOP (Video Object Plane) constituting the GOV is expressed by modulo_time_base, which expresses a relative time with reference to the absolute coding start time in seconds, and VOP_time_increment, which expresses a time elapsed from the time (synchronization point) indicated by modulo_time_base in milliseconds.

Method and apparatus for low-complexity spatial scalable decoding

PROCESS AND DEVICE OF COMPRESSION Of IMAGE, SYSTEM OF TELECOMMUNICATION COMPRISING SUCH a DEVICE AND PROGRAM IMPLEMENTING SUCH a PROCESS

Method for compression of video sequence using video source coder, involves marking one of compressed flows with identifier that is not-interpretable by coder, and interlacing and synchronizing flows to obtain single compressed flow

Procédé de compression d'une séquence vidéo (100) partiellement masquée par une séquence de masques (101) occultant au moins une zone privée d'au moins une image de ladite séquence (100), caractérisé en ce qu'il comporte au moins les étapes suivantes : i. compresser (201), à l'aide d'un codeur vidéo (200), la séquence vidéo masquée (20) afin d'obtenir un premier flux compressé (21), ii. compresser (202), à l'aide du même codeur vidéo (200), la différence (22) entre la séquence vidéo (100) originale et la séquence vidéo masquée compressée puis décompressée (21 bis) afin d'obtenir un second flux compressé (23), iii. marquer le second flux compressé (23) avec un identifiant non interprétable par ledit codeur vidéo (200), de façon à ce qu'un décodeur vidéo adapté audit codeur ne puisse pas décompresser ledit second flux (23), iv. entrelacer et synchroniser (203) les premier et second flux compressés (21,23) afin d'obtenir un unique flux compressé (105).

SYSTEM OF INTERACTIVE PROCESS FOR the TRANSMISSION ON a LOW NETWORK FLOW Of KEY IMAGES SELECTIONNEES IN a Video stream

METHODS AND APPARARTUSES FOR CONSTRUCTING A RESIDUAL DATA STREAM AND METHODS AND APPARATUSES FOR RECONSTRUCTING IMAGE BLOCKS

INFORMATION RECORDING MEDIUM, DATA SORTING DEVICE, AND DATA REPRODUCTION DEVICE

비디오 코딩 및 디코딩 장치, 방법 및 컴퓨터 프로그램

... 방법은 베이스 계층, 제 1 강화 계층 및 제 2 강화 계층을 포함하는 비트스트림을 인코딩하는 단계와, 비트스트림 내의 제 2 강화 계층을 위한 예측을 위해 사용되는 베이스 계층 및 제 1 강화 계층 모두의 표시를 인코딩하는 단계와, 비트스트림에서, 베이스 계층으로부터 제 2 강화 계층으로 적용 가능한 제 1 세트의 예측 타입 - 제 1 세트의 예측 타입은 계층들 간의 예측에 이용 가능한 모든 예측 타입들의 서브세트임 - 의 표시를 인코딩하는 단계와, 비트스트림에서, 베이스 계층 또는 제 1 강화 계층으로부터 제 2 강화 계층으로 적용 가능한 제 2 세트의 예측 타입 - 제 2 세트의 예측 타입은 계층들 간의 예측에 이용 가능한 모든 예측 타입들의 서브세트임 - 의 표시를 인코딩하는 단계를 포함한다.

System and method for video encoding and decoding

A video coding method comprises dividing a coefficient vector into two or more sub-vectors, each sub-vector having a length less than or equal to a length of the coefficient vector, indicating a size of each sub-vector and a position of each sub-vector within the coefficient vector, and forming a block corresponding to each sub-vector. COPYRIGHT KIPO & WIPO 2010 ...

METHOD AND SYSTEM FOR DETERMINING CODING PARAMETERS ON VARIABLE-RESOLUTION STREAMS

Method of determining the coding parameters of a variable-resolution video stream by a video coder, said video stream being composed of a plurality (C) of resolution layers and being compressed so as to be transmitted at a given rate or a given quality Qi through a heterogeneous network to a plurality (K) of users (Ui), said method comprising a classification step the aim of which is to associate each resolution level with a group of users (Ui) and to determine the optimal coding parameters for each resolution level as a function of the requirements of each group of users (Ui).

SYSTEMS AND METHODS FOR ENCODING AND DECODING REDUNDANT MOTION VECTORS IN COMPRESSED VIDEO BITSTREAMS

The invention is related to methods and apparatus that encode (8) and decode redundant motion vectors (818) for predictive-coded visual object planes (P-VOPs) to increase the robustness of transmitted video signals. One embodiment provides the redundant motion vectors in a user data video packet of an MPEG-4 compliant bitstream, which thereby allows the enhanced bitstream to remain compliant with MPEG-4 syntax and backwards compatible with MPEG-4 decoders. One embodiment of a decoder (1306) can advantageously reconstruct a predictive-coded video object plane (P-VOP) from a standard motion vector and the previous frame; from a redundant motion vector and a frame prior to the previous frame; or from both.

VIDEO COMMUNICATION SYSTEM USING MODEL-BASED CODING AND PRIORITIZATION TECHNIQUES

A method and communication system are disclosed that use object prioritization and layered image coding in image/video transmission. Objects within an image/video are identified and models are assigned to represent the objects. Priorities are assigned for the objects in accordance with predetermined prioritization rules, then communication channels to communicate data related to the models are assigned so that a higher priority object is assigned to a communication channel having a reliability factor higher than a lower priority object.

Video coding and video decoding apparatus

A video encoding apparatus is provided with a resolution converting section, an encoding section, and a transmitting section. The resolution converting section enlarges or reduces a binary picture which represents the shape of an object. The encoding section encodes a binary picture reduced by the resolution converting section. The reduction ratio used by the resolution converting section is encoded, and the transmitting section transmits this encoded reduction ratio along with encoded data on the binary picture. The amount of encoded data produced from the encoding section is controlled by changing the enlargement/reduction ratio used by the resolution converting section.

NON-ENTROPY ENCODED LAYER DEPENDENCY INFORMATION

Systems, methods, and devices for coding multilayer video data are disclosed that may include encoding, decoding, transmitting, or receiving a non-entropy encoded layer dependency information at a position within a video parameter set (VPS) extension prior to syntax elements of the VPS extension that are entropy encoded. The systems, methods, and devices may encode or decode the non-entropy encoded layer dependency information before an entropy encoded syntax element. The systems, methods, and devices may encode or decode video data of one or more of the layers of video data based on the non-entropy encoded layer dependency information. The layer dependency information indicates whether one of the layers is a direct reference layer for another of the layers.

Video coding method and corresponding encoder

The MPEG-4 video standard includes a predictive coding scheme. When a scene-cut occurs in the sequence processed by said coding scheme, the first video object plane (VOP) which follows it is coded as an I-VOP, instead of predicting it from the previous VOP, completely different. In case of temporal scalability, when the scene-cut occurs between two VOPs of the enhancement layer, specific rules for selecting the temporal reference(s) during the prediction operations in said enhancement layer are defined.

Image coding apparatus, image coding method, image decoding apparatus and image decoding method

A coded bit stream 30 generated on a coding side consists of a VO header 30a, a VOL header 30b, a GOV header 30c, a VOP header 30d andVOPdata30e, and the VOL header 30bmultiplexes an object intra-coded indicator signal 7' indicating whether all the VOP data 30e contained in a VOL or GOV are intra coded or not. This enables a decoding side to recognize whether all the VOP data 30e contained in the VOL or GOV in the coded bit stream 30 are intra coded or not by only analyzing the object intra-coded indicator signal 7'. This can facilitate such processings as frame skip control or random access of the VOPs.

Receiving apparatus and method with storage of the high resolution versions of video objects

In a receiver, high resolution video objects are stored and these objects are dispayed as replacements for lower resolution versions of these objects if received.

HIERARCHICAL MOTION ESTIMATION FOR VIDEO COMPRESSION AND MOTION ANALYSIS

VIDEO TRANSMITTING APPARATUS AND VIDEO RECEIVING APPARATUS

PROBLEM TO BE SOLVED: To provide a video transmitting apparatus and a video receiving apparatus capable of efficiently transmitting only the video data of a target region to decode the data without causing deterioration of an encoding efficiency, and capable of changing the target region even during reproducing the video. SOLUTION: A low-resolution basic layer acquired by reducing a high-resolution input video image is encoded in a basic layer encoder 116. On the other hand, a region map indicating a divided region at the time of encoding is calculated in a region map calculator 118. An input video image and the basic layer encoding video image are decoded, and then an expansion layer being a difference video image from the video image acquired by expanding the image to the resolution of the input video image is divided according to the region map, and after that, intra-frame encoding is performed for each divided region in an expanding layer encoder 120. At that time, an offset table indicating ...

КОДИРОВАНИЕ, ХРАНЕНИЕ И ПЕРЕДАЧА ИНФОРМАЦИИ О МАСШТАБИРУЕМОСТИ

Изобретение относится к кодеру/декодеру масштабируемого потока данных, включающего по меньшей мере два уровня масштабируемости. Техническим результатом является повышение эффективности масштабируемого потока данных и обеспечение возможности непосредственной передачи в потоке битов, в формате файла или посредством протокола передачи информации о масштабируемости для конкретного уровня масштабируемого потока битов. Предложен способ и устройство кодирования, декодирования, хранения и передачи масштабируемого потока данных, включающего уровни, имеющие различные характеристики кодирования. Способ включает создание одного или более уровней масштабируемого потока данных, при этом по меньшей мере один уровень имеет характеристику кодирования, которая включает по меньшей мере одно из следующего: информацию о масштабируемости степени детализации (FGS); информацию о масштабируемости зоны интереса (ROI); информацию о масштабируемом уровне субсэмпла; информацию о зависимостях декодирования и наборы начальных параметров, способ также включает сигнализацию об уровнях с помощью характеристик кодирования так, чтобы характеристики могли быть считаны декодером без необходимости декодирования всего уровня. 12 н. и 37 з.п. ф-лы, 5 ил., 8 табл. РОССИЙСКАЯ ФЕДЕРАЦИЯ (19) RU (11) 2 377 736 (13) C2 (51) МПК H04N 7/26 (2006.01) ФЕДЕРАЛЬНАЯ СЛУЖБА ПО ИНТЕЛЛЕКТУАЛЬНОЙ СОБСТВЕННОСТИ, ПАТЕНТАМ И ТОВАРНЫМ ЗНАКАМ (12) ОПИСАНИЕ ИЗОБРЕТЕНИЯ К ПАТЕНТУ (21), (22) Заявка: 2007141755/09, 10.04.2006 (24) Дата начала отсчета срока действия патента: 10.04.2006 (72) Автор(ы): ВАНГ Йе-Куи (FI), ХАННУКСЕЛА Миска (FI) (43) Дата публикации заявки: 20.05.2009 C 2 2 3 7 7 7 3 6 R U C 2 (56) Список документов, цитированных в отчете о поиске: US 2004006575 A1, 01.08.2004. WO 01103442 A1, 11.01.2001. WO 0245440 A1, 06.06.2002. US 2004139462 A1, 15.07.2004. US 6501797 B1, 31.12.2002. WO 03063505 A1, 31.07.2003. RU 2001123542 A, 27.06.2003. WO 2005022918 A1, 10.03.2005. WEIPING LI, Overview of Fine Granularity ...

СПОСОБ ДЕКОДИРОВАНИЯ ВИДЕОСИГНАЛА

... 1. Способ декодирования видеосигнала на основе масштабируемости с точной детализацией (МсТД), заключающийся в том, что ! получают информацию идентификации изображения, указывающую эталонное изображение текущего блока, и ! декодируют текущий блок с использованием эталонного изображения, ! при этом эталонное изображение базового уровня и соответствующее ему эталонное изображение уровня повышенного качества имеют одинаковую информацию идентификации изображения. ! 2. Способ по п.1, в котором, когда изображение, включающее в себя текущий блок, является ключевым изображением, эталонное изображение текущего блока является эталонным изображением базового уровня или соответствующим ему эталонным изображением уровня повышенного качества. ! 3. Способ по п.1, в котором дополнительно получают эталонное изображении текущего блока из списка эталонных изображений на основе информации идентификации изображения. ! 4. Способ по п.1, в котором эталонное изображение уровня повышенного качества имеет качество ...

СПОСОБ ИНДИКАЦИИ ЧИСЛА ПОДУРОВНЕЙ В МНОГОУРОВНЕВОМ ВИДЕОПОТОКЕ

Группа изобретений относится к технологиям кодирования и декодирования видео, а более конкретно - к извлечению выходного уровня в кодированном видеопотоке с несколькими уровнями. Техническим результатом является обеспечение снижения избыточности во входном видеосигнале путем сжатия. Предложен способ декодирования видео, выполняемый по меньшей мере одним процессором. Способ содержит этап, на котором осуществляют идентификацию максимального числа временных подуровней, разрешенного в кодированной видеопоследовательности, ссылающейся на набор параметров видео соответственно в поле набора параметров видео (VPS) и в поле набора параметров последовательности (SPS). Далее осуществляют декодирование кодированной видеопоследовательности на основе идентифицированного максимального числа временных подуровней, разрешенного в кодированной видеопоследовательности, ссылающейся на набор параметров видео. 3 н. и 6 з.п. ф-лы, 23 ил., 1 табл.

VORRICHTUNGEN UND VERFAHREN ZUM KODIEREN UND DEKODIEREN VON BILDERN

Methods for encoding and decoding an image, and corresponding devices

Error resiliency within the enhancement layers of scalable video transmissions

A method (800) for improving a quality of a scalable video object plane enhancement layer transmission over an error-prone network. The enhancement layer transmission includes at least one re-synchronisation marker (310) followed by a Video Packet Header (750) and header extensions (740). A reference VOPs' identifier (e.g. 'ref_select_code' (715)) may be replicated from the video object plane header (710) into a number of enhancement layer header extensions (740). An error corrupting the reference VOPs' identifier is recovered (830, 840, 850, 860) by decoding a correct reference VOP's identifier from subsequent enhancement layer header extensions. Correct reference video object planes are identified (870, 880) to be used in a reconstruction of an enhancement layer video object plane in the scalable video transmission. This improves the error performance in an enhancement layer of video transmissions over wireless channels and the Internet where the errors can be severe.

Method, apparatus and computer program product for encoding a mask of a frame and decoding an encoded mask of a frame

The invention is directed to a method 100 of encoding 120 a mask of a frame, wherein the mask comprises a plurality of pixels with at least one component, wherein the value of each component of a pixel is set to a first value if the pixel is within an area of interest or set to a second value if a pixel is outside the area of interest. The method 100 comprises: segmenting 121 the mask into a first, second and third segments; setting 123 the value of the first colour component of each pixel of an encoded mask to the value of a component of a respective pixel of the first segment; setting 124 the value of the second colour component of each pixel of the encoded mask to the value of a component of a respective pixel of the second segment; and setting 125 the value of the third colour component of each pixel of the encoded mask to the value of a component of a respective pixel of the third segment. Additional inventions defined by the claims relate to a means for extracting a mask window and ...

Encoding and decoding methods and devices that select pixel transform coefficients based on image frame and block merits

A method for encoding a video sequence, comprising at least one frame having plural blocks of pixels, comprises: determining a frame merit (e.g. determined based on a fixed relationship between luminance frame and colour frame distortions) and a distortion at the frame level such that a video merit (e.g. using peak-signal-to-noise ratio), computed based on the distortion and frame merit, corresponds to a target video merit; determining, for each block of the plurality, a block merit for the concerned block based on the frame merit; transforming, pixel values for the block into a set of coefficients each having a coefficient type; selecting coefficient types based, for each coefficient, on an initial coefficient type encoding merit and on the block merit for the concerned block (e.g., if the coefficient type merit is greater than the block merit); quantizing the selected coefficients into quantized symbols; and encoding the quantized symbols. A broadly equivalent decoding method is also ...

SYSTEM AND PROCEDURE FOR THE CODING AND DECODING OF DATA OF THE IMPROVEMENT LEVEL BY USE OF DESCRIPTIVE MODEL PARAMETERS

Method and apparatus for macroblock adaptive inter-layer intra texture prediction

There are provided scalable video encoders and decoders and corresponding methods for scalable video encoding and decoding. A scalable video encoder includes an encoder (100) for selectively using spatial intra prediction to code, on a macroblock adaptive basis, an enhancement layer residue generated between an enhancement layer macroblock and a corresponding upsampled base layer macroblock.

CODING, STORAGE AND SIGNALLING OF SCALABILITY INFORMATION

A method and device for encoding, decoding, storage and transmission of a scalable data stream to include layers having different coding properties. The method includes: producing one or more layers of the scalable data stream, wherein the coding properties include at least one of the following: Fine granularity scalability information; Region-of-interest scalability information; Sub-sample scalable layer information; Decoding dependency information; and Initial parameter sets, and signaling the layers with the characterized coding property such that they are readable by a decoder without the need to decode the entire layers. Also, a method of encoding, decoding, storage, and transmission of a scalable bit stream, wherein at least two scalability layers are present and each layer is characterized by a set of at least one property, such as Fine granularity scalability information; Region- of-interest scalability information; Sub-sample scalable layer information; Decoding dependency information ...

SUPPORT OF NON-HEVC BASE LAYER IN HEVC MULTI-LAYER EXTENSIONS

An apparatus configured to code video information includes a memory and a processor in communication with the memory. The memory is configured to store video information associated with a bitstream. The apparatus further includes a processor in communication with the memory, the processor configured to determine whether a reference layer is included in the bitstream. The processor is further configured to determine an indication of one or more parameters for a decoded picture buffer based upon whether the reference layer is included in the bitstream and to code the video information based at least in part on the determined indication of the one or more parameters for the decoded picture buffer.

SUPPORT OF NON-HEVC BASE LAYER IN HEVC MULTI-LAYER EXTENSIONS

An apparatus configured to code video information includes a memory and a processor in communication with the memory. The memory is configured to store video information associated with a bitstream. The apparatus further includes a processor in communication with the memory, the processor configured to determine whether a reference layer is included in the bitstream. The processor is further configured to determine, based upon whether the reference layer is included in the bitstream, whether or not to process an indication and to, if the reference layer is included in the bitstream, process, in a video bitstream, the indication. The processor is also configured to code the video information based at least in part on the processed indication.

SUPPORT OF NON-HEVC BASE LAYER IN HEVC MULTI-LAYER EXTENSIONS

An apparatus configured to code video information includes a memory and a processor in communication with the memory. The memory is configured to store video information associated with a bitstream. The apparatus further includes a processor in communication with the memory, the processor configured to determine whether a reference layer is included in the bitstream. The processor is further configured to determine an indication of one or more parameters for a decoded picture buffer based upon whether the reference layer is included in the bitstream and to code the video information based at least in part on the determined indication of the one or more parameters for the decoded picture buffer.

IMAGE CODING APPARATUS, IMAGE CODING METHOD, IMAGE DECODING APPARATUS AND IMAGE DECODING METHOD

A coded bit stream 30 generated on a coding side consists of a VO header 30a, a VOL header 30b, a GOV header 30c, a VOP header 30d and VOP data 30e, and the VOL header 30b multiplexes an object intra-coded indicator signal 7' indicating whether all the VOP data 30e contained in a VOL or GOV are intra coded or not. This enables a decoding side to recognize whether all the VOP data 30e contained in the VOL or GOV in the coded bit stream 30 are intra coded or not by only analyzing the object intra-coded indicator signal 7'. This can facilitate such processings as frame skip control or random access of the VOPs.

INFORMATION RECORDING MEDIUM AND DATA REPRODUCING DEVICE

An information recording medium on which an access unit containing basic data and extension data compatible with the next generation is so recorded that a decoder for decoding only the basic data can process the access unit containing the basic data and the extension data. On the information recording medium, a stream composed of a plurality of access units and containing at least either an image or sound is recorded. One access unit has a first packet containing basic data and a second packet containing extension data related to the basic data. The basic data can be decoded into a complete state without necessity of the extension data. The extension data is for improving the quality of data created from the basic data. The stream has information representing the attributes of the first and second packets. © KIPO & WIPO 2008 ...

영상의 디코딩 방법 및 이를 이용하는 장치

... 본 발명에 따른 영상의 디코딩 방법은 미래에 사용될 보류된 정보의 존재 여부를 나타내는 지시 정보를 포함하는 파라미터 세트를 수신하여, 파싱하는 단계와; 상기 지시 정보가 상기 보류된 정보가 존재하는 것을 나타내면, 상기 보류된 정보를 포함하는 슬라이드 헤더를 수신하여 파싱하는 단계와; 상기 보류된 정보에 대응하는 시멘틱스 및 값에 따라 영상을 디코딩 하는 단계를 포함할 수 있다. 이에 의해, 계층적 영상을 지원하는 비트스트림에서 추가적인 확장 정보 지시를 기술하는 방법 및 장치가 제공된다.

METHOD FOR DECODING IMAGE AND APPARATUS USING SAME

... 본 발명에 따른 영상의 디코딩 방법은 미래에 사용될 보류된 정보의 존재 여부를 나타내는 지시 정보를 포함하는 파라미터 세트를 수신하여, 파싱하는 단계와; 상기 지시 정보가 상기 보류된 정보가 존재하는 것을 나타내면, 상기 보류된 정보를 포함하는 슬라이드 헤더를 수신하여 파싱하는 단계와; 상기 보류된 정보에 대응하는 시멘틱스 및 값에 따라 영상을 디코딩 하는 단계를 포함할 수 있다. 이에 의해, 계층적 영상을 지원하는 비트스트림에서 추가적인 확장 정보 지시를 기술하는 방법 및 장치가 제공된다.

SCALABLE METHOD FOR ENCODING AND DECODING BINARY IMAGES USING MODES OF LOWER LAYER AND CURRENT LAYER, AND APPARATUS THEREFOR

PURPOSE: A scalable method for encoding and decoding binary images using modes of a lower layer and a current layer, and an apparatus therefor are provided to reduce encoding bits by allotting encoding bits with considering correlation between a lower layer and an enhancement layer. CONSTITUTION: A plurality of sub-sampling elements(1210,1211,...,121N-2,121N-1) receive images from previous sub-sampling elements(1210,1211,...,121N-2) thereof for sub-sampling the images. A plurality of scan order converting elements(1220,1221,...,122N-1,122N) receive the image of each layer for dividing the image into macro blocks. A plurality of scalable encoding elements (1230,1231,...,123N-1,123N) receive the macroblocks of each layer, image marco blocks of a lower layer, and a previous picture of each layer for encoding three modes 'all_0', 'all_255' and 'intra not coded' into one mode, encoding 'intra not coded && MVD=0' and 'inter not coded && MVD!=0' into an 'intra not coded' mode, and encoding 'inter coded && MVD=0' and 'inter coded && MVD!=0' into an 'inter coded' mode.

métodos e dispositivos para codificar e decodificar um sinal representativo de uma sequência de imagem, mídia não transitória legível por computador e sinal representativo de uma sequência de imagem

method and apparatus for adaptive prediction interlayer, intratextura coding

PREFERRED TRANSMISSION/STREAMING ORDER OF FINE-GRANULAR SCALABILITY

A method for streaming enhancement layer video frame data on a variable bandwidth network involves coding original uncoded video data with a non-scalable codec to generate I and P base layer frames; generating residual temporal B frames and SNR I and P frames from the original uncoded video data and the base layer frames; coding the temporal and SNR frames with a scalabel coded; determining an available bandwidth of the variable bandwidth network; transmitting at least portions of the scalable coded temporal frames when the available bandwidth is a first bandwidth ranging between a minimum bit-rate allocated for transmitting only base layer frames and a predetermined bit-rate which is below a maximum bit-rate of the network; and additionally transmitting remaining portions of the scalable coded temporal frames and at least portions of the scalable coded SNR frames when the available bandwidth is a second banwidth extending between the predetermined bit-rate and the maximum bit-rate of the ...

METHOD OF REPRESENTING A SEQUENCE OF PICTURES USING 3D MODELS, AND CORRESPONDING DEVICES AND SIGNAL

The invention relates to a method of representing a sequence of pictures which are grouped into sets comprising at least two successive pictures, known as groups of pictures (GOP), whereby a textured, meshed three-dimensional model is associated with each of said GOPs. According to the invention, the three-dimensional model associated with the n level GOP is represented with an irregular mesh taking account of at least one vertex of at least the irregular mesh representing the three-dimensional model that is associated with the n-1 level GOP, said vertex being known as the common vertex.

SYSTEMS AND METHODS FOR ERROR RESILIENT ENCODING

The present invention is related to error resilient video encoding. Embodiments of the present invention provide systems (Figure 1B, 100B) and methods for reducing error propagation in a video data stream, for refreshing macroblocks, for reducing frame rates in a video data stream, for generating error correction information for a media stream, for performing bit rate allocation for a video data stream, and for detecting scene changes in a video data stream.

Buffering of decoded reference pictures

A method of decoding a scalable video data stream comprising a base layer and at least one enhancement layer, the method comprising: decoding pictures of the video data stream according to a first decoding algorithm, if pictures only from the base layer are to be decoded; and decoding pictures of the video data stream according to a second decoding algorithm, if pictures from the base layer and from at least one enhancement layer are to be decoded.

Water ring scanning apparatus and method, and apparatus and method for encoding/decoding video sequences using the same

A water ring scanning apparatus and method, and an apparatus and method for encoding/decoding video sequences using the same are disclosed. A water ring scanning apparatus includes: a preferential scan unit for scanning information on a water ring origin point (water_ring(0)) in an image frame, which is a most significant bit of the image frame to be preferentially scanned; a scan location decision unit for deciding a location of i_th generated water ring (water_ring(i)), which is a rectangular-shape ring surrounding the water ring origin point; and a scan unit for scanning information on the location of the i_th generated water ring.

Methods and Systems for Block-Based Residual Upsampling

Embodiments of the present invention comprise methods and systems for block-based residual upsampling. Some embodiments of the present invention comprise methods and systems for residual upsampling for spatially scalable video coding.

Variable length coding system

Systems, methods, and processor executable code for high quality wide-range multi-layer image compression of a sequence of video images. A non-transient electronic storage media stores the processor executable code configured and is capable of causing one or more processors to compress a sequence of digitized video images. The method includes generating a hierarchy of processed images from a digitized video image, determining a plurality of regions within each processed image, each region being selected based on lossless coding efficiency; and applying a lossless variable-length coding independently to each such region.

Methods for encoding and decoding an image, and corresponding devices

A video sequence comprises at least one frame comprising a plurality of blocks of pixels. A method for encoding the video sequence includes the steps of: determining a frame merit and a distortion at the frame level such that a video merit, computed based on said distortion and said frame merit, corresponds to a target video merit; determining, for each block of said plurality of blocks, a block merit for the concerned block based on the frame merit; transforming, for each block of the plurality of blocks, pixel values for the concerned block into a set of coefficients each having a coefficient type; selecting coefficient types based, for each coefficient, on an initial encoding merit for said coefficient type and on the block merit for the concerned block; quantizing the selected coefficients into quantized symbols; and encoding the quantized symbols. Corresponding decoding methods, encoding and decoding devices are also proposed.

FORWARD ERROR CORRECTION USING SOURCE BLOCKS WITH SYMBOLS FROM AT LEAST TWO DATASTREAMS WITH SYNCHRONIZED START SYMBOL IDENTIFIERS AMONG THE DATASTREAMS

A forward error correction (FEC) data generator has an input for at least two datastreams for which FEC data shall be generated in a joint manner, each datastream having a plurality of symbols. A FEC data symbol is based on a FEC source block possibly having a subset of symbols of the at least two data streams. The FEC data generator further has a signaling information generator configured to generate signaling information for the FEC data symbol regarding which symbols within the at least two datastreams belong to the corresponding source block by determining pointers to start symbols within a first and a second datastream, respectively, of the at least two datastreams and a number of symbols within the first datastream and second datastreams, respectively, that belong to the corresponding source block. 1. A forward error correction data generator comprising:an input for at least two datastreams for which forward error correction data shall be generated in a joint manner, each datastream comprising a plurality of symbols, wherein a forward error correction data symbol is based on a forward error correction (FEC) source block;a signaling information generator configured to generate signaling information for the forward error correction data symbol regarding which symbols within the at least two datastreams belong to the corresponding FEC source block by determining a pointer to a start symbol within a first datastream of the at least two datastreams, a pointer to a start symbol within a second datastream of the at least two datastreams, a number of symbols within the first datastream that belong to the corresponding source block, and a number of symbols within the second datastream that belong to the corresponding source block;a synchronizer configured to determine a common identifier for the start symbols within the at least two datastreams;wherein the signaling information generator is configured to include the common identifier into the signaling information to ...

Method, device and system for producing a merged digital video sequence

A video processing device for producing a frame of a merged digital video sequence. A memory storing a first and a second digital video sequence depicting the same scene. The first digital video sequence has a higher pixel density than the second digital video sequence. A scaler generating an up-scaled version having the same pixel density as the first video sequence. A decoder decoding a frame of the first digital video sequence and a skip block identifying a position for a skip block and a non-skip block in the frame of the first digital video sequence. A block extractor extracting a block of pixels from the frame of the second digital video sequence based on the skip block and a block of pixels from the frame of the first digital video sequence based on the non-skip block. A merging unit merging both extracted blocks to produce the merged video sequence.

METHOD AND APPARATUS FOR DECODING MULTI-LAYER VIDEO, AND METHOD AND APPARATUS FOR ENCODING MULTI-LAYER VIDEO

A method of decoding multi-layer video includes decoding a first layer picture, storing the decoded first layer picture in a decoded picture buffer (DPB), and marking the first layer picture as a short-term reference picture; obtaining interlayer reference picture set (RPS) information regarding a second layer picture having a same first picture order count (POC) as the first layer picture; marking the first layer picture, which is marked as the short-term reference picture, as a long-term reference picture, based on the interlayer RPS information; performing interlayer prediction with respect to the second layer picture with reference to the first layer picture; decoding the second layer picture based on a result of performing the interlayer prediction; and, after the second layer picture is decoded, marking the first layer picture, which is marked as the long-term reference picture, as a short-term reference picture. 1. A method of decoding multi-layer video , the method comprising:decoding a picture of a first layer;storing the decoded picture of the first layer in a decoded picture buffer (DPB);marking the decoded picture of the first layer as a short-term reference picture;obtaining interlayer reference picture set (RPS) information regarding a picture of a second layer having a second picture order count (POC) that is the same as a first POC of the picture of the first layer;marking the picture of the first layer, which is marked as the short-term reference picture, as a long-term reference picture based on the interlayer RPS information;performing interlayer prediction with respect to the picture of the second layer with reference to the picture of the first layer;decoding the picture of the second layer based on a result of performing the interlayer prediction; andmarking the picture of the first layer, which is marked as the long-term reference picture, as a short-term reference picture.2. The method of claim 1 , wherein the interlayer RPS information ...

METHOD OF GENERATING A FRAMED VIDEO SYSTEM

A method to frame a video stream is provided. A video stream is captured, then motion of the camera, object presence in the video stream, and position of the object are detected. A framed video stream is generated using a framing in dependence on the motion of the camera and the position of the object. A system for framing a video stream is also provided, wherein the system comprises a camera and a processing unit, and the processing unit comprises at least one processor and at least on memory including computer program instructions to execute a method to frame a video stream. 1. A method of framing a video stream , the method comprising:capturing a video stream having frames using a camera, an object being present in the video stream during at least part of the frames;detecting a motion of the camera;detecting the presence of the object in the video stream;determining a position of the object within at least one frame in which the object is present; andgenerating a framed video stream using a framing in dependence on the motion of the camera and the position of the object.2. The method according to claim 1 , wherein the dependence is determined by the presence of the object such thatthe framing is in dependence on the motion of the camera when the object is not present in the video stream, andthe framing is in dependence on the position of the object when the object is present in the video stream.3. The method according to claim 2 , wherein the framing is simultaneously dependent on the motion of the camera and on the position of the object when the object is present in the video stream.4. The method according to claim 3 , wherein the framing is dependent on the motion of the camera and also dependent on the position of the object claim 3 , the relative degree of dependence on the motion of the camera and dependence on the position of the object being dependent on a relative weighting factor claim 3 , the relative weighting factor depending on a detection score ...

APPARATUS AND METHODS FOR VIDEO COMPRESSION USING MULTI-RESOLUTION SCALABLE CODING

Apparatus and methods for digital video data compression via a scalable, multi-resolution approach. In one embodiment, the video content may be encoded using a multi-resolution and/or multi-quality scalable coding approach that reduces computational and/or energy load on a client device. In one implementation, a low fidelity image is obtained based on a first full resolution image. The low fidelity image may be encoded to obtain a low fidelity bitstream. A second full resolution image may be obtained based on the low fidelity bitstream. A portion of a difference image obtained based on the second full resolution image and the first full resolution may be encoded to obtain a high fidelity bitstream. The low fidelity bitstream and the high fidelity bitstream may be provided to e.g., a receiving device. 19.-. (canceled)10. A method for providing video content , the method comprising:obtaining a first panoramic image by decoding a first bitstream using a first decoder;obtaining a view frame image by at least decoding a second bitstream using a second decoder;obtaining a second panoramic image at least in part by up-sampling the first panoramic image to the resolution of the view frame image;obtaining an output view frame image at least in part by combining the view frame image and the second panoramic image; anddisplay the obtained output view frame image via a rendering device.11. The method of claim 10 , wherein the first panoramic image comprises a low fidelity image characterized by at least a first resolution claim 10 , and the second panoramic image comprises a high fidelity image characterized by at least a second resolution that is greater than the first resolution.12. The method of claim 11 , wherein a ratio of the first resolution to the second resolution is characterized by a resolution scalability parameter.13. The method of claim 12 , wherein:the resolution scalability parameter is based at least on a display capability of a display device; andthe method ...

IDENTIFYING A PARAMETER SET FOR DECODING A MULTI-LAYER VIDEO REPRESENTATION

A method of identifying a parameter set for decoding a multi-layer video representation. The method includes identifying the parameter set based on a parameter set identifier and one or more layer identifiers indicating a layer of the video representation. Optionally, the method may further include returning the identified parameter set from a parameter set database, and activating the parameter set. Identifying parameter sets using both a parameter set identifier and one or more layer identifiers is advantageous in that the length of the parameter set identifier codeword may be shorter. This results in bitrate savings, since the number of bits which need to be transmitted is reduced. Corresponding computer program products and video decoders for decoding a multi-layer video representation are disclosed. 1. A method of identifying a valid parameter set for decoding a multi-layer video representation , the method comprising:Identifying the parameter set based on a parameter set identifier and one or more layer identifiers indicating a layer of the video representation.2. The method according to claim 1 , wherein the parameter set is valid for a range of values of the one or more layer identifiers.3. The method according to claim 2 , wherein the range of values is indicated in a Network Abstraction Layer claim 2 , NAL claim 2 , unit header of the parameter set.4. The method according to claim 1 , wherein the parameter set is a Picture Parameter Set claim 1 , PPS claim 1 , the parameter set identifier is a PPS identifier obtained from a slice header of a coded slice of the video representation claim 1 , and the one or more layer identifiers are obtained from a Network Abstraction Layer claim 1 , NAL claim 1 , unit header of the coded slice.5. The method according to claim 1 , wherein the parameter set is a Sequence Parameter Set claim 1 , SPS claim 1 , the parameter set identifier is an SPS identifier obtained from a Picture Parameter Set claim 1 , PPS claim 1 , and ...

SCALABILITY OF MULTI-DIRECTIONAL VIDEO STREAMING

Aspects of the present disclosure provide techniques for reducing latency and improving image quality of a viewport extracted from multi-directional video communications. According to such techniques, first streams of coded video data are received from a source. The first streams include coded data for each of a plurality of tiles representing a multi-directional video, where each tile corresponding to a predetermined spatial region of the multi-directional video, and at least one tile of the plurality of tiles in the first streams contains a current viewport location at a receiver. The techniques include decoding the first streams and displaying the tile containing the current viewport location. When the viewport location at the receiver changes to include a new tile of the plurality of tiles, retrieving and decoding first streams for the new tile, displaying the decoded content for the changed viewport location, and transmitting the changed viewport location to the source. 1. A video reception method , comprising:receiving, from a source, first streams of coded data for each of a plurality of tiles representing a multi-directional video including a first tile encoded at a first tier of quality and other tiles of the plurality of tiles coded as a base layer of a second tier of quality, wherein each tile corresponds to a predetermined spatial region of the multi-directional video and a current viewport location at a receiver includes at least the first tile;decoding the first tier of the first tile from the first streams;displaying the decoded first tier for the current viewport location; decoding the base layer of the second tier of the second tile from first streams,', 'transmitting an indication of the second tile to the source;, 'when the viewport location at the receiver changes to include a second tile of the other tilesreceiving, from the source and in response to the transmitting, second streams of coded video data including the second tile coded as an ...

IMAGE PROCESSING SYSTEM WITH BINARY ADAPTIVE GOLOMB CODING AND METHOD OF OPERATION THEREOF

A system and method of operation of an image processing system includes: a pre-processing module for receiving a raw image block of a source image from an imaging device; a transform module for forming a coefficient block by performing a transform operation on the raw image block, and the transform operation including a wavelet transform or a discrete cosine transform; and an encoding module wherein the encoding module is for calculating a coefficient significance vector, a partition significance vector, a run-length coded value, and a Golomb coded value for a portion of a significant partition, and forming an encoded block in an image bitstream having the run-length coded value and the Golomb coded value, and the encoded block. 1. A method of operation of an image processing system comprising:receiving a raw image block of a source image from an imaging device;forming a coefficient block by performing a transform operation on the raw image block, the transform operation including a wavelet transform or a discrete cosine transform;calculating a coefficient significance vector for a current bitplane of the coefficient block, the coefficient significance vector having a significant value set at each index position having a non-zero value at a higher bitplane;calculating a partition significance vector for the current bitplane of the coefficient block, the partition significance vector having the significant value for each coefficient partition having a non-zero value;calculating a run-length coded value for a portion of the partition significance vector;calculating a Golomb coded value for a portion of a significant partition;forming an encoded block having the run-length coded value and the Golomb coded value; andforming a bitstream having the encoded block.2. The method as claimed in wherein a wavelet coefficient of the lowpass subband of the coefficient block is prioritized by multiplying by a scaling factor.3. The method as claimed in wherein the Golomb code table ...

LOW-COMPLEXITY TWO-DIMENSIONAL (2D) SEPARABLE TRANSFORM DESIGN WITH TRANSPOSE BUFFER MANAGEMENT

Methods are provided for reducing the size of a transpose buffer used for computation of a two-dimensional (2D) separable transform. Scaling factors and clip bit widths determined for a particular transpose buffer size and the expected transform sizes are used to reduce the size of the intermediate results of applying the 2D separable transform. The reduced bit widths of the intermediate results may vary across the intermediate results. In some embodiments, the scaling factors and associated clip bit widths may be adapted during encoding. 1. An apparatus for executing a method for decoding an encoded video bit stream , the method comprising:entropy decoding a block of transform coefficients from the video bit stream;applying a first one-dimensional (1D) inverse transform of a two-dimensional (2D) separable inverse transform to the block of transform coefficients;reducing a bit width of each intermediate result of applying the first 1D inverse transform, wherein the reduced bit width of a first intermediate result and the reduced bit width of a second intermediate result are different, wherein reducing the bit width comprises scaling the bit width of each intermediate result based on a predetermined shift amount; and clipping the scaled bit width of each intermediate result to a predetermined bit width to attain a final bit width, wherein the final bit width for a first scaled intermediate result is different from the final bit width for a second scaled intermediate result;storing the reduced bit width intermediate results in a transpose buffer; andapplying a second 1D inverse transform of the 2D separable inverse transform to the reduced bit width intermediate results to recover a block of residual values.2. The apparatus of claim 1 , wherein the predetermined shift amount is different from a predetermined shift amount used to generate the transform coefficients in an encoder.3. The apparatus of claim 1 , wherein the predetermined shift amount and the predetermined ...

LOW-COMPLEXITY TWO-DIMENSIONAL (2D) SEPARABLE TRANSFORM DESIGN WITH TRANSPOSE BUFFER MANAGEMENT

Methods are provided for reducing the size of a transpose buffer used for computation of a two-dimensional (2D) separable transform. Scaling factors and clip bit widths determined for a particular transpose buffer size and the expected transform sizes are used to reduce the size of the intermediate results of applying the 2D separable transform. The reduced bit widths of the intermediate results may vary across the intermediate results. In some embodiments, the scaling factors and associated clip bit widths may be adapted during encoding. 1. A method comprising:entropy decoding a block of transform coefficients from an encoded video bit stream;applying a first one-dimensional (1D) inverse transform of a two-dimensional (2D) separable inverse transform to the block of transform coefficients;reducing a bit width of each intermediate result of applying the first 1D inverse transform, wherein the reduced bit width of a first intermediate result and the reduced bit width of a second intermediate result are different, wherein reducing the bit width comprises scaling the bit width of each intermediate result based on a predetermined shift amount; and clipping the scaled bit width of each intermediate result to a predetermined bit width to attain a final bit width, wherein the final bit width for a first scaled intermediate result is different from the final bit width for a second scaled intermediate result;storing the reduced bit width intermediate results in a transpose buffer; andapplying a second 1D inverse transform of the 2D separable inverse transform to the reduced bit width intermediate results to recover a block of residual values.2. The method of claim 1 , wherein the predetermined shift amount is different from a predetermined shift amount used to generate the transform coefficients in an encoder.3. The method of claim 1 , wherein the predetermined shift amount and the predetermined bit width for each scaled intermediate result were predetermined based on a size ...

SUPPORT OF NON-HEVC BASE LAYER IN HEVC MULTI-LAYER EXTENSIONS

An apparatus configured to decode video information includes a memory and a processor in communication with the memory. The memory is configured to a memory configured to store video information associated with bitstream. The apparatus further includes a processor in communication with the memory, the processor configured to determine that a reference layer is not included in the bitstream and to receive, from an external source, a decoded base layer picture. The processor is further configured to receive, from the external source, a first indication that the picture is an intra random access point (IRAP) picture. The processor is also configured to receive a second indication whether the picture is one of an instantaneous decoder refresh (IDR) picture, a clean random access (CRA) picture, or a broken link access (BLA) picture; and to decode the video information based at least in part on the first and second indications. 1. A method of decoding video information , the method comprising:determining that a reference layer is not included in a bitstream;receiving, from an external source, a decoded base layer picture;receiving, from the external source, a first indication that the picture is an intra random access point (IRAP) picture;receiving a second indication whether the picture is one of an instantaneous decoder refresh (IDR) picture, a clean random access (CRA) picture, or a broken link access (BLA) picture; anddecoding the video information based at least in part on the first and second indications.2. The method of claim 1 , wherein the reference layer is decoded according to a non-HEVC (High Efficiency Video Coding) codec.3. The method of claim 1 , wherein the reference layer is decoded according to an Advanced Video Coding (AVC) codec.4. The method of claim 1 , wherein determining whether the reference layer is included in the bitstream comprises determining whether the reference layer is included in the bitstream based upon a value included in a one of a ...

SUPPORT OF NON-HEVC BASE LAYER IN HEVC MULTI-LAYER EXTENSIONS

An apparatus configured to code video information includes a memory and a processor in communication with the memory. The memory is configured to store video information associated with a bitstream. The apparatus further includes a processor in communication with the memory, the processor configured to determine whether a reference layer is included in the bitstream. The processor is further configured to determine an indication of one or more parameters for a decoded picture buffer based upon whether the reference layer is included in the bitstream and to code the video information based at least in part on the determined indication of the one or more parameters for the decoded picture buffer. 1. A method of coding video information , the method comprising:determining whether a reference layer is included in a bitstream;determining an indication of one or more parameters for a decoded picture buffer based upon whether the reference layer is included in the bitstream; andcoding the video information based at least in part on the determined indication of the one or more parameters for the decoded picture buffer.2. The method of claim 1 , wherein the reference layer is coded according to a non-HEVC (High Efficiency Video Coding) codec.3. The method of claim 1 , wherein the reference layer is coded according to an Advanced Video Coding (AVC) codec.4. The method of claim 1 , wherein determining whether the reference layer is included in the bitstream comprises determining whether the reference layer is included in the bitstream based upon a value included in a one of a video parameter set claim 1 , a sequence parameter set claim 1 , a picture parameter set claim 1 , or an adaptation parameter set.5. The method of claim 1 , wherein the one or more parameters comprise a parameter which signals a maximum size of the decoded picture buffer for a highest temporal sub-layer to be decoded.6. The method of claim 5 , wherein determining the indication of the parameter which ...

SERVER DEVICE, CLIENT DEVICE AND DYNAMIC IMAGE TRANSMISSION METHOD FOR VIRTUAL DESKTOP INFRASTRUCTURE

A server device, a client device and a dynamic image transmission method for a virtual desktop infrastructure are provided. The dynamic image transmission method for the virtual desktop infrastructure includes the following steps. A region information of a dynamic image displayed on a server device is detected by the server device. The region information is transmitted to a client device by the server device. The dynamic image is rendered on the client device according to the region information. The dynamic image is obtained from an Internet by the client device according to a network link information obtained from the server device, or the dynamic image is obtained by decompressing a compressed data provided from the server device. 1. A dynamic image transmission method for a virtual desktop infrastructure (VDI) , comprising:detecting a region information of a dynamic image by a server device on which the dynamic image is displayed;transmitting the region information to a client device by the server device; andrendering the dynamic image on the client device according to the region information by the client device, wherein the dynamic image is obtained from an Internet according to a network link information obtained from the server device, or the dynamic image is obtained by decompressing a compressed data provided from the server device.2. The dynamic image transmission method for the virtual desktop infrastructure according to claim 1 , wherein the region information comprises a display coordinate and a display size of the dynamic image.3. The dynamic image transmission method for the virtual desktop infrastructure according to claim 1 , wherein in the step of detecting the region information of the dynamic image by the server device on which the dynamic image is displayed claim 1 , the region information is updated when the dynamic image moves or scales.4. The dynamic image transmission method for the virtual desktop infrastructure according to claim 1 , ...

IMAGE DECODING METHOD AND APPARATUS USING SAME

The present invention relates to a method and an apparatus for decoding an image, for decoding a bitstream including a plurality of layers. The image decoding method may comprise: a step of receiving and identifying dependency information indicating whether an upper layer is coded by the same coding method as a lower layer; and a step of recovering the image of the upper layer based on the identified dependency information. Thus, information indicating whether the information of the reference layer which the current layer refers to is encoded data or recovered value can be identified. 1. A video decoding method that decodes a bitstream comprising a plurality of layers , the video decoding method comprising:receiving and identifying dependency information indicating whether an upper layer is coded by the same coding method as a lower layer; andreconstructing a video of the upper layer based on the identified dependency information.2. The video decoding method of claim 1 , wherein the dependency information comprises information indicating whether the upper layer refers to coded data on the lower layer.3. The video decoding method of claim 2 , wherein the coded data comprises at least one of motion information claim 2 , block partitioning and a residual with respect to a video of the lower layer.4. The video decoding method of claim 3 , wherein the reconstructing of the video of the upper layer comprises parsing the coded data on the lower layer; and predicting a motion of the video of the upper layer by referring to the motion information.5. The video decoding method of claim 2 , wherein the dependency information comprises information indicating whether the upper layer refers to reconstructed data on the lower layer.6. The video decoding method of claim 5 , wherein the reconstructed data comprises an upsampled sample value of a video of the lower layer.7. The video decoding method of claim 6 , wherein the reconstructing of the video of the upper layer comprises ...

Hierarchical motion estimation for video compression and motion analysis

Systems and methods for hierarchical motion estimation are described. The hierarchical motion estimation may provide motion information and pixel correlation among temporal pictures at different resolutions, which may be utilized in motion related video processing applications such as video coding, motion compensation based denoising, interpolation, and others to improve the quality and/or speed of motion predictions. Systems and methods of video processing that include pre- and post-processing utilizing information from hierarchical motion estimations are also discussed. Specifically, systems and methods of video processing with hierarchical motion estimation instead of or in addition to other motion estimations are shown.

SCALABILITY OF MULTI-DIRECTIONAL VIDEO STREAMING

Aspects of the present disclosure provide techniques for reducing latency and improving image quality of a viewport extracted from multi-directional video communications. According to such techniques, first streams of coded video data are received from a source. The first streams include coded data for each of a plurality of tiles representing a multi-directional video, where each tile corresponding to a predetermined spatial region of the multi-directional video, and at least one tile of the plurality of tiles in the first streams contains a current viewport location at a receiver. The techniques include decoding the first streams and displaying the tile containing the current viewport location. When the viewport location at the receiver changes to include a new tile of the plurality of tiles, retrieving and decoding first streams for the new tile, displaying the decoded content for the changed viewport location, and transmitting the changed viewport location to the source. 121.-. (canceled)22. A video reception method , comprising:receiving a coded bitstream of multi-directional video of a scene including a first version of a frame in a first projection format and a second version of the frame in a second projection format;first decoding the first version to produce a first decoded image in the first projection format;second decoding the second version to produce a second decoded image in the second projection format;converting the first decoded image from the first projection format to the second projection format;combining the first decoded image in the second projection format with the second decoded image in the second projection format to produce a combined image in the second projection format; andoutputting the combined image as a decoded version of the frame.23. The method of claim 22 , wherein:the first projection format is a equirectangular projection;the second projection format is a cube map projection;24. The method of claim 22 , wherein:the combined ...

Non-entropy encoded representation format

Systems, methods, and devices for coding multilayer video data are disclosed that may include encoding, decoding, transmitting, or receiving multilayer video data. The systems, methods, and devices may receive or transmit a non-entropy coded representation format within a video parameter set (VPS). The systems, methods, and devices may code (encode or decode) video data based on the non-entropy coded representation format within the VPS, wherein the representation format includes one or more of chroma format, whether different colour planes are separately coded, picture width, picture height, luma bit depth, and chroma bit depth.

Coding, storage and signalling of scalability information

A method and device for encoding, decoding, storage and transmission of a scalable data stream to include layers having different coding properties including: producing one or more layers of the scalable data stream, wherein the coding properties include at least one of the following: Fine granularity scalability information; Region-of-interest scalability information; Sub-sample scalable layer information; Decoding dependency information; and Initial parameter sets, and signaling the layers with the characterized coding property such that they are readable by a decoder without the need to decode the entire layers. A corresponding method of encoding, decoding, storage, and transmission of a scalable bit stream is also disclosed, wherein at least two scalability layers are present and each layer has a set of at least one property, such as those above identified.

SIGNALING PARTITION INFORMATION FOR 3D LOOKUP TABLE FOR COLOR GAMUT SCALABILITY IN MULTI-LAYER VIDEO CODING

Techniques are described for signaling information used to generate three-dimensional (3D) color lookup tables for color gamut scalability in multi-layer video coding. A lower layer of video data may include color data in a first color gamut and a higher layer of the video data may include color data in a second color gamut. To generate inter-layer reference pictures, a video encoder or video decoder performs color prediction using a 3D lookup table to convert the color data of a reference picture in the first color gamut to the second color gamut. According to the techniques, a video encoder may encode partition information and/or color values of a 3D lookup table generated for color gamut scalability. A video decoder may decode the partition information and/or color values to generate the 3D lookup table in order to perform color gamut scalability. 1. A method of decoding video data , the method comprising:determining a base partition value for a three-dimensional (3D) lookup table for color gamut scalability;determining a luma partition value for a luma component of the 3D lookup table; partitioning each of the luma component, a first chroma component and a second chroma component of the 3D lookup table into a first number of octants based on the base partition value, and', 'partitioning each of the first number of octants of the luma component into a second number of octants based on the luma partition value;, 'generating the 3D lookup table with coarser partitioning for chroma components and finer partitioning for the luma component, includingdecoding residual data of video blocks of the video data; andreconstructing the video blocks of the video data based on the decoded residual data and at least one reference picture generated using the 3D lookup table.2. The method of claim 1 , wherein determining the luma partition value comprises decoding at least one syntax element indicating he luma partition value for the luma component of the 3D lookup table.3. The ...

METHOD AND APPARATUS FOR ENCODING SCALABLE VIDEO FOR ENCODING AUXILIARY PICTURE, METHOD AND APPARATUS FOR DECODING SCALABLE VIDEO FOR DECODING AUXILIARY PICTURE

Provided are a scalable video decoding method and a scalable video decoding apparatus. The scalable video decoding method includes obtaining, from a bitstream, scalability mask information specifying whether scalable video decoding is performed according to each of scalability types in a current video, and when scalability mask information for scalable video decoding an auxiliary picture indicates performance, determining one of auxiliary picture types comprising an alpha plane and a depth picture of a primary picture of another layer, by using a scalability index indicating a type of the auxiliary picture to be decoded in a current layer, and decoding the auxiliary picture of the current layer. 1. A scalable video decoding method comprising:obtaining, from a bitstream, scalability mask information specifying whether scalable video decoding is performed according to each of scalability types in a current video;from among the scalability mask information, when scalability mask information for scalable video decoding an auxiliary picture indicates performance, obtaining a scalability index indicating a type of the auxiliary picture to be decoded in a current layer; anddecoding the auxiliary picture of the current layer which is determined, by using the scalability index, as one of auxiliary picture types comprising an alpha plane and a depth picture of a primary picture of another layer.2. The scalable video decoding method of claim 1 , wherein a layer that comprises only auxiliary pictures and is from among a layer set comprising one or more layers is not a target output layer.3. The scalable video decoding method of claim 1 , wherein:the primary picture associated with the auxiliary picture is present,the primary picture is associated with one or more auxiliary pictures having different auxiliary picture types, andthe auxiliary picture types comprise the alpha plane, the depth picture, and chroma data.4. The scalable video decoding method of claim 1 , wherein:a type ...

Apparatus and methods for video compression using multi-resolution scalable coding

Apparatus and methods for digital video data compression via a scalable, multi-resolution approach. In one embodiment, the video content may be encoded using a multi-resolution and/or multi-quality scalable coding approach that reduces computational and/or energy load on a client device. In one implementation, a low fidelity image is obtained based on a first full resolution image. The low fidelity image may be encoded to obtain a low fidelity bitstream. A second full resolution image may be obtained based on the low fidelity bitstream. A portion of a difference image obtained based on the second full resolution image and the first full resolution may be encoded to obtain a high fidelity bitstream. The low fidelity bitstream and the high fidelity bitstream may be provided to e.g., a receiving device.

METHOD FOR DECODING IMAGE AND APPARATUS USING SAME

A method for decoding an image according to the present invention comprises the steps of: receiving and parsing a parameter set including indication information which indicates the presence of withheld information to be used in the future; receiving and parsing a slide header including the withheld information, when the indication information indicates the presence of the withheld information; and decoding the image according to semantics and a value corresponding to the withheld information. As a result, provided are a method and an apparatus for describing an additional extension information indication in a bitstream supporting a hierarchical image. 18-. (canceled)9. A picture decoding method , by a decoding apparatus , comprising:receiving a picture parameter set (PPS) comprising a num_extra_slice_header_bits syntax element specifying a number of extra bits for a slice segment header;receiving the slice segment header, wherein the slice segment header comprising zero or more reserved flags when a current slice segment is not a dependent slice segment, wherein a number of the reserved flags in the slice segment header is same as the number of extra bits which is determined based on the num_extra_slice_header_bits syntax element; anddecoding a picture based on the slice segment header,wherein the slice segment header comprises a dependent slice segment flag representing whether the current slice segment is the dependent slice segment , andwherein the slice segment header comprises one or more of the reserved flags when a value of the num_extra_slice_header_bits syntax element is greater than 0 and the current slice segment is not the dependent slice segment.10. The method of claim 9 , wherein the num_extra_slice_header_bits syntax element is signaled at a position following a syntax element specifying a sequence parameter set (SPS) identifier (ID) of an SPS activated in the picture parameter set.11. The method of claim 9 , wherein the reserved flag is for a multi- ...

APPARATUS AND METHODS FOR VIDEO COMPRESSION USING MULTI-RESOLUTION SCALABLE CODING

Apparatus and methods for digital video data compression via a scalable, multi-resolution approach. In one embodiment, the video content may be encoded using a multi-resolution and/or multi-quality scalable coding approach that reduces computational and/or energy load on a client device. In one implementation, a low fidelity image is obtained based on a first full resolution image. The low fidelity image may be encoded to obtain a low fidelity bitstream. A second full resolution image may be obtained based on the low fidelity bitstream. A portion of a difference image obtained based on the second full resolution image and the first full resolution may be encoded to obtain a high fidelity bitstream. The low fidelity bitstream and the high fidelity bitstream may be provided to e.g., a receiving device. 121.-. (canceled)22. A method of obtaining an image responsive to a change of a viewport , the method comprising:obtaining a difference image based at least on a first full-resolution image and a second full-resolution image;encoding a portion of the difference image to produce an encoded portion, the encoded portion corresponding to a position of the viewport; andproviding, via a communications interface to a client device, at least the encoded portion corresponding to the position of the viewport.23. The method of claim 22 , further comprising:obtaining the first full-resolution image from a sequence of images, the first full-resolution having a first frame resolution;downsampling the first full-resolution image to obtain a downsampled image having a second frame resolution, the second frame resolution being lower than the first frame resolution; andencoding the downsampled image into a reduced-fidelity bitstream.24. The method of claim 23 , further comprising selecting an image resolution of the second frame resolution of the downsampled image based at least on a scaling factor ranging from two (2) to sixteen (16) claim 23 , inclusive.25. The method of claim 23 , ...

METHOD FOR DECODING IMAGE AND APPARATUS USING SAME

A method for decoding an image according to the present invention comprises the steps of: receiving and parsing a parameter set including indication information which indicates the presence of withheld information to be used in the future; receiving and parsing a slide header including the withheld information, when the indication information indicates the presence of the withheld information; and decoding the image according to semantics and a value corresponding to the withheld information. As a result, provided are a method and an apparatus for describing an additional extension information indication in a bitstream supporting a hierarchical image. 1. A video decoding method comprising:receiving and parsing a parameter set comprising indication information specifying whether reserved information is for future used is present;receiving and parsing a slice header comprising the reserved information when the indication information specifies that the reserved information is present; anddecoding a video based on semantics and a value corresponding to the reserved information.2. The video decoding method of claim 1 , wherein the indication information is received being comprised in a picture parameter set.3. The video decoding method of claim 2 , wherein the indication information is information specifying an extra slice header bit number added for the slice header to comprise the reserved information claim 2 , and the extra slice header bit number is 0 when a bit stream supports a single-layer video.4. The video decoding method of claim 2 , wherein the indication information is signaled at a position following a syntax element specifying a sequence parameter set (SPS) identifier (ID) of an SPS activated in the picture parameter set and a syntax element specifying whether flag information indicating whether the slice header is a dependent slice header is present.5. The video decoding method of claim 2 , wherein the reserved information comprises a number of semantics ...

METHOD FOR DECODING IMAGE AND APPARATUS USING SAME

A method for decoding an image according to the present invention comprises the steps of: receiving and parsing a parameter set including indication information which indicates the presence of withheld information to be used in the future; receiving and parsing a slide header including the withheld information, when the indication information indicates the presence of the withheld information; and decoding the image according to semantics and a value corresponding to the withheld information. As a result, provided are a method and an apparatus for describing an additional extension information indication in a bitstream supporting a hierarchical image. 18-. (canceled)9. A picture decoding method , by a decoding apparatus , comprising:receiving a picture parameter set (PPS) comprising a num_extra_slice_header_bits syntax element specifying a number of extra bits for a slice segment header;receiving the slice segment header, wherein the slice segment header comprising zero or more reserved flags when a current slice segment is not a dependent slice segment, wherein a number of the reserved flags in the slice segment header is same as the number of extra bits which is determined based on the num_extra_slice_header_bits syntax element; anddecoding a picture based on the slice segment header,wherein the picture parameter set further comprises a first picture parameter set identifier syntax element specifying an identifier (ID) of the picture parameter set,wherein the slice segment header further comprises a second picture parameter set identifier syntax element indicating the identifier (ID) of the picture parameter set, andwherein the slice segment header comprises a dependent slice segment flag representing whether the current slice segment is the dependent slice segment.10. The method of claim 9 , wherein the num_extra_slice_header_bits syntax element is signaled at a position following a syntax element specifying a sequence parameter set (SPS) identifier (ID) of an ...

FORWARD ERROR CORRECTION USING SOURCE BLOCKS WITH SYMBOLS FROM AT LEAST TWO DATASTREAMS WITH SYNCHRONIZED START SYMBOL IDENTIFIERS AMONG THE DATASTREAMS

A forward error correction (FEC) data generator has an input for at least two datastreams for which FEC data shall be generated in a joint manner, each datastream having a plurality of symbols. A FEC data symbol is based on a FEC source block possibly having a subset of symbols of the at least two data streams. The FEC data generator further has a signaling information generator configured to generate signaling information for the FEC data symbol regarding which symbols within the at least two datastreams belong to the corresponding source block by determining pointers to start symbols within a first and a second datastream, respectively, of the at least two datastreams and a number of symbols within the first datastream and second datastreams, respectively, that belong to the corresponding source block. 1. A forward error correction data generator comprising:an input for at least two datastreams for which forward error correction data shall be generated in a joint manner, each datastream comprising a plurality of symbols, wherein a forward error correction data symbol is based on a forward error correction (FEC) source block;a signaling information generator configured to generate signaling information for the forward error correction data symbol regarding which symbols within the at least two datastreams belong to the corresponding FEC source block by determining a pointer to a start symbol within a first datastream of the at least two datastreams, a pointer to a start symbol within a second datastream of the at least two datastreams, a number of symbols within the first datastream that belong to the corresponding source block, and a number of symbols within the second datastream that belong to the corresponding source block;a synchronizer configured to determine a common identifier for the start symbols within the at least two datastreams;wherein the signaling information generator is configured to include the common identifier into the signaling information to ...

METHOD FOR DECODING IMAGE AND APPARATUS USING SAME

A method for decoding an image according to the present invention comprises the steps of: receiving and parsing a parameter set including indication information which indicates the presence of withheld information to be used in the future; receiving and parsing a slide header including the withheld information, when the indication information indicates the presence of the withheld information; and decoding the image according to semantics and a value corresponding to the withheld information. As a result, provided are a method and an apparatus for describing an additional extension information indication in a bitstream supporting a hierarchical image. 18-. (canceled)9. A picture decoding method , by a decoding apparatus , comprising:receiving a picture parameter set (PPS) comprising a num_extra_slice_header_bits syntax element specifying a number of extra bits for a slice segment header;receiving the slice segment header comprising zero or more reserved flags, wherein a number of the reserved flags in the slice segment header is same as the number of extra bits which is determined based on the num_extra_slice_header_bits syntax element; anddecoding a picture based on the slice segment header,wherein the picture parameter set further comprises a first picture parameter set identifier syntax element specifying an identifier (ID) of the picture parameter set, andwherein the slice segment header further comprises a second picture parameter set identifier syntax element indicating the identifier (ID) of the picture parameter set.10. The method of claim 9 , wherein the num_extra_slice_header_bits syntax element is signaled at a position following a syntax element specifying a sequence parameter set (SPS) identifier (ID) of an SPS activated in the picture parameter set.11. The method of claim 9 , wherein the reserved flag is for a multi-viewpoint layer and a video supporting spatial scalability or a three-dimensional (3D) video.12. The method of claim 9 , wherein the ...

Determination bitstream decoding capability in video coding

A multi-layer video decoder is configured to determine, based on a list of triplet entries, whether the multi-layer video decoder is capable of decoding a bitstream that comprises an encoded representation of the multi-layer video data. The number of triplet entries in the list is equal to a number of single-layer decoders in the multi-layer video decoder. Each respective triplet entry in the list of triplet entries indicates a profile, a tier, and a level for a respective single-layer decoder in the multi-layer video decoder. The multi-layer video decoder is configured such that, based on the multi-layer video decoder being capable of decoding the bitstream, the multi-layer video decoder decodes the bitstream.

LOW-COMPLEXITY TWO-DIMENSIONAL (2D) SEPARABLE TRANSFORM DESIGN WITH TRANSPOSE BUFFER MANAGEMENT

Methods are provided for reducing the size of a transpose buffer used for computation of a two-dimensional (2D) separable transform. Scaling factors and clip bit widths determined for a particular transpose buffer size and the expected transform sizes are used to reduce the size of the intermediate results of applying the 2D separable transform. The reduced bit widths of the intermediate results may vary across the intermediate results. In some embodiments, the scaling factors and associated clip bit widths may be adapted during encoding. 1. An apparatus for executing a method for decoding an encoded video bit stream , the method comprising:entropy decoding a block of transform coefficients from the video bit stream;applying a first one-dimensional (1D) inverse transform of a two-dimensional (2D) separable inverse transform to the block of transform coefficients;reducing a bit width of each intermediate result of applying the first 1D inverse transform, wherein the reduced bit width of a first intermediate result and the reduced bit width of a second intermediate result are different, wherein reducing the bit width comprises scaling the bit width of each intermediate result based on a predetermined shift amount; and clipping the scaled bit width of each intermediate result to a predetermined bit width to attain a final bit width, wherein the final bit width for a first scaled intermediate result is different from the final bit width for a second scaled intermediate result;storing the reduced bit width intermediate results in a transpose buffer; andapplying a second 1D inverse transform of the 2D separable inverse transform to the reduced bit width intermediate results to recover a block of residual values.2. The apparatus of claim 1 , wherein the predetermined shift amount is different from a predetermined shift amount used to generate the transform coefficients in an encoder.3. The apparatus of claim 1 , wherein the predetermined shift amount and the predetermined ...

LOW-COMPLEXITY TWO-DIMENSIONAL (2D) SEPARABLE TRANSFORM DESIGN WITH TRANSPOSE BUFFER MANAGEMENT

Methods are provided for reducing the size of a transpose buffer used for computation of a two-dimensional (2D) separable transform. Scaling factors and clip bit widths determined for a particular transpose buffer size and the expected transform sizes are used to reduce the size of the intermediate results of applying the 2D separable transform. The reduced bit widths of the intermediate results may vary across the intermediate results. In some embodiments, the scaling factors and associated clip bit widths may be adapted during encoding. 1. An apparatus for executing a method for decoding an encoded video bit stream , the method comprising:entropy decoding a block of transform coefficients from the video bit stream;applying a first one-dimensional (1D) inverse transform of a two-dimensional (2D) separable inverse transform to the block of transform coefficients;reducing a bit width of each intermediate result of applying the first 1D inverse transform, wherein the reduced bit width of a first intermediate result and the reduced bit width of a second intermediate result are different, wherein reducing the bit width comprises scaling the bit width of each intermediate result based on a predetermined shift amount; and clipping the scaled bit width of each intermediate result to a predetermined bit width to attain a final bit width, wherein the final bit width for a first scaled intermediate result is different from the final bit width for a second scaled intermediate result;storing the reduced bit width intermediate results in a transpose buffer; andapplying a second 1D inverse transform of the 2D separable inverse transform to the reduced bit width intermediate results to recover a block of residual values.2. The apparatus of claim 1 , wherein the predetermined shift amount is different from a predetermined shift amount used to generate the transform coefficients in an encoder.3. The apparatus of claim 1 , wherein the predetermined shift amount and the predetermined ...

Method and System for Encoding a 3D Scene

A computer-implemented method for encoding a scene volume includes: (a) identifying features of a scene volume that are within a camera perspective range with respect to a default camera perspective; (b) converting the identified features into rendered features; and (c) sorting the rendered features into a plurality of scene layers, each including corresponding depth, color, and transparency maps for the respective rendered features. Further, (a), (b), and (c) may be repeated, operating on temporally ordered scene volumes, to produce and output a sequence encoding a video. Corresponding systems and non-transitory computer-readable media are disclosed for encoding a 3D scene and for decoding an encoded 3D scene. Efficient compression, transmission, and playback of video describing a 3D scene can be enabled, including for virtual reality displays with updates based on a changing perspective of a user viewer for variable-perspective playback.

Linear down/up sampling apparatuses and generalized scan interleaving based encoding/decoding method and apparatus using the sampling apparatuses

본 발명은 일반화된 문맥값을 이용한 격주사선 처리 부호화/복호화 방법 및 장치 그리고 이 장치에 사용되는 선형 다운/업 샘플링 장치에 관한 것이다. The present invention relates to a bi-scan line processing encoding / decoding method and apparatus using a generalized context value and a linear down / up sampling apparatus used in the apparatus. 본 발명에 의한 선형 다운 샘플링 장치는 주어진 축소 비율이 m/n이면, 이 축소 비율을 [1/2 K ]와 [(m2 K )/n]의 두 부분들로 분할하고, 분할된 두 부분들을 순차적으로 적용한 선형 다운 샘플링을 실시한다. 본 발명에 의한 선형 업 샘플링 장치는 주어진 확대 비율이 n/m이면, 이 확대 비율을 [n/(m2 K )]와 [2 K ]의 두 부분들로 분할하고, 이 두 부분들을 순차적으로 적용한 선형 업 샘플링을 실시한다. The linear down sampling apparatus according to the present invention divides this reduction ratio into two parts [1/2 K ] and [(m2 K ) / n] if the given reduction ratio is m / n, and divides the divided two portions. Perform linear down sampling applied sequentially. The linear up-sampling apparatus according to the present invention divides the enlargement ratio into two parts, [n / (m2 K )] and [ 2K ], if the given enlargement ratio is n / m, and applies these two portions sequentially. Perform linear upsampling. 상기 선형 다운 샘플링 및 선형 업 샘플링 기법을 기존의 문맥값을 이용한 격주사선 처리 부호화 방법에 적용함으로써, 임의의 비율로 축소된 하위 계층을 이용하여 현재의 계층을 부호화/복호화한다. By applying the linear downsampling and linear upsampling techniques to an existing bi-scanning coding method using a context value, the current layer is encoded / decoded using a lower layer reduced at an arbitrary ratio.

Picture processing device and picture processing method

위치 및/또는 크기가 시간에 따라 변하는 비디오 오브젝트(VO)의 스케일러빌리티를 획득하기 위한 장치 및 방법. 절대 좌표계에서 상위 계층 화상의 위치 및 하위 계층 화상의 위치가 결정되며 그래서 확대된 화상 및 상위 계층 화상내의 대응 화소들이 절대 좌표계에서 동일한 위치들에 배치될 수 있다. 오브젝트, 하위 계층, 상위 계층, 순방향 예측, 역방향 예측, 양방향 예측

System and method to code and decode video signals

Изобретение относится к области кодирования и декодирования видеосигналов. Техническим результатом является повышение эффективности кодирования и декодирования видеосигналов. Указанный технический результат достигается тем, что предложен способ видеокодирования изображений, включающий разделение вектора коэффициентов макроблока на два или более субвектора без дополняющих нулей, при этом каждый субвектор имеет длину, меньшую или равную длине вектора коэффициентов, указание размера каждого субвектора и положения каждого субвектора в векторе коэффициентов и формирование блока, соответствующего каждому субвектору. 8 н. и 43 з.п. ф-лы, 6 ил. РОССИЙСКАЯ ФЕДЕРАЦИЯ (19) RU (11) 2 420 023 (13) C1 (51) МПК H04N 7/46 (2006.01) G06T 9/00 (2006.01) ФЕДЕРАЛЬНАЯ СЛУЖБА ПО ИНТЕЛЛЕКТУАЛЬНОЙ СОБСТВЕННОСТИ, ПАТЕНТАМ И ТОВАРНЫМ ЗНАКАМ (12) ОПИСАНИЕ ИЗОБРЕТЕНИЯ К ПАТЕНТУ (21)(22) Заявка: 2009137469/09, 12.03.2008 (24) Дата начала отсчета срока действия патента: 12.03.2008 (72) Автор(ы): РИДЖ Джастин (US), ВАНГ Ксианглин (US) R U (73) Патентообладатель(и): Нокиа Корпорейшн (FI) Приоритет(ы): (30) Конвенционный приоритет: 13.03.2007 US 60/894,667 (56) Список документов, цитированных в отчете о поиске: ЕР 1696675 А2, 30.08.2006. ЕР 0562420 А2, 29.09.1993. ЕР 1296524 A1, 26.03.2003. US 2006291729 A1, 28.12.2006. US 5272529 A, 21.12.1993. ЕР 0830029 А2, 18.03.1998. RU 2005113308 A, 20.01.2006. RU 2119727 C1, 27.09.1998. RU 2004125588 A, 27.01.2006. RIDGE J. ET AL, CE8: VLCs for SVC, JOINT VIDEO TEAM (JVT) OF ISO/IEC MPEG & ITUT VCEG, (см. прод.) C 1 2 4 2 0 0 2 3 2 4 2 0 0 2 3 C 1 (45) Опубликовано: 27.05.2011 Бюл. № 15 (85) Дата начала рассмотрения заявки PCT на национальной фазе: 13.10.2009 (86) Заявка PCT: IB 2008/050905 (12.03.2008) (87) Публикация заявки РСТ: WO 2008/110999 (18.09.2008) Адрес для переписки: 191036, Санкт-Петербург, а/я 24, "НЕВИНПАТ", пат.пов. А.В.Поликарпову R U (54) СИСТЕМА И СПОСОБ КОДИРОВАНИЯ И ДЕКОДИРОВАНИЯ ВИДЕОСИГНАЛОВ (57) Реферат: Изобретение относится к ...

Video communication system using model-based coding and prioritzation techniques

A method and communication system are disclosed that use object prioritization and layered image coding in image/video transmission. Objects within an image/video are identified and models are assigned to represent the objects. Priorities are assigned for the objects in accordance with predetermined prioritization rules, then communication channels to communicate data related to the models are assigned so that a higher priority object is assigned to a communication channel having a reliability factor higher than a lower priority object.

Systems and methods with error resilience in enhancement layer bitstream of scalable video coding

A scalable layered video coding scheme that encodes video data frames into multiple layers, including a base layer of comparatively low quality video and multiple enhancement layers of increasingly higher quality video, adds error resilience to the enhancement layer. Unique resynchronization marks are inserted into the enhancement layer bitstream in headers associated with each video packet, headers associated with each bit plane, and headers associated with each video-of-plane (VOP) segment. Following transmission of the enhancement layer bitstream, the decoder tries to detect errors in the packets. Upon detection, the decoder seeks forward in the bitstream for the next known resynchronization mark. Once this mark is found, the decoder is able to begin decoding the next video packet. With the addition of many resynchronization marks within each frame, the decoder can recover very quickly and with minimal data loss in the event of a packet loss or channel error in the received enhancement layer bitstream. The video coding scheme also facilitates redundant encoding of header information from the higher-level VOP header down into lower level bit plane headers and video packet headers. Header extension codes are added to the bit plane and video packet headers to identify whether the redundant data is included.

Edge calculation-based pre-judgment filtering method and device

本发明涉及医疗及机器学习技术领域，特别是一种基于边缘计算的预判过滤方法及装置。本发明在舌象图片处理过程中，通过在采集设备和云端服务器之间增加边缘计算步骤，对采集到的原始图片进行判断筛选，将筛选后的图片上传给云端服务器，大大减少了无效图片数据的传递及识别，实现了实时和更快速的数据处理和分析，减少高分辨率图片的传输迟延时间，也解决了传统云计算模式下存在的舌象传输高延迟、网络不稳定和低带宽的问题，有效地提升了后续舌诊系统的运行效率，减少了请求响应时间、减少网络带宽，同时保证数据的安全性和私密性。

Video communication system using model-based coding and prioritization techniques

이미지/비디오 전송에서 계층화된 이미지 코딩 및 오브젝트 우선 순위화를 사용하는 방법 및 통신 시스템이 개시되어 있다. 이미지/비디오 내의 오브젝트들이 식별되고, 모델들이 오브젝트들을 나타내도록 할당된다. 우선 순위들이 미리 결정된 우선 순위 규칙들에 따라 오브젝트들에 대해 할당되어, 보다 더 높은 우선 순위 오브젝트가 보다 더 낮은 우선 순위 오브젝트보다 더 높은 신뢰도 인자를 갖는 통신 채널에 할당되도록 모델들에 관련된 데이터를 통신하도록 통신 채널들이 할당된다. A method and communication system using layered image coding and object prioritization in image / video transmission is disclosed. Objects in the image / video are identified, and models are assigned to represent the objects. Priorities are assigned to the objects according to predetermined priority rules to communicate data related to the models such that a higher priority object is assigned to a communication channel having a higher reliability factor than a lower priority object. Communication channels are allocated.

Virtual telemicroscope

A method and system that uses a computer system as a telemicroscope. A plurality of images of a specimen are captured (Digital camera scanner video camera). The images correspond to the entire specimen and a plurality of segments of the specimen (Multiple linked images). The high-resolution images corresponding to said plurality of segments have different magnification levels and locations (magnifying glass effect); a linking map is generated between said images (Multiple linked images). The linking map comprises information regarding geographical location of the images in relation to the specimen's structure (Image geographical measurement); and images and said linking map are transmitted to a remote user via a computer network thereby allowing the user to view the images with different magnification levels without compromising in image clarity (Computer station one and computer station two). The transmitted images are viewed in a dynamic manner, permitting the user to navigate, enlarge, measure, compare, annotate and exam the digitized images on a virtual slides displayed on a computer screen (Image analysis measurement). The operation of the system closely mimics that of a light microscope.

Data encoding apparatus and method, image decoding apparatus and method, recording medium and recording method

비디오 오브젝트(VO)의 스케일러빌리티를 획득하기 위한 장치 및 방법으로서, 위치 및/또는 크기가 시간에 따라서 변동한다. 절대 좌표 시스템에서 상위 계층 화상의 위치 및 하위 계층 화상의 위치가 결정되어 확장된 화상 및 상위 계층 화상내의 대응하는 화소들이 절대 좌표 시스템에서 동일한 위치들에 배치될 수 있다. Apparatus and method for obtaining scalability of a video object (VO), the position and / or the size of which varies with time. The position of the upper hierarchical picture and the position of the lower hierarchical picture in the absolute coordinate system may be determined such that corresponding pixels in the expanded picture and the higher hierarchical picture may be placed at the same locations in the absolute coordinate system.

Picture coding method

본 발명은 픽처들(pictures)을 인코딩하기 위한 방법에 관한 것으로, 주된 코딩 픽처들 및 주된 코딩 픽처들의 중복 코딩 픽처들이 형성되고, 각 주된 코딩 픽처는 각각의 중복 코딩 픽처와 실질적으로 동일한 픽처 정보를 포함한다. 중복 코딩 픽처들중 적어도 하나는 각각의 주된 코딩 픽처의 픽처 정보의 일부에만 대응하는 픽처 정보를 포함한다. 본 발명은 또한 시스템, 인코더, 디코더, 전송 장치, 수신 장치, 소프트웨어 프로그램, 저장 매체, 및 비트스트림에 관한 것이다.

Water ring scan apparatus and method, video coding/decoding apparatus and method using that

1. 청구범위에 기재된 발명이 속한 기술분야 1. TECHNICAL FIELD OF THE INVENTION 본 발명은 파문 스캔 장치 및 그 방법과 이를 이용한 영상 코딩/디코딩 장치 및 그 방법에 관한 것임. The present invention relates to a ripple scan device and a method thereof, and an image coding / decoding device using the same. 2. 발명이 해결하려고 하는 기술적 과제 2. The technical problem to be solved by the invention 본 발명은 임의의 특정 위치의 영상 정보를 최우선적으로 코딩한 후에 바로 이웃하는 외각에 위치하는 영상 정보를 그 다음에 코딩하는 과정을 반복 수행하는 파문 스캔 장치 및 그 방법과 상기 방법을 실현시키기 위한 프로그램을 기록한 컴퓨터로 읽을 수 있는 기록매체, 및 파문 스캔 오더(Water Ring Scan Order)를 이용하여 인간의 시각 시스템(HVS : Human Visual System)에 적합하게 영상 정보를 전달하여 시각적으로 우수한 화질을 얻을 수 있도록 하는 영상 코딩/디코딩 장치 및 그 방법과 상기 방법을 실현시키기 위한 프로그램을 기록한 컴퓨터로 읽을 수 있는 기록매체를 제공하는데 그 목적이 있음. The present invention provides a method and method for realizing a ripple scanning apparatus for repeating a process of coding image information located at a neighboring outer side immediately after first coding image information at an arbitrary position. A computer-readable recording medium that records the program, and a water ring scan order, deliver visual information that is suitable for the human visual system (HVS) to achieve visually superior image quality. An object of the present invention is to provide an image coding / decoding apparatus and a method thereof, and a computer-readable recording medium having recorded thereon a program for realizing the method. 3. 발명의 해결방법의 요지 3. Summary of Solution to Invention 본 발명은, 우선적으로 파문 스캔을 수행하여야 할 시각적으로 중요한 특정 영상 부분인 파문 발생 위치(파문(0))부터 파문 스캔을 시작하기 위한 파문 스캔 시작 수단; 상기 파문 발생 위치에 사각형 모양의 링을 둘러싸는 형태로 다음 파문 스캔 위치(파문(1))를 결정한 후에, 사각형 모양의 링을 그 전에 처리한 사각형 모양의 링에 둘러싸는 형태로 다음 파문 스캔 위치(파문(i))를 결정하기 위한 파문스캔 위치 결정 수단; 및 상기 파문 스캔 위치 결정 수단에서 결정된 파문 스캔 위치에 따라 파문 스캔을 수행하기 위한 파문 스캔 수단을 포함한다. The present invention relates to a method comprising: a ripple scan start means for starting a ripple scan from a ripple occurrence position (ripple (0)), which is a visually important specific image portion to be subjected to ripple scan first; After determining the next ripple ...

Image encoding device, image encoding method, and program

Image decoding method

Linear down/up sampling apparatuses and generalized scan interleaving based encoding/decoding method and apparatus using the sampling apparatuses

본 발명은 일반화된 주변 화소 성향 값을 이용한 격주사선 처리 부호화/복호화 방법 및 장치 그리고 이 장치에 사용되는 선형 다운/업 샘플링 장치에 관한 것이다. 본 발명에 의한 선형 다운 샘플링 장치는 주어진 축소 비율이 m/n이면, 이 축소 비율을 [1/2 K ]와 [(m2 K )/n]의 두 부분들로 분할하고, 분할된 두 부분들을 순차적으로 적용한 선형 다운 샘플링을 실시한다. 본 발명에 의한 선형 업 샘플링 장치는 주어진 확대 비율이 n/m이면, 이 확대 비율을 [n/(m2 K )]와 [2 K ]의 두 부분들로 분할하고, 이 두 부분들을 순차적으로 적용한 선형 업 샘플링을 실시한다. 상기 선형 다운 샘플링 및 선형 업 샘플링 기법을 기존의 주변 화소 성향값을 이용한 격주사선 처리 부호화 방법에 적용함으로써, 임의의 비율로 축소된 하위 계층을 이용하여 현재의 계층을 부호화/복호화한다.

Image processing apparatus, image processing method

本发明提供了一种图像处理设备，包括：特征区域检测部分，检测图像中的多个特征区域；条件存储部分，在其上存储根据特征区域的特征而不同的分配条件，以便根据特征区域的特征来分配不同的压缩强度；压缩部分，分别对多幅特征区域图像进行压缩，所述多幅特征区域图像是所述多个特征区域的图像；以及压缩控制部分，参照条件存储部分上存储的条件，根据所述多个特征区域的特征，对压缩部分分别对所述多幅特征区域图像进行压缩的压缩强度进行控制。本发明还提供了一种图像处理设备，包括：编码方式存储部分，以与对象的特征的量相关联的方式来存储编码方式；特征区域检测部分，从图像中检测多个特征区域；以及压缩部分，以编码方式存储部分中以与所述多个特征区域中包括的对象的特征的量相关联的方式而存储的编码方式，分别对所述多个特征区域的图像进行压缩。

Digital image coding method and digital image coder, and digital image decoding method and digital image decoder, and data storage medium

본 발명의 디지털 화상 부호화 장치는, 도 2에 도시하는 바와 같이, 저해상도 텍스처 신호 Std를 차분 부호화하는 부호화기(1100b)와, 고해상도 텍스처 신호 Sth를 차분 부호화하는 부호화기(1100a)를 갖고, 고해상도 텍스처 신호 Sth를 그 예측 신호를 이용하여 차분 부호화할 때, 상기 부호화기(1100b)에 있어서의 보전기(138)에 의해, 상기 부호화기(1100b)에서 재생한 저해상도 텍스처 신호의 유의가 아닌 샘플값을, 그 유의인 샘플값로부터 얻어진 의사 샘플값으로 치환하는 보전 처리를 행하고, 상기 해당 보전 처리를 실시한 재생 저해상도 텍스처 신호에 근거하여 상기 고해상도 텍스처 신호 Sth에 대한 예측 신호를 생성하도록 한 것이다. 이러한 구성의 화상 부호화 장치에서는, 보전 처리가 실시된 재생 저해상도 텍스처 신호에 근거하여 고해상도 텍스처 신호 Sth의 예측 신호가 생성되기 때문에, 부호화 처리의 대상으로 되는 블럭(단위 처리 영역)의 고해상도 텍스처 신호와 그 예측 신호의 차분인 차분 신호가 억제되게 되어, 물체의 경계부에 위치하는 블럭에 대응하는 고해상도 텍스처 신호를, 부호화 효율의 열화를 억제하면서 차분 부호화할 수 있다.

Data structure for image transmission, image coding method, and image decoding method

본 발명에 따르면, 형상 신호 및 텍스쳐 신호를 화상 정보로서 포함하는 임의 형상 화상 신호의 부호화 신호(Ep)를 복호화하는 화상 복호화 장치(100b)에 있어서, 형상 신호만을 화상 정보로서 포함하는 2치 화상 신호의 부호화 신호(E2)를 복호화할 수 있도록 하고, 또한 2치 화상 신호의 부호화시에 그 형상 부호화 비트열에 의사적인 텍스쳐 부호화 비트열을 부가할 필요가 없도록 함으로써, 부호량을 억제할 수 있다. According to the present invention, in the image decoding apparatus 100b for decoding the coded signal Ep of an arbitrary shape image signal including the shape signal and the texture signal as the image information, the binary image signal including only the shape signal as image information. The code amount can be suppressed by allowing the coded signal E2 to be decoded and by eliminating the need to add a pseudo texture coded bit string to the shape coded bit string at the time of encoding the binary image signal. 그 데이터 구조에 따른 화상 식별자를 갖는 화상 부호화 신호를 상기 화상 식별자를 참조하여 해석하는 데이터 해석기(160)를 구비하여, 형상 부호화 비트열과 화소값 부호화 비트열을 표시용 데이터로서 포함하는 임의 형상 부호화 신호에 대한 복호화 처리가 형상 복호화부(170) 및 텍스쳐 복호화부(180)에 의해 실행되고, 형상 부호화 비트열만을 표시용 데이터로서 포함하는 2치 부호화 신호의 복호화 처리가 형상 복호화부(170)에 의해 실행되도록 구성하였다. An arbitrary shape coded signal including a shape coded bit stream and a pixel value coded bit stream as display data, comprising a data analyzer 160 for analyzing a picture coded signal having a picture identifier according to the data structure with reference to the picture identifier. Is executed by the shape decoding unit 170 and the texture decoding unit 180, and the shape decoding unit 170 performs decoding processing of the binary coded signal including only the shape coded bit stream as display data. Configured to run.

A kind of multi-viewpoint three-dimensional video hierarchy encoding method and coding/decoding method

本发明提供了一种多视点立体视频分层编码方法和解码方法，其可以使解码端在进行解码时方便地抽取码流的一部分进行解码，从而实现反向兼容。

Method and apparatus for macroblock adaptive inter-layer intra texture prediction

BLOCK CODING METHOD, MPEG TYPE, IN WHICH A RESOLUTION IS ASSIGNED TO EACH BLOCK

SNR scalable video encoding method and corresponding decoding method

본 발명은 스케일가능 비디오 엔코더, 특히 베이스층 회로와 적어도 하나의 인헨스먼트층 회로를 구비한 엔코더에 관한 것으로, 상기 회로들은 압축된 베이스층 비디오 데이타에 연계되고 비디오 디코더에 전송하기에 적합한 인헨스먼트층 비디오 데이타를 발생할 수 있다. 상기 엔코더에 있어서, 매칭 추구 에러 코딩 단계가 특히 적응되는 계층 삼각형 메시 표현을 기초로 하는 구현된 엔코딩 방법은 베이스층 엔코딩 단계와 인헨스먼트층 엔코딩 단계를 포함한다. 본 발명은 또한 대응 디코딩 방법에 관한 것이다.

METHOD AND SYSTEM FOR DETERMINING ENCODING PARAMETERS ON VARIABLE RESOLUTION FLOWS

Procédé de détermination des paramètres de codage d'un flux vidéo à résolution variable par un codeur vidéo, ledit flux vidéo étant composé d'une pluralité (C) de couches de résolution et étant compressé pour être transmis à un débit donné Di ou une qualité donnée Qi à travers un réseau hétérogène vers une pluralité (K) d'utilisateurs (Ui), ledit procédé comportant une étape de classification dont le but est d'associer chaque niveau de résolution à un groupe d'utilisateurs (Ui) et de déterminer les paramètres de codage optimaux pour chaque niveau de résolution en fonction des besoins de chaque groupe d'utilisateurs (Ui). A method of determining the encoding parameters of a variable resolution video stream by a video encoder, said video stream being composed of a plurality (C) of resolution layers and being compressed to be transmitted at a given bit rate Di or a quality Qi data across a heterogeneous network to a plurality (K) of users (Ui), said method comprising a classification step whose purpose is to associate each level of resolution to a group of users (Ui) and determine the optimal coding parameters for each level of resolution according to the needs of each user group (Ui).

System and method for encoding and decoding the residual signal for fine granular scalable video

본 발명은 비디오 인코더 및 비디오 디코더를 개시한다. 비디오 인코더는 비디오 프레임의 입력 스트림을 수신할 수 있고, 그로부터 스트리밍 비디오 수신기에 전송하기 적절한 압축된 베이스층 비디오 데이터를 생성할 수 있는 베이스층 회로를 포함한다. 비디오 인코더는 원시 변환 계수(O) 및 재구성된 베이스층 변환 계수들(B)을 수신하고, 원시 변환 계수(O)와 재구성된 베이스층 변환 계수(B) 간의 차이에 비례하는 잔류 신호(R)를 생성하는 확대층 회로를 포함하기도 한다. 확대층 회로는 잔류 신호(R)의 부호 및 잔류 신호(R)의 비트 플레인을 인코딩하고 스트리밍 비디오 수신기로 전송한다. 비디오 디코더는 재구성된 베이스층 변환 계수를 결정하는 베이스층 회로 및 재구성된 확대층 변환 계수를 결정하는 확대층 회로를 포함한다.

METHOD FOR REPRESENTING A SEQUENCE OF IMAGES BY 3D MODELS, SIGNAL AND DEVICES THEREOF

L'invention concerne un procédé de représentation d'une séquence d'images regroupées en ensembles d'au moins deux images successives, appelés GOPs, un modèle tridimensionnel maillé texturé étant associé à chacun desdits GOPs.Selon l'invention, le modèle tridimensionnel associé au GOP de niveau n est représenté à l'aide d'un maillage irrégulier tenant compte d'au moins un sommet d'au moins le maillage irrégulier représentant le modèle tridimensionnel associé au GOP de niveau n-1, ledit sommet étant appelé sommet commun. The invention relates to a method of representing a sequence of images grouped into sets of at least two successive images, called GOPs, a three-dimensional meshed textured model being associated with each of said GOPs. According to the invention, the associated three-dimensional model at the level n GOP is represented using an irregular mesh taking into account at least one vertex of at least the irregular mesh representing the three-dimensional model associated with the level n-1 GOP, said vertex being called the common vertex .

The method and apparatus that image is encoded/decoded using geometric modification picture

本发明涉及一种通过使用几何修改图片对视频进行编码/解码的方法和装置。根据本发明的对图像进行编码的方法包括：通过几何地修改参考图片来生成几何修改图片；以及第一预测块生成步骤，通过执行参考几何修改图片的帧间预测来生成当前块的第一预测块。

Method of representing a sequence of pictures using 3d models, and corresponding devices and signal

The invention relates to a method of representing a sequence of pictures which are grouped into sets comprising at least two successive pictures, known as groups of pictures (GOP), whereby a textured, meshed three-dimensional model is associated with each of said GOPs. According to the invention, the three-dimensional model associated with the n level GOP is represented with an irregular mesh taking account of at least one vertex of at least the irregular mesh representing the three-dimensional model that is associated with the n-1 level GOP, said vertex being known as the common vertex.

Data structure for picture transmission, picture coding method and decoding method

根据本发明,在把形状信号和结构信号作为图象信息并对包含的任意形状图象信号的编码信号进行解码的图象解码装置中,能够仅把形状信号作为图象信息进行解码,但是在编码时又不必附加模拟的结构编码比特串,而抑制代码量。本发明设置有对图象识别符的图象编码信号进行解析的数据解析器,通过形状解码部和结构解码部对任意形状编码信号进行解码处理,形状解码部对仅把形状编码比特串作为显示用数据而包含的二进制编码信号进行解码处理。

Video encoding and decoding method and device

本发明涉及一种用于视频序列压缩的编码方法，所述视频序列被分为帧组(GOF)，每一帧组借助三维(3D)小波变换被分解，所述变换在每一分解级连续包括运动补偿步骤、时间滤波步骤和空间分解步骤。运动补偿基于一个运动估计，它导致产生一些被编码的空间矢量，这些空间矢量和所涉及的空间级的编码的纹理信息一起(并就在其之前)被放在编码的位流中。运动矢量的编码操作在最低空间分辨率执行，只是在每一其它空间分辨率的所述运动矢量的精化位逐个精化位平面内地被放在被编码位流中。特定的标记被引入编码的位流，用于指示该位平面、时间分解级和空间分解级各自的结尾。根据本发明，对于每一个时间分解级，然后在编码的位流中引入另外特定的标记，用于在每一空间分解级中指示与所述空间分解级相关的运动矢量信息的结尾。这一解决方案允许在非常低的解码比特率下跳过剩余的运动信息而只解码纹理信息，或者在另一个实现中，跳过所述剩余的运动信息以及所涉及的时间级的剩余空间级。

Method and apparatus for low-complexity spatial scalable encoding

A video encoder (300) and method are disclosed, the encoder for receiving high-resolution video and providing compressed high-resolution scalable and standard-resolution bitstreams, and including a standard-resolution encoder (312), a selector (346) coupled with the standard-resolution encoder for selecting between a signal indicative of the received high-resolution sequence and a signal indicative of a standard-resolution version of the received sequence, and a high-resolution encoder (348) coupled with the selector for providing a high-resolution scalable bitstream.

A kind of multi-viewpoint three-dimensional video hierarchy encoding method and coding/decoding method

本发明提供了一种多视点立体视频分层编码方法和解码方法，其可以使解码端在进行解码时方便地抽取码流的一部分进行解码，从而实现反向兼容。

Method and device for interlayer forecasting of internal texture adaptive to macroblock

FIELD: information technologies. ^ SUBSTANCE: coders and decoders of scalable video signal are proposed, as well as appropriate methods for scalable coding and decoding of video signal. Coder of scalable video signal includes coder (100) for selective use of spatial internal forecasting for coding, at macroblock-adaptive basis, differential signal of optimisation layer, generated between macroblock of optimisation layer and appropriate macroblock of basic layer exposed to increasing digitisation. ^ EFFECT: higher efficiency of coding with interlayer forecasting of internal texture of video signal. ^ 36 cl, 8 dwg, 4 tbl РОССИЙСКАЯ ФЕДЕРАЦИЯ (19) RU (11) 2 411 689 (13) C2 (51) МПК H04N 7/34 (2006.01) ФЕДЕРАЛЬНАЯ СЛУЖБА ПО ИНТЕЛЛЕКТУАЛЬНОЙ СОБСТВЕННОСТИ, ПАТЕНТАМ И ТОВАРНЫМ ЗНАКАМ (12) ОПИСАНИЕ ИЗОБРЕТЕНИЯ К ПАТЕНТУ (21)(22) Заявка: 2008104893/09, 18.05.2006 (24) Дата начала отсчета срока действия патента: 18.05.2006 (73) Патентообладатель(и): ТОМСОН ЛАЙСЕНСИНГ (FR) R U Приоритет(ы): (30) Конвенционный приоритет: 11.07.2005 US 60/698,140 (72) Автор(ы): ИНЬ Пэн (US), БОЙС Джилл МакДональд (US), ПАНДИТ Пурвин Бибхас (US) (43) Дата публикации заявки: 20.08.2009 Бюл. № 23 2 4 1 1 6 8 9 2 4 1 1 6 8 9 R U (56) Список документов, цитированных в отчете о поиске: SUN S., FRANCOIS Е, Extended Spatial Scalability with picture-level adaptation, JOINT VIDEO TEAM (JVT) OF ISO/IEC MPEG & ITUT VCEG, JVT-O008, 15TH MEETING, Busan, 1622 April 2005, c.c.1-20. US 6493387 B1, 10.12.2002. ЕР 0644695 A2, 22.03.1995. RU 2128405 C1, 27.03.1999. YIN P. et al, Complexity Scalable Video Codec, ISO/IEC JTC1/SC29/WG11 (см. прод.) C 2 C 2 (45) Опубликовано: 10.02.2011 Бюл. № 4 (85) Дата начала рассмотрения заявки PCT на национальной фазе: 11.02.2008 (86) Заявка PCT: US 2006/019212 (18.05.2006) (87) Публикация заявки РСТ: WO 2007/008286 (18.01.2007) Адрес для переписки: 129090, Москва, ул. Б.Спасская, 25, стр.3, ООО "Юридическая фирма Городисский и Партнеры", пат.пов. Ю.Д.Кузнецову, рег.№ 595 (54) ...

Video decoding using parsed intermediate representation of video data for subsequent parallel decoding

 A video decoding apparatus comprises at least one parsing unit 130,140 configured to receive input video data 110 as an encoded video bitstream which contains sequential internal dependencies, e.g. entropy coding or motion vector dependencies in a stream encoded using the base and enhancement layer-based scalable video coding (SVC) standard. The parsing units generate an intermediate representation (intermediate format) of the input video data in which at least a subset of the sequential internal dependencies are resolved - e.g. comprising a macroblock type for each macroblock for a sequence, or a motion vector or set of transform coefficients for at least one macroblock in the sequence; intermediate representations are stored in buffers 150, 160, 170. The video decoding apparatus further comprises a reconstruction unit 180 configured to retrieve in parallel plural input streams of the intermediate representation and perform a decoding operation on the plural streams in parallel - e.g. including parallel de-quantisation, for different quality (base, enhancement) layers (see Figure 7) - to generate decoded output video data. An equivalent method, as set out in Figure 8, is also disclosed.

Video coding method

The invention, provided for an implementation, in a video encoder with base layer coding means and enhancement layer coding means, relates to a method of coding the video objects (VOs) of a sequence according to the following steps : segmentation of the sequence, and coding operation of the texture and shape of said VOs. According to a preferred embodiment, the texture coding operation itself comprises motion compensated prediction operations, during which the temporal references of the enhancement layer VO planes (VOPs) of type P or B are selected only on a temporal distance criterion, without any consideration of the layer they belong to.

Method for decoding image and apparatus using same

Method for encoding/decoding image and method for storing bit stream

本发明涉及一种用于对图像进行编/解码的方法和存储比特流的方法。对图像进行编码的方法包括：生成当前块的几何修改信息；确定几何修改标志；确定当前块的几何修改类型信息；确定指示参考几何修改信息的参考几何修改索引；基于当前块的参考几何修改信息确定当前块的预测几何修改信息；确定残留几何修改信息；通过基于当前块的参考图片和当前块的几何修改信息执行帧间预测来生成当前块的预测块；基于当前块的残差数据生成残差块；以及基于当前块的预测块和残差块对当前块进行编码；以及编码包括几何修改标志、参考几何修改索引、残留几何修改信息、几何修改类型信息的比特流，其中，几何修改信息被用于对当前块所参照的参考区域执行仿射修改。

Method and apparatus for macroblock adaptive inter-layer intra texture prediction

There are provided scalable video encoders and decoders and corresponding methods for scalable video encoding and decoding. A scalable video encoder includes an encoder (100) for selectively using spatial intra prediction to code, on a macroblock adaptive basis, an enhancement layer residue generated between an enhancement layer macroblock and a corresponding upsampled base layer macroblock.

Method and apparatus for entropy coding in fine granularity scalable video coding

A FGS entropy coding method is suitable for the case when the refinement coefficients at the FGS layer have different prediction from its base layer. When temporal prediction is used in FGS layer coding and the refinement coefficients at the FGS layer have different prediction from its base layer, drift problem may be caused if the FGS layer is partially decoded. Such drift problem may significantly affect coding performance. This new FGS entropy coding method that can solve or greatly alleviate such drift effect and therefore improve coding performance. Three different FGS methods can be used: FGS entropy coding based on spatial frequency location; FGS entropy coding for decoder oriented two-loop structure; and FGS entropy coding with block-confined coding pass.

File and folder structure for layered compressed image sequences

Systems, methods, and computer programs for high quality wide-range multi-layer image compression coding, including consistent ubiquitous use of floating point values in essentially all computations; an adjustable floating-point deadband; use of an optimal hand-split filter; use of entire SNR layers at lower resolution levels; targeting of specific SNR layers to specific quality improvements; concentration of coding bits in regions of interest in targeted band-split and SNR layers; use of statically-assigned targets for high-pass and/or for SNR layers; improved SNR by using a lower quantization value for regions of an image showing a higher compression coding error; application of non-linear functions of color when computing difference values when creating an SNR layer; use of liner overall quantization at lower resolution levels with regional quantization scaling; removal of source image noise before motion-compensated compression or film steadying; use of one or more full-range low bands; use of alternate quantization control images for SNR bands and other high resolution enhancing bands; application of lossless variable-length coding using adaptive regions; use of a folder and file structure for layers of bits; and a method of inserting new intra frames by counting the number of bits needed for a motion compensated frame.

Image Encoding Device, Image Encoding Method, Image Decoding Device and Image Decoding Method

효과적인 랜덤 억세스가 가능해진다. 1초의 정밀도내에서 부호화 시작 절대 시간이 배열된 비디오 평면의 그룹(GOV)층은 부호화 비트열의 층으로 제공된다. GOV층은 부호화 비트열의 헤드(head) 뿐만 아니라 부호화 비트열내의 임의의 위치에 삽입될 수 있다. GOV층을 구성하는 각 화상 객체 평면(VOP)의 디스플레이 시간은 부호화 시작 절대 시간을 표준으로 하여 초의 단위로 절대 시간을 나타내는 modulo_time_base와, modulo_time_base에 의해 나타내지는 시간(동기화 시점) 이래로 경과된 시간을 ms(millisecond)의 단위로 나타내는 VOP_time_increment로 표시된다. Effective random access is possible. A group (GOV) layer of the video plane in which the encoding start absolute time is arranged within a precision of 1 second is provided as a layer of encoded bit strings. The GOV layer may be inserted at any position within the encoded bit string as well as the head of the encoded bit string. The display time of each image object plane (VOP) constituting the GOV layer is ms in which the elapsed time since modulo_time_base representing the absolute time in seconds and the time indicated by the modulo_time_base (synchronization time), based on the absolute time of encoding start, are ms. It is represented by VOP_time_increment expressed in units of milliseconds.

Hierarchical coded data distribution apparatus and method

Method and device for video scene composition

The invention relates to a cost-effective and optimized method of composing a scene content from digital video data streams containing video objects, said method comprising a decoding step for generating decoded object frames from said digital video data streams, and a rendering step for composing intermediate-composed frames in a composition buffer from said decoded object frames. The method of scene composition according to the invention comprises a scaling step applied to said intermediate-composed frames for generating output frames constituting scene content. Indeed, by performing a scaling step on intermediate-composed frames of the final scene, enlarged frames are obtained in a single processing step, which considerably reduces the computational load. The use of a signal co-processor for the scaling step provides a possibility of anticipating simultaneously the decoding of objects, performed by a signal processor, used in the composition of the future intermediate-composed frame. Use : Video scene compositor

System and method for video encoding and decoding using sub-vectors

A video coding method comprises dividing a coefficient vector into two or more sub-vectors, each sub-vector having a length less than or equal to a length of the coefficient vector, indicating a size of each sub-vector and a position of each sub-vector within the coefficient vector, and forming a block corresponding to each sub-vector.

Methods of coding the order information for multiple-layer vertices

A method for coding multiple layer, vertex-based shape representation and bit stream scalable shape includes selecting vertices in a hierarchical scheme; defining multiple layers of vertices; arranging M layers of vertices in order, from the most salient layer to the least salient layer; placing vertices in their natural order along their image contour within each layer; storing vertices from each layer separately; and recording vertex order information for each vertex in each layer of vertices. Four variations of the method for multiple layer vertex representation and coding are disclosed where the correct order information is coded for correct reconstruction of the shape information.

Transmitting device and transmitting method, receiving device and receiving method, transmitting/receiving device and transmitting/receiving method, recorded medium, and signal

From the transmission side, a background and objects (#1 to #3) both constituting an image are transmitted at a transmission rate R/4. On the receiving side, the image is displayed with a spatial resolution and a temporal resolution. When the object (#1) is dragged at time t1 on the receiving side, the transmission of the background and objects (#2 and #3) is stopped on the transmission side and only the object (#1) is transmitted at all the transmission rates R, as shown in Figure 16(A). Thus, on the receiving side, the image including the object (#1) being dragged is displayed with an improved spatial resolution for the object (#1) by sacrificing the temporal resolution of the image.

Image encoding device, image encoding method, image decoding device and image decoding method

A coded bit stream 30 generated on a coding side consists of a VO header 30a, a VOL header 30b, a GOV header 30c, a VOP header 30d and VOP data 30e, and the VOL header 30b multiplexes an object intra-coded indicator signal 7' indicating whether all the VOP data 30e contained in a VOL or GOV are intra coded or not. This enables a decoding side to recognize whether all the VOP data 30e contained in the VOL or GOV in the coded bit stream 30 are intra coded or not by only analyzing the object intra-coded indicator signal 7'. This can facilitate such processings as frame skip control or random access of the VOPs.

Image coding apparatus

A coded bit stream 30 generated on a coding side consists of a VO header 30a, a VOL header 30b, a GOV header 30c, a VOP header 30d andVOPdata30e, and the VOL header 30bmultiplexes an object intra-coded indicator signal 7' indicating whether all the VOP data 30e contained in a VOL or GOV are intra coded or not. This enables a decoding side to recognize whether all the VOP data 30e contained in the VOL or GOV in the coded bit stream 30 are intra coded or not by only analyzing the object intra-coded indicator signal 7'. This can facilitate such processings as frame skip control or random access of the VOPs. <IMAGE>

Method for determinating local time base of video picture object plane

公开了一种埋置于压缩数据中的局部时基编码方法。局部时基被编成两部分码。第一部分有一表示基准时基中的特定间隙的模数时基,而第二部分有一相对于基准时间的时基增量。采用了两种时基增量形式使得有可能有不同的编码顺序和显示顺序。还描述了带有局部时基的多个压缩流的同步机构。还采用了一种时基补偿机构,使得能够进行更精细粒度的多个压缩流的同步。

Method and system for improving weak selector signal of mixed raster signal

Image processing method and apparatus

Water ring scanning apparatus and method, and apparatus and method for encoding/decoding video sequences using the same

A water ring scanning apparatus and method, and an apparatus and method for encoding/decoding video sequences using the same are disclosed. A water ring scanning apparatus includes: a preferential scan unit for scanning information on a water ring origin point (water_ring( 0 )) in an image frame, which is a most significant bit of the image frame to be preferentially scanned; a scan location decision unit for deciding a location of i_th generated water ring (water_ring(i)), which is a rectangular-shape ring surrounding the water ring origin point; and a scan unit for scanning information on the location of the i_th generated water ring.

Method for stamping display time of multiple video object image and synchronization method

公开了一种埋置于压缩数据中的局部时基编码方法。局部时基被编成两部分码。第一部分有一表示基准时基中的特定间隙的模数时基，而第二部分有一相对于基准时间的时基增量。采用了两种时基增量形式使得有可能有不同的编码顺序和显示顺序。还描述了带有局部时基的多个压缩流的同步机构。还采用了一种时基补偿机构，使得能够进行更精细粒度的多个压缩流的同步。

System and method for video encoding and decoding using sub-vectors

A video coding method comprises dividing a coefficient vector into two or more sub-vectors, each sub-vector having a length less than or equal to a length of the coefficient vector, indicating a size of each sub-vector and a position of each sub-vector within the coefficient vector, and forming a block corresponding to each sub-vector.

Scene composition and contents creation apparatus and method of real panoramic contents for multiuser supporting

1. 청구범위에 기재된 발명이 속한 기술분야 본 발명은 사용자 공유를 위한 실사 파노라믹 콘텐츠의 장면 저작/콘텐츠 생성 장치 및 그 방법에 관한 것임. 2. 발명이 해결하려고 하는 기술적 과제 본 발명은 실사 파노라믹 콘텐츠의 장면을 저작(구성)하고 그 화면 내에 서브(sub) 콘텐츠를 추가 배치한 후에 객체 부호화하여 실사 파노라믹 콘텐츠를 생성함으로써, 일반적인 그래픽 영상이 아닌 실사 파노라믹 콘텐츠를 복수 사용자가 공유할 수 있도록 하기 위한, 사용자 공유를 위한 실사 파노라믹 콘텐츠의 장면 저작/콘텐츠 생성 장치 및 그 방법을 제공하는데 그 목적이 있음. 3. 발명의 해결방법의 요지 본 발명은, 사용자 공유를 위한 실사 파노라믹 콘텐츠의 장면 저작/콘텐츠 생성 장치에 있어서, 서브(sub) 콘텐츠의 장면을 저작(구성)하기 위한 서브 콘텐츠 장면 저작 수단; 상기 서브 콘텐츠 장면 저작 수단에서 저작한 서브(sub) 콘텐츠를 이용하여 실사 메인 파노라믹 콘텐츠에 접근하기 위한 서브(sub) 콘텐츠를 생성하기 위한 서브 콘텐츠 생성 수단; 실사 파노라믹 영상을 이용하여 실사 메인 파노라믹 콘텐츠의 장면을 저작(구성)하기 위한 실사 메인 파노라믹 콘텐츠 장면 저작 수단; 상기 실사 메인 파노라믹 콘텐츠 장면 저작 수단에서 저작하는 실사 메인 파노라믹 콘텐츠의 장면 내에 상기 서브 콘텐츠 생성 수단에서 생성한 서브(sub) 콘텐 츠를 서브(sub) 장면으로 추가하여 배치하기 위한 콘텐츠 배치 수단; 및 상기 콘텐츠 배치 수단에서 배치한 두 콘텐츠 간의 관계를 설정하고 각각 별도로 부호화하여 실사 파노라믹 콘텐츠를 생성하기 위한 실사 파노라믹 콘텐츠 생성 수단을 포함함. 4. 발명의 중요한 용도 본 발명은 화상 회의 또는 원격 탐사 또는 기타 실사 파노라믹 영상을 이용한 가상체험 등에 이용됨. 실사 파노라믹 콘텐츠, 서브 콘텐츠, 내부 배치, 객체 부호화, 파노라믹 콘텐츠 공유

Method for encoding/decoding image

本发明涉及一种用于对图像进行编/解码的方法。对图像进行解码的方法包括：接收包括分别对应于多个参考图片的多个标志语法元素的比特流；如果标志语法元素指示比特流包括对应于标志语法元素的参考图片的全局几何修改信息，则从比特流读取与对应于标志语法元素的参考图片相关联的全局几何修改信息语法元素；基于对应于标志语法元素的参考图片的几何修改信息语法元素来重构对应于标志语法元素的参考图片的几何修改信息；基于对应于标志语法元素的参考图片的所重构的几何修改信息来几何地修改对应于标志语法元素的参考图片；基于几何地修改后的参考图片通过帧间预测来生成预测块；以及基于残差块和预测块来重构当前图片。

Support of non-HEVC base layer in HEVC multi-layer extensions

An apparatus configured to decode video information includes a memory and a processor in communication with the memory. The memory is configured to store video information associated with a bitstream. The apparatus further includes a processor in communication with the memory, the processor configured to determine that a reference layer is not included in the bitstream. The processor is further configured to receive, from an external source, a decoded base layer picture associated with an access unit, to store the decoded base layer picture in a memory. The processor is further configured to decode pictures associated with the access unit based on the stored decoded base layer picture, and subsequent to decoding the pictures associated with the access unit, empty the decoded base layer picture from the memory.

Image encoder, image encoding method, image decoder, image decoding method, and distribution media

Recording method, data reproducting apparatus and method

本发明提供一种记录方法、数据再生装置及数据再生方法。该记录方法是向信息记录媒体的记录方法，包括将流记录到信息记录媒体中的记录步骤，该流具有多个访问单元，且至少包含图像及声音中的某一个；在上述记录步骤中，如下地将上述流记录到上述记录媒体中：上述访问单元具有：包含基本数据的第1数据包、以及包含与上述基本数据相关联的扩展数据的第2数据包；上述基本数据是，不需要上述扩展数据就可以解码成完全的状态的数据，上述扩展数据是，用于提高由上述基本数据所生成的数据的质量的数据；上述流具有示出上述第1数据包及上述第2数据包的属性的信息。

Picture coding device, picture coding method,picture decoding device, picture decoding method, and providing medium

Efficient random access is made possible. A group of video plane (GOV) layers in which encoding start absolute time is arranged to be within an accuracy of a second is provided as the layer of a coded bit stream. The GOV layer can be inserted not only at the head of the coded bit stream but at an arbitrary position in the coded bit stream. The display time of each video object plane (VOP) constituting the GOV layer is represented by modulo_time_base which represents absolute time in the unit of a second with the encoding start absolute time as standard and VOP_time_increment which represents in the unit of a millisecond the time that has elapsed since time (synchronization point) indicated by the modulo_time_base. <IMAGE>

Temporal motion constrained sub-picture indication in video coding

本发明公开了一种视频译码机制。所述机制包括：接收码流，所述码流包括参数集和通过对图像进行分割获得的一个或多个子图像；对所述参数集进行解析，获得表示当前子图像是时间运动约束子图像的标志；根据所述标志，独立于所述图像，从所述码流中提取所述当前子图像；对所述当前子图像进行解码，以产生视频序列；发送所述视频序列，以用于显示。

Information recording medium, data discrimination device, and data reproduction device

The present invention provides an information recording medium in which an access unit including basic data and extension data is recorded, so as to allow a decoder that decodes only basic data to process the access unit which includes the basic data and the extension data for the next generation. The information recording medium is an information recording medium on which a stream is recorded, the stream having plural access units and including at least one of video and audio, wherein each of the access units has a first packet which includes basic data and a second packet which includes extension data related to the basic data; the basic data is data that can be decoded into a completed state without requiring the extension data, and the extension data is data for improving the quality of data generated from the basic data; and a size of the first packet is less than or equal to a predetermined size.