Low complexity enhancement video coding

A bitstream for transmitting one or more enhancement residuals planes suitable to be added to a set of preliminary pictures obtained from a decoder reconstructed video, comprises a decoder configuration for controlling a decoding process of the bitstream, and encoded enhancement data comprising encoded residual data representing differences between a reference video frame and a decoded version of the video frame (as per LCEVC / MPEG 5). The decoder configuration comprises scaling mode parameter(s), wherein each scaling mode parameter indicates a transform matrix that should be used for decoding coefficient groups of transform coefficients. The enhancement coding may operate on top of a base layer, which may provide base encoding and decoding. Spatial scaling may be applied across different layers. Only the base layer encodes full video, which may be at a lower resolution. The enhancement coding instead operates on computed sets of residuals. The sets of residuals are computed for layers ...

Quantization of residuals in video coding

A method of encoding an input signal is provided, the method comprising: quantizing a set of data based on temporal information associated with said set of data.

System and method for performing object analysis

There is provided a system that, when in operation, classifies one or more elements within an input signal, wherein the system: receives a compressed version of the input signal, wherein the compressed version comprises at least two sets of compressed data in a hierarchy, wherein each set of compressed data, when decoded, enables the signal to be reconstructed up to a respective level of quality; decodes the compressed version of the signal up to a first level of quality by decoding a first set of compressed data to generate a first reconstructed signal; performs a first classification operation on the first reconstructed signal; decodes the compressed version of the signal up to a second level of quality by decoding a second set of compressed data to generate a second reconstructed signal; and performs one or more second classification operations on the second reconstructed signal.

Use of tiered hierarchical coding for point cloud compression

A method of encoding a three-dimensional point cloud. The method comprising: obtaining a set of points within the three-dimensional point cloud, a point within the set of points having a co-ordinate in three-dimensions; converting the points into a two-dimensional representation, wherein, for a point within the set of points, information describing the co-ordinate is represented as a location within the two-dimensional representation and a value at the location; and encoding the two-dimensional representation using a tier-based hierarchical coding format to output encoded data, wherein the tier-based hierarchical coding format encodes the two- dimensional representation as a plurality of layers, the plurality of layers representing echelons of data used to progressively reconstruct the signal at different levels of quality.

Low complexity enhancement video coding

Examples of a low complexity enhancement video coding are described. The claimed invention relates to a bitstream for transmitting one or more enhancement residuals planes to be added to a set of preliminary pictures that are obtained from a decoder reconstructed video. The application is to a bitstream comprising a decoder configuration for controlling a decoding process of the bitstream. The decoder configuration comprises a no-enhancement variable to indicate if the bitstream comprises enhancement data for a respective frame, wherein a first value of the no-enhancement variable indicates that the bitstream comprises enhancement data for a respective frame, and a second value of the no-enhancement variable indicates that the bitstream comprises no enhancement data for the respective frame. A related decoding process is also claimed.

Modified upsampling for video coding technology

A first level encoded stream is received and decoded to derive a first set of residuals. A first output video comprising an output of a base decoder applied to a base level encoded stream is received. The first set of residuals is combined with the first output video to generate a second output video. The second output video is up-sampled to generate an up-sampled second output video. The up-sampling comprises adding a value derived from an element in the first set of residuals from which a block in the up-sampled second output video was derived to the block in the up-sampled second output video. A second level encoded stream is received and decoded to derive a second set of residuals. The second set of residuals is combined with the up-sampled second output video to generate a reconstructed output video.

Low complexity enhancement video coding

Examples of a low complexity enhancement video coding are described. The claimed invention relates to a bitstream for transmitting one or more enhancement residuals planes to be added to a set of preliminary pictures that are obtained from a decoder reconstructed video. The application is to a decoder configuration for controlling a decoding process of the bitstream wherein the decoder configuration comprises a variable temporal_enabled which indicates whether to invoke, during the decoding process, a temporal prediction process comprising invoking a temporal prediction process to obtain an array of temporally predicted residuals, adding the array of temporally predicted residuals to an array of residuals obtained after a transform process is invoked to obtain a combined array and storing the combined array to a temporal buffer. A related decoding process is also claimed.

Low complexity enhancement video coding

A bitstream for transmitting enhancement residuals plane(s) suitable to be added to a set of preliminary pictures obtained from a decoder reconstructed video, comprises a decoder configuration for controlling a bitstream decoding process, and encoded enhancement data comprising encoded residual data representing differences between a reference video frame and a decoded version of the video frame (as per LCEVC / MPEG 5). The decoder configuration comprises a transform_type variable, wherein a value of the transform_type variable indicates a type of transform to be applied to transform coefficients in the decoding process. The enhancement coding may operate on top of a base layer, which may provide base encoding and decoding. Spatial scaling may be applied across different layers. Only the base layer encodes full video, which may be at a lower resolution. The enhancement coding instead operates on computed sets of residuals. The sets of residuals are computed for layers, which may represent ...

Temporal signalling for video coding technology

An encoder configured to: receive an input video comprising frames, each frame being divided into tiles and each tile being divided into blocks, generate a base stream using a base encoder, determine a temporal mode for enhancement streams for reconstructing the input video together with the base stream, generate the enhancement streams based on data derived from the base stream and the input video according to the determined temporal mode, and assign a value to a block-based temporal parameter indicating the temporal mode for the block of the video and the tiles comprising the block, wherein the temporal mode is one of a first temporal mode that does not apply non-zero values from a temporal buffer, and a second temporal mode that does apply non-zero values from the temporal buffer, wherein generating the further encoded enhancement streams comprises applying a transform to the blocks, and wherein the temporal mode is determined for a frame of the input video. Also disclosed is a decoder ...

Low complexity enhancement video coding

Examples of a low complexity enhancement video coding (LCEVC) are described. The claimed invention relates to a bitstream for transmitting one or more enhancement residuals planes to be added to a set of preliminary pictures that are obtained from a decoder reconstructed video. The application is to a decoder configuration for controlling a decoding process of the bitstream wherein the decoder configuration comprises a variable tile_dimension_type which indicates the enhancement data comprises tiles. Preferably the variable also indicates that there are no tiles. Preferably the enhancement data comprises surfaces, each surface corresponding to a colour plane, an enhancement sub-layer and a transform coefficient. Further parameters indicate how encoded data in a surface is encoded, the size of a surface, how a decoding process should derive an address of a beginning of the surface in the bitstream. Preferably the tiles correspond to rectangular regions of the video frame.

Use of hierarchical video and image coding for telepresence

Medical telepresence system, comprising: receiving plurality of data feeds from live medical procedure, at least one data feed comprising video signal; hierarchical encoder to encode plurality of data feeds using first hierarchical data coding scheme; transcoder to convert first tier-based hierarchical data coding scheme to second tier-based hierarchical data coding stream; recorder for storing output of hierarchical encoder as set of tier-based files, each representing different levels of quality. First hierarchical encoded data decodable by first set of computing devices, connected by first network connection, for viewing; second tier-based hierarchical data coding stream receivable at second set of computing devices, connected by second lower quality network connection. Encoded data from one of first and second tier-based hierarchical data coding scheme may be selected based on one or more: location; network connection; properties of computing device. The crux of the invention is using ...

Video encoding using pre-processing

MPEG-5 Part 2 Low Complexity Enhancement Video Coding (LCEVC) or SMPTE VC-6 2117, types of hierarchical encoding, in conjunction with entropy encoding, i.e. Huffman coding or run length encoding (RLE). Video encoding, comprising: pre-processing 830, 830’ input video using: blurring filter 810, 810’; sharpening filter 815, 815’; down-sampling 605, 1105, 820 input video 600 from first spatial resolution, to second, lower, spatial resolution; encoding 613, 615, 621 signals derived from input video stream at first spatial resolution 805 and second spatial resolution 825. Signal encoding, comprising: plurality of neural network layers, communicatively coupled in series, each receiving input-derived-data, applies set of weights, and applies differentiable non-linear activation function; down-sampler converts neural network layer output-derived-data from first sampling resolution to second, lower, sampling resolution; interface provides down-sampler output-derived-data to base encoder operating ...

Temporal signalling for video coding technology

An encoder configured to receive an input video comprising respective frames, each frame being divided into a plurality of tiles and each tile being divided into a plurality of blocks. The encoder is configured to generate a base encoded stream using a base encoder, determine a temporal mode for one or more further encoded enhancement streams generated using an enhancement encoder and generate the one or more further encoded enhancement streams according to the determined temporal mode. The temporal mode is either a first temporal mode that does not apply non-zero values from a temporal buffer or a second temporal mode that does apply non-zero values from the temporal buffer. Generating the one or more further encoded enhancement streams comprises applying a transform to each of a series of blocks. The temporal mode is determined for one or more of a frame, tile or block.

Low complexity enhancement video coding

Examples of a low complexity enhancement video coding are described. The claimed invention relates to a bitstream for transmitting one or more enhancement residuals planes to be added to a set of preliminary pictures that are obtained from a decoder reconstructed video. The application is to a decoder configuration for controlling a decoding process of the bitstream wherein the decoder configuration comprises a variable the first value of which indicates the bitstream does not comprise a temporal signalling coefficient group and a second value of which indicates the bitstream comprises the temporal signalling coefficient group. A related decoding process is also claimed.

Adaptive content delivery network

A server 200 for providing digital video content to a video client, the server 200 being configured to: receive digital video content from a content delivery network 100, the digital video content being in a delivery format of the content delivery network (CDN) 100; convert the digital video content from the delivery format of the content delivery network 100 to provide the digital video content in a playback format of a video client requesting the digital video content; output the digital video content in the playback format for the video client. A corresponding method is also claimed. Preferably, the server receives video from a CDN edge server 120, 130, 140 and converts the video to a hierarchical or scalable video format comprising a base layer and one or more enhancement layers E1, E2. If the client can decode the hierarchical video, a base layer alone or a base layer and one or more enhancement layers may be delivered to the client 310, 320. Otherwise one or more layers may be transcoded ...

Low complexity enhancement video coding

Examples of a low complexity enhancement video coding are described. The claimed invention relates to a bitstream for transmitting one or more enhancement residuals planes to be added to a set of preliminary pictures that are obtained from a decoder reconstructed video. The application is to bitstream for transmitting one or more enhancement residuals planes suitable to be added to a set of preliminary pictures obtained from a decoder reconstructed video, comprising: a decoder configuration for controlling a decoding process of the bitstream and encoded enhancement data comprising encoded residual data representing differences between a reference video frame and a decoded version of the video frame, wherein the decoder configuration comprises a variable which indicates a mode of operation for generating and using one or more quantization matrices. A related decoding process is also claimed.

Low complexity enhancement video coding

A bitstream for transmitting enhancement residuals planes to be added 2430 to pictures obtained from a decoder reconstructed video 2416, comprising encoded enhancement data 2422 and a decoder configuration 2404 comprising a first flag indicating whether encoded data is sent on a frame basis or a field basis. A frame-basis may comprise frames generated by a progressive or interlaced encoding mode and a field basis may comprise frames generated by an interlaced encoding mode. The first flag may indicate that the bitstream comprises a second flag indicating a specific field, such as a top or bottom field. The flags may be signalled as part of the payload in the bitstream at a frequency of one per instantaneous decoder refresh (IDR) picture. Also disclosed is a method of decoding the bitstream.. Also disclosed is a method of decoding the bitstream.

Low complexity enhancement video coding

Examples of a low complexity enhancement video coding are described. The claimed invention relates to a bitstream for transmitting one or more enhancement residuals planes to be added to a set of preliminary pictures that are obtained from a decoder reconstructed video. The application is to bitstream for transmitting one or more enhancement residuals planes suitable to be added to a set of preliminary pictures obtained from a decoder reconstructed video, comprising: a decoder configuration for controlling a decoding process of the bitstream and encoded enhancement data comprising encoded residual data representing differences between a reference video frame and a decoded version of the video frame, wherein the decoder configuration comprises: a first dither control variable dithering control flag which indicates whether dithering should be applied during the decoding process. A related decoding process is also claimed.

Low complexity enhancement video coding

A bitstream for transmitting enhancement residuals planes to be added 2430 to pictures obtained from a decoder reconstructed video 2416, comprising encoded enhancement data 2422 comprising residual data representing the differences between a reference video frame and decoded video frame, and a decoder configuration 2404 comprising scaling mode parameters indicating whether respective upsampling modes should be used when decoding 2423 the encoded data. The parameters may indicate that no upsampling is used, that upscaling in a first direction is used, or that upscaling in the first and a second direction is used. Each enhancement layer of a hierarchical coding scheme may comprise respective scaling parameters. The flags may be signalled as part of the payload in the bitstream at a frequency of one per instantaneous decoder refresh (IDR) picture. Also disclosed is a method of decoding the bitstream.

Temporal processing for video coding technology

A decoder (400) configured to receive a first output video and one or more further encoded streams (416, 428), decode respective frames of the one or more further encoded streams to derive respective sets of residuals; and combine (470) the sets of residuals with the first output video to generate a reconstructed output video (448). Each frame is divided into a plurality of tiles and each tile is divided into a plurality of blocks. To decode respective frames, the decoder is configured to obtain (440, 446) a preliminary set of residuals from the one or more further encoded streams, derive a set of temporal predictions using a temporal buffer (432), and combine (468) the set of temporal predictions with the preliminary set of residuals. The decoder is configured to provide for zeroing of values of the set of temporal predictions at a frame level, at a tile level and at a block level.

Temporal signalling for video coding technology

An encoder (300) configured to receive an input video (302) comprising respective frames, each frame being divided into a plurality of tiles and each tile being divided into a plurality of blocks. The encoder is configured to generate a base encoded stream (310) using a base encoder (306), determine (334) a temporal mode for one or more further encoded enhancement streams (328) generated using an enhancement encoder and generate the one or more further encoded enhancement streams (328) according to the determined temporal mode. The temporal mode is either a first temporal mode that does not apply non-zero values from a temporal buffer or a second temporal mode that does apply non-zero values from the temporal buffer (332). Generating the one or more further encoded enhancement streams comprises applying a transform (348) to each of a series of blocks. The temporal mode is determined for one or more of a frame, tile or block.

Low complexity enhancement video coding

Examples of a low complexity enhancement video coding are described. Encoding and decoding methods are described, as well as corresponding encoders and decoders. The enhancement coding may operate on top of a base layer, which may provide base encoding and decoding. Spatial scaling may be applied across different layers. Only the base layer encodes full video, which may be at a lower resolution. The enhancement coding instead operates on computed sets of residuals. The sets of residuals are computed for a plurality of layers, which may represent different levels of scaling in one or more dimensions. A number of encoding and decoding components or tools are described, which may involve the application of transformations, quantization, entropy encoding and temporal buffering. At an example decoder, an encoded base stream and one or more encoded enhancement streams may be independently decoded and combined to reconstruct an original video.

Low complexity enhancement video coding

Examples of a low complexity enhancement video coding are described. The claimed invention relates to a bitstream for transmitting one or more enhancement residuals planes to be added to a set of preliminary pictures that are obtained from a decoder reconstructed video. The application is to a decoder configuration for controlling a decoding process of the bitstream wherein the decoder configuration comprises a variable temporal refresh bit which indicates an intermediate array for storing values during the decoding process should be refreshed for a respective frame by replacing a first set of values with a second set of values. A related decoding process is also claimed.

Low complexity enhancement video coding

Examples of a low complexity enhancement video coding are described. The claimed invention relates to a bitstream for transmitting one or more enhancement residuals planes to be added to a set of preliminary pictures that are obtained from a decoder reconstructed video. The application is to a decoder configuration for controlling a decoding process of the bitstream wherein the decoder configuration comprises a signalling flag which indicates whether temporal tile prediction should be used by the decoding process for a tile of a frame. A related decoding process is also claimed.

Low complexity enhancement video coding

Examples of a low complexity enhancement video coding are described. The claimed invention relates to a bitstream for transmitting one or more enhancement residuals planes to be added to a set of preliminary pictures that are obtained from a decoder reconstructed video. The application is to a decoder configuration for controlling a decoding process of the bitstream comprising a no-enhancement variable, a first value of which indicates the decoder configuration further comprises a first set of picture configuration variables for controlling a decoding process for a respective frame and a second value of which indicates the decoder configuration comprises a second set of picture configuration variables for controlling a decoding process of the bitstream when enhancement data for the respective frame is not to be used with the second set of picture configuration variables being different to the first set of picture configuration variables. A related decoding process is also claimed.

Temporal signalling for video coding technology

Quantization of residuals in video coding

Quantization of residuals in video coding

According to aspects of the invention there is provided a method of encoding an input video into a plurality of encoded streams, wherein the encoded streams may be combined to reconstruct the input video. There may be provided an encoding method comprising: receiving an input video; downsampling the input video to create a downsampled video; instructing an encoding of the downsampled video using a base encoder to create a base encoded stream; instructing a decoding of the base encoded stream using a base decoder to generate a reconstructed video; comparing the reconstructed video to the downsampled video to create a first set of residuals; and, encoding the first set of residuals to create a first level encoded stream, including: applying a transform to the first set of residuals to create a first set of coefficients; applying a quantization operation to the first set of coefficients to create a first set of quantized coefficients; and applying an encoding operation to the first set of ...

Use of hierarchical video and image coding for telepresence

Residual filtering in signal enhancement coding

According to aspects of the invention there is provided a method of encoding an input signal, the method comprising: producing a base encoded signal by feeding an encoder with a downsampled version of an input signal; producing a first residual signal by: obtaining a decoded version of the base encoded signal; and using a difference between the decoded version of the base encoded signal and the downsampled version of the input signal to produce a first residual signal; encoding the first residual signal to produce a first encoded residual signal; producing a second residual signal by: decoding the first encoded residual signal to produce a first decoded residual signal; filtering the first decoded residual signal to produce a filtered version of the first decoded residual signal; correcting the decoded version of the base encoded signal using the filtered version of the first decoded residual signal to create a corrected decoded version; upsampling the corrected decoded version; and using ...

Temporal processing for video coding technology

A video decoder configured to receive a first output video and one or more encoded streams, decode respective frames of the encoded streams to derive respective sets of residuals; and combine the sets of residuals with the first output video to generate a reconstructed output video. Each frame is divided into a plurality of tiles and each tile is divided into a plurality of blocks. To decode respective frames, the decoder is configured to obtain a preliminary set of residuals from the one or more further encoded streams, derive a set of temporal predictions using a temporal buffer 432, and combine the set of temporal predictions with the preliminary set of residuals. The decoder is configured to clear or zero a buffer of values of the set of temporal predictions at a frame level, at a tile level and at a block level. At the tile level, in embodiments the tile refresh is signalled using a syntax element associated to a specific block in the tile. The decoder in embodiments conforms to the ...

Low latency communication system and method of operation

A system 100 that encodes an input signal provided to an encoder 150 to provide corresponding encoded data (e.g., in a tiled or hierarchical layer manner, conforming to a LCEVC or VC-6 standard), wherein the encoded data is communicated via a data communication network 140 to at least one decoder 160. The system is characterized in that the encoder 150 computes and encodes at least one portion or at least one lower resolution layer of the encoded data and communicates the at least one portion or at least one lower resolution (base) layer (300, 400, Figure 3) to the decoder 160 concurrently as the encoder 150 computes and encodes at least one other portion or at least one higher resolution (enhancement) layer (310, 410) of the encoded data for later communication to the at least one decoder 160, so that the encoder 150 and the at least one decoder 160 function temporally concurrently when processing a given image frame included in the input signal. The encoded data may include metadata dynamically ...

Residual filtering in signal enhancement coding

According to aspects of the invention there is provided a method of encoding an input signal, the method comprising: producing a base encoded signal by feeding an encoder with a downsampled version of an input signal; producing a first residual signal by: obtaining a decoded version of the base encoded signal; and using a difference between the decoded version of the base encoded signal and the downsampled version of the input signal to produce a first residual signal; encoding the first residual signal to produce a first encoded residual signal; producing a second residual signal by: decoding the first encoded residual signal to produce a first decoded residual signal; filtering the first decoded residual signal to produce a filtered version of the first decoded residual signal; correcting the decoded version of the base encoded signal using the filtered version of the first decoded residual signal to create a corrected decoded version; upsampling the corrected decoded version; and using ...

Low complexity enhancement video coding

Examples of a low complexity enhancement video coding are described. The claimed invention relates to a bitstream for transmitting one or more enhancement residuals planes to be added to a set of preliminary pictures that are obtained from a decoder reconstructed video. The application is to bitstream for transmitting one or more enhancement residuals planes suitable to be added to a set of preliminary pictures obtained from a decoder reconstructed video, comprising: a decoder configuration for controlling a decoding process of the bitstream and encoded enhancement data comprising encoded residual data representing differences between a reference video frame and a decoded version of the video frame. The encoded enhancement data is comprised in one or more payloads with each payload comprising a first flag indicating how a portion of the payload is encoded. A related decoding process is also claimed.

Low complexity enhancement video coding

Examples of a low complexity enhancement video coding (LCEVC) are described. The claimed invention relates to a bitstream for transmitting one or more enhancement residuals planes to be added to a set of preliminary pictures that are obtained from a decoder reconstructed video. The application is to a decoder configuration for controlling a decoding process of the bitstream wherein the decoder configuration comprises a variable resolution_type which specifies a resolution of the one or more enhancement residual planes. Preferably the resolution of a luma plane is specified. Preferably the bitstream comprises a further variable, chroma_sampling_type, which indicates a chroma format and wherein the resolution_type further indicates a resolution of a chroma plane.

Quantization of residuals in video coding

Low complexity enhancement video coding

Exchanging information in hierarchical video coding

According to an aspect of the invention there may be provided a method of encoding a stream of data, the method comprising: receiving an input signal; applying a first encoding operation on the input signal using a first codec to generate a first encoded stream; and, applying a second encoding operation on the input signal to generate a second encoded stream, wherein the first and second encoded streams are for combination at a decoder; and wherein the method further comprises exchanging information between the first encoding operation and the second encoding operation. A method of decoding, an encoder, decoder and computer readable medium are also provided.

Low complexity enhancement video coding

A bitstream for transmitting enhancement residuals planes to be added 2430 to pictures obtained from a decoder reconstructed video 2416, comprising encoded enhancement data 2422 and a decoder configuration 2404 comprising a first flag indicating whether the decoding process 2400 should use deblocking filtering 2426 when decoding 2423 encoded residuals in a first enhancement layer 2420 of a hierarchical coding scheme. The bitstream may comprise a second flag indicating whether the bitstream further comprises third and fourth flags indicating the coefficients of the filter. The filter may be a 4x4 weighted mask. The flags may be signalled as part of the payload in the bitstream at a frequency of one per instantaneous decoder refresh (IDR) picture. Also disclosed is a method of decoding the bitstream.

Temporal processing for video coding technology

Distributed analysis of a multi-layer signal encoding

A method comprising: encoding, at a first location, a plurality of video camera feeds using a layer-based encoding. This is followed by generating encoded data streams for each of a plurality of layers within the layer-based encoding, wherein different layers in the plurality of layers corresponds to different levels of quality. In a preferred embodiment the levels of quality being spatial resolutions. Transmitting, to a second location remote from the first location, encoded data streams for one or more lowest layers for the plurality of video camera feeds. This is followed by decoding, at the second location, the encoded data streams to generate a set of reconstructions of the plurality of video camera feeds at a first spatial resolution and applying one or more video analysis functions to the set of reconstructions to identify one or more video camera feeds for further analysis. In a preferred embodiment it identifies regions of interest (ROI). This is followed by a request for further ...

Low complexity enhancement video coding

Examples of a low complexity enhancement video coding are described. Encoding and decoding methods are described, as well as corresponding encoders and decoders. The claimed invention relates to a bitstream for transmitting one or more enhancement residuals planes to be added to a set of preliminary pictures that are obtained from a decoder reconstructed video. The bitstream comprises a stream of network abstraction layer, NAL, units, each comprising a unit header and one or more data blocks, the data blocks of the NAL units including one or more data blocks comprising decoder configuration information for controlling a decoding process and one or more data blocks comprising encoded enhancement data comprising encoded residual data representing differences between a reference video frame and a decoded version of the video frame. The NAL unit header comprises a unit type of the NAL unit and starts at the third bit of the NAL unit header. A corresponding bitstream decoding process is also ...

Low complexity enhancement video coding

Examples of a low complexity enhancement video coding are described. The claimed invention relates to a bitstream for transmitting one or more enhancement residuals planes to be added to a set of preliminary pictures that are obtained from a decoder reconstructed video, comprising a decoder configuration for controlling a decoding process of the bitstream and encoded enhancement data comprising encoded residual data representing differences between a reference video frame and a decoded version of the video frame, wherein the decoder configuration comprises a variable temporal step width flag which indicates whether a variable temporal step width modifier is present or not and the variable temporal step width flag having a first value indicates that a value for the variable temporal step width modifier is present in the bitstream and a decoder should assign the value to temporal step width modifier and the variable the variable temporal step width flag having a second value indicates that ...

Low complexity enhancement video coding

Examples of a low complexity enhancement video coding are described. Encoding and decoding methods are described, as well as corresponding encoders and decoders. The claimed invention relates to a bitstream for transmitting one or more enhancement residuals planes to be added to a set of preliminary pictures that are obtained from a decoder reconstructed video. The bitstream comprises a stream of network abstraction layer, NAL, units, each comprising a unit header and one or more data blocks, the data blocks of the NAL units including one or more data blocks comprising decoder configuration information for controlling a decoding process and one or more data blocks comprising encoded enhancement data comprising encoded residual data representing differences between a reference video frame and a decoded version of the video frame. A corresponding bitstream decoding process is also claimed.

Rate control for a video encoder

A method of encoding an input video as a hybrid video stream, the method comprising: receiving the input video at a first resolution;obtaining an indication of a desired quality level for the encoding, the desired quality level setting one or more bit rates for the hybrid video stream, said hybrid stream comprising a base encoded stream at a second resolution and a plurality of enhancement streams at each of the first and second resolutions, the first resolution being higher than the second resolution;encoding each of the plurality of enhancement streams by:generating a set of residuals based on a difference between the input video and a reconstructed video at the respective resolution of the enhancement stream;determining quantisation parameters for the set of residuals for based on the desired quality level;quantising the set of residuals based on the quantisation parameters; and creating an encoded stream from the set of quantised residuals.

Flexible encoding of components in tiered hierarchical coding

Examples described herein relate to signal coding. Systems and methods of encoding and decoding a signal, such as a video signal, are described. In one case, a method of encoding a signal uses a hierarchical coding approach, wherein the signal is encoded at a first layer using a first encoding module and at a second layer using a second encoding module. The signal is composed of two or more components. The method includes steps of sending a signal from the second encoding module to the first encoding module to instruct the first encoding module to provide to the second encoding module only a first component of the signal at the first layer.

Low complexity enhancement video coding

Examples of a low complexity enhancement video coding are described. The claimed invention relates to a bitstream for transmitting one or more enhancement residuals planes to be added to a set of preliminary pictures that are obtained from a decoder reconstructed video. The application is to a decoder configuration for controlling a decoding process of the bitstream comprising a no-enhancement variable, wherein a first value of the no enhancement variable indicates, that a decoder should perform dequantization and transformation processes on entropy decoded quantized coefficients to obtain an array of residuals and wherein a second value of the no enhancement variable indicates that at a decoder, the decoder should set values of an array to a predetermined value, wherein the decoder should invoke a picture reconstruction process based on the array. A related decoding process is also claimed.

System and method for performing object analysis

Video decoding using post-processing control

MPEG-5 Part 2 Low Complexity Enhancement Video Coding (LCEVC) or SMPTE VC-6 2117, types of hierarchical encoding, in conjunction with entropy encoding, i.e. Huffman coding or run length encoding (RLE). Video decoding, comprising: receiving indication of desired video output property; decode 710, 711, 714, 810 received video streams 701, 702, 703, 805 into reconstructed video output stream 750; if video output 820 property differs from reconstructed video output stream, then applying sample conversion 825 to reconstructed video output stream; post-processing 815 is applied to reconstructed video output stream before output 820. The desired video output property may be: a desired resolution; or bit-depth. Sample conversion may comprise up-sampling, which may further comprise: non-linear up-sampling; neural network up-sampling; and/or fractional up-sampling. Post-processing may comprise dithering, which may further comprise dithering type and dithering strength. Decoding may be achieved using ...

Quantization of residuals in video coding

A method of decoding an encoded stream into a reconstructed output signal is provided, the method comprising: receiving a first output signal decoded from a first base encoded stream according to a first codec; receiving a level encoded stream; decoding the level encoded stream to obtain a set of residuals; and, combining the set of residuals with the first output signal to generate a reconstructed signal, wherein the decoding the level encoded stream comprises: decoding a set of quantized coefficients from the level encoded stream; dequantizing the set of quantized coefficients.

Quantization of residuals in video coding

A method of decoding an encoded signal is provided, said encoded signal received within a bitstream, the method comprising: receiving a set of quantized data associated with the encoded signal; determining at least one dequantization parameter; and dequantizing the quantized data based at least in part of the at least one dequantization parameter.

Low complexity enhancement video coding

Examples of a low complexity enhancement video coding (LCEVC) are described. The claimed invention relates to a bitstream for transmitting one or more enhancement residuals planes to be added to a set of preliminary pictures that are obtained from a decoder reconstructed video. The application is to a decoder configuration for controlling a decoding process of the bitstream wherein the decoder configuration comprises a variable user_data_enabled which indicates whether user data is included in the bitstream. Preferably there is an indication of the size of the user data. Preferably there is an indication of whether decoding should be based on 2-bits or 6-bits of user data in the bitstream. Preferably bit shift operations are performed, said bit shift operations being either 2-bit or 6-bit to the right ...

Low complexity enhancement video coding

A bitstream for transmitting enhancement residuals planes to be added 2430 to pictures obtained from a decoder reconstructed video 2416, comprising encoded enhancement data 2422 comprising residual data representing the differences between a reference video frame and decoded video frame, and a decoder configuration 2404 comprising scaling mode parameters indicating whether the decoding process should comprise upscaling 2432 the encoded enhancement data, and modifying 2434 the upscaled encoded enhancement data. The modification may comprise adjusting the upscaled data such that their mean value is equal to the non-upscaled enhancement data. The flags may be signalled as part of the payload in the bitstream at a frequency of one per instantaneous decoder refresh (IDR) picture. Also disclosed is a method of decoding the bitstream..

Video decoding using post-processing control

Object analysis