STREAM ERZEUGUNGSVORRICHTUNG FOR MOBILE PICTURES, CODING DEVICE FOR MOBILE PICTURES, MULTIPLEX DEVICE FOR MOBILE PICTURES AND DECODING DEVICE FOR MOBILE PICTURES

STREAM ERZEUGUNGSVORRICHTUNG FOR MOBILE PICTURES, CODING DEVICE FOR MOBILE PICTURES, MULTIPLEX DEVICE FOR MOBILE PICTURES AND DECODING DEVICE FOR MOBILE PICTURES

MOVING PICTURE STREAM GENERATION APPARATUS, MOVING PICTURE CODING APPARATUS, MOVING PICTURE MULTIPLEXING APPARATUS AND MOVING PICTURE DECODING APPARATUS

To provide a moving picture stream generation apparatus and the 'like that generates a moving picture stream that can be played back in trick-play such as variable-speed playback and reverse playback even in a coding format such as the MPEG-4 AVC In which flexible prediction structures are allowed. A moving picture stream generation apparatus includes: a trick-play information generation unit TricPlay for generating supplemental information on a random access unit basis, the supplemental information being referred to at the time of playback of each random access Unit and each random access Unit including one or more pictures; and a variable length coding unit VLC for generating a stream .including the generated supplemental information and the one or more pictures by adding -the supplemental information to each corresponding random access unit. At the top of each random access unit, an intra coded picture that can be decoded without depending non any picture is placed, and the supplemental ...

MOVING PICTURE STREAM GENERATION APPARATUS, MOVING PICTURE CODING APPARATUS, MOVING PICTURE MULTIPLEXING APPARATUS AND MOVING PICTURE DECODING APPARATUS

To provide a moving picture stream generation apparatus and the like that generates a moving picture stream that can be played back in trick-play such as variable-speed playback and reverse playback even in a coding format such as the MPEG-4 AVC in which flexible prediction structures are allowed. A moving picture stream generation apparatus includes: a trick-play information generation unit TricPlay for generating supplemental information on a random access unit basis, the supplemental information being referred to at the time of playback of each random access unit and each random access unit including one or more pictures; and a variable length coding unit VLC for generating a stream including the generated supplemental information and the one or more pictures by adding the supplemental information to each corresponding random access unit. At the top of each random access unit, an intra coded picture that can be decoded without depending on any picture is placed, and the supplemental ...

Inter-layer prediction method for video signal

The present invention relates to a method for conducting interlayer texture prediction in encoding or decoding of video signal . The present method constructs a pair of frame macro blocks from a single field macro block or vertically-adjacent two field macro blocks of a base layer, and using texture information of the constructed pair of frame macro blocks in interlayer texture prediction of a pair of frame macro blocks of a current layer.

NETWORK VIDEO STREAMING WITH TRICK PLAY BASED ON SEPARATE TRICK PLAY FILES

Network services encode multimedia content, such as video, into multiple adaptive bitrate streams of encoded video and a separate trick play stream of encoded video to support trick play features. The trick play stream is encoded at a lower encoding bitrate and frame rate than each of the adaptive bitrate streams. The adaptive bitrate streams and the trick play stream are stored in the network services. During normal content streaming and playback, a client device downloads a selected one of the adaptive bitrate streams from network serviced for playback at the client device. To implement a trick play feature, the client device downloads the trick play stream from the network services for trick play playback.

TRANSMISSION DEVICE, TRANSMISSION METHOD, RECEPTION DEVICE, AND RECEPTION METHOD

In a case where a plurality of transmission video data having predetermined opto-electrical transfer characteristics are switched therebetween and transmitted, processes for obtaining image data for display from the transmission video data are achieved to be appropriately performed at a receiver side. 1. A transmission device comprising:an encoding unit configured to encode transmission video data obtained by switching between a plurality of kinds of transmission video data having predetermined opto-electrical transfer characteristics to obtain a video stream;a transmission unit configured to transmit a container in a predetermined format containing the video stream; andan information insertion unit configured to insert, into the container, identification information representing a kind of a transmission video data in the video stream contained in the container, such that the identification information indicates the kind of transmission video data resulting from switching, from a timing a predetermined amount of time or longer before a timing of the switching.2. The transmission device according to claim 1 , wherein the plurality of kinds of transmission video data include:first transmission video data having a standard dynamic range opto-electrical transfer characteristic, the first transmission video data being obtained by performing opto-electrical conversion with the standard dynamic range opto-electrical transfer characteristic on standard dynamic range video data; andsecond transmission video data having a high dynamic range opto-electrical transfer characteristic, the second transmission video data being obtained by performing opto-electrical conversion with the high dynamic range opto-electrical transfer characteristic on high dynamic range video data.3. The transmission device according to claim 1 , wherein the plurality of kinds of transmission video data include:first transmission video data having a high dynamic range opto-electrical transfer ...

Emulation of Bi predicted pictures using adjacent pictures for improved video

A method and apparatus for emulation of Bi predicted B pictures is described where a B picture is constructed only from information from one preceding and successive frame without pixel averaging or motion vector computation. In the case of H.264 or analogous codecs, a top field of a B picture is formed from the successive I or P picture top field, and the bottom field formed from the previous P picture bottom field. B picture emulation may reverse the previous and successive pictures. For interlaced pictures, the odd and ever interlacing fields are treated as top and bottom fields, and also use information from both one preceding and successive frame. The resulting Bi predicted B pictures reduce inter-GOP flicker.

Method of coding artifacts reduction

A method to reduce coding artifacts within a discrete decoded picture includes a spatial and/or temporal filtering with respective filter characteristics dependent on an image quality value (Q). Preferably, the spatial filtering includes a deblocking filtering, wherein the deblocking filter operation decreases with an increasing image quality value (Q) and/or the deblocking filtering chooses an image quality value (Q) dependent weighting function for a pixel to be filtered according to an activity of both blocks to which common border said pixel belongs.

CODING AND DECODING OF MOVING PICTURES

STREAM ERZEUGUNGSVORRICHTUNG FOR MOBILE PICTURES, CODING DEVICE FOR MOBILE PICTURES, MULTIPLEX DEVICE FOR MOBILE PICTURES AND DECODING DEVICE FOR MOBILE PICTURES

STREAM ERZEUGUNGSVORRICHTUNG FOR MOBILE PICTURES, CODING DEVICE FOR MOBILE PICTURES, MULTIPLEX DEVICE FOR MOBILE PICTURES AND DECODING DEVICE FOR MOBILE PICTURES

STREAM ERZEUGUNGSVORRICHTUNG FOR MOBILE PICTURES, CODING DEVICE FOR MOBILE PICTURES, MULTIPLEX DEVICE FOR MOBILE PICTURES AND DECODING DEVICE FOR MOBILE PICTURES

Generating random motion picture video source system

Motion vector calculation method

When a block (MB22) of which motion vector is referred to in the direct mode contains a plurality of motion vectors, 2 motion vectors MV23 and MV24, which are used for inter picture prediction of a current picture (P23) to be coded, are determined by scaling a value obtained from averaging the plurality of motion vectors or selecting one of the plurality of the motion vectors.

ENCODING DEVICE, ENCODING METHOD, DECODING DEVICE, AND DECODING METHOD

Continuous reproduction can be made possible. An encoding apparatus for executing an encoding process with an encoding system capable of at least B-pictures as pictures to be prediction-encoded comprises a timing calculation means for, anticipating that a plurality of encoded information created by performing the encoding process will be sequentially decoded on a decoding side, calculating output timing for results of decoding the encoded information, and a timing notification means for notifying the decoding side of the output timing calculated by the timing calculation means before a result of decoding corresponding encoded information is obtained.

PICTURE DECODING METHOD FOR DECODING CODED PICTURE DATA AND PERFORMING DISTORTION REMOVAL BY COMPARING PIXEL DIFFERENCE VALUES WITH THRESHOLD

A picture coding method provides coding an input picture. The method includes dividing the input picture into a plurality of blocks, coding the input picture on a block basis to obtain coded data of each block, and decoding the coded data of each block on a block basis to obtain a reconstructed picture having a plurality of blocks. The method also includes removing coding distortion in an area disposed on both sides of a block boundary between a first block and an adjacent second block in the reconstructed picture having the plurality of blocks. Each block is adaptively decoded either as a field structure block, including only even field pixels or only odd field pixels, or a frame structure block, including odd field pixels and even field pixels. The method further includes storing the reconstructed picture, for which coding distortion is removed, as a reference picture.

Verfahren und Apparat zum Filtern von Bildfarbsignalen

PROCEDURE AND APPARATUS FOR FILTERING PICTURE COLOR SIGNALS

STREAM ERZEUGUNGSVORRICHTUNG FOR MOBILE PICTURES, CODING DEVICE FOR MOBILE PICTURES, MULTIPLEX DEVICE FOR MOBILE PICTURES AND DECODING DEVICE FOR MOBILE PICTURES

CODING AND DECODING OF MOVING PICTURES

Moving picture encoding apparatus and method, moving picture decoding apparatus and method

As an embodiment of a moving picture encoding apparatus, a moving picture type judgment section judges whether an input moving picture is a stereoscopic picture and, when the moving picture is a stereoscopic picture, a stereoscopic picture identifier is set to ''1'' and a moving picture rotation section rotates the moving picture clockwise by +90 degrees or -90 degrees. On the other hand, when the moving picture is not a stereoscopic picture, the stereoscopic picture identifier is set to ''0'' and the moving picture is not rotated. Then, a moving picture interlaced encoding section produces an encoded bit stream by performing interlaced encoding of the moving picture and a stereoscopic picture identifier encoding section produces encoded information by encoding the stereoscopic picture identifier. Further, a multiplexing section produces a multiplexed encoded bit stream by multiplexing the above-mentioned encoded bit stream and encoded information.

METHOD FOR IMPLEMENTING PARALLEL OF GRAPHIC PROCESSING UNIT OPERATING EDGE-DIRECTED ADAPTIVE INTRA-FIELD DEINTERLACING TECHNIQUE

A method for implementing the parallel of a graphic processing unit operating the edge-directed adaptive intra-field deinterlacing technique according to the embodiment of the present invention includes a step of estimating a deinterlacing prediction model based on geographical duality from an interlaced image, and a step of interpolating loss pixels in the deinterlaced image. A graphic processing unit uses a thread to calculate a loss pixel in the deinterlaced image. So, a memory bandwidth can be improved. COPYRIGHT KIPO 2016 ...

CHROMA FORMAT DEPENDENT QUANTIZATION MATRICES FOR VIDEO ENCODING AND DECODING

In a video coding system, it is proposed to transmit only a luma quantization matrix and no chroma quantization matrix when the chroma format is monochrome, and otherwise (i.e. not monochrome) to transmit at least both a luma quantization matrix and a chroma quantization matrix. This allows to avoid the transmission of data elements that are useless. It allows to improve simultaneously the encoding (less operations to perform), the transmission (less data to be transmitted) and decoding (less operations to perform).

Image information encoding apparatus, image information decoding apparatus, and image information recording and reproducing system

A video encoder enables a picture quality of a reproduced image to be improved and a moving object to move smoothly. Also this video encoder enable an edit to be carried out at the frame unit without deteriorating an encoding efficiency. The video encoder comprises a frame memory for storing therein image data of present frame, a frame memory for storing therein image data of preceding frame, an external memory control means for supplying read/write control signals to the frame memories, a motion detecting circuit for executing a motion detection processing by use of block data of present and preceding frames and image data of present and succeeding frames to provide first and second motion vector data, motion compensating circuits for extracting block data from preceding and succeeding frames based on the first and second motion vector data, a first adding circuit for adding and averaging these extracted block data, a second adding circuit for subtracting an output of the first adding ...

Encoding apparatus and decoding apparatus

An encoding apparatus having a direct mode as a prediction mode, when a pixel with opposite parity from a top field to a bottom field, for example, is referred to for obtaining a reference vector in the direct mode, performs correction by adding or subtracting a value corresponding to a half pixel to or from a value of the obtained reference vector. The encoding apparatus, when a pixel with opposite parity is referred to for obtaining a first and a second direct vector by temporally scaling the corrected reference vector, performs correction by adding or subtracting a value corresponding to a half pixel to or from values of the obtained direct vectors.

Encoding and decoding architecture of checkerboard multiplexed image data

A device includes a coder or a codec configured for interleaved image data utilizing diamond shaped blocks for motion estimation and/or motion compensation and utilizing square or orthogonal transforms of residual data. In various embodiments, the decoder may be configured, among others, to perform de-blocking on edges of the diamond shaped blocks and/or data padding at boundaries of the image data.

Moving picture encoding apparatus and method, moving picture decoding apparatus and method

As an embodiment of a moving picture encoding apparatus, a moving picture type judgment section judges whether an input moving picture is a stereoscopic picture and, when the moving picture is a stereoscopic picture, a stereoscopic picture identifier is set to "1" and a moving picture rotation section rotates the moving picture clockwise by +90 degrees or -90 degrees. On the other hand, when the moving picture is not a stereoscopic picture, the stereoscopic picture identifier is set to "0" and the moving picture is not rotated. Then, a moving picture interlaced encoding section produces an encoded bit stream by performing interlaced encoding of the moving picture and a stereoscopic picture identifier encoding section produces encoded information by encoding the stereoscopic picture identifier. Further, a multiplexing section produces a multiplexed encoded bit stream by multiplexing the above-mentioned encoded bit stream and encoded information.

Image decoding apparatus for removal of coding distortion by comparing pixel difference value with threshold

An image decoding apparatus is provided that decodes a coded image, the coded image being generated by coding an image segmented into a plurality of blocks on a block basis. The image decoding apparatus includes a quantization parameter obtaining unit that obtains a quantization parameter for each block of the plurality of blocks, a decoding unit that decodes the coded image to obtain a reconstructed image, and a pixel difference value obtaining unit that obtains a pixel difference value. The image decoding apparatus also includes a comparing unit that compares the pixel difference value with a threshold value, and a removing unit that removes a coding distortion in an area disposed on both sides of a block boundary between the first block and the second block, by applying a filter for coding distortion removal.

SUPPLEMENTAL ENHANCEMENT INFORMATION INCLUDING CONFIDENCE LEVEL AND MIXED CONTENT INFORMATION

This application relates to video encoding and decoding, and specifically to tools and techniques for using and providing supplemental enhancement information in bitstreams. Among other things, the detailed description presents innovations for bitstreams having supplemental enhancement information (SEI). In particular embodiments, the SEI message includes picture source data (e.g., data indicating whether the associated picture is a progressive scan picture or an interlaced scan picture and/or data indicating whether the associated picture is a duplicate picture). The SEI message can also express a confidence level of the encoder's relative confidence in the accuracy of this picture source data. A decoder can use the confidence level indication to determine whether the decoder should separately identify the picture as progressive or interlaced and/or a duplicate picture or honor the picture source scanning information in the SEI as it is.

Intra prediction method of chrominance block using luminance sample, and apparatus using same

Disclosed are an intra prediction method of a chrominance block using a luminance sample and an apparatus using the same. An image decoding method comprises the steps of: calculating an intra prediction mode of a chrominance block on the basis of an LM mapping table when the chrominance block uses an LM; and generating a prediction block for the chrominance block on the basis of the calculated intra prediction mode of the chrominance block. When intra prediction mode information of chrominance blocks are decoded, mutually different tables are used depending on whether or not an LM is used, so that encoding and decoding can be performed without an unnecessary waste of bits.

MULTIPLE COLOR CHANNEL MULTIPLE REGRESSION PREDICTOR

Motion picture coded-bitstream converter

STREAM ERZEUGUNGSVORRICHTUNG FOR MOBILE PICTURES, CODING DEVICE FOR MOBILE PICTURES, MULTIPLEX DEVICE FOR MOBILE PICTURES AND DECODING DEVICE FOR MOBILE PICTURES

Encoder, decoder, encoding method, and decoding method

Provided is an encoder including: circuitry; and memory coupled to the circuitry. In operation, the circuitry: performs a mapping process of Luma Mapping with Chroma Scaling (LMCS) for transforming a first pixel value space applied to a luma display image signal into a second pixel value space applied to a luma encoding process signal, using line segments forming a transform curve, each of which corresponds to a different one of sections obtained by partitioning the first pixel value space; and encodes an image, and in the performing of the LMCS, the circuitry determines the transform curve so that among boundary values in the second pixel value space, a first value obtained by dividing a boundary value by a base width defined according to a bit depth of the image is not equal to a second value obtained by dividing another boundary value by the base width.

CODING DISTORTION REMOVAL METHOD

Mosaic-shaped block noise occurs when a compressed video signal is reproduced. This block noise is removed, but removing block noise from every block using a deblocking filter imposes a significant load on the deblocking filter. This load is therefore reduced by determining whether coding distortion removal (deblocking) is necessary, and applying a deblocking filter only when needed.

ADVANCED BI-DIRECTIONAL PREDICTIVE CODING OF INTERLACED VIDEO

Low complexity enhancement video coding

A bitstream for transmitting enhancement residuals planes to be added 2430 to pictures obtained from a decoder reconstructed video 2416, comprising encoded enhancement data 2422 and a decoder configuration 2404 comprising a first flag indicating whether encoded data is sent on a frame basis or a field basis. A frame-basis may comprise frames generated by a progressive or interlaced encoding mode and a field basis may comprise frames generated by an interlaced encoding mode. The first flag may indicate that the bitstream comprises a second flag indicating a specific field, such as a top or bottom field. The flags may be signalled as part of the payload in the bitstream at a frequency of one per instantaneous decoder refresh (IDR) picture. Also disclosed is a method of decoding the bitstream.. Also disclosed is a method of decoding the bitstream.

Tuning video compression for high frame rate and variable frame rate capture

Video data with high frame rates may be displayed on devices with limited resources (e.g., decoder and/or display resources). These devices may have their resources devoted to other tasks or may not be capable to display the video data at the high frame rates. The coding method may include coding the frames such that additional droppable frames are included in the encoded video data. The decoding method may include dropping droppable frames before the encoded video data is decoded to reduce the number of frames that will be decoded and displayed. These methods may be applied to video data that has a variable frame rate and may be combined with processing the image sequence for slow motion playback.

IMAGE DECODING METHOD, IMAGE CODING METHOD, IMAGE DECODING APPARATUS, IMAGE CODING APPARATUS, AND IMAGE CODING AND DECODING APPARATUS

An image decoding method of decoding, on a block-by-block basis, image data included in a coded stream includes: deriving candidates for an intra prediction mode to be used for intra prediction for a decoding target block, the number of the candidates constantly being a plural number; obtaining, from the coded stream, an index for identifying one of the derived candidates for the intra prediction mode; and determining, based on the obtained index, one of the derived candidates for the intra prediction mode as the intra prediction mode to be used for intra prediction for the decoding target block.

PICTURE CODING METHOD, PICTURE DECODING METHOD, PICTURE CODING APPARATUS, PICTURE DECODING APPARATUS, AND PROGRAM THEREOF

A picture coding method of the present invention codes a picture signal and a ratio of a number of luminance pixels and a number of chrominance pixels for the picture signal, and then one coding method out of at least two coding methods is selected depending on the ratio. Next, data related to a picture size is coded in accordance with the selected coding method. The data related to the picture size indicates a size of the picture corresponding to the picture signal or an output area, which is a pixel area to be outputted in decoding in a whole pixel area coded in the picture signal coding.

Moving picture coding method and moving picture coding apparatus for coding a current block in a temporal direct mode

A moving picture coding apparatus includes a motion compensation coding unit for deciding a coding mode for coding a current block to be coded and for generating predictive image data based on the coding mode, and includes a direct mode enable/disable judgment unit for judging whether or not scaling processing can be performed when the coding mode decided by the motion compensation coding unit is a temporal direct mode. When it is judged that the scaling processing cannot be performed, the motion compensation coding unit performs motion compensation either by using another coding mode or without the scaling processing.

Coding device and method, decoding device and method, recording medium, and program

An encoding apparatus and an encoding method, a decoding apparatus and a decoding method, a recording medium, and a program suitable for encoding image signals with a higher compression ratio for transmission or accumulation. In an arithmetic coding section, from among the syntax elements of input image compression information, the frame/field flag is first encoded by a frame/field flag context model. When the macroblock to be processed is subjected to frame-based encoding, a frame-based context model, specified in the current H.26L standard, is applied. On the other hand, when the macroblock to be processed is subjected to field-based encoding, a field-based context model is applied for the syntax elements described below. The present invention is applied to an encoder for encoding image information and a decoder for decoding image information.

Video decoding implementations for a graphics processing unit

Video decoding innovations for multithreading implementations and graphics processor unit (“GPU”) implementations are described. For example, for multithreaded decoding, a decoder uses innovations in the areas of layered data structures, picture extent discovery, a picture command queue, and/or task scheduling for multithreading. Or, for a GPU implementation, a decoder uses innovations in the areas of inverse transforms, inverse quantization, fractional interpolation, intra prediction using waves, loop filtering using waves, memory usage and/or performance-adaptive loop filtering. Innovations are also described in the areas of error handling and recovery, determination of neighbor availability for operations such as context modeling and intra prediction, CABAC decoding, computation of collocated information for direct mode macroblocks in B slices, reduction of memory consumption, implementation of trick play modes, and picture dropping for quality adjustment.

DIRECT MODE MOTION VECTOR COMPUTATION AVOIDING DIVISIONS BY ZERO

Encoding/decoding fields of predetermined field polarity apparatus and method

3D video transmission on a legacy transport infrastructure

The present disclosure relates to a method for transmitting two consecutive pairs of images. The method may include decimating each image with a ratio of 2, assembling the two decimated images of each pair in a composite image, transmitting the composite images, and reconstructing complete images from the composite images. In decimation, the information removed from the images of the first pair may be kept in the images of the second pair, from the spatial point of view, and the complete images may be reconstructed by de-interlacing processing from the composite images.

Neighbor determination in video decoding

Video decoding innovations for multithreading implementations and graphics processor unit (“GPU”) implementations are described. For example, for multithreaded decoding, a decoder uses innovations in the areas of layered data structures, picture extent discovery, a picture command queue, and/or task scheduling for multithreading. Or, for a GPU implementation, a decoder uses innovations in the areas of inverse transforms, inverse quantization, fractional interpolation, intra prediction using waves, loop filtering using waves, memory usage and/or performance-adaptive loop filtering. Innovations are also described in the areas of error handling and recovery, determination of neighbor availability for operations such as context modeling and intra prediction, CABAC decoding, computation of collocated information for direct mode macroblocks in B slices, reduction of memory consumption, implementation of trick play modes, and picture dropping for quality adjustment.

Picture coding method, picture decoding method, picture coding apparatus, picture decoding apparatus, and program thereof

A picture coding method of the present invention codes a picture signal and a ratio of a number of luminance pixels and a number of chrominance pixels for the picture signal, and then one coding method out of at least two coding methods is selected depending on the ratio. Next, data related to a picture size is coded in accordance with the selected coding method. The data related to the picture size indicates a size of the picture corresponding to the picture signal or an output area, which is a pixel area to be outputted in decoding in a whole pixel area coded in the picture signal coding.

Motion vector calculation method

When a block (MB22) of which motion vector is referred to in the direct mode contains a plurality of motion vectors, 2 motion vectors MV23 and MV24, which are used for inter picture prediction of a current picture (P23) to be coded, are determined by scaling a value obtained from averaging the plurality of motion vectors or selecting one of the plurality of the motion vectors.

METHOD AND APPARATUS FOR THUMBNAIL GENERATION FOR A VIDEO DEVICE

Systems and processes are provided to generate a thumbnail image including a tuner configured for receiving and demodulating a video signal including a video packet having a packet header and a video frame, a processor configured for generating a modified packet header by modifying the packet header to set a number of reference frames to zero and to designate the video frame as unused for reference, decoding the video frame in response to the modified packet header to extract the video frame, and generating the thumbnail image in response to the video frame, a memory configured for storing the thumbnail image, and a video output configured for coupling the thumbnail image to a display in response to a user video search request.

SYSTEMS AND METHODS FOR DEBLOCKING FILTERING

Methods and systems for in-loop filtering may comprise receiving a video comprising at least one frame. The frame may comprise at least one block of pixels. A content complexity of the block of pixels may be determined. A viewing characteristic of the video may be determined. A number of borders to be filtered may be determined based on at least one of the content complexity or the viewing characteristic. A deblocking filter strength may be determined based on at least one of the content complexity or the viewing characteristic. The number of borders of the block of pixels may be filtered according to the deblocking filter strength.

CONTENT-AWARE PQ RANGE ANALYZER AND TONE MAPPING IN LIVE FEEDS

Motion picture encoding and decoding devices

SIDE INFORMATION BASED VERTICAL CHROMA FILTERING AFTER DEINTERLACING

A method for correcting artifacts in compressed video having interlaced frames may comprise receiving decoded video data, the decoded video data including a frame and metadata corresponding to the frame. The method may further comprise applying a vertical chroma filter to the frame responsive to determining that the metadata indicates that the frame is an interlaced frame.

PALETTE CODING FOR SCREEN CONTENT CODING

Video data may be palette decoded. Data defining a palette table may be received. The palette table may comprise index values corresponding to respective colors. Palette index prediction data may be received and may comprise data indicating index values for at least a portion of a palette index map mapping pixels of the video data to color indices in the palette table. The palette index prediction data may comprise run value data associating run values with index values for at least a portion of a palette index map. A run value may be associated with an escape color index. The palette index map may be generated from the palette index prediction data at least in part by determining whether to adjust an index value of the palette index prediction data based on a last index value. The video data may be reconstructed in accordance with the palette index map.

TRANSMISSION DEVICE, TRANSMISSION METHOD, RECEPTION DEVICE, AND RECEPTION METHOD

In a case where a plurality of transmission video data having predetermined opto-electrical transfer characteristics are switched therebetween and transmitted, processes for obtaining image data for display from the transmission video data are achieved to be appropriately performed at a receiver side. A video stream is obtained by switching between a plurality of kinds of transmission video data having predetermined opto-electrical transfer characteristics and encoding the resulting transmission video data. A container in a predetermined format containing the video stream is transmitted. Identification information representing the kind of transmission video data included in the video stream contained in the container is inserted in the container, such that the identification information indicates the kind of transmission video data resulting from switching, from a timing that is a predetermined amount of time or longer before the switching timing.

Vorrichtung und Verfahren zur Kodierung/Dekodierung von Bewegtbildern und Speichermedium zur Speicherung von den kodierten Bewegtbildern

CODIERUNGSVORRICHTUNG UND DECODIERUNGSVORRICHTUNG FÜR BEWEGLICHE BILDER

Method for scalable video coding of hybrid interlaced and progressive content

DISPLAY STREAM CODEC FOR DISPLAY DEVICE AND DISPLAY DATA ENCODING METHOD

aparelho e processo para codificar/decodificar imagem em movimento.

METHOD AND APPARATUS FOR CODING/DECODING A LARGE FIELD OF VIEW VIDEO

A method is proposed for coding a large field of view video into a bitstream, at least one picture of the omnidirectional video being represented as a surface, the surface being projected onto at least one 2D picture using a projection function. Such method comprises, for at least one current block of the at least one 2D picture: adapting (S2400) a size of the at least one current block as a function of a pixel density function determined according to the projection function; and encoding (S2410) the at least one current block into the bitstream using the adapted size.

Apparatus and method of encoding/decoding moving picture using second encoder/decoder to transform predictive error signal for each field

Progressively scanned specific frames that exist for every predetermined period in a moving picture signal is encoded by infra-frame processing or by uni-directional prediction using other encoded specific frames and by orthogonal transform at the 2n-th (n being an integer) order in the vertical direction, to produce a first bit stream. Frames or fields of the moving picture signal other than the specific frames are predicted by using a preceding reference frame and/or an upcoming reference frame, to produce a predictive error signal for each field. The predictive error signal is encoded by orthogonal transform at the 21-th order in the vertical direction to produce a second bit stream. The first and second bit streams are alternatively stored in a storage medium. Specific frames that exist for every predetermined period in bit streams are decoded by inverse orthogonal transform at the 2n-th order in the vertical direction and by infra-frame processing or by uni-directional prediction using ...

Moving picture stream generation apparatus, moving picture coding apparatus, moving picture multiplexing apparatus and moving picture decoding apparatus

To provide a moving picture stream generation apparatus and the like that generates a moving picture stream that can be played back in trick-play such as variable-speed playback and reverse playback even in a coding format such as the MPEG-4 AVC in which flexible prediction structures are allowed. A moving picture stream generation apparatus includes: a trick-play information generation unit TricPlay for generating supplemental information on a random access unit basis, the supplemental information being referred to at the time of playback of each random access unit and each random access unit including one or more pictures; and a variable length coding unit VLC for generating a stream including the generated supplemental information and the one or more pictures by adding the supplemental information to each corresponding random access unit. At the top of each random access unit, an intra coded picture that can be decoded without depending on any picture is placed, and the supplemental ...

Method for deriving motion for high resolution pictures from motion data of low resolution pictures and coding and decoding devices implementing said method

The invention relates to a method for deriving motion data for a macroblock divided in elementary blocks of a high resolution picture, called high layer macroblock, from motion data of macroblocks of a low resolution picture, called base layer macroblock. The method comprises the following steps: computing, for each elementary block, an intermediate position within the low resolution picture from the elementary block position depending on the coding modes of the high layer macroblock and of the high and low resolution pictures; identifying the base layer macroblock, called base_MB, comprising the pixel located at the intermediate position; computing a final position within the low resolution picture from the virtual base layer position depending on the coding modes of the base_MB, of the high layer macroblock; identifying the base layer macroblock, called real_base_MB, comprising the pixel located at the final position; and deriving motion data, for the high layer macroblock, from motion ...

Resampling and picture resizing operations for multi-resolution video coding and decoding

Techniques and tools for high accuracy position calculation for picture resizing in applications such as spatially-scalable video coding and decoding are described. In one aspect, resampling of a video picture is performed according to a resampling scale factor. The resampling comprises computation of a sample value at a position i,j in a resampled array. The computation includes computing a derived horizontal or vertical sub-sample position x or y in a manner that involves approximating a value in part by multiplying a 2n value by an inverse (approximate or exact) of the upsampling scale factor. The approximating can be a rounding or some other kind of approximating, such as a ceiling or floor function that approximates to a nearby integer. The sample value is interpolated using a filter.

Moving picture stream generation apparatus, moving picture coding apparatus, moving picture multiplexing apparatus and moving picture decoding apparatus

A moving picture stream generation apparatus that generates a moving picture stream that can be played back in trick-play such as variable-speed and reverse playback even in a coding format such as MPEG-4 AVC, in which flexible prediction structures are allowed. The moving picture stream generation apparatus includes: a trick-play information generation unit generating supplemental information, the supplemental information being referred to at the time of playback of each random access unit including one or more pictures; and a variable length coding unit generating a stream including the generated supplemental information and the one or more pictures by adding the supplemental information to each corresponding random access unit. At the top of each random access unit, an intra coded picture that can be decoded without depending on any picture is placed, and the supplemental information includes information specifying pictures to be decoded at the time when pictures included in each random ...

ORIENTATION ADJUSTMENT FOR CASTING VIDEOS

System, method, and computer product embodiments for proving an orientation adjustment for casting visual content on a display device are described. A computing device selects an orientation adjustment to be used in transcoding a video having a frame and assigned an orientation. The computing device requests a transcoder within the computing device to transcode the frame based on the orientation adjustment to generate a transcoded frame. The transcoded frame is converted into a format comparable to a reference frame representing the frame that is corrected transcoded to the assigned orientation. Then, the computing device compares the converted frame with the reference frame to determine that the frame is transcoded correctly to the assigned orientation. If the frame is transcoded correctly, the computing device uses the selected orientation adjustment when transcoding visual content for casting or streaming on a display device in an orientation matching that of the visual content.

Picture orientation and quality metrics supplemental enhancement information message for video coding

Video encoders and video decoders are configured to supplemental enhancement information (SEI) messages. The SEI messages may include picture orientation transform type syntax elements that indicate how a picture may be rotated and/or mirrored. The SEI messages may also include quality metrics.

Coded image bit stream foramt converter

A format converter which receives a compressed image bit stream removes the requirement for separate motion vector calculation in the decoding and conversion steps. The bit stream (a) is input to an extracting unit (1a) for the extraction of coding control data (m), including motion vectors, used by the decoder unit (1b). The motion vectors from the coding control data extracting unit (1a) are used by a motion vector calculating unit (2a) in the format converter (2), together with interpolated field position data (p) to calculate the motion vectors (n) to be used by the format converter (2b). These motion vectors (n) are subsequently fed, together with coding control data (m) and field position data (p), to a coding controller (3a) to generate further motion vectors (q) for the final encoding unit (3b).

Tuning video compression for high frame rate and variable frame rate capture

Video data with high frame rates may be displayed on devices with limited resources (e.g., decoder and/or display resources). These devices may have their resources devoted to other tasks or may not be capable to display the video data at the high frame rates. The coding method may include coding the frames such that additional droppable frames are included in the encoded video data. The decoding method may include dropping droppable frames before the encoded video data is decoded to reduce the number of frames that will be decoded and displayed. These methods may be applied to video data that has a variable frame rate and may be combined with processing the image sequence for slow motion playback.

Encoding device, encoding method, decoding device, and decoding method

Inter-layer prediction method for video signal

The present invention relates to a method for conducting interlayer motion prediction in encoding or decoding of video signal. The method constructs a frame macro block pair by vertically-adjacent two macro blocks of the base layer, selectively uses the deblocking filter to the constructed frame macro block pair and uses the texture information of the frame macro block pair to the interlayer motion prediction of the frame macro block pair of the current layer.

MOTION VECTOR CALCULATION METHOD

When a block (MB22) of which motion vector is referred to in the direct mode contains a plurality of motion vectors, 2 motion vectors MV23 and MV24, which are used for inter picture prediction of a current picture (P23) to be coded, are determined by scaling a value obtained from averaging the plurality of motion vectors or selecting one of the plurality of the motion vectors.

Motion vector calculation method

When a block (MB22) of which motion vector is referred to in the direct mode contains a plurality of motion vectors, 2 motion vectors MV23 and MV24, which are used for inter picture prediction of a current picture (P23) to be coded, are determined by scaling a value obtained from averaging the plurality of motion vectors or selecting one of the plurality of the motion vectors.

Method of content adaptive video encoding

A method of content adaptive encoding video comprising segmenting video content into segments based on predefined classifications or models. Based on the segment classifications, each segment is encoded with a different encoder chosen from a plurality of encoders. Each encoder is associated with a model. The chosen encoder is particularly suited to encoding the unique subject matter of the segment. The coded bit-stream for each segment includes information regarding which encoder was used to encode that segment. A matching decoder of a plurality of decoders is chosen using the information in the coded bitstream to decode each segment using a decoder suited for the classification or model of the segment. If scenes exist which do not fall in a predefined classification, or where classification is more difficult based on the scene content, these scenes are segmented, coded and decoded using a generic coder and decoder.

IMAGE DECODING METHOD, IMAGE CODING METHOD, IMAGE DECODING APPARATUS, IMAGE CODING APPARATUS, AND IMAGE CODING AND DECODING APPARATUS

An image decoding method of decoding, on a block-by-block basis, image data included in a coded stream includes: deriving candidates for an intra prediction mode to be used for intra prediction for a decoding target block, the number of the candidates constantly being a plural number; obtaining, from the coded stream, an index for identifying one of the derived candidates for the intra prediction mode; and determining, based on the obtained index, one of the derived candidates for the intra prediction mode as the intra prediction mode to be used for intra prediction for the decoding target block.

Camera system

Each of multiple cameras encodes and transmits a video signal captured, the encoding being performed with one of multiple variable bit rate encoding schemes each of which has a different average bit rate. A receiving device periodically measures the total bandwidth of the video signals received from the multiple cameras, and when the total bandwidth exceeds a first threshold value the receiving device switches the encoding scheme used by the cameras to a scheme having a lower average bit rate. In addition, when the total bandwidth falls below a second threshold value that is equal to or less than the first threshold value, the receiving device switches the encoding scheme used by the cameras to a scheme having a higher average bit rate.

Direct mode motion vector computation avoiding divisions by zero

The moving picture coding apparatus includes a motion compensation coding unit (107) for deciding a coding mode for coding a current block to be coded and for generating predictive image data based on the coding mode; and a direct mode enable/disable judgment unit (109) for judging whether or not scaling processing can be performed when the coding mode decided by the motion compensation coding unit (107) is a temporal direct mode. When it is judged that the scaling processing cannot be performed, the motion compensation coding unit (107) performs motion compensation either by using another coding mode or without the scaling processing.

Video signal processing device and video signal processing method

APPARATUSES, METHODS, COMPUTER PROGRAMS AND COMPUTER-READABLE MEDIA

Intra prediction method of chrominance block using luminance sample, and apparatus using same

Moving image coding/decoding apparatus and method

Video encoding/decoding methods, corresponding computer programs and video encoding/decoding devices

A method for encoding an interlaced video comprising a sequence of alternating TOP and BOT fields is disclosed. The method for encoding comprises: producing a sequence of frames, each frame being determined from at least two consecutive fields, each field forming a rectangular region of the frame, encoding each frame of the sequence to produce an encoded video of the sequence of frames.

Multiple color channel multiple regression predictor

Inter-color image prediction is based on multi-channel multiple regression (MMR) models. Image prediction is applied to the efficient coding of images and video signals of high dynamic range. MMR models may include first order parameters, second order parameters, and cross-pixel parameters. MMR models using extension parameters incorporating neighbor pixel relations are also presented. Using minimum means-square error criteria, closed form solutions for the prediction parameters are presented for a variety of MMR models.

Image decoding device, image coding device, methods thereof, programs thereof, integrated circuits thereof, and transcoding device

An image decoding device for increasing decoding efficiency and reducing the number of memory accesses includes a division unit dividing a picture into first and second coded image data; and first and second decoding units decoding, in parallel, the first and second coded image data and storing decoding results into a frame storage unit. The first and second decoding units decode the first and second coded image data using second and first decoding result information, respectively, and store the resulting first and second decoding result information into an information storage unit. When decoding a target macroblock, each of the first and second decoding units performs image processing on the corresponding second or first decoding result information indicating part of the decoded macroblock included in the macroblock line adjacent to the macroblock line including the target macroblock, and the target macroblock.

ORIENTATION ADJUSTMENT FOR CASTING VIDEOS

System, method, and computer product embodiments for proving an orientation adjustment for casting visual content on a display device are described. A computing device selects an orientation adjustment to be used in transcoding a video having a frame and assigned an orientation. The computing device requests a transcoder within the computing device to transcode the frame based on the orientation adjustment to generate a transcoded frame. The transcoded frame is converted into a format comparable to a reference frame representing the frame that is corrected transcoded to the assigned orientation. Then, the computing device compares the converted frame with the reference frame to determine that the frame is transcoded correctly to the assigned orientation. If the frame is transcoded correctly, the computing device uses the selected orientation adjustment when transcoding visual content for casting or streaming on a display device in an orientation matching that of the visual content.

Coding device and method, decoding device and method, recording medium, and program

An encoding apparatus and an encoding method, a decoding apparatus and a decoding method, a recording medium, and a program suitable for encoding image signals with a higher compression ratio for transmission or accumulation. In an arithmetic coding section, from among the syntax elements of input image compression information, the frame/field flag is first encoded by a frame/field flag context model. When the macroblock to be processed is subjected to frame-based encoding, a frame-based context model, specified in the current H.26L standard, is applied. On the other hand, when the macroblock to be processed is subjected to field-based encoding, a field-based context model is applied for the syntax elements described below. The present invention is applied to an encoder for encoding image information and a decoder for decoding image information.

Supplemental enhancement information including confidence level and mixed content information

This application relates to video encoding and decoding, and specifically to tools and techniques for using and providing supplemental enhancement information in bitstreams. Among other things, the detailed description presents innovations for bitstreams having supplemental enhancement information (SEI). In particular embodiments, the SEI message includes picture source data (e.g., data indicating whether the associated picture is a progressive scan picture or an interlaced scan picture and/or data indicating whether the associated picture is a duplicate picture). The SEI message can also express a confidence level of the encoder's relative confidence in the accuracy of this picture source data. A decoder can use the confidence level indication to determine whether the decoder should separately identify the picture as progressive or interlaced and/or a duplicate picture or honor the picture source scanning information in the SEI as it is.

Image decoding method, image coding method, image decoding apparatus, image coding apparatus, and image coding and decoding apparatus

An image decoding method of decoding, on a block-by-block basis, image data included in a coded stream includes: deriving candidates for an intra prediction mode to be used for intra prediction for a decoding target block, the number of the candidates constantly being a plural number; obtaining, from the coded stream, an index for identifying one of the derived candidates for the intra prediction mode; and determining, based on the obtained index, one of the derived candidates for the intra prediction mode as the intra prediction mode to be used for intra prediction for the decoding target block.

Apparatus and method for image encoding/decoding using predictability of intra-prediction mode

An apparatus and a method for video encoding/decoding using predictability of an intra-prediction mode are disclosed. The apparatus for encoding a video of the present disclosure includes: an intra-prediction mode determiner for determining an encoder prediction mode which is an intra-prediction mode of a current block of the video; an encoder for encoding a residual block generated by subtracting, from the current block, a predicted block generated by predicting the current block according to the encoder prediction mode; a mode information generator for generating mode information according to whether or not a video decoding apparatus is able to predict the encoder prediction mode; and an encoded data generator for generating encoded data including the encoded residual block and the mode information. The present disclosure can enhance compression in video encoding/decoding by using intra-prediction to predict the video with a minimum necessary bit rate.

Motion vector calculation method

When a block (MB22) of which motion vector is referred to in the direct mode contains a plurality of motion vectors, 2 motion vectors MV23 and MV24, which are used for inter picture prediction of a current picture (P23) to be coded, are determined by scaling a value obtained from averaging the plurality of motion vectors or selecting one of the plurality of the motion vectors.

Verfahren zur adaptiven Kodierung von digitalen Zeilensprungvideosequenzen

Verfahren und Apparat zum Filtern von Bildfarbsignalen

VIDEO BLOCK PARTITION BASED ON QUINARY TREE

The invention relates to a video processing method, device and system, wherein the representative method includes: determining, according to a splitting information, for a current video block of a video, a partition mode in which the current video block is split into M portions, wherein M>4; and performing a conversion for the current video block based on the partition mode.

Image encoding device and image encoding method

An image encoding device has: a first acquisition unit and a second acquisition unit that acquire a moving image; an encoding unit that encodes the acquired moving image in accordance with a predetermined encoding order and a predetermined encoding method; and a reception unit that receives an instruction to stop performing a process. When the reception unit receives the instruction, the encoding unit uses a last acquired image as an image that was to be acquired after the last acquired image and encodes all acquired images.

Systems and Methods for Video Content Analysis

Video analytics systems and methods are described that typically comprise a video encoder operable to generate macroblock video analytics metadata (VAMD) from a video frame. Functional modules receive the VAMD and an encoded version of the video frame is configured to generate video analytics information related to the frame using the VAMD and the encoded video frame. The downstream decoder can use the VAMD to obtain a global motion vector related to the frame, detect and track motion of an object within the frame and monitor a line provided or found within the frame. Traversals of the line by a moving object can be detected and counted using information in the VAMD and the line may be part of a polygon that delineates an area to be monitored within the encoded frame. The VAMD can comprise macroblock level and video frame level information.

Control device, camera system, and program

According to a control device of the present invention, there is provided a center server including a display processing unit that performs control so as to display a panorama image display area in which a panorama image captured with a camera terminal device is displayed and an enlarged image display area in which an enlarged image is displayed, the enlarged image being obtained by enlarging an area corresponding to a position specified on the panorama image, and a control unit that performs control so as to capture with the camera terminal device an image of the area corresponding to the position specified on the panorama image. The display processing unit displays on the enlarged image display area the image captured with the camera terminal device in accordance with control by the control unit, and the panorama image is a circular panorama image.

Method and system for improving compressed image chroma information

Methods, systems, and computer programs for improving compressed image chroma information. In one aspect of the invention, a resolution for a red color component of a color video image is used that is higher than the resolution for a blue color component of the color video image. Another aspect includes utilizing a lower or higher value of a quantization parameter (QP) for one or more chroma channels as compared to the luminance channel. Another aspect is use of a logarithmic representation of a video image to benefit image coding. Another aspect uses more than two chroma channels to represent a video image.

Video frame encoding and decoding

A video frame arithmetical context adaptive encoding and decoding scheme is presented which is based on the finding, that, for sake of a better definition of neighborhood between blocks of picture samples, i.e. the neighboring block which the syntax element to be coded or decoded relates to and the current block based on the attribute of which the assignment of a context model is conducted, and when the neighboring block lies beyond the borders or circumference of the current macroblock containing the current block, it is important to make the determination of the macroblock containing the neighboring block dependent upon as to whether the current macroblock pair region containing the current block is of a first or a second distribution type, i.e., frame or field coded.

System and method for audio video pattern sequence diagnostic tool

There is provided a system and method for confirming correct encoder processing for a media file. There is provided a method comprising preparing a diagnostic clip, embedding the diagnostic clip in the media file to create a modified media file, encoding the modified media file according to a set of encoder settings to create an encoded media file embedded with an encoded diagnostic clip, displaying the encoded diagnostic clip to a user, and assessing the accuracy of the encoder settings based on a feedback received from the user. In this manner, users may quickly and accurately diagnose encoder settings after encoding the media file. Users may more easily identify which encodes caused which problems and avoid the costly overhead of backtracking in the production process.

Mpeg-w decoder

A device comprising a Moving Picture Experts Group (MPEG)-W decoder; and one or more processing systems to execute the instructions of the MPEG-W decoder, which configure the one or more processing systems to receive a request for streaming content; select an estimate of a bandwidth for a connection between a destination device and a source device; select a device type pertaining to the destination device; generate a stream request that includes an MPEG-W link, the estimate of the bandwidth, the device type, the MPEG-W link including an address pertaining to the source device, a name of the streaming content, and a file extension of an MPEG-W format; transmit the stream request to the source device; select a streaming content based on the stream request; wherein the streaming content has a resolution corresponding to the estimate of the bandwidth; and transmitting the streaming content to the destination device.

Method for operating a multi-media wireless system in a multi-user environment

In one aspect, a method of operating a wireless system is disclosed. The method comprises allocating each video packet to a plurality of user specific priority queues. The method further comprises assigning each of the queues to a video quality layer. The method further comprises selectively dropping of one or more of video packets in cases of network congestion based on the video quality layer information.

Dynamic encode setting adjustment

A player decodes and renders encoded digital data received from an encoder. During processing, the player periodically monitors dropped frames as well as time spent. If the dropped frames are below a minimum, the player determines to signal the encoder to increase bit rate or frame rate by consulting a table. If the player determines to increase bit rate, the player signals accordingly. However, if the player determines to increase frame rate, the player first verifies that the spent time is below a minimum. To the contrary, if the dropped frames are both above the minimum and a first maximum but not a second maximum, the player determines to signal the encoder to decrease bit rate or frame rate by consulting the table and signaling accordingly. However, if the dropped frames are above the second maximum, the player signals the encoder to decrease the frame rate without consulting the table.

Video encoding control method and apparatus

A video encoding control method for controlling encoding of an input video signal. The method includes the steps of detecting an underflow of a decoder buffer; if the underflow of the decoder buffer has been detected, suppressing an amount of generated code by skipping an encoding target picture or by encoding the encoding target picture so as to produce a minimum amount of generated code; after suppressing the amount of generated code, comparing a current rate of occupancy in the decoder buffer with a predetermined threshold for the rate of occupancy in the decoder buffer; and performing a control for continuously suppressing the amount of code generated for each encoding target image by using the above step of suppressing the amount of generated code until the rate of occupancy in the decoder buffer exceeds the threshold based on a result of the above comparison.

Decoding apparatus, decoding method, and computer-readable storage medium

A selector selects one of a standard parameter corresponding to a filter strength contained in input movie image data and an original parameter originally set at the decoding side as a filter parameter to be used. A screen-display filter performs deblocking filtering using the filter parameter selected by the selector on decoded movie image data. A post-filter performs deblocking filtering using the standard parameter and stores the obtained decoded image data in a memory to allow it to be used in inter-frame compensation.

Dynamic image distribution system, dynamic image distribution method and dynamic image distribution program

[Problem] To provide a dynamic image distribution system, dynamic image distribution method, and dynamic image distribution program enabling the arbitrary setting of a viewing range for compression-encoded dynamic images and the interactive modification of the viewing range. [Solution] A dynamic image distribution system manages compression-encoded dynamic images as a group of tiles, each containing at least one macro block. The dynamic image distribution system is provided with: a transmitter for managing the display region of the dynamic image and, on the basis of the display region, reads a tile from the stored group of tiles and subjects the tile to correction processing, before synthesizing and transmitting a dynamic image bit stream of one frame from the processed tile; and a receiver for receiving and decoding the dynamic image bit stream, displaying the decoded dynamic image, inputting a user operation and transmitting the user operation to the transmitter.

Method and system for creating, receiving and playing multiview images, and related mobile communication device

A method and a system for creating, receiving and playing multi-view images are provided, and a related mobile communication device is also provided. A service server in the system receives images collected by the devices and encodes the received images based at least partly on redundancy of the images. The service server converts the received images into the multi-view images and sends them to a client terminal.

Method and device for mixing video streams at the macroblock level

The invention relates to a method and device for mixing video streams in a video mixer device, by means of which a plurality of input video streams from different subscribers which are encoded with code words for macroblocks and in which the code words have interdependencies are combined into an output video stream. The input video streams are at least entropy-decoded to such a degree that the dependencies among the code words are dissolved, wherein the macroblocks are re-organized and mixed with each other, and the mixed macroblocks are entropy-encoded to obtain a new dedicated video stream.

Systems and Methods for Video and Audio data Storage and Distribution.

Data compression and decompression methods for compressing and decompressing data based on an actual or expected throughput (bandwidth) of a system. In one embodiment, a controller tracks and monitors the throughput (data storage and retrieval) of a data compression system and generates control signals to enable/disable different compression algorithms when, e.g., a bottleneck occurs so as to increase the throughput and eliminate the bottleneck.

Application directed user interface remoting using video encoding techniques

Methods, techniques, and systems for user interface remoting using video streaming techniques are provided. Example embodiments provide User Interface Remoting and Optimization System (“UIROS”), which enables the efficient remoting of user interfaces on behalf of their guests using generic video streaming techniques, such as H.264, to send compressed user interface image information in the form of video frame encoded bitstreams. With application cooperation, pixels are explicitly cached on the server using lookahead methods to lower latency in remoting the user interface for certain operations. In one embodiment, the UIROS comprises server side support including a UI remoting server, a video encoder, and rendering support and client side support including a UI remoting client, a video decoder, and a display. These components cooperate to implement optimized UI remoting that is bandwidth efficient, low latency and CPU efficient.

DYNAMIC BANDWIDTH VOTING

In some aspects, the present disclosure provides a method for bandgap voting. In some configurations, the method includes receiving, at a hardware voting component associated with a destination subsystem, metadata for each of a plurality of compressed display tiles, wherein for each of the plurality of compressed display tiles the metadata indicates an amount of compression of the compressed display tile. In some configurations, the method includes dividing the plurality of compressed display tiles into a plurality of sets of compressed display tiles. In some configurations, for each of the plurality of sets of compressed display tiles, the method includes determining a desired bandwidth for communicating the set of compressed display tiles over a bus, and receiving the set of compressed display tiles at the destination subsystem over the bus at an actual bandwidth that is based on the desired bandwidth. 1. A method for bandwidth voting , comprising:receiving, at a hardware voting component associated with a destination subsystem, metadata for each of a plurality of compressed display tiles, wherein for each of the plurality of compressed display tiles the metadata indicates an amount of compression of the compressed display tile;dividing the plurality of compressed display tiles into a plurality of sets of compressed display tiles; and determining a desired bandwidth for communicating the set of compressed display tiles over a bus based on the metadata corresponding to the set of compressed display tiles; and', 'receiving the set of compressed display tiles at the destination subsystem over the bus at an actual bandwidth that is based on the desired bandwidth., 'for each of the plurality of sets of compressed display tiles2. The method of claim 1 , further comprising claim 1 , for each of the plurality of sets of compressed display tiles:transmitting a request for the desired bandwidth to a controller; anddetermining, by the controller, the actual bandwidth based ...

Foreground detection for video stabilization

Video foreground and background detection is performed on a received video sequence on a macroblock by macroblock basis using motion vector encoding information associated with each macroblock. Some of the macroblocks in each frame, for example, edge or corner macroblocks, may be exempt from the foreground and background detection. The detection information, along with the video data, is passed to an image stabilization algorithm that prepares the video for subsequent video compression.

METHOD AND SYSTEM FOR ENCODING VIDEO WITH OVERLAY

Encoding video data comprises receiving an image sequence comprising first and second input image frames, adding an overlay, thereby generating first and second generated image frames, and encoding a video stream containing output image frames with and without overlay. The first input image frame is encoded as an intra-frame to form a first output image frame. The second input image frame is encoded as an inter-frame with reference to the first output image frame to form a second output image frame. The generated image frames are encoded as inter-frames with reference to the first and second output image frames to form first and second overlaid output image frames. A first part of the second generated image frame is encoded with reference to the first overlaid output image frame, and a second part of the second generated image frame is encoded with reference to the second output image frame. 1. A method of encoding video data , comprising:receiving an image sequence comprising a first input image frame and a second input image frame,receiving an overlay to be applied to the image sequence, the overlay comprising a picture element and spatial coordinates for positioning the picture element in the first and second input image frames,adding the picture element to the first and second input image frames in accordance with the spatial coordinates, thereby generating an overlaid image sequence comprising a first generated image frame and a second generated image frame,encoding a video stream containing output image frames without overlay and corresponding output image frames with overlay, wherein:the first input image frame is encoded as an intra-frame to form a first output image frame,the second input image frame is encoded as an inter-frame with reference to the first output image frame to form a second output image frame,the first generated image frame is encoded as an inter-frame with reference to the first output image frame to form a first overlaid output image ...

METHODS AND SYSTEMS FOR OPTIMIZING VIDEO STREAMING

A method for performing a surgical procedure includes adjusting an encoding configuration of a video encoder in response to receiving an input associated with a change of state of a surgical system performing the surgical procedure, and encoding image data of the surgical procedure captured after the change of state based on the adjusted encoding configuration. 1. (canceled)2. A teleoperated surgical system , comprising:a video encoder configured to encode video image data based on an encoding parameter, the video image data corresponding to video images of a medical procedure; receive a signal indicative that an upcoming state change of the surgical system is expected to occur, wherein the state change affects the video image data; and', 'in response to receiving the signal, adjust a value of the encoding', 'parameter., 'a processor configured to3. The surgical system of claim 2 ,wherein the processor is configured to adjust the encoding parameter prior to the state change occurring.4. The surgical system of claim 2 , further comprising:an interface configured to receive an input command, wherein the surgical system is configured to effectuate the state change in response to receiving the input command;wherein the signal indicative that the state change is expected to occur is generated in response to the interface receiving the input command.5. The surgical system of claim 4 , further comprising:a medical instrument, wherein the state change comprises any of: moving the medical instrument, executing a function of the medical instrument, and changing an operation mode of the medical instrument.6. The surgical system of claim 4 , further comprising:an endoscopic image capture device configured to generate the video image data, wherein the state change comprises any of: moving the endoscopic image capture device, changing a field of view of the endoscopic image capture device, and changing an operation mode of the endoscopic image capture device.7. The surgical ...

IMAGE CODING METHOD, IMAGE CODING DEVICE, IMAGE PROCESSING APPARATUS, AND IMAGE TRANSMITTING/RECEIVING SYSTEM

An image coding device encodes image data in units of encoding line number that is number of lines necessary for implementing encoding. The image coding device includes: an image-data transforming unit that transforms image data of lines, number of which is smaller than the encoding-line number, into to-be-encoded image data of the encoding-line number of lines; and an encoding unit that encodes the to-be-encoded image data. 1. An image coding device that encodes image data in units of encoding line number that is number of lines necessary for implementing encoding , the image coding device comprising:an image-data transforming unit that transforms image data of lines, number of which is smaller than the encoding-line number, into to-be-encoded image data of the encoding-line number of lines; andan encoding unit that encodes the to-be-encoded image data.2. The image coding device according to claim 1 , further comprisinga line-number determining unit that determines the number of lines of the image data to be transformed into the to-be-encoded image data depending on communication status information indicating communication status of a network over which the encoded image data is to be transmitted, whereinthe image-data transforming unit transforms the image data of the determined number of lines into the to-be-encoded image data.3. The image coding device according to claim 2 , wherein the communication status information indicates an amount of data transmittable over the network claim 2 , andthe line-number determining unit determines the number of lines such that the larger the amount of transmittable data, the smaller the number of lines.4. The image coding device according to claim 1 , wherein the image-data transforming unit divides each line of the image data to be transformed into subblocks claim 1 , each of the subblocks being made up of a predetermined number of pixels claim 1 , and rearranges the subblocks into image data of the encoding-line number of ...

Adaptive coding, transmission and efficient display of multimedia (acted)

Embodiments of the invention receive videos and feedback data associated with the videos from a client device and adaptively encode the videos based on the feedback data. The encoded videos are suitable to be transmitted over a network and displayed on the client device. Embodiments of an encoding server adaptively changes resolution of a video on the fly or scale the video quality up or down based on the factors described by the feedback data, including network condition for transmitting the encoded video, network delay, encoder and decoder processing capacity and feedback from viewers of the decoded video. Furthermore, the encoding server adaptively encodes the video based on a combination of various factors described by the feedback data.

Camera System Transmission In Bandwidth Constrained Environments

An image capture accelerator performs accelerated processing of image data. In one embodiment, the image capture accelerator includes accelerator circuitry including a pre-processing engine and a compression engine. The pre-processing engine is configured to perform accelerated processing on received image data, and the compression engine is configured to compress processed image data received from the pre-processing engine. In one embodiment, the image capture accelerator further includes a demultiplexer configured to receive image data captured by an image sensor array implemented within, for example, an image sensor chip. The demultiplexer may output the received image data to an image signal processor when the image data is captured by the image sensor array in a standard capture mode, and may output the received image data to the accelerator circuitry when the image data is captured by the image sensor array in an accelerated capture mode. 1. A camera system , comprising:an image sensor chip configured to produce image data representative of light incident upon the image sensor chip; an input to receive the image data from the image sensor chip;', 'a compression engine configured to decimate the received image data into a plurality of image sub-band components including a first image sub-band component representative of the image data; and', in response to the amount of bandwidth available to the camera system being less than a threshold amount of bandwidth, encode the first image sub-band component and output the encoded first image sub-band component; and', 'in response to the amount of bandwidth available to the camera system being greater than the threshold amount of bandwidth, encode the image data and output the encoded image data., 'an encoder configured to], 'an image signal processor chip (“ISP”) configured to detect an amount of bandwidth available to the camera system, the ISP comprising2. The camera system of claim 1 , wherein the ISP further ...

METHOD AND SYSTEM FOR ADAPTIVE IMAGE TRANSFERRING FOR ENHANCING IMAGE QUALITY

An adaptive image transmission method for improving image quality, and a system thereof. The adaptive image transmission method for improving image quality includes the steps of: generating a reduced image by reducing an image for measuring a quality of an original image to be transmitted, by an image transmission system; measuring a restored image quality of the reduced image restored by decoding after performing pre-encoding on the reduced image, by the image transmission system; selectively resizing the original image based on the restored image quality, by the image transmission system; and encoding the selectively resized original image and transmitting the encoded image to an image reception system, by the image transmission system. 1. An adaptive image transmission method for improving image quality , the method comprising the steps of:generating a reduced image by reducing an image for measuring a quality of an original image to be transmitted, by an image transmission system;measuring a restored image quality of the reduced image restored by decoding after performing pre-encoding on the reduced image, by the image transmission system;selectively resizing the original image based on the restored image quality, by the image transmission system; andencoding the selectively resized original image and transmitting the encoded image to an image reception system, by the image transmission system.2. The method of claim 1 , further comprising the steps of:confirming a network delay factor, by the image transmission system; anddetermining a reduction level of the reduced image based on the confirmed network delay factor.3. The method of claim 2 , wherein the step of confirming a network delay factor by the image transmission system includes the step of:confirming a predicted network delay time as the network delay factor based on feedback information received from the image reception system, by the image transmission system; orconfirming a state of a transmission ...

System and methods for video and audio data distribution

Data compression and decompression methods for compressing and decompressing data based on an actual or expected throughput (bandwidth) of a system. In one embodiment, a controller tracks and monitors the throughput (data storage and retrieval) of a data compression system and generates control signals to enable/disable different compression algorithms when, e.g., a bottleneck occurs so as to increase the throughput and eliminate the bottleneck.

EXTENSIONS OF MOTION-CONSTRAINED TILE SETS SEI MESSAGE FOR INTERACTIVITY

An extension to the motion-constrained tile sets SEI message provides functionality to signal all tiles are independently decodable and to signal the ROIs that may have more than one tile per ROI. With this extension, the functionality to redefine any independently decodable region-of-interest in a CVS at a coding tree unit level based on user interactivity is enabled. The extension supports the interactivity utilized in various applications such as interactive Ultra High Definition Television (UHDTV), dynamic high-quality zoom-in application, interactive on-demand, e-learning, smart surveillance and many other applications. Additionally, the temporal MCTS SEI message is able to be used by an encoder for tiled streaming to signal explicitly to the decoder that the decoder need only to display the ROI. 157-. (canceled)58. An apparatus for processing bitstream of video , comprising: decode a encoded bitstream; and', 'generate an image based on information which indicates whether a value of each sample in a motion constrained tile set is the same as a value of a sample obtained in case all coding tree blocks of all pictures are decoded, and in case boundaries of the motion constrained tile set are treated as picture boundaries for the decoding, and the coding tree blocks that do not belong to the motion constrained tile set are not decoded,', 'wherein the information includes one flag that applies to every tile., 'a decoding unit configured to59. The apparatus according to claim 58 , wherein the information is included in a supplemental enhancement information message of the encoded bitstream.60. The apparatus according to claim 58 , further comprisinga receiving unit configured to receive the encoded bitstream including a supplemental enhancement information message.61. The apparatus according to claim 58 , wherein the decoding unit is further configured to generate the image of a region including one or more tiles.62. The apparatus according to claim 61 , wherein the ...

CAMERA SYSTEM

Each of multiple cameras encodes and transmits a video signal captured, the encoding being performed with one of multiple variable bit rate encoding schemes each of which has a different average bit rate. A receiving device periodically measures the total bandwidth of the video signals received from the multiple cameras, and when the total bandwidth exceeds a first threshold value the receiving device switches the encoding scheme used by the cameras to a scheme having a lower average bit rate. In addition, when the total bandwidth falls below a second threshold value that is equal to or less than the first threshold value, the receiving device switches the encoding scheme used by the cameras to a scheme having a higher average bit rate. 1. A method for controlling a camera system , the method comprising:receiving video signals from one or more cameras via network, each of the video signals being encoded with one of a plurality of encoding schemes;providing, to the one or more cameras via network, a first signal if a total bandwidth of the video signals is above a first threshold value; andproviding, to the one or more cameras via network, a second signal if the total bandwidth is below a second threshold value, whereinthe first signal is provided to change an encoding scheme in use to another encoding scheme using lower bit rate; andthe second signal is provided to change an encoding scheme in use to another encoding scheme using higher bit rate.2. The method for controlling the camera system according to claim 1 , whereinthe plurality of encoding schemes include one or more variable bit rate encoding schemes whose average bit rates are different from each other.3. The method for controlling the camera system according to claim 1 , whereinthe second threshold value is equal to or less than the first threshold value.4. The method for controlling the camera system according to claim 2 , further comprising:in response to the total bandwidth of the video signals being ...

VIDEO DECODING AND ENCODING SYSTEM

Video decoder adapted for decoding video based on decoder parameters selected from variable decoder parameters, the decoder comprising an estimator adapted to estimate user viewing experience based on sensor data and comprising a constraint analyzer adapted to analyze constraints when using the decoder parameters, the video decoder further comprising a selector adapted to select said decoder parameters from the variable decoder parameters, wherein the selector is coupled to the estimator and the constraint analyzer. 1. Video decoder adapted for decoding video based on decoder parameters selected from variable decoder parameters , the decoder comprising an estimator adapted to estimate user viewing experience based on sensor data and comprising a constraint analyzer adapted to analyze constraints when using the decoder parameters , the video decoder further comprising a selector adapted to select said decoder parameters from the variable decoder parameters , wherein the selector is coupled to the estimator and the constraint analyzer.2. Video decoder according to claim 1 , wherein the selector is adapted to select decoder parameters so that user viewing experience and constraints are balanced according to a set of predetermined rules.3. Video decoder according to any one of the previous claims claim 1 , wherein the selector is adapted to translate the selected decoder parameters into codec parameters claim 1 , and wherein the video decoder further comprises a communication module for sending the codec parameters to a video encoder.4. Video decoder according to any one of the previous claims claim 1 , wherein the constraints comprise one or multiple of computational requirements claim 1 , memory footprint claim 1 , battery use and bandwidth use.5. Video decoder according to any one of the previous claims claim 1 , wherein the sensor data is adapted to measure environmental parameters and wherein the user viewing experience is estimated based on predetermined ...

SYSTEM AND METHOD FOR SENDING VIDEO DATA OVER A WIRELESS CHANNEL

A system and method for transmitting video. Each frame of video is divided into a number of regions, that are transmitted in order beginning with a region of most importance. The region of most importance may be different from one frame to the next. When the video is transmitted over a channel with limited channel capacity, so that some frames are not transmitted completely, the region of most importance in a current frame may be selected to be the first region not transmitted in the previous frame. The system and method may be useful for the transmission of video data over a wireless link having variable or limited channel capacity. 1. A method for transmitting video for a display panel comprising N regions , numbered 1 through N , wherein N is a positive integer , the method comprising:identifying, for a first frame of video, a first region of most importance, from among the N regions;transmitting data from the first frame of video, one region at a time, beginning with the first region of most importance, until a first frame transmission interval corresponding to the first frame of video has elapsed;identifying, for a second frame of video, a second region of most importance, from among the N regions, the second region of most importance being different from the first region of most importance; andtransmitting data from the second frame of video, one region at a time, beginning with the second region of most importance, until a second frame transmission interval corresponding to the second frame of video has elapsed.2. The method of claim 1 , wherein the identifying of the second region of most importance comprises identifying a region from among the N regions for which a measure of the difference between data for the first frame and data for the second frame is greatest claim 1 , when during the first frame transmission interval all N regions were transmitted.3. The method of claim 1 , wherein the identifying of the second region of most importance comprises ...

Encoding, transmission and decoding of combined high motion and high fidelity content

Provided are systems, methods, and computer-readable media for encoding, transmitting and decoding content having high fidelity and high motion content. In one aspect, a device includes at least one processor and at least memory having computer-readable instructions, which when executed by the at least one processor, cause the at least one processor to receive an encoded frame; determine whether the encoded frame includes at least one region having high fidelity content; and upon determining that the encoded frame includes at least one region having high fidelity content, perform a first decoding process for decoding the at least one region having high fidelity content, display a previous version of the high fidelity content on a display while the first decoding process is being performed, and display a decoded version of the at least one region having the high fidelity content on the display when performing the first decoding process is complete.

COMMUNICATION TERMINAL, COMMUNICATION FUNCTION STARTING METHOD, AND COMPUTER-READABLE RECORDING MEDIUM

A communication terminal includes a display control unit configured to display, on a display unit, a function selecting screen that contains a first icon for receiving a selection of a first communication function and a second icon for receiving a selection of a second communication function. The first communication function is to provide communication using a signaling protocol for connecting to or disconnecting from a destination of communication and an encoding protocol for encapsulating communication data in IP packets. The second communication function is to provide communication using the same signaling protocol and a different encoding protocol. The communication terminal also includes a receiving unit configured to receive a selection of the first icon or the second icon; and a starting unit configured to start the first communication function and the second communication function in response to the selection of the first icon and the second icon, respectively. 1a display control unit configured to display, on a display unit, a function selecting screen that contains a first icon for receiving a selection of a first communication function and a second icon for receiving a selection of a second communication function, the first communication function being to provide communication using a signaling protocol for connecting to or disconnecting from a destination of communication and an encoding protocol for encapsulating communication data in internet protocol (IP) packets, the second communication function being to provide communication using the signaling protocol of the first communication function and an encoding protocol different from that of the first communication function;a receiving unit configured to receive a selection of the first icon or the second icon; and start the first communication function in response to the selection of the first icon, and', 'start the second communication function in response to the selection of the second icon., 'a ...

FEEDBACK OPTIMIZED VIDEO CODING PARAMETERS

A system for managing delivery of video content. The system includes a controller and one or more players. The controller may be configured to control generation of a plurality of streams containing the video content based upon feedback regarding decoding at least one of the plurality of streams. The one or more players may be configured to select a stream from the plurality of streams, generate decoding statistics for the selected stream, and send the decoding statistics to the controller as the feedback. 1. A computer-implemented method , comprising:sending, to a client device, a manifest file including information about one or more available content streams;transmitting, to the client device, a selected content stream of the one or more available content streams, the selection of the selected content stream based at least in part on the information in the manifest file;receiving at least one player metric associated with a content player installed on the client device, the content player configured to provide playback of the selected content stream on the client device; andadjusting the one or more available content streams based at least in part on the at least one player metric.2. The method of claim 1 , further comprising:determining a set of encoding parameters based at least on the at least one player metric.3. The method of claim 2 , wherein the set of encoding parameters includes at least one of display resolution claim 2 , bitrate claim 2 , profile and level claim 2 , group of picture structure claim 2 , or entropy coding.4. The method of claim 2 , further comprising:determining an optimized set of encoding parameters for the client device by an analysis system.5. The method of claim 4 , further comprising:causing at least one encoder to generate at least one updated content stream based at least on the set of encoding parameters or the optimized set of encoding parameters.6. The method of claim 5 , further comprising:sending an updated manifest file ...

Method and Apparatus for Manipulating MPEG Video

A computer implemented method of manipulating and displaying an MPEG stream is described. In one embodiment of the invention, a computer implemented method comprises defining a spatial location across a series of pictures of an MPEG stream; and for each picture of the series of pictures in the MPEG stream, partially decoding the picture to determine an area of the picture falling within the spatial location.

Moving image distribution server, moving image reproduction apparatus, control method, and recording medium

Rendering processing is performed such that a distribution screen is rendered in rendering processing of a subsequent stage by referring to a Depth map generated by rendering processing of a preceding stage. A moving image distribution server selects the Depth map for coding determination during execution of rendering processing of the subsequent stage for a first screen, and determines for each set block whether to perform inter-frame coding by referring to a Depth map generated for a second screen rendered before the first screen. After rendering processing of the subsequent stage has ended for the first screen, the server performs coding in accordance with the determination result and sends the coded moving image data to an external device. The determination result is sent to the external device before generation of the coded moving image data of the first screen is completed.

Systems and Methods for Encoding Alternative Streams of Video for Playback on Playback Devices having Predetermined Display Aspect Ratios and Network Connection Maximum Data Rates

Systems and methods for adaptive bitrate streaming of alternative streams of video encoded at resolution and sample aspect ratio combinations and maximum bitrates in accordance with embodiments of the invention are disclosed. In one embodiment of the invention, a source encoder configured to encode a source video stream as a plurality of alternative streams of video for playback on a playback device includes a processor configured to receive multimedia content including source video data having a primary resolution, a primary sample aspect ratio, and a primary frame rate and to encode the source video data as alternative streams of video, where the resolution and sample aspect ratio of at least one of the alternative streams of video are selected to have an aspect ratio that is the same as a predetermined display aspect ratio and at least one of the alternative streams is encoded at a maximum bitrate. 1 receive multimedia content, where the multimedia content comprises source video data having a primary resolution, a primary sample aspect ratio, and a primary frame rate; and', 'encode the source video data as a set of alternative streams of video, where:', 'the resolution and sample aspect ratio of at least one of the alternative streams of video are selected to have an aspect ratio that is the same as a predetermined display aspect ratio; and', 'at least one of the alternative streams is encoded at a maximum bitrate corresponding to a predetermined network connection maximum data rate., 'a processor configured by an encoding application to. A source encoder configured to encode a source video stream as a plurality of alternative streams of video for playback on a playback device, comprising: The current application is a continuation of U.S. patent application Ser. No. 14/464,146 filed Aug. 20, 2014 which is a continuation of U.S. patent application Ser. No. 13/432,521 filed Mar. 28, 2012 which issued on Aug. 26, 2014 as U.S. Pat. No. 8,818,171 which claimed ...

Image Processing Methods and Image Processing Apparatuses

Image processing methods and image processing apparatuses are provided. The image processing method comprises: determining at least one region of interest in an image; determining a parameter of interest of pixels in the image at least according to distribution of the at least one region of interest in the image; determining target positions of the pixels according to the parameter of interest of the pixels and a reduction ratio; and obtaining, according to the target positions of the pixels, a reduced image corresponding to the image. A proportion occupied by pixels of each region in a reduced image after compression is determined according to a degree of interest of a user in each region in an image, to cause a region appreciated by the user to be presented with high quality during restoration, and facilitate image processing after compression. 1. A method , comprising:determining, by a system comprising a processor, at least one region of interest in an image;determining a parameter of interest of pixels in the image at least according to a distribution of the at least one region of interest in the image;determining target positions of the pixels according to the parameter of interest of the pixels and a reduction ratio; andobtaining, according to the target positions of the pixels, a reduced image corresponding to the image.2. The method of claim 1 , wherein the determining the parameter of interest of pixels in the image at least according to the distribution of the at least one region of interest in the image comprises:determining the parameter of interest of the pixels according to the distribution of the at least one region of interest in the image and distribution information of the pixels in the image.3. The method of claim 2 , wherein the distribution information of the pixels in the image comprises:first position information of the pixels relative to the at least one region of interest.4. The method of claim 2 , wherein the distribution information of ...

METHOD AND DEVICE FOR TRANSMITTING A SEQUENCE OF PICTURES, AND CORRESPONDING METHOD AND DEVICE FOR RECEPTION, COMPUTER PROGRAM AND RECORDING MEDIUM

A method and device for transmitting a sequence of images, and corresponding method and device for receiving same, computer program and recording medium. The invention pertains to a method for transmitting a sequence of images. According to the invention, said method comprises the following steps: identifying (), in at least one image of said sequence, at least two distinct regions; for each of said regions, determining () a coding mode adapted to said region; coding () said at least one image using, for each of said regions, the coding mode adapted to said region, and transmission () in a single video stream. 1. A transmission method for a sequence of pictures , characterized in that it comprises the following steps:{'b': '11', 'identification (), in at least one picture in said sequence, of at least two separate regions;'}{'b': '12', 'for each of said regions, determination () of a mode of coding that is suited to said region;'}{'b': 13', '14, 'coding () of said at least one picture by using, for each of said regions, the mode of coding that is suited to said region, and transmission () in a single video stream.'}212. The transmission method as claimed in claim 1 , characterized in that said step of determination () takes account of the content of said region.312. The transmission method as claimed in claim 2 , characterized in that said step of determination () takes account of an activity in said region.4. The transmission method as claimed in claim 1 , characterized in that said mode of coding that is suited to a region is defined for a plurality of pictures in said sequence.5. The transmission method as claimed in claim 1 , characterized in that said modes of coding belong to the group comprising:coding of IPPP, or “I picture, P picture, P picture, P picture”, type,coding of hierarchic P picture type,coding of IPPPI, or “I picture, P picture, P picture, P picture, I picture”, type,coding of adaptive intra refresh type.6. The transmission method as claimed in ...

Image communication apparatus, image transmission apparatus, and image reception apparatus

Included are an encoding section, a decoding section, and an image recognition section. The encoding section performs an encoding process for a video signal to be input based on a calculated encoding mode, and transmits an encoded stream. The decoding section performs a decoding process for the received encoded stream, and outputs a decoded image. The image recognition section performs an image recognition process for the decoded image. The encoding section adjusts the encoding mode based on recognition accuracy information representing the certainty of a recognition result in the image recognition section.

IMAGE PROCESSING APPARATUS, IMAGE PROCESSING METHOD, AND IMAGE DISPLAY SYSTEM

An image processing apparatus includes a content interface, a communication interface and a controller configured to receive content from a content source through the content interface, encode image frames comprised in the content according to an encoding mode, and transmit the encoded image frames to a display apparatus through the communication interface. The controller encodes the image frames according to a first encoding option in a first encoding mode and encodes the image frames according to a second encoding option having a different encoding time delay from that of the first encoding option in a second encoding mode. 1. An image processing apparatus comprising:a content interface;a communication interface; anda controller configured to receive content comprising a plurality of image frames from a content source through the content interface, encode the plurality image frames according to an encoding mode selected from among a plurality of content modes, and transmit the encoded image frames to a display apparatus through the communication interface,wherein the controller is further configured to encode the plurality of image frames in a first encoding mode based on a first encoding option and to encode the plurality of image frames in a second encoding mode having a different encoding time delay from the first encoding mode according to a second encoding option.2. The image processing apparatus of claim 1 , wherein the controller is further configured to encode the plurality of image frames according to the first encoding option having a first encoding time delay and a first loss rate of image information in the first encoding mode claim 1 , andthe controller is further configured to encode the plurality of image frames according to the second encoding option having a second encoding time delay greater than the first encoding time delay and a second loss rate of image information smaller than the first loss rate of image information.3. The image processing ...

METHODS, SYSTEMS AND DEVICES FOR ADJUSTING PANORAMIC VIDEO CONTENT

Aspects of the subject disclosure may include, for example, embodiments for capturing video content with a camera. The camera is communicatively coupled to the device. Further embodiments include obtaining a network condition of a communication network. Additional embodiments include determining a network criterion according to the network condition. Also, embodiments include calculating a threshold according to the network criterion. Further embodiments include adjusting the video content in response to determining network criterion resulting in adjusted video content. Additional embodiments include determining that a first portion of the adjusted video content satisfies the threshold. Also, embodiments include transmitting the adjusted video content to a video content server over the communication network. Other embodiments are disclosed. 1. A device , comprising:a processing system including a processor; and identifying a network condition that adversely affects network bandwidth of a communication network;', capturing video content with a camera with a panoramic view for the video content at a first panoramic setting, wherein the camera is communicatively coupled to the device; and', 'adjusting the video content according to the network condition resulting in adjusted video content, wherein the adjusting reduces a scope of images in the video content by reducing the panoramic view of the video content from the first panoramic setting to a second panoramic setting that decreases bandwidth utilization of the communication network to mitigate the network condition., 'responsive to the identifying], 'a memory that stores executable instructions that, when executed by the processing system, facilitate performance of operations, the operations comprising2. The device of claim 1 , wherein the operations further comprise calculating a threshold according to the network condition.3. The device of claim 2 , wherein the operations further comprise:determining that a first ...

METHODS, SYSTEMS AND DEVICES FOR ADJUSTING PANORAMIC VIEW OF A CAMERA FOR CAPTURING VIDEO CONTENT

Aspects of the subject disclosure may include, for example, embodiments for selecting a first camera from one or more cameras communicatively coupled to a computing device. Further embodiments include adjusting a first hardware controller on the first camera in response to detecting a network condition of a communication network resulting in an adjusted first camera. Additional embodiments include capturing first video content with the adjusted first camera. Also, embodiments include transmitting the first video content to a video content server over the communication network. Other embodiments are disclosed. 1. A device , comprising:a processing system including a processor; anda memory that stores executable instructions that, when executed by the processing system, facilitate performance of operations, the operations comprising:detecting a network condition that adversely affects network bandwidth of a communication network; selecting a first camera from one or more cameras communicatively coupled to the device;', 'adjusting, according to the network condition, a first hardware controller on the first camera to reduce a scope of images captured by the first camera, wherein the adjusting results in an adjusted first camera, and wherein reducing the scope of images captured by the first camera decreases bandwidth usage of the communication network by the first camera; and', 'capturing first video content with the adjusted first camera., 'responsive to the detecting2. The device of claim 1 , wherein the operations further comprise transmitting the first video content to a video content server over the communication network.3. The device of claim 1 , wherein the first video content is panoramic video content.4. The device of claim 1 , wherein the adjusting of the first hardware controller on the first camera comprises adjusting a first panoramic view captured by the first camera claim 1 , wherein a first range of the first panoramic view is from 180 degrees to 360 ...

COMMON COPY COMPRESSION

Embodiments of the present invention provide systems, methods, and computer storage media directed to hosting a plurality of copies of a digital content. A common component and one or more individual components from one or more copies of the digital content are generated. As such, the common component and the one or more individual components are stored, such that each individual component in conjunction with the common component represents a separate copy of the digital content. In some implementations, a compression ratio may be customized for determining the sizing of the common component and individual component. 1. One or more non-transitory computer storage media storing computer-useable instructions that , when used by one or more computing devices , cause the one or more computing devices to perform operations for hosting a plurality of copies of a digital content , the operations comprising:determining a compression ratio for the plurality of copies of the digital content;generating a common component, an individual component, and at least one residual component from one or more copies of the digital content, the components sized based at least upon the compression ratio, wherein the at least one residual component includes residual errors of the common component required for reconstructing; andstoring the common component and a plurality of copies of the individual component, each copy of the individual component representing a copy of the digital content.2. The one or more computer storage media of claim 1 , the operations further comprising:reconstructing a copy of the digital content using the common component and a selected copy of the individual component.3. The one or more computer storage media of claim 2 , wherein the reconstructing is initiated upon receiving a request to provide the copy of the digital content claim 2 , and wherein the selected copy of the individual component is identified based upon the request.4. (canceled)5. The one or more ...

METHOD AND DEVICE FOR COMPRESSING IMAGE ON BASIS OF PHOTOGRAPHY INFORMATION

An image encoding method includes: obtaining imaging information determined during a process of capturing an image; generating metadata for determining a compression strength of the image based on the imaging information; determining the compression strength of the image based on the metadata; and encoding the image based on the determined compression strength. 1. An image encoding method comprising:obtaining imaging information determined during a process of capturing an image;generating metadata for determining a compression strength of the image based on the imaging information;determining the compression strength of the image based on the metadata; andencoding the image based on the determined compression strength.2. The image encoding method of claim 1 ,wherein the obtaining of the imaging information comprises obtaining imaging information comprising at least one of an exposure value of the image, a shutter speed, an iris value, and an ISO sensitivity, andwherein the generating of the metadata comprises: generating information about an average brightness value of the image based on the obtained imaging information.3. The image encoding method of claim 1 ,wherein the obtaining of the imaging information comprises obtaining imaging information from a sensor attached to an image capturing apparatus and comprising at least one of a geomagnetic sensor and an acceleration sensor, andwherein the generating of the metadata comprises: generating motion information of the image based on the obtained imaging information.4. The image encoding method of claim 1 ,wherein the obtaining of the imaging information comprises obtaining imaging information comprising at least one of information about a face recognition region and information about a focused-on region in the image, andwherein the generating of the metadata comprises: generating coordinate information related to the imaging information, based on the obtained imaging information.5. The image encoding method of claim ...

Systems and methods for improving video stutter in high resolution progressive video

Systems and methods for improving video stutter in high resolution progressive video captured with fast exposure times. In a first approach, digital video is captured with fast shutter speeds that cause objects moving within the frame to appear motionless. The video codec generates motion information that may be utilized to add an artificial motion blur to each frame of the digital video during processing in a digital video pipeline. The motion blur creates the appearance that an object is moving in the frame. In a second approach, the lens assembly of the digital camera includes an electronically controlled filter that attenuates the light reaching an image sensor such that the shutter speeds may be decreased in order to capture motion blur. The electronically controlled filter may be a liquid crystal display (LCD) device that is set to a plurality of different transparency levels based on a target exposure value.

DISPLAY APPARATUS AND CONTROL METHOD THEREOF

Predicting which of content presented to a user on a graphical user interface of a display apparatus will be selected by the user and performing preliminary image processing on the predicted content to shorten image processing time for reproducing the content if the content is actually selected by the user for reproduction. 1. A display apparatus comprising:an image processor configured to perform image processing on an image signal of video content;a display configured to display an image of the video content based on the image signal subjected to the image processing of the image processor;a user interface configured to receive user input; anda processor configured to control the display to display a graphical user interface comprising a plurality of items respectively corresponding to a plurality of pieces of video content, predict video content corresponding to an item that a user will select among the plurality of displayed items, and control the image processor to apply first image processing on the video content, and in response to the user interface receiving the user input selecting the video content for reproduction, apply second image processing on the video content processed by the first image processing to display the image of the video content.2. The display apparatus according to claim 1 , wherein the processor predicts the video content based on interest of the user claim 1 , and determines the interest of the user based on at least one among clicking times claim 1 , a cursor keeping time claim 1 , an eye fixing time of a user claim 1 , user control times and screen displaying times with regard to a plurality of items.3. The display apparatus according to claim 1 , wherein the processor predicts the video content based on a correlation with content currently reproduced or content previously reproduced claim 1 , and the correlation is high based on a storing time claim 1 , a storing location claim 1 , a production time claim 1 , a production place ...

IMAGE PROCESSING DEVICE AND METHOD

Provided is an image processing device including a receiving section configured to receive a bitstream obtained by encoding an image having at least one layer and buffer management parameter information of each layer indicating at least one of that a parameter for managing a decoder buffer is a parameter for performing a decoding process of only a corresponding layer and that the parameter for managing the decoder buffer is a parameter for performing a decoding process of a corresponding layer and a lower layer, and a decoding section configured to decode the bitstream received by the receiving section and generate an image. 1. An image processing device comprising:a setting section configured to set buffer management parameter information of each layer of a plurality of layers indicating at least one of that a parameter for managing a decoder buffer is a parameter for performing a decoding process of only a corresponding layer and that the parameter for managing the decoder buffer is a parameter for performing a decoding process of the corresponding layer and a lower layer;an encoding section configured to encode an image having at least one layer and generate a bitstream; anda transmitting section configured to transmit the buffer management parameter information set by the setting section and the bitstream generated by the encoding section,wherein the setting section, the encoding section, and the transmitting section are each implemented via at least one processor.2. The image processing device according to claim 1 ,wherein the plurality of layers includes a layer and a sublayer.3. The image processing device according to claim 2 ,wherein the layer is a view of multi-view coding.4. The image processing device according to claim 2 ,wherein the layer is a layer of scalable video coding.5. The image processing device according to claim 1 ,wherein the buffer management parameter information is described in supplemental enhancement information (SEI).6. The image ...

Sending a Frame Difference or Raw Chunk Based on a Known Acknowledgement

Systems, apparatuses, and methods for sending hybrid frames as part of an encoded video stream are disclosed. A system includes a transmitter and a receiver communicating wirelessly. The transmitter partitions a first frame of a video stream into a plurality of portions and sends the plurality of portions to the receiver. The transmitter records which portions of the first frame which were not acknowledged by the receiver. Next, the transmitter generates one or more first portions of a hybrid frame based only on data from a second frame of the video stream and the transmitter generates one or more second portions of the hybrid frame based on a comparison of data from the second frame to data of the first frame. The one or more first portions of the hybrid frame correspond to portions of the first frame which were not acknowledged by the receiver. 1. A system comprising:a transmitter; anda receiver; partition a first frame of a video stream into a plurality of portions;', 'send the plurality of portions of the first frame to the receiver;', 'store indications for any portions of the plurality of portions of the first frame which were not acknowledged as being received by the receiver;', 'generate one or more portions of a hybrid frame based only on data from a second frame of the video stream; and', 'generate one or more portions of the hybrid frame based on a comparison of data from the second frame to data of the first frame., 'wherein the transmitter is configured to2. The system as recited in claim 1 , wherein the first frame is an intra-coded frame (I-frame) claim 1 , and wherein for each portion of a plurality of portions of the hybrid frame claim 1 , the transmitter is configured to:generate the portion based only on data from the first frame if the portion corresponds to a portion of the I-frame which was not acknowledged by the receiver during transmission of the I-frame; andgenerate the portion based on difference data of the second frame compared to the ...

SYNCHRONIZED WIRELESS AND VIDEO OPERATIONS

Methods and systems are disclosed for joint scheduling of wireless and video activities. Video data may be accessed to estimate an encoding time interval for the video data, identify a per-frame display duration for the video data, and to define a non-encoding time interval. A schedule may be generated for a set of network-calibration events that indicates, for each network-calibration event of the set of network-calibration events. Streaming of the video data to a display device may be initiated such that for each frame of a set of frames represented in the video data: the frame is encoded, transmitted, and the set of network-calibration events is initiated according to the schedule. Each of the network-calibration event being configured to be initiated during a non-encoding time interval during which none of the set of frames are being encoded. 1. A method comprising:accessing, by a computing device, video data;estimating an encoding time interval for the video data that indicates a duration of encoding a single frame from the video data;identifying a per-frame display duration for the video data that indicates a period of time during which a single frame from the video data is to be displayed;defining a non-encoding time interval as being a difference between the per-frame display duration and the encoding time interval;generating a schedule for a set of network-calibration events that indicates, for each network-calibration event of the set of network-calibration events, a time at which the network-calibration event is to be initiated, the time being relative to a frame-processing event corresponding to a frame represented in the video data; encoding the frame; and', 'transmitting the encoded frame, wherein the transmission is timed such that a time period between transmissions of sequential encoded frames is equal to the per-frame display duration; and, 'streaming the video data to a display device, wherein the streaming includes, for each frame of a set of ...

IMAGE CODING APPARATUS, IMAGE CODING METHOD, IMAGE DECODING APPARATUS, IMAGE DECODING METHOD, AND STORAGE MEDIUM

An image coding apparatus includes a block dividing unit configured to divide an input image into a plurality of blocks, a prediction unit configured to perform prediction based on coded pixels to generate prediction errors, a transformation unit configured to perform orthogonal transform to the prediction errors to generate transform coefficients, a quantization matrix generation unit configured to generate quantization matrices that are used to quantize the transform coefficients, a quantization matrix coding unit configured to calculate difference values by scanning the quantization matrices and to code the difference values, a quantization unit configured to generate quantization coefficients by quantizing the generated transform coefficients using the quantization matrices, and a coefficient coding unit configured to code the quantization coefficients, wherein the quantization matrix coding unit is configured to scan coefficients of the quantization matrices in a unidirectional manner to calculate the difference value. 1. An image decoding apparatus for decoding a bit stream , the image decoding apparatus comprising:an acquisition unit configured to acquire, from the bit stream, a difference value between elements included in a quantization matrix of n rows×n columns (n is an integer equal to or greater than 4);a derivation unit configured to derive a first element by adding a first difference value of a plurality of difference values acquired by the acquisition unit and 8 and derive an (r-th)-element (r is an integer equal to or greater than 2) by adding an r-th difference value of the plurality of difference values and an (r−1)-th element, so as to derive a plurality of elements; andan association unit configured to associate the plurality of elements derived by the derivation unit with elements in the quantization matrix that can be expressed in a two-dimensional array,wherein in a case where the association unit associates a predetermined element of the ...

IMAGE CODING APPARATUS, IMAGE CODING METHOD, IMAGE DECODING APPARATUS, IMAGE DECODING METHOD, AND STORAGE MEDIUM

An image coding apparatus includes a block dividing unit configured to divide an input image into a plurality of blocks, a prediction unit configured to perform prediction based on coded pixels to generate prediction errors, a transformation unit configured to perform orthogonal transform to the prediction errors to generate transform coefficients, a quantization matrix generation unit configured to generate quantization matrices that are used to quantize the transform coefficients, a quantization matrix coding unit configured to calculate difference values by scanning the quantization matrices and to code the difference values, a quantization unit configured to generate quantization coefficients by quantizing the generated transform coefficients using the quantization matrices, and a coefficient coding unit configured to code the quantization coefficients, wherein the quantization matrix coding unit is configured to scan coefficients of the quantization matrices in a unidirectional manner to calculate the difference value. 1. An image coding apparatus comprising:an acquisition unit configured to acquire a difference value between elements included in a quantization matrix of n rows and n columns (n is an integer equal to or greater than 4) that is used for coding image data to be coded and that can be expressed in a two-dimensional array; anda coding unit configured to code the image data by using the quantization matrix,wherein the acquisition unit acquires a difference value between an element corresponding to a (p+1)-th row (p is an integer equal to or greater than 2 and smaller than n) and a first column of the quantization matrix and an element corresponding to a first row and a p-th column of the quantization matrix, andwherein the acquisition unit acquires a difference value between an element corresponding to a n-th row and a (n−1)-th column of the quantization matrix and an element corresponding to a (n−2)-th row and a n-th column of the quantization ...

IMAGE CODING APPARATUS, IMAGE CODING METHOD, IMAGE DECODING APPARATUS, IMAGE DECODING METHOD, AND STORAGE MEDIUM

An image coding apparatus includes a block dividing unit configured to divide an input image into a plurality of blocks, a prediction unit configured to perform prediction based on coded pixels to generate prediction errors, a transformation unit configured to perform orthogonal transform to the prediction errors to generate transform coefficients, a quantization matrix generation unit configured to generate quantization matrices that are used to quantize the transform coefficients, a quantization matrix coding unit configured to calculate difference values by scanning the quantization matrices and to code the difference values, a quantization unit configured to generate quantization coefficients by quantizing the generated transform coefficients using the quantization matrices, and a coefficient coding unit configured to code the quantization coefficients, wherein the quantization matrix coding unit is configured to scan coefficients of the quantization matrices in a unidirectional manner to calculate the difference value. 1. An image coding apparatus comprising:an acquisition unit configured acquire a difference value between elements included in a quantization matrix of n rows and n columns (n is an integer equal to or greater than 4) that is used for coding image data to be coded and that can be expressed in a two-dimensional array; anda coding unit configured to code the image data by using the quantization matrix,wherein the acquisition unit acquires a difference value between an element corresponding to a (p+1)-th row (p is an integer equal to or greater than 2 and smaller than n) and a first column of the quantization matrix and an element corresponding to a first row and a p-th column of the quantization matrix, andwherein the acquisition unit acquires a difference value between an element corresponding to a n-th row and a (n−2)-th column of the quantization matrix and an element corresponding to a (n−3)-th row and a n-th column of the quantization matrix.2 ...

Secure communications system and method

A system and method providing a collection of associated servers in a data center connected to the Internet. The servers, each being related to a service, deliver a client to a user, encapsulating the related services to common standard Internet browser software. The system and method provide a window to the Internet. The associated servers perform browsing for a user, stripping out viruses and malware and delivering safe content. The content enables a user to view and interact with the content on its computer, but not processing that content on the user's computer; the content is not stored on any local storage at the user's computer. The system and method for the delivery of services is tightly integrated into the Internet browsing experience and provides the end-user with anonymity, privacy, fraud protection, and multiple-client sharing of meta-information pertaining to the browsing experience.

LOW LATENCY WIRELESS COMMUNICATION SYSTEM FOR TELEOPERATED VEHICLE ENVIRONMENTS

A vehicle remote support system includes a communication system that operates over a plurality of parallel wireless network connections to provide low-latency video from vehicle to a remote support server that provides remote support to the vehicle dependent on real-time video. The vehicle includes a source that encodes multiple versions of the original video segments (e.g., one per wireless network connection) and transmits the multiple versions of the segments to a sink at the remote support server over the respective wireless connections. This redundant multi-path communication system rationally allocates network resources to the managed video streams and balances bandwidth against latency in order to avoid network congestion and safety issues associated with single-path transmissions. In other embodiments, a similar communication system that transmits video or other real-time messages between a source and a sink may be utilized in cloud robotics applications. 1. A method for wirelessly receiving low latency video at a remote support server supporting a teleoperated vehicle during a remote support session , the method comprising:establishing the remote support session with the vehicle;receiving at a video processor, a first encoded video segment and a segment identifier for the first encoded video segment from a first wireless network connection;determining that the segment identifier is absent from a segment identifier buffer;responsive to determining that the segment identifier is absent from the segment identifier buffer, storing the segment identifier to the segment identifier buffer and providing the first encoded video segment to a video device;receiving at the video processor, a second encoded video segment and the segment identifier from a second wireless network connection different than the first wireless network connection, the second encoded video segment including redundant video data to the first encoded video segment;determining that the segment ...

DIGITAL MEDIA DISTRIBUTION DEVICE

A digital media distribution device that includes an encoder, a decoder coupled to the encoder, and a transcoder coupled to the decoder. The encoder is configured to encode input data that is received by the digital media distribution device into a first data format. The decoder is configured to decode output data to be output by the digital media distribution device. The transcoder is configured to convert the encoded input data from the first data format into a second data format. The digital media distribution device is configured to be coupled to a computer network. 1. A digital media distribution device comprising:an encoder that is configured to encode input data that is received by the digital media distribution device into a first data format under control from a computer terminal unit;a decoder, coupled to the encoder via a computer network, that is configured to decode output data to be output by the digital media distribution device under control from the computer terminal unit; anda transcoder, coupled to the decoder, that is configured to convert the encoded input data from the first data format into a second data format; wherein: the decoder and the encoder are both controlled by the computer terminal unit via at least one of a serial connection or the computer network, the encoder is coupled to the decoder solely by the computer network, and the transcoder is coupled to the decoder and to the encoder via the computer network.2. The digital media distribution device according to claim 1 , wherein the encoder and the decoder are remotely controllable.3. The digital media distribution device according to claim 1 , wherein the encoder and the decoder perform a verification check and report their status to a user before processing data claim 1 , including reporting decoding and encoding capability based on a bandwidth test.4. The digital media distribution device according to claim 1 , wherein the digital media distribution device is configured for wavelet ...

ENCODING DEVICE COMPRISING VIDEO SWITCHING DEVICE, ENCODING METHOD INCLUDING VIDEO SWITCHING DETECTION METHOD

A video switching device includes a video switching unit that has at least two video signal input units, and an encoding device. The video switching unit includes a switch unit that outputs two signals as a result of changes in different states, the two signals being a pre-control signal and a camera switching signal, and a camera video switching unit that switches two video signals. The encoding device includes an encoding unit that encodes video signals, and a control unit that, by means of the pre-control signal, reduces the amount of code generated by the encoding unit. 2. The video switching device according to claim 1 , wherein when the camera switching signal is outputted from the switch unit claim 1 , the control unit performs control to return the reduced amount of code generated by the encoding unit to an original amount.3. A video switching method comprising:inputting video signals from at least two cameras;outputting one of the inputted video signals;encoding the outputted video signal;setting a switch to a first state;outputting a pre-control signal based on the first state of the switch;reducing an amount of generated code in the encoding by the pre-control signal;setting the switch from the first state to a second state;outputting a camera switching signal based on the second state of the switch; andswitching a video signal outputted by the camera switching signal.4. The video switching method of claim 3 , further comprising:returning the reduced amount of generated code in the encoding to an original amount when the camera switching signal is outputted. The present invention relates to an encoding device including a video switching device, and an encoding method including a video switching detection method.A conventional video switching device will be described with reference to .is a block diagram for explaining the conventional video switching device.A video switching device includes a video switching unit and an encoding device .The video ...

ENCODING DEVICE COMPRISING VIDEO SWITCHING DEVICE, ENCODING METHOD INCLUDING VIDEO SWITCHING DETECTION METHOD

A video switching device includes a video switching unit that has at least two video signal input units, and an encoding device. The video switching unit includes a first control detection unit that, on the basis of an externally inputted control signal, outputs a pre-control signal; a second control detection signal that, on the basis of the control signal, outputs a camera switching instruction signal for switching camera video signals during a vertical blanking interval; and a camera video switching unit that switches two video signals. The encoding device includes an encoding unit that encodes video signals; and a control unit that, by means of the pre-control signal, reduces the amount of code generated by the encoding unit. 1. A video switching device comprising:a video switching unit having video signal input units to which video signals from at least two cameras are inputted; andan encoding device configured to encode video signals from the video switching unit,wherein the video switching unit including:a first control detection unit configured to output a pre-control signal based on a control signal inputted from an outside;a second control detection unit configured to output a camera switching signal for switching a camera video signal during a vertical blanking interval; anda camera video switching unit configured to switch and output video signals inputted through the video signal input units based on the camera switching signal when the camera switching signal is outputted from the second control detection unit,wherein the encoding device includes:an encoding unit configured to encode video signals outputted from the camera video switching unit; anda control unit configured to, by means of the pre-control signal outputted from the first control detection unit, reduce an amount of code generated by the encoding unit, andwherein the first control detection unit starts to output the pre-control signal in immediate response to the control signal inputted ...

METHOD, APPARATUS AND SYSTEM FOR DISPLAYING VIDEO DATA

A plurality of display device profiles is decoded from a bitstream containing video data. A display device profile is selected by comparing at least a portion of the device information of the display device profiles with corresponding device information of the first display device. An image modification parameter set is selected from a plurality of image modification parameter sets according to the selected display device profile, the plurality of image modification parameter sets being decoded from the bitstream and each of the plurality of image modification parameter sets providing information regarding luminance mapping to be applied to one or more portions of the video data. At least a portion of the video data is displayed on the first display device from the bitstream of video data by applying the selected image modification parameter set to the portion of video data from the bitstream of video data. 1. A method of displaying video data on a first display device , the method comprising:decoding a plurality of display device profiles from a bitstream containing the video data, each of the plurality of display device profiles containing device information comprising display luminance, contrast ratio and colour gamut of a target display device;selecting a display device profile from the decoded plurality of display device profiles by comparing at least a portion of the device information of the display device profiles with corresponding device information of the first display device;selecting an image modification parameter set from a plurality of image modification parameter sets according to the selected display device profile, the plurality of image modification parameter sets being decoded from the bitstream and each of the plurality of image modification parameter sets providing information regarding luminance mapping to be applied to one or more portions of the video data from the bitstream of video data; anddisplaying at least a portion of the video data ...

Method and Apparatus for Response of Feedback Information during Video Call

A method and apparatus of encoding frames with a frame type structure adaptively according to a current encoding status after receiving a request for an IDR frame or receiving an indication of picture data loss are disclosed. If the check result of the current encoding status is true, the second frame type structure is the same as the first frame type structure; and if the check result of the current encoding status is false, the second frame type structure is different from the first frame type structure. Another method and apparatus of encoding frames with a reference frame structure and a frame type structure adaptively according to one or more current encoding statuses after receiving an indication of picture data loss are disclosed. The system may use two different check results to adaptively select the reference frame structure and the frame type structure. 1. A method of video encoding performed by a video encoder with feedback information from a decoder , the method comprising:encoding one or more first input frames with a first frame type structure; and checking a current encoding status; and', 'encoding one or more second input frames with a second frame type structure, wherein whether the second frame type structure is the same as the first frame type structure is based on the current encoding status., 'after receiving a request for an IDR frame (an Intra frame with decoder refresh point) or receiving an indication of picture data loss2. The method of claim 1 , wherein the indication of picture data loss comprises an indication of loss of an undefined/unknown amount of coded video data belonging to one or more pictures or an indication of loss of a defined/known amount of coded video data belonging to one or more pictures.3. The method of claim 1 , wherein if a check result of the current encoding status is true claim 1 , the second frame type structure is the same as the first frame type structure; and if the check result of the current encoding status ...

BLURRING PRIVACY MASKS

Methods and apparatus, including computer program products, implementing and using techniques for encoding a video sequence comprising a plurality of image frames, by an encoder are described. An image frame is received from a video stream. An input is received, which indicates one or more regions in the received image frame for which a privacy mask should be applied. The one or more regions are represented by one or more coding units. The image frame is encoded into an output frame, wherein image data in the one or more regions is replaced by intra-predicted coding units with transformed coefficients set to zero, the intra-predicted coding units are obtained from a prediction stage in the encoder. 1. A method for encoding a video sequence comprising a plurality of image frames , by an encoder , the method comprising:receiving an image frame from a video stream;receiving an input indicating one or more regions in the received image frame for which a privacy mask should be applied, wherein the one or more regions are represented by one or more coding units; andencoding the image frame into an output frame, wherein image data in the one or more regions is replaced by intra-predicted coding units obtained from a simplified representation of the image frame generated in a prediction stage of the encoder.2. The method of claim 1 , further comprising:selecting a size of the coding units automatically by the encoder.3. The method of claim 1 , further comprising:selecting a size of the coding units manually by a user.4. The method of claim 1 , wherein a size of the coding units is selected based on a desired blurriness level claim 1 , and wherein the size of the coding units and the desired blurriness level correspond to those of the simplified representation of the image frame.5. The method of claim 1 , wherein the one or more regions in the received image frame for which a privacy mask should be applied are automatically identified using object detection techniques.6. The ...

Segmented video codec for high resolution and high frame rate video

Embodiments disclosed herein provide systems, methods, and computer readable media for a segmented video codec for high resolution and high frame rate video. In a particular embodiment, a method of encoding a composite video stream provides identifying a first portion of an image of a video stream for encoding using first parameters and a second portion of the image of the video stream for encoding using second parameters. The method further provides segmenting the first portion of the image into one or more first tiles and the second portion of the image into one or more second tiles. The method further provides encoding the first tiles using the first parameters and the second tiles using the second parameters and, after the encoding, combining the first tiles and the second tiles into the composite video stream.

THERMAL THROTTLING OF WiDi VIDEO STREAM RESOLUTION

Methods and apparatus relating to thermal throttling of WiDi (Wireless Display) video stream resolution are described. In an embodiment, logic generates one or more signals to cause a processor to a change the resolution and/or frame rate of a video stream in response to input from one or more sensors and one or more values. The one or more signals can also cause wireless display logic to modify a compression level of the video stream received from the processor prior to transmission of a compressed version of the video stream to a display device. Other embodiments are also disclosed and claimed. 1. An apparatus comprising:first logic, the logic at least partially comprising hardware logic, to generate one or more signals to cause a processor to change at least one of a resolution or frame rate of a video stream in response to input from one or more sensors and one or more values.2. The apparatus of claim 1 , wherein the one or more signals are to cause wireless display logic to modify a compression level of the video stream received from the processor prior to transmission of a compressed version of the video stream to a display device.3. The apparatus of claim 1 , wherein the processor is to comprise a general-purpose processor or a graphics processor.4. The apparatus of claim 1 , wherein the one or more sensors to detect variations claim 1 , corresponding to components of the processor claim 1 , in one or more of: temperature claim 1 , operating frequency claim 1 , operating voltage claim 1 , operating current claim 1 , dynamic capacitance claim 1 , power consumption claim 1 , inter-core communication activity claim 1 , or docking configuration.5. The apparatus of claim 1 , wherein a compression level of the video stream is to be modified in a wireless software driver for wireless logic of a computing device that includes the processor.6. The apparatus of claim 1 , comprising wireless logic claim 1 , coupled to the display device claim 1 , to receive the ...

IMAGE ENCODING DEVICE, IMAGE ENCODING METHOD, IMAGE DECODING DEVICE, AND IMAGE DECODING METHOD

An image encoding device includes an encoder that encodes a first field of a specific frame as an intra picture which is predicted by using only an ultra prediction, and that encodes the first field of the above-described specific frame, a second field of the above-described specific frame, a picture whose encoding order is later than that of the first field of the above-described specific frame later and whose display order is earlier than that of the first field, and another picture whose encoding order and also display order are later than those of the first field of the above-described specific frame in order of those pictures, and a multiplexer that multiplexes information showing that the first field of the above-described specific frame is a picture, in a bitstream, at which decoding can be started into the above-described bitstream. 14-. (canceled)5. An image encoding device that encodes each field as a picture , each frame consisting of two fields: a first field and a second field , said image encoding device comprising:an encoding setter that makes a setup for encoding a first field of a specific frame as an intra picture which is predicted by using only an intra prediction, and encoding the first field of said specific frame, a second field of said specific frame, a picture whose encoding order is later than that of the second field of said specific frame later and whose display order is earlier than that of the second field, and a picture whose encoding order and also display order are later than those of the second field of said specific frame in order of those pictures; anda multiplexer that multiplexes information showing that the first field of said specific frame is a picture, in a bitstream, at which decoding can be started into said bitstream, whereinsaid encoding setter sets only a picture whose display order is later than the first field of said specific frame, as a reference picture for inter prediction, for the second field of said specific ...

Data transfer circuit and data transfer method

A data transfer circuit including: a measurement circuit that measures a transfer time of transfer data; a data processing circuit that is connected to the measurement circuit, and that, when the transfer time exceeds a threshold, performs lossy compression to reduce a data volume; and a control circuit that is connected to the data processing circuit, and that performs control to transfer data.

Method And System For Optimizing Bitrate Selection

A method including encoding a video program into a plurality of video streams, each of the plurality of video streams being encoded at a corresponding one of a plurality of bitrates; providing, to a plurality of viewing clients, an option to select one of the plurality of video streams; determining a streaming capacity of each of the viewing clients; and determining an improved plurality of bitrates based on streaming capacities of the plurality of viewing clients. 1. A method , comprising:encoding a video program into a plurality of video streams, each of the plurality of video streams being encoded at a corresponding one of a plurality of bitrates;providing, to a plurality of viewing clients, an option to select one of the plurality of video streams;determining a streaming capacity of each of the viewing clients; anddetermining an improved plurality of bitrates based on streaming capacities of the plurality of viewing clients.2. The method of claim 1 , further comprising:encoding the video program into a further plurality of video streams, each of the further plurality of video streams being encoded at a corresponding one of the optimized plurality of bitrates.3. The method of claim 2 , further comprising:providing, to a plurality of further viewing clients, an option to select one of the further plurality of video streams;determining a streaming capacity of each of the further viewing clients; anddetermining a further improved plurality of bitrates based on the streaming capacities of the plurality of further viewing clients.4. The method of claim 1 , further comprising:generating a further stream at a fictitious bitrate, wherein the further stream is generated based on one of the video streams, and wherein the fictitious bitrate is a bitrate that is not one of the plurality of bitrates at which the plurality of video streams are encoded,wherein the providing, to the plurality of viewing clients, an option to select one of the plurality of video streams comprises ...

SYSTEM AND METHOD FOR FOVEATED COMPRESSION OF IMAGE FRAMES IN A SYSTEM ON A CHIP

An exemplary method for intelligent compression uses a foveated-compression approach. First, the location of a fixation point within an image frame is determined. Next, the image frame is sectored into two or more sectors such that one of the two or more sectors is designated as a fixation sector and the remaining sectors are designated as foveation sectors. A sector may be defined by one or more tiles within the image frame. The fixation sector includes the particular tile that contains the fixation point and is compressed according to a lossless compression algorithm. The foveation sectors are compressed according to lossy compression algorithms. As the locations of foveation sectors increase in angular distance from the location of the fixation sector, a compression factor may be increased. 144-. (canceled)45. A method for intelligent data compression in a portable computing device (“PCD”) , the method comprising:determining a fixation point within an image frame by a fixation point sensor, wherein the fixation point sensor is configured to determine an area of user focus within a given image frame;sectoring the image frame into two or more sectors, wherein the two or more sectors comprises a fixation sector that includes the fixation point and one or more foveated sectors, each foveated sector does not include the fixation point, and each sector comprises a plurality of tiles;compressing the image frame such that the fixation sector is compressed according to a compression algorithm having a low compression factor and the one or more foveated sectors are compressed according to a compression algorithm having a high compression factor, wherein each respective tile within a particular foveated sector is subject to a different compression factor that is based on a distance between the fixation sector and the respective tile, each compression factor of a respective tile within a foveated sector having a magnitude that is assigned corresponding to the distance ...

Adaptive video compression for latency control

One embodiment of the present invention sets forth a technique for adaptively compressing video frames. The technique includes encoding a first plurality of video frames based on a first video compression algorithm to generate first encoded video frames and transmitting the first encoded video frames to a client device. The technique further includes receiving a user input event, switching from the first video compression algorithm to a second video compression algorithm in response to the user input event, encoding a second plurality of video frames based on the second video compression algorithm to generate second encoded video frames, and transmitting the second encoded video frames to the client device.

VEHICLE-TO-MANY-VEHICLE COMMUNICATION

Methods and apparatus are described for vehicle-to-vehicle communication. Embodiments receive a data request from a remote vehicle for data not available to the remote vehicle. Visual data from a host vehicle responsive to the data request that includes the data not available to the remote vehicle is determined. The visual data is analyzed for objects to create metadata associated with the visual data. The visual data and the metadata are provided to the remote vehicle in response to the data request. 1. A system for vehicle-to-vehicle communication , the system comprising:processing circuitry to:receive a data request from a remote vehicle for data not available to the remote vehicle;determine visual data from a host vehicle responsive to the data request that includes the data not available to the remote vehicle;analyze the visual data for objects to create metadata associated with the visual data; andprovide the visual data and the metadata to the remote vehicle in response to the data request.2. The system of claim 1 , the processing circuitry is further configured to receive the visual data from the host vehicle claim 1 , the visual data is compressed.3. The system of claim 2 , the visual data comprises a region of interest (ROI) from a larger image.4. The system of claim 3 , the visual data comprises a plurality of ROIs from the larger image.5. The system of any of claim 1 , the processing circuitry is further configured to:determine available transmission bandwidth to the remote vehicle;reencode the visual data to a lower resolution;compress the reencoded visual data to create the visual data provided to the remote vehicle.6. The system of claim 1 , the processing circuitry is further configured to:determine the visual data is not available;determine the host vehicle has access to the visual data;request the visual data from the host vehicle; andreceive the visual data from the host vehicle.7. The system of claim 1 , to determine the visual data the ...

Mechanics and Processes for Remote Control of Live Video Production

Mechanics and processes for remote control of live video production are disclosed herein. Producing a live, online video currently requires having direct control of the encoding system. The essential practice of the mechanics and processes is the design of a web service allowing encoder functionality to be controlled remotely, via a web interface or mobile device application (a.k.a. app). 1. A system which allows for remote production of live video either over the internet or through a LAN. Comprised of a remote device , specialized web service , and video encoder/production software.2. An encoding API which translates web service requests into actions targeting a separate encoding/production process.3. A user interface which translates user actions into messages for transmission via HTTP 1.1 to a web service which controls a piece of video encoding/production software. The present application claims priority from and the benefit of U.S. Provisional Application No. 61/717,485 filed on Oct. 23, 2012 which is herein incorporated by reference.describes the architecture of the system and overall method of practice.Users will supply their own remote device, it could be any device with an HTML 5 capable web browser or a device for which we develop a device specific application. They will use their device to visit the hosted Web Service Interface which is provided by the Remote Production Web Service hosted on the Remote Production Server. The Web Service operates the encoding/production software through an encoder specific API, written to abstract the encoder/producer functionality in such a way that the web service can translate user actions into an appropriate operation for the encoder software.Creating an encoder specific API requires utilizing operating system level object communication libraries to interact with the encoding/production software. On the Microsoft Windows platform this is the COM/OLE/Automation API and Libraries, on the Mac platform it is Applescript. ...

METHOD AND DEVICE FOR ENCODING AND DECODING A STACK OF IMAGES, AND CORRESPONDING COMPUTER PROGRAM PRODUCT

Encoding or decoding a stack of images of a same scene focused at different focalization distances from one image to another can involve encoding or decoding information representing an image of the stack of images, where the image meets an image sharpness criterion, reconstructing the image into a reconstructed image, and encoding or decoding at least one other image of the stack of images by prediction from at least the reconstructed image. 1. A method comprisingencoding a stack of images of a same scene focused at a different focalization distances from one image to another, wherein the encoding comprises:encoding information representing an image of the stack of images, the image being selected in the stack of images according to an image sharpness criterion, and reconstructing the image into a reconstructed image;encoding at least one other image of the stack of images by prediction from at least the reconstructed image.2. The method of claim 1 , wherein the image sharpness criterion corresponds to a number of pixels in focus in an image.3. The method of claim 2 , wherein the selected image in the stack of images is an image having a highest number of pixels in focus among the images included in the stack of images.4. The method of claim 3 , wherein the image in the stack of images having the highest number of pixels in focus is an all-in-focus image.5. The method of claim 1 , wherein encoding the at least one other image of the stack of images by prediction from at least the reconstructed image comprises encoding claim 1 , for at least a pixel of the at least one other image claim 1 , a value from a corresponding pixel collocated in the reconstructed image and from a blurring function depending on a depth position associated with the at least one other image to encode.6. The method of claim 1 , wherein the stack of images is one of a group of stacks of images captured with different viewing angles claim 1 , the stacks of images included in the group of stacks ...

TECHNIQUES TO DYNAMICALLY SELECT A VIDEO ENCODER FOR STREAMING VIDEO ENCODING

Techniques to dynamically select a video encoder for streaming video encoding are described. For example, in one embodiment, an apparatus may include an encoding configuration component operative to receive network performance information for a video stream at a sending device, the video stream at a first video bitrate with a first video encoding codec, and assign a second video bitrate with a second video encoding codec to a media component based on the network performance information, wherein the second video encoding codec is used based on generating the video stream at the second video bitrate, the media component operative to generate the video stream at the sending device at the second video bitrate with the second video encoding code, and the network component operative to send the video stream from the sending device to the receiving device using the second video encoding codec. Other embodiments are described and claimed. 1. At least one computer-readable storage medium comprising instructions that , when executed , cause a system to:generate a video stream at a sending device at a first video bitrate with a first video encoding codec;send the video stream from the sending device to a receiving device;receive network performance information for the video stream;determine a second video bitrate based on the network performance information for the video stream;generate the video stream at the sending device at the second video bitrate with a second video encoding codec, wherein the second video encoding codec is used based on generating the video stream at the second video bitrate; andsend the video stream from the sending device to the receiving device using the second video encoding codec.2. The computer-readable storage medium of claim 1 , comprising further instructions that claim 1 , when executed claim 1 , cause a system to:receive a video codec selection policy from a messaging server device; andgenerate the video stream at the sending device at the ...

Cilent-Based Adaptive Streaming of Nonlinear Media

A method for adaptive streaming of nonlinear video is described wherein the method comprises receiving a manifest file comprising metadata defining a playback period defining video data of a predetermined playback duration, a playback period including at least one adaptation set defining a plurality of representations, each representation defining a set of segment identifiers, each segment identifier identifying a segment comprising a sequence of video frames; the metadata further comprising spatial playback information including at least a first region descriptor associated with a first adaptation set of a first playback period, the first region descriptor defining a destination identifier and a first region in video frames of the first adaptation set, the destination identifier signaling the client apparatus that the first region is linked to a second adaptation set; the client apparatus using the metadata to playback video data of the first adaptation set by requesting one or more network nodes to transmit segments of the first adaptation set; and, receiving or determining, during playback of requested segments, information associated with at least a second region in the video frames of the first adaptation set, the second region defining a region of interest (ROI) of a user of the client apparatus; the client apparatus selecting the second adaptation set for playback after the end of the playback of the first adaptation set on the basis of the first and second region, the selecting being based on a distance or an overlap between the first and second region. 1. A method for adaptive streaming of nonlinear video comprising:a client apparatus receiving a first manifest file comprising metadata defining one or more playback periods, a playback period defining video data of a predetermined playback duration, a playback period including at least one adaptation set defining a plurality of representations, each representation defining a set of segment identifiers, each ...

DYNAMIC COMPRESSION OF MULTIMEDIA CONTENT BASED ON SOCIAL AND RELATIONAL CONTEXT

In one aspect, a computer-implemented method for compressing content based on a social factor, an environmental factor, and a relational factor is described. The method may include monitoring access to the content, forming, by a processor, a contextual evaluation based on the monitored access and determining an importance of the content based on the contextual evaluation. The method may further include storing the content in a compressed form, where the compressed form is selected based on the importance. 1. A computer-implemented method for compressing content comprising:monitoring access to the content;forming, by a processor, a contextual evaluation based on the monitored access and determining an importance of the content based on the contextual evaluation;storing the content in a compressed form, wherein the compressed form is selected based on the importance.2. The computer-implemented method of wherein the contextual evaluation comprises one or more of a social media trend claim 1 , an environmental importance factor claim 1 , a relationship with at least one individual in the content claim 1 , and a location factor indicative of a location of a first sharing of the content.3. The computer-implemented method of claim 1 , wherein the content is stored in a location that is determined based on the compressed form.4. The computer-implemented method of claim 1 , wherein the content is a video.5. The computer-implemented method of claim 2 , wherein the social media trend comprises popularity on one or more social media websites.6. The computer-implemented method of claim 2 , wherein the environmental factor comprises one or more of a location of a user claim 2 , a location of a second user with respect to the first user claim 2 , and meteorological information.7. The computer-implemented method of claim 1 , wherein forming the contextual evaluation comprises determining if a subject matter of the content is likely to be accessed at least a predetermined number of ...

SYSTEM AND METHOD FOR FOVEATED COMPRESSION OF IMAGE FRAMES IN A SYSTEM ON A CHIP

An exemplary method for intelligent compression uses a foveated-compression approach. First, the location of a fixation point within an image frame is determined. Next, the image frame is sectored into two or more sectors such that one of the two or more sectors is designated as a fixation sector and the remaining sectors are designated as foveation sectors. A sector may be defined by one or more tiles within the image frame. The fixation sector includes the particular tile that contains the fixation point and is compressed according to a lossless compression algorithm. The foveation sectors are compressed according to lossy compression algorithms. As the locations of foveation sectors increase in angular distance from the location of the fixation sector, a compression factor may be increased. 1. A method for intelligent data compression in a portable computing device (“PCD”) , the method comprising:determining a fixation point within an image frame;sectoring the image frame into two or more sectors, wherein the two or more sectors comprises a fixation sector that includes the fixation point and one or more foveated sectors;compressing the image frame such that the fixation sector is compressed according to a compression algorithm having a low compression factor and the one or more foveated sectors are compressed according to a compression algorithm having a high compression factor; andstoring the compressed image frame.2. The method of claim 1 , wherein the compression algorithm having a low compression factor is a lossless compression algorithm.3. The method of claim 1 , wherein the compression algorithm having a high compression factor is a lossy compression algorithm.4. The method of claim 1 , further comprising:determining a blind spot within an image frame;determining a blind foveated sector, wherein the blind foveated sector is one of the one or more foveated sectors that includes the blind spot; andcompressing the blind foveated sector according to a lossy ...

Content Adaptive Decoder Quality Management

In one example, a quality management controller of a video processing system may optimize a video recovery action through the selective dropping of video frames. The video processing system may store a compressed video data set in memory. The video processing system may receive a recovery quality indication describing a recovery priority of a user. The video processing system may apply a quality management controller in a video pipeline to execute a video recovery action to retrieve an output data set from the compressed video data set using a video decoder. The quality management controller may select a recovery initiation frame from the compressed video data set to be an initial frame to decompress based upon the recovery quality indication.

Method and apparatus for transreceiving broadcast signal for panorama service

The present invention relates to a providing a method and/or an apparatus for transceiving a broadcast signal for a panorama broadcast service. The method for transmitting a broadcast signal, according to one embodiment of the present invention, comprises the steps of: encoding an image, multiplexing into a single broadcast stream, the encoded image and signaling information related to the image, wherein the signaling information includes signaling information related to a panoramic image; generating a broadcast signal including the multiplex broadcast stream; and transmitting the generated broadcast signal.

TWO-WAY AUDIO AND VIDEO COMMUNICATION UTILIZING SEGMENT-BASED ADAPTIVE STREAMING TECHNIQUES

A participation device in a multiparty conference call may act as a server device and/or a client device for two-way audio and video (AV) streaming. A server device may encode a requested AV stream into a set of different encoding profiles that may be dynamically determined based on the varying channel conditions and device capacities of the client devices. At least a portion of differently encoded AV streams is selected and dynamically communicated to the client devices for display. Session parameters are determined according to the varying channel conditions and the device capacities of the client devices to create intended sessions. The selected encoded AV streams are communicated utilizing segment-based adaptive streaming techniques such as HTTP. A client device may access to a HTTP session to download an expected AV stream from the server device. The downloaded AV stream may be decoded into different decoding profiles for display as needed. 1. A method for networking , the method comprising: encoding an audio and video stream utilizing a set of different encoding profiles, wherein said set of different encoding profiles are determined based on channel conditions and device capacities of one or more other devices in said multiparty audio and video conference call; and', 'communicating at least a portion of said encoded audio and video streams to said one or more other devices in said multiparty audio and video conference call., 'in a device that participates in a multiparty audio and video conference call220-. (canceled) This patent application makes reference to, claims priority to and claims benefit from U.S. Provisional Application Ser. No. 61/489,152 (Attorney Docket No. 24043US01) which was filed on May 23, 2011.The above stated application is hereby incorporated herein by reference in its entirety.This application also makes reference to:U.S. application Ser. No. ______ (Attorney Docket Number 24044US02) filed on Jun. 28, 2011; U.S. application Ser. No. ...

Camera system, master camera device, and slave camera device

A master camera device and a plurality of slave camera devices are directly connected through a network, and form one network segment. The master camera device performs multicast communication with each slave camera device, and acquires information representing a transmission condition from each slave camera device. In a case where a worsening transmission condition relative to a predetermined threshold is detected from a transmission condition of each slave camera device and a transmission condition of the master camera device, the master camera device performs multicast communication with each slave camera device, and controls an encoding level representing a degree of encoding process, sequentially from an encoder having a lower priority, including the encoder of the master camera device, to improve the transmission condition. Thus, by an efficient communication, the transmission condition is improved from an initial stage having an unstable transmission condition, to obtain a preferable real-time image.

DECODING A PICTURE BASED ON A REFERENCE PICTURE SET ON AN ELECTRONIC DEVICE

A method for decoding a picture on an electronic device is described. The method includes obtaining a bitstream. The method also includes obtaining a current picture. The method further includes obtaining a relative reference picture set (RPS) parameter. The method additionally includes initializing an index value. Furthermore, the method includes processing another RPS parameter based on the index value. The method also includes decoding the current picture. 1. A electronic device comprising a decoder for decoding a video bitstream , the decoder is configured for performing a method comprisingidentifying a reference picture set from the bitstream, wherein the bitstream includes at least one flag corresponding to at least one reference picture of the reference picture set, wherein a current picture is associated with the reference picture set and encoded in the bitstream; anddecoding the current picture from the bitstream using inter prediction with some reference pictures within the reference picture set;decoding the at least one flag from the bitstream, wherein the least on flag indicates that the at least one reference picture is to be kept for decoding subsequent pictures, and wherein the at least one reference picture is not used for decoding the current picture.2. The electronic device of claim 1 , wherein identifying the reference picture set is based on a slice header obtained from said bitstream.3. A electronic device comprising a encoder for encoding a video bitstream claim 1 , the encoder is configured for performing a method comprising:generating a reference picture set for a current picture of the video bitstream;encoding a block of the current picture using inter prediction with some reference pictures within the reference picture set;sending said reference picture set to said bitstream;sending, to the bitstream, at least one flag corresponding to at least one reference picture of the reference picture set, wherein the least on flag indicates that the ...

System and methods for feedback-based data transmission

A computer-implemented method includes receiving a feedback message from a receiver of image data. The feedback message includes a reference frame identifier associated with a reference frame correctly received or decoded by the receiver. The method further includes determining a difference between the reference frame identifier and a current frame identifier. The current frame identifier is associated with a current frame to be encoded and the difference indicates a number of frames between the reference frame and the current frame. The method also includes encoding the current frame based at least in part on the difference.

Image processor

In an earliest vertical synchronization period after sending an encoded image data is restarted, a first reference image determination circuit determines to employ a local decoded image generated in a vertical synchronization period immediately preceding a vertical synchronization period in which an error occurs among multiple local decoded images stored in a first DRAM as a reference image. In an earliest vertical synchronization period after a decoding circuit is reset, a second reference image determination circuit determines to employ a decoded image generated in the vertical synchronization period immediately preceding the vertical synchronization period in which the error occurs among multiple decoded images stored in a second DRAM as a reference image.

Virtual Field Buffer Based Decoding

Aspects of virtual field buffer based decoding are described. In one embodiment, a current picture field is read from a coded picture buffer comprising coded pictures of video, for example. The current picture may be associated with a top or bottom field polarity. According to decoding and picture output orders, the current picture field is assigned to an available field entry of a virtual field buffer, and an available frame index of a virtual frame map is assigned to the current picture field. The assignment of the available frame index to the current picture field is indicated to a decoder that decodes the current picture field with reference to the assigned frame index. According to aspects of the embodiments described herein, rather than determining complimentary picture fields after decoding, the assignment of complimentary picture fields to virtual frame indexes before decoding provides certain efficiencies.

METHOD AND DEVICE FOR TRANSMISSION OF VIDEO DATA OF DIFFERENT DYNAMIC RANGES

In a case where a plurality of transmission video data having predetermined opto-electrical transfer characteristics are switched therebetween and transmitted, processes for obtaining image data for display from the transmission video data are achieved to be appropriately performed at a receiver side. 1. A transmission device comprising: encode transmission video data obtained by switching between a plurality of kinds of transmission video data having predetermined opto-electrical transfer characteristics to obtain a video stream;', 'transmit a container containing the video stream; and', 'insert, into the container, identification information representing a kind of a transmission video data in the video stream contained in the container, such that the identification information indicates the kind of transmission video data resulting from switching of the kind of the transmission video data in the video stream, the identification information being inserted into the container at a timing that is prior to a timing of the switching by a predetermined amount of time or longer., 'at least one processor configured to'}2. The transmission device according to claim 1 , wherein the plurality of kinds of the transmission video data include:first transmission video data having a standard dynamic range opto-electrical transfer characteristic, the first transmission video data being obtained by performing opto-electrical conversion with the standard dynamic range opto-electrical transfer characteristic on standard dynamic range video data; andsecond transmission video data having a high dynamic range opto-electrical transfer characteristic, the second transmission video data being obtained by performing opto-electrical conversion with the high dynamic range opto-electrical transfer characteristic on high dynamic range video data.3. The transmission device according to claim 1 , wherein the plurality of kinds of transmission video data include:first transmission video data having ...

Method and system for enhancing user experience for remoting technologies

The disclosure herein describes a client-side system that enhances user experience on a remoting client without consuming additional network bandwidth. During operation, the system receives a sequence of frame updates for a display screen, and determines a sequence of frames corresponding to the frame updates. The system further adaptively applies one or more image enhancing techniques to the sequence of frames based on available network bandwidth, frame refresh rate, or image quality. The image enhancement techniques include predicting a frame based on previously received frames, interpolating a frame based on at least two buffered frames, and reducing appearance of artifacts in a received frame, thereby reducing visual artifacts.

Analytic Reprocessing for Data Stream System and Method

A head mounted display (HMD) identifies viewing trends for a video based on multiple viewings of the video by users having different user characteristics. The analysis identifies viewing trends based on user characteristics, e.g., the age and gender of the user. When a subsequent user is viewing the video, a production & post production module receives the user's profile information and identifies the predicted viewing location of the user at particular times during the video using the identified trends based on where previous users/viewers, who have a profile or characteristics similar to the user, were looking at the particular times during the video. The production & post production module identifies the center tile as the predicted viewing location at a particular time for the user and prepares and encodes the video stream based on the predicted viewing location and, for example, streams the video to the HMD in which the predicted viewing location is the center tile at the associated time in the video. This can increase the effectiveness of the data transmitted to the HUD. 1. A method for encoding a first video stream , comprising the steps of:identifying a first set of user characteristics for a first user;predicting a predicted viewing location for said first user at a first time of the first video stream; andencoding a first portion of the first video stream based upon said predicted viewing location.2. The method of claim 1 , wherein said encoded first portion of the first video stream includes said first time of the first video stream.3. The method of claim 1 , wherein said predicted viewing location is the location in the first video stream where the first user is predicted to look during said first time.4. The method of claim 3 , wherein said predicted viewing location is identified as a center tile and wherein said encoding step encodes said predicted viewing location using a lower compression rate than a second location of said video stream at said ...

FAST-START STREAMING AND BUFFERING OF STREAMING CONTENT FOR PERSONAL MEDIA PLAYER

Systems and methods allow playback of a media stream received via a network. The media stream is received and stored in a buffer prior to playback. Responsive to receiving the user command to change the content of the media stream, the buffer is flushed prior to receiving the changed content in the media stream. 1. A method for playing a media stream received via a network , the method comprising:receiving the media stream;storing the received media stream in a buffer;providing the media stream for playback;while the media stream is being provided for playback, receiving a user command to change the content of the media stream; andresponsive to receiving the user command, flushing the buffer prior to receiving the changed content in the media stream.2. The method of further comprising re-filling the buffer with the media stream containing the changed content claim 1 , and playing the changed content from the buffer.3. The method of wherein the playing of the changed content from the buffer comprises initiating playback of the changed content from the buffer at a decreased playback speed.4. The method of wherein playback of the changed content continues at the decreased playback speed until the buffer fills to a predetermined threshold.5. The method of wherein the playing of the changed content further comprises playing the received media stream at a normal playback speed after the buffer is filled to the predetermined threshold.6. The method of claim 3 , wherein the method further comprises time-stretching an audio portion of the media stream while maintaining a pitch level of the audio portion when the playback speed is decreased.7. The method of claim 1 , wherein the media stream is received via the network from a remote server claim 1 , and wherein the method further comprises transmitting claim 1 , responsive to the user input claim 1 , a command to the remote server via the network to thereby direct the remote server to change the media stream.8. The method of ...

Multi-Bitrate Video With Dynamic Blocks

Methods, systems, computer-readable media, and apparatuses for providing dynamic block control of multi-bitrate video are described. In some embodiments, a computing device may determine transcoder conditions of a transcoder independent of a client device. The computing device may dynamically adjust a block size of one or more blocks of a stream based on the transcoder conditions. In some embodiments, a computing device may receive a stream. The client device may package the stream into a first packaged stream having a first block size and a second packaged stream having a second block size less than the first block size. In some embodiments, a client device may determine an actual minimum number of blocks to buffer prior to initiating content playback based on a received predicted network and/or transcoder quality of service forecast. The client device may adjust its preset minimum number of blocks to the actual minimum number of blocks. 1. A method comprising:receiving, by a computing device and from a client device, a request for a content item;determining, by the computing device, a minimum quantity of blocks for initial playback of a data stream associated with the content item via the client device; a first payload size for a first portion of the data stream, wherein the first portion comprises the minimum quantity of blocks; and', 'a second payload size for a second portion of the data stream that is subsequent to the first portion of the data stream, wherein the first payload size is smaller than the second payload size; and, 'determining, based on the content item and the minimum quantity of blocks for initial playback of the content itemsending, by the computing device and to the client device, the first portion of the data stream.2. The method of claim 1 , further comprising:changing, based on sending the minimum quantity of blocks to the client device, a payload size of the first portion from the first payload size to the second payload size.3. The ...

Method and Apparatus for Adaptive Region-Based Decoding to Enhance User Experience for 360-degree VR Video

Methods and apparatus of video decoding for a 360-degree video sequence are disclosed. According to one method, a bitstream comprising compressed data for a previous 360-degree frame and a current 360-degree frame in a 360-degree video sequence is received. A first view region in the previous 360-degree frame associated with a first field of view is determined for a user at a previous frame time. An extended region from the first view region in the current 360-degree frame is determined based on user's viewpoint information. The extended region in the current 360-degree frame is then decoded. A second view region in the current 360-degree frame associated with an actual field of view is rendered for the user at a current frame time. 1. A method of video decoding for a 360-degree video sequence , the method comprising:determining a first view region in a previous 360-degree frame associated with a first field of view for a user at a previous frame time;determining an extended region from the first view region in a current 360-degree frame based on user's viewpoint information; anddecoding the extended region in the current 360-degree frame.2. The method of claim 1 , wherein the extended region is enlarged in a turn direction when user's viewpoint turns.3. The method of claim 2 , wherein the extended region is reduced when the user's viewpoint is back to still.4. The method of claim 1 , wherein the extended region is enlarged in a direction corresponding to previous viewpoint motion.5. The method of claim 4 , wherein the extended region is enlarged according to predicted viewpoint motion derived using linear prediction of previous viewpoint motion.6. The method of claim 4 , wherein the extended region is enlarged according to predicted viewpoint motion derived using non-linear prediction of previous viewpoint motion.7. The method of claim 1 , wherein the extended region is determined according to learning mechanism using user's view tendency.8. The method of claim 7 , ...

ENCODING SCHEME

A method performed under control of an encoder may include receiving at least one picture frame during a first predetermined period, each of the at least one picture frame of the first predetermined period including a first offset image and a second offset image; encoding a first offset image of a first picture frame of the at least one picture frame of the first predetermined period; receiving at least one picture frame during a second predetermined period, each of the at least one picture frame of the second predetermined period including a first offset image and a second offset image; and encoding a second offset image of a first picture frame of the at least one picture frame of the second predetermined period. 1. A method performed under control of an encoder , comprising:receiving at least one picture frame during a first predetermined period, each of the at least one picture frame of the first predetermined period including a first offset image and a second offset image;encoding a first offset image of a first picture frame of the at least one picture frame of the first predetermined period;receiving at least one picture frame during a second predetermined period, each of the at least one picture frame of the second predetermined period including a first offset image and a second offset image; andencoding a second offset image of a first picture frame of the at least one picture frame of the second predetermined period.2. The method of claim 1 , further comprising:encoding a second offset image of the first picture frame of the first predetermined period based, at least in part, on the encoded first offset image of the first picture frame of the first predetermined period; andencoding a first offset image of the first picture frame of the second predetermined period based, at least in part, on the encoded second offset image of the first picture frame of the second predetermined period.3. The method of claim 2 , wherein the encoded first offset image of the ...

Method And System For Optimizing Bitrate Selection

A method including encoding a video program into a plurality of video streams, each of the plurality of video streams being encoded at a corresponding one of a plurality of bitrates; providing, to a plurality of viewing clients, an option to select one of the plurality of video streams; determining a streaming capacity of each of the viewing clients; and determining an improved plurality of bitrates based on streaming capacities of the plurality of viewing clients. 123.-. (canceled)24. A method , comprising:encoding a first plurality of video streams of a video program each being configured with one of a first plurality of bitrates;generating a first alternate video stream at a first alternate bitrate that is not one of the first plurality of bitrates at which the first plurality of video streams are encoded;providing, to a plurality of viewing clients, an option to select one of the first plurality of video streams or the first alternate video stream at the first alternate bitrate; anddetermining, by the optimization logic, a second plurality of bitrates based on at least one selection of the first alternate stream at the first alternate bitrate by the plurality of viewing clients.25. The method of claim 24 , wherein the first alternate video stream at the first alternate bitrate is generated based on padding one of the first plurality of video streams with additional data.26. The method of claim 25 , wherein the additional data is one of null data claim 25 , random noise claim 25 , video data or non-video data and wherein the first alternate video stream at the first alternate bitrate is higher than the bitrate of the one of the first plurality of video streams that is selected to generate the first alternate video stream at the first alternate bitrate.27. The method of claim 24 , wherein each of a second plurality of video streams are configured with one of the second plurality of bitrates.28. The method of claim 24 , further comprising:receiving an indication of ...

PREDICTING AND VERIFYING REGIONS OF INTEREST SELECTIONS

Video images are rendered in viewports of content viewers. Each content viewer views video images through a respective viewport in the viewports. Spatial locations in the video images to which foveal visions of the content viewers are directed are determined. ROIs in the video images are identified based on the spatial locations in the video images. 1. A method for determining regions of interest (ROIs) in video images , comprising:generating user viewing behavior data while rendering a video clip including a video image in a plurality of viewports of a plurality of content viewers, wherein each content viewer in the plurality of content viewers views the video clip including the video image through a respective viewport in the plurality of viewports;determining, from the user viewing behavior data, a plurality of spatial locations, in the video image, to which a plurality of foveal visions of the plurality of content viewers is directed;identifying, based on the plurality of spatial locations in the video image, two or more ROIs in the video image;encoding two or more image portions in the two or more ROIs of the video image and one or more other image portions outside the two or more ROIs of the video image into a video stream;wherein the two or more image portions are non-overlapping with the one or more other image portions;wherein the two or more image portions in the two or more ROIs of the video image are encoded in the video stream at spatiotemporal resolutions higher than other spatiotemporal resolutions at which the one or more other image portions outside the two or more ROIs of the video image are encoded in the video stream;transmitting, to a streaming client device, the video stream.2. The method of claim 1 , further comprising:compressing pixel values, of the video image, in the two or more image portions in the two or more ROIs with first peak-signal-noise-ratios (PSNRs);compressing pixel values, of the video image, in the one or more other image ...

CAMERA SYSTEM TRANSMISSION IN BANDWIDTH CONSTRAINED ENVIRONMENTS

An image capture accelerator performs accelerated processing of image data. In one embodiment, the image capture accelerator includes accelerator circuitry including a pre-processing engine and a compression engine. The pre-processing engine is configured to perform accelerated processing on received image data, and the compression engine is configured to compress processed image data received from the pre-processing engine. In one embodiment, the image capture accelerator further includes a demultiplexer configured to receive image data captured by an image sensor array implemented within, for example, an image sensor chip. The demultiplexer may output the received image data to an image signal processor when the image data is captured by the image sensor array in a standard capture mode, and may output the received image data to the accelerator circuitry when the image data is captured by the image sensor array in an accelerated capture mode. 1. A camera system , comprising:an image sensor chip configured to produce image data representative of light incident upon the image sensor chip; an input configured to receive the image data from the image sensor chip;', 'a compression engine configured to decimate the received image data into a plurality of image sub-band components; and', 'one or more outputs configured to output the image data and a set of the plurality of image sub-band components; and, 'an image capture accelerator chip (“ICA”) comprising one or more inputs configured to receive the image data and the set of image sub-band components;', 'an encoder configured to encode the received image data and the set of image sub-band components; and', 'an output configured to select and output either the encoded image data or one or more encoded image sub-band components based on the detected amount of output bandwidth., 'an image signal processor chip (“ISP”) with a first input and a second input, the ICA coupled between the image sensor chip and the ISP, the ISP ...

Method and Apparatus for frame rate control in Transmitter of Wireless Communications System

A method for frame rate control in a transmitter of a wireless communications system is disclosed. The method comprises generating a frame and a first information corresponding to a first expiration time of the frame by a frame generating module; handling the frame according to the first expiration time by the driver module; and informing the frame generating module an adjusting information according to a first pre-determined rule by the driver module.

METHODS AND SYSTEMS FOR VIDEO PROCESSING

A method for processing an online video stream may include determining a transmission performance of a network for a queue of video frames, wherein each video frame in the queue may be associated with a priority level. The method may also include determining a maximum discarding level based on the transmission performance of the network. The method may further include removing a target video frame of which the associated priority level is lower than or equal to the maximum discarding level from the queue. 1. A video processing system for encoding video streams , comprising:at least one camera configured to generate a plurality of video frames; andone or more video processing devices, configured to encode the plurality of video frames, obtain a candidate video frame the plurality of video frames;', 'determine a complexity of the candidate video frame;', 'obtain a first quantization parameter for performing the encoding; and', 'determine whether a first encoded size of the candidate video frame exceeds a predetermined threshold based on the complexity of the candidate video frame and the first quantization parameter;', determine a second quantization parameter, so that a second encoded size of the candidate video frame based on the second quantization parameter is lower than or equal to the predetermined threshold; and', 'encode the candidate video frame based on the second quantization parameter., 'when the first encoded size exceeds the predetermined threshold], 'wherein during operation, the one or more video processing devices2. The video processing system of claim 1 , wherein the complexity of the candidate video frame includes a sum of absolute differences (SAD) of the candidate video frame claim 1 , and the complexity of the candidate video frame is determined based on an SAD of at least one preceding video frames.3. The video processing system of claim 1 , wherein the one or more video processing devices further:encode the candidate video frame based on the ...

COMMUNICATION TERMINAL, COMMUNICATION FUNCTION STARTING METHOD, AND COMPUTER-READABLE RECORDING MEDIUM

A communication terminal includes a display control unit configured to display, on a display unit, a function selecting screen that contains a first icon for receiving a selection of a first communication function and a second icon for receiving a selection of a second communication function. The first communication function is to provide communication using a signaling protocol for connecting to or disconnecting from a destination of communication and an encoding protocol for encapsulating communication data in IP packets. The second communication function is to provide communication using the same signaling protocol and a different encoding protocol. The communication terminal also includes a receiving unit configured to receive a selection of the first icon or the second icon; and a starting unit configured to start the first communication function and the second communication function in response to the selection of the first icon and the second icon, respectively. 1. (canceled)2. A communication terminal , comprising: causes a display to display a function selecting screen that contains a first icon for receiving a selection of a first communication function and a second icon for receiving a selection of a second communication function, the first communication function being to provide communication using a signaling protocol for connecting to or disconnecting from a destination of communication and a first video coding method for coding video, the second communication function being to provide communication using the signaling protocol of the first communication function and a second video coding method different from that of the first communication function,', 'receives a selection of the first icon or the second icon,', 'executes the first communication function when the processing circuitry receives the selection of the first icon, and', 'executes the second communication function when the processing circuitry receives the selection of the second icon; and, ...

Video transmission apparatus

A video transmission apparatus includes a camera controller that obtains camera movement amount data indicating a direction and an amount of movement of a camera, and an image encoder that performs motion compensation on image data received from the camera and determines an image search range for the motion compensation based on the camera movement amount data. The image encoder adjusts a motion vector indicated by the camera movement amount data for each coordinate position in the image data based on a lens characteristic of the camera, and determines the image search range for the motion compensation based on the adjusted motion vector for each coordinate position.

Resampling and picture resizing operations for multi-resolution video coding and decoding

Techniques and tools for high accuracy position calculation for picture resizing in applications such as spatially-scalable video coding and decoding are described. In one aspect, resampling of a video picture is performed according to a resampling scale factor. The resampling comprises computation of a sample value at a position i,j in a resampled array. The computation includes computing a derived horizontal or vertical sub-sample position x or y in a manner that involves approximating a value in part by multiplying a 2 n value by an inverse (approximate or exact) of the upsampling scale factor. The approximating can be a rounding or some other kind of approximating, such as a ceiling or floor function that approximates to a nearby integer. The sample value is interpolated using a filter.

ESTIMATION OF VIDEO QUALITY OF EXPERIENCE ON MEDIA SERVICES

Systems and methods of media servers for estimating the video quality of experience (QoE) of human viewers of video content or communications at video receivers. With these systems and methods, a media server can collect, within a plurality of predetermined time windows synchronized in time, operational parameters of ingress and egress networks over which such video content or communications can be transmitted, as well as coding parameters of a video decoder and a video encoder within the media server. Having collected the operational parameters of the ingress network and egress network and the coding parameters of the video decoder and video encoder, the media server can determine QoE scores associated with some or all the ingress network, the video decoder, the video encoder, and the egress network, and estimate a resulting video QoE for a human viewer at a video receiver as a predefined combination of the respective QoE scores. 1. A method of a media server for estimating a video quality of experience (QoE) of a human viewer of video content or communications at a video receiver , comprising:obtaining, by a media server within a first one or more of a plurality of predetermined synchronized time windows, operational parameters of one or more of an ingress network and an egress network over which video content or communications is transmittable, the media server being communicably coupleable to a video sender over the ingress network and communicably coupleable to a video receiver over the egress network, the media server including a video decoder and a video encoder;obtaining, by the media server within a second one or more of the plurality of predetermined synchronized time windows, coding parameters of one or more of the video decoder and the video encoder;having obtained the operational parameters and the coding parameters, determining, by the media server, one or more first QoE scores for one or more of the ingress network and the egress network based at ...

ADAPTIVE CODING, TRANSMISSION AND EFFICIENT DISPLAY OF MULTIMEDIA (ACTED)

Embodiments of the invention receive videos and feedback data associated with the videos from a client device and adaptively encode the videos based on the feedback data. The encoded videos are suitable to be transmitted over a network and displayed on the client device. Embodiments of an encoding server adaptively changes resolution of a video on the fly or scale the video quality up or down based on the factors described by the feedback data, including network condition for transmitting the encoded video, network delay, encoder and decoder processing capacity and feedback from viewers of the decoded video. Furthermore, the encoding server adaptively encodes the video based on a combination of various factors described by the feedback data. 1. A computer-implemented method performed on an input video by an encoding server comprised of a processor and a memory , the method performed by the processor comprising:performing different encodings on the input video to obtain a plurality of encoded bitstreams, said different encodings obtained by applying multiple encoding schemes to the input video, each encoding scheme associated with corresponding network conditions and corresponding capabilities of a client device, the network conditions including bandwidth constraints, the capabilities including video display requirements of the client device;receiving feedback data from the client device;selecting an encoded bitstream from the plurality of encoded bitstreams having a minimum cost, a cost of a corresponding encoded bitstream determined based on any combination of (i) a distortion due to an encoding associated with the corresponding encoded bitstream, (ii) a data rate for transmitting the corresponding encoded bitstream according to the feedback data, and (iii) the capabilities of the client device; andtransmitting the selected encoded bitstream to the client device.2. The method of claim 1 , wherein the multiple encoding schemes include applying various color ...

TIME LAPSE RECORDING VIDEO SYSTEMS

A system for time lapse video recording includes an image processing device configured to receive a compressed video that is encoded using a video compression module operative to encode video from a video camera using a video compression standard, wherein the image processing device is operative to control a time lapse rate to pick and store a plurality of image frames from the series of compressed image frames at the time lapse rate to create a time lapse video, wherein the image processing device is configured to cause the video compression module to modify a GOP length to achieve a predetermined time lapse video quality. 1. A system for time lapse video recording , comprising;an image processing device configured to receive a compressed video, wherein the compressed video is encoded using a video compression module that is operative to encode video from a video camera using a video compression standard, wherein the video compression standard is operative to compress a series of image frames into a plurality of key frames (I-frames) and at least one partial frame (P-frame) after at least one I-frame, wherein the video compression module is operative to modify a group of pictures length (GOP length) between I-frames such that the module controls an amount of P-frames after at least one I-frame or a frame rate at which the I-frames or P-frames are taken, andwherein the image processing device is operative to control a time lapse rate to pick and store a plurality of image frames from the series of compressed image frames at the time lapse rate to create a time lapse video, wherein the image processing device is configured to cause the video compression module to modify the GOP length to achieve a predetermined time lapse video quality.2. The system of claim 1 , wherein image processing device is configured to cause the video compression module to modify the GOP length such that the time lapse rate equals or is a multiple of the length of the GOP such that the image ...