Methods and systems for real-time storyboarding with a web page and graphical user interface for automatic video parsing and browsing

Systems and methods to enable real-time and near real-time storyboarding on the World Wide Web in addition to a graphical user interface for video parsing and browsing the of the storyboard. Specifically, storyboarding can be accomplished on the World Wide Web by parsing an input video into representative or key frames. These frames then can be posted to a web document, or the like, for subsequent viewing by a user. This allows a video to be distilled down to the essential frames thus eliminating storage and bandwidth problems as well as eliminating the need for a user to view the entirety of the video. Furthermore, the graphical user interface allows a user to visually interact with an input video signal to determine the key or representative frames, or to retrieve video segments associated with already determined key frames. Furthermore, the interface allows manipulation of these frames including, but not limited to, playing of the entire segment represented by that key or significant frame as well as actual determining of the cuts between significant segments.

Rate Control for Stream Switching

An apparatus comprising a first node configured to communicate with a second node, wherein the first node is configured to receive a first stream from the second node, receive a bridging stream from the second node, and receive the second stream from the second node, and wherein the bridging stream has a lower bit-rate than the second stream. Included is an apparatus comprising at least one processor configured to implement a method comprising transmitting a first stream at a first time, transmitting a bridging stream that has a bit-rate greater than the first stream and less than the second stream at a second time, and transmitting the second stream at a third time.

Media Processing Devices For Detecting and Ranking Insertion Points In Media, And Methods Thereof

In accordance with an embodiment of the present invention, a method for inserting secondary content into a media stream includes dividing the media stream having a plurality of frames into a plurality of shots at a processor. The method further includes grouping consecutive shots from the plurality of shots into a plurality of scenes. A first list of insertion points is generated for introducing the secondary content. The insertion points of the first list are boundaries between consecutive scenes in the plurality of scenes. An average insertion point saliency of the media stream is generated at the insertion points in the first list. A second list of insertion points is then generated. The insertion points in the second list are arranged to maximize a function of the average insertion point saliency and a distance between each insertion point in the second list with other insertion points in the second list. 1. A method for inserting secondary content into a media stream having primary content , the method comprising:at a processor, dividing the media stream comprising a plurality of frames into a plurality of shots;grouping consecutive shots from the plurality of shots into a plurality of scenes;generating a first list of insertion points for introducing the secondary content, wherein the insertion points of the first list are boundaries between consecutive scenes in the plurality of scenes;generating an average insertion point saliency of the media stream at the insertion points in the first list; andgenerating a second list of insertion points, wherein the insertion points are arranged in the second list to maximize a function of the average insertion point saliency and a distance between each insertion point in the second list with other insertion points in the second list.2. The method of claim 1 , further comprising:determining a distance between each possible insertion point with other insertion points in the first list.3. The method of claim 1 , wherein ...

System and method for image authentication

In accordance with an embodiment, a method of authenticating images includes electronically receiving an anchor image and a query image, performing a feature point extraction of an anchor image, and performing a feature point extraction of a query image. The method also includes clustering feature points of the anchor image and feature points of the query image, where clustering includes determining matching feature points, determining outlier feature points, and excluding outlier feature points. Whether the anchor image is similar to the query image is determined based on a distance between the feature points of the anchor image and the feature points of the query image. If the anchor image is similar to the query image, possible tampered areas of the query image based on the outlier feature points are identified.

System and method for matching targeted advertisements for video content delivery

In accordance with an embodiment, a method of matching video content to advertising content includes electronically receiving a video content metadata from a content provider, and matching the video content metadata to advertising content metadata of a global list of advertisements. The video content metadata corresponds to video content being sent to a user device and includes at least one keyword. Furthermore, the advertising content metadata corresponds to advertising content and includes at least one keyword. Matching the video content metadata to advertising content metadata includes comparing the at least one keyword of the video content metadata to the at least one keyword of the advertising content metadata.

Media Processing Devices For Adaptive Delivery Of On-Demand Media, And Methods Thereof

In one embodiment, a method of streaming media includes partitioning a media stream to be transmitted into a first stream of media segments at a media server. The first stream of the media segments has a first sequence. An index table is generated to identify the first sequence of the first stream of the media segments. The index table is encrypted using a key. A second stream of the media segments is generated. The second stream has a second sequence, which is random relative to the first sequence. The encrypted index table and a transcoded media stream having the second stream of the media segments are transmitted.

System and method for securing media content

A system and method for securing media content are provided. A method for distributing security media content includes embedding a marking payload into media content, thereby producing embedded media content, applying a transform to the embedded media content, thereby producing secured media content, and distributing the secured media content. The marking payload is embedded based on perceptual information regarding the media content.

Emotion modification for image and video content

Apparatus and method for modification of emotion conveyed by an image. In one aspect, a metric corresponding to the emotion conveyed by an image is generated, and a command for modifying the emotion of the image causes the emotion conveyed by the image to be changed according to the specified change to emotion. The command to modify the image emotion can be made via an emotion keyword, and can include an indicated magnitude of emotion change. Emotion conveyed by an image can be specified via an emotion vector, where elements of the vector correspond with emotions arranged along orthogonal dimensions in an emotion space. In one aspect, an emotion predictor is trained to predict the emotion conveyed by an image via determining characteristic values for a set of image feature categories, based on a set of images associated with emotion keywords of the emotion space.

Universal multimedia optic disc player and its application for revocable copy protection

The media player employs an operating system that supports a virtual machine into which auto-run playback programs may be loaded and run. The auto run playback program is stored on the media containing the program content, such as on an optical disc medium. When the medium is inserted in the player, the auto run playback program automatically launches and is thereafter used to access playback the media content. Support for legacy media is provided to allow the player to playback compact discs and DVD discs that were manufactured without the auto run playback program.

Data hiding in digital multimedia

A method and system for hiding authentication data within a multimedia data stream provides for cross-authentication. The method includes the step of obtaining a first set of authentication data, where the first set of authentication data is based on data contained in a first media channel of the multimedia data stream. The method further includes the step of hiding the first set of authentication data in a second media channel of a multimedia data stream. When dealing with active data streams, the present invention provides for hiding a first subset of the active data stream in a visual channel of the multimedia data stream. A second subset of the active data stream is then hidden in the audio channel of the multimedia data stream. In one embodiment, the first subset includes executable content, where the second subset includes a controlled data stream.

Media processing devices for detecting and ranking insertion points in media, and methods thereof

In accordance with an embodiment of the present invention, a method for inserting secondary content into a media stream includes dividing the media stream having a plurality of frames into a plurality of shots at a processor. The method further includes grouping consecutive shots from the plurality of shots into a plurality of scenes. A first list of insertion points is generated for introducing the secondary content. The insertion points of the first list are boundaries between consecutive scenes in the plurality of scenes. An average insertion point saliency of the media stream is generated at the insertion points in the first list. A second list of insertion points is then generated. The insertion points in the second list are arranged to maximize a function of the average insertion point saliency and a distance between each insertion point in the second list with other insertion points in the second list.

System and method for content protection in a content delivery network

An embodiment of an apparatus to authenticate a sequence of video frames includes a process to choose intra-frames of the sequence and sample DC components thereof to produce a set of test fingerprints. To reduce a dimensionality of the test fingerprints, the DC components of the chosen intra-frames are multiplied by a projection matrix formed of eigenvectors associated with the larger eigenvalues of a covariance matrix for a library of frames. The projected test fingerprints are compared against a reference set of fingerprints for authentication. Time-stamp spacings of the chosen intra-frames are determined, and these spacings are employed to select candidate frames for authentication in the reference set of fingerprints.

Rate control for stream switching

An apparatus comprising a first node configured to communicate with a second node, wherein the first node is configured to receive a first stream from the second node, receive a bridging stream from the second node, and receive the second stream from the second node, and wherein the bridging stream has a lower bit-rate than the second stream. Included is an apparatus comprising at least one processor configured to implement a method comprising transmitting a first stream at a first time, transmitting a bridging stream that has a bit-rate greater than the first stream and less than the second stream at a second time, and transmitting the second stream at a third time.

Universal multimedia optic disc player and its application for revocable copy protection

The media player employs an operating system that supports a virtual machine into which auto-run playback programs may be loaded and run. The auto run playback program is stored on the media containing the program content, such as on an optical disc medium. When the medium is inserted in the player, the auto run playback program automatically launches and is thereafter used to access playback of the media content. Support for legacy media is provided to allow the player to playback compact discs and DVD discs that were manufactured without the auto run playback program ...

System and Method for Targeted Advertisements for Video Content Delivery

In accordance with an embodiment, a method of inserting advertisements into video content includes electronically receiving video content metadata from a content provider, matching the video content metadata to advertising content metadata to provide a first list of advertisements, filtering the first list of advertisements according to user preference data to determine a second list of advertisements, and transmitting the second list of advertisements to a user device for insertion into the video content. The video content metadata corresponds to video content being sent to a user device, and the advertising content metadata corresponds to advertising content.

Photographic picture quality improvement recommendation system using objects

A computer program product comprising computer executable instructions stored on a non-transitory computer readable medium such that when executed by a processor, causes the processor to identify an object of interest in a visual media element, analyze the object of interest according to a defined set of rules to form a recommendation for improvement of the visual media element, and recommend the improvement to the visual media element to a user. A method comprising receiving a visual media element as an input, determining a relevant object of interest within the visual media element, analyzing an aesthetic appearance of the relevant object of interest according to a guideline, and recommending a change to the visual media element for conforming to the guideline.

Systems and methods for connection pooling for video streaming in content delivery networks

System and methods for connection pooling for video streaming in content delivery networks (CSNs) are provided. An embodiment method for connection pooling in a content delivery network (CDN) by a proxy server includes receiving, from a client, a request for media content, sending, to a control server, a query to locate an origin media server having the media content if the media content is cache-missing, receiving, from the control server, information regarding the origin media server having the media content requested by the client, and forwarding the request for the media content to the origin media server having the media content using a reusable connection from a pool of the reusable connections between the proxy server and the origin media server if the reusable connection is unoccupied.

Image Processing System and Method for Object Tracking

An image processing method can be performed on a video image that includes an initial frame and a plurality of subsequent frames. An object is located within the initial frame of the video image and a histogram related to the object is generated. A foreground map that includes the object is also generated. For each subsequent frame, a mean shift iteration is performed to adjust the location of the object within the current frame. The histogram related to the object and the foreground map can then be updated.

System and Method for Organizing Multimedia Content

In one embodiment, a method including receiving, by a server, an input video and extracting features of the input video to produce extracted features. The method also includes comparing the extracted features of the input video with metadata stored in a metadata database storage and incorporating the input video into a matched video corresponding to metadata that matches the extracted features of the input video upon determining that the extracted features of the input video match metadata in the metadata database storage. 1. A method comprising:receiving, by a server, an input video;extracting features of the input video to produce extracted features;comparing the extracted features of the input video with metadata stored in a metadata database storage; andincorporating the input video into a matched video corresponding to metadata that matches the extracted features of the input video upon determining that the extracted features of the input video match metadata in the metadata database storage.2. The method of claim 1 , wherein incorporating the input video into the matched video comprises:creating an indicator indicating that the input video matches the matched video;extracting additional metadata from the input video; andincorporating the additional metadata with the metadata in the metadata database storage that matches the extracted features.3. The method of claim 1 , further comprising:extracting a plurality of key frames from the input video upon determining that the extracted features of the input video do not match metadata in the metadata database storage; andgenerating a plurality of key frame fingerprints in accordance with the plurality of key frames.4. The method of claim 3 , wherein generating the plurality of key frame fingerprints comprises:generating a plurality of head streams in accordance with the plurality of key frames; andgenerating a plurality of tail streams in accordance with the plurality of key frames.5. The method of claim 4 , further ...

System and method for bit-allocation in video coding

A system and method for region-of-interest-based bit-allocation scheme for video coding is provided. A method for encoding an image sequence of inter-frames and intra-frames includes grouping the inter-frames and the intra-frames in at least one group of pictures (GOP), and performing a frame-level bit-allocation to inter-frames and the intra-frames in the GOP. For each frame of the inter-frames and the intra-frames in the GOP, the method also includes partitioning the frame into a plurality of macroblocks, identifying macroblocks in the plurality of macroblocks as having regions of interest (ROI), and performing a macroblock level bit-allocation for the frame based on macroblocks identified as having ROI. The method further includes encoding the image sequence based on the bit-allocations, thereby producing an encoded image sequence, and outputting the encoded image sequence.

System and Method for Encoder-Integrated Media Denoising

Embodiments are provided herein to achieve video or image sequence encoding with an improved denoising algorithm that is both efficient computationally and has acceptable overhead cost in comparison to other denoising schemes for video encoding. The embodiments include using recursive bilateral filtering as part of the denoising algorithm, which is integrated into a video encoder to overcome limitations of other encoder-integrated denoising algorithms. An embodiment method includes receiving, at a filtering and residual computation function at the encoder, a macro block comprising a plurality of pixels. The filtering and residual computation function also receives, from a motion estimation function at the encoder, a reference block. The reference block comprises a plurality of reference pixels corresponding to the macro block. The filtering and residual computation function further applies a recursive bilateral filter function to each of the pixels of the macro block using the reference pixels of the reference block. 1. A method for removing noise in a video or image sequence , the method comprising:receiving, at an encoder, a current frame comprising a plurality of current pixels and a previous frame comprising a plurality of previous pixels corresponding to the current pixels;computing, for each current pixel of the current pixels, a similarity term for bilateral filtering using the previous pixels; andapplying a recursive bilateral filter to each current pixels using the similarity term for bilateral filtering.2. The method of claim 1 , wherein applying recursive bilateral filter to each current pixel comprises applying both recursive filtering and bilateral filtering to each current pixel claim 1 , wherein coefficients for applying the recursive bilateral filter are computed by calculating similarities of temporally aligned pixels in the current frame and an aligned frame corresponding to the current frame claim 1 , and wherein results of applying the recursive ...

System and Method for Compressing Images and Video

A system and method for image and video compression using compressive sensing is provided. An embodiment method for compressing an image having a plurality of image blocks includes selecting an image block from the plurality of image blocks to compress, computing a sum of sinusoidal signals at different frequencies and amplitudes representation for the selected image block, quantizing the amplitudes of the sinusoidal signals at different frequencies, and saving the quantized amplitudes as a first compressed image block. The method also includes truncating the quantized amplitudes, thereby producing truncated quantized amplitudes, saving the truncated quantized amplitudes as a second compressed image block, and selecting either the first compressed image block or the second compressed image block as a final compressed image block. The selecting is based on a measure of the quality of the first compressed image block and the second compressed image block. 1. A method for compressing an image having a plurality of image blocks , the method comprising:selecting, by a processor, an image block from the plurality of image blocks to compress;computing, by the processor, a sum of sinusoidal signals at different frequencies and amplitudes representation for the selected image block;quantizing, by the processor, the amplitudes of the sinusoidal signals at the different frequencies;saving, by the processor, in memory the quantized amplitudes as a first compressed image block;truncating, by the processor, the quantized amplitudes to produce truncated quantized amplitudes;saving, by the processor, in memory the truncated quantized amplitudes as a second compressed image block; andselecting, by the processor, either the first compressed image block or the second compressed image block as a final compressed image block, wherein the selecting is in accordance with a comparison of a first quality of the first compressed image block and a second quality of the second compressed image ...

Method and Apparatus for Video Insertion

An embodiment of a system and method that inserts a virtual image into a sequence of video frames. The method includes capturing geometric characteristics of the sequence of video frames, employing the captured geometric characteristics to define an area of the video frames for insertion of a virtual image, registering a video camera to the captured geometric characteristics, identifying features in the sequence of video frames to identify the defined area of video frames for insertion of the virtual image, and inserting the virtual image in the defined area. Vanishing points are estimated to determine the geometric characteristics, and the virtual image is blended with the area of video frames prior to inserting the virtual image in the defined area.

Video skimming methods and systems

In an embodiment, a method of creating a skimming preview of a video includes electronically receiving a plurality of video shots, analyzing each frame in a video shot from the plurality of video shots, where analyzing includes determining a saliency of each frame of the video shot. The method also includes determining a key frame of the video shot based on the saliency of each frame the video shot, extracting visual features from the key frame, performing shot clustering of the plurality of video shots to determine concept patterns based on the visual features, and generating a reconstruction reference tree based on the shot clustering. The reconstruction reference tree includes video shots categorized according to each concept pattern.

Combined binary string for signaling byte range of media fragments in adaptive streaming

A system and method for providing media streaming are provided. A media description file having a range string indicator is used to specify location offsets of a plurality of media fragments within a media file. The range string may be stored directly in the media description file or the media description file may contain an indicator specifying a file containing the range string. The media description file may also include a range unit specifying the size of the offsets in the range string. In an embodiment, offsets within the individual media fragments may also be provided, either in the media description file or in a different file.

MULTI-VIEW VIDEO STREAMING WITH FAST AND SMOOTH VIEW SWITCH

A video server comprises memory to store video content obtained from multiple camera views; one or more streaming components configured to stream video content to a client application; and one or more frame feeder components. A frame feeder component is configured to access first video content corresponding to a first camera view and provide the first video content to a streaming component; access, in response to a request received at the video server to stream second video content corresponding to a second camera view, intermediate video content corresponding to one or more camera views intermediate to the first and second camera views; and access the second video content, and provide the intermediate video content and the second intermediate video to the streaming component. 1. A video server comprising:memory to store video content obtained from multiple camera views;a streaming component configured to stream video content to a client application; and access first video content corresponding to a first camera view and provide the first video content to a streaming component;', 'access, in response to a request received at the video server to stream second video content corresponding to a second camera view, intermediate video content corresponding to one or more camera views intermediate to the first and second camera views; and', 'access the second video content, and provide the intermediate video content and the second intermediate video to the streaming component., 'a frame feeder component configured to2. The video server of claim 1 ,wherein the memory is arranged as a video frame matrix buffer, including a first matrix dimension corresponding to a specified camera view and a second matrix dimension corresponding to time steps associated with a video frame sampling rate, andwherein the frame feeder component is configured to, in response to receiving a command for a first type of video special effect, traverse the video frame matrix buffer to access video ...

Video indexing and image retrieval system

A video segmentation system generates an S-distance measurement that is a representation of the similarity between adjacent frames of a video sequence. The video segmentation system employs frequency decomposition of a direct current (DC) luminance signal of a compressed video sequence. High and low frequency component signatures are generated from a frequency-decomposed signal using wavelet transformation. A cut detector identifies cut transitions from the low frequency component signature. A fade detector identifies fade transitions the high frequency component signature. A dissolve transition detector employs a double frame differencing algorithm to identify dissolve transitions. A video retrieval system likewise generates an S-distance between a query image and a database image. The video retrieval system employs the low and high frequency component signature to generate the S-distance measurement of the similarity between the query image and the database image. The results of the S-distance ...

Using depth information to assist motion compensation-based video coding

An apparatus comprising a plurality of ports, and a processor coupled to the ports and configured to receive a plurality of video frames from any of the ports, wherein the video frames comprise an object and a background, and wherein the video frames comprise a plurality of color pixels for the object and the background, receive a plurality of depth frames from any of the ports, wherein the depth frames comprise the object and the background, and wherein the depth frames comprise an indication of an object depth relative to a background depth, and encode the video frames using the indication of the object depth relative to the background depth.

Method and system for video summarization

A video summary method comprises dividing a video into a plurality of video shots, analyzing each frame in a video shot from the plurality of video shots, determining a saliency of each frame of the video shot, determining a key frame of the video shot based on the saliency of each frame of the video shot, extracting visual features from the key frame and performing shot clustering of the plurality of video shots to determine concept patterns based on the visual features. The method further comprises fusing different concept patterns using a saliency tuning method and generating a summary of the video based upon a global optimization method.

Method and System for Image Processing to Classify an Object in an Image

In an image processing method, an object is located within an image. An area around the object is determined and divided into at least first and second portions based upon image information within the area. The object can then be classified based upon both image information in the first portion of the area and image information in the second portion of the area.

System and Method for Compressing and Decompressing Images and Video

A system and method for image and video compression and decompression using compressive sensing is provided. A method for decompressing a compressed image, where the compressed image having a plurality of compressed image blocks, and the method is performed on a processor, includes selecting a compressed image block, entropy decoding the selected compressed image block, and recovering an image block corresponding to the decoded selected compressed image block using compressive sensing recovery.

Compressive sampling for multimedia coding

An apparatus comprising a decorrelator, a compressive sampler coupled to the decorrelator, and an encoder coupled to the compressive sampler, wherein the compressive sampler is configured to receive sparse data and compress the sparse data using compressive sampling. Also included is a network component comprising at least one processor configured to implement a method comprising decorrelating sparse data or data including sparse data, compressing the sparse data using compressive sampling, and encoding the data. Also included is a method comprising receiving a data stream comprising a sparse data portion, compressing the sparse data portion using compressive sampling, and compressing the remaining data portion without using compressive sampling.

System and Method for Bit-Allocation in Video Coding

A system and method for region-of-interest-based bit-allocation scheme for video coding is provided. A method for encoding an image sequence of inter-frames and intra-frames includes grouping the inter-frames and the intra-frames in at least one group of pictures (GOP), and performing a frame-level bit-allocation to inter-frames and the intra-frames in the GOP. For each frame of the inter-frames and the intra-frames in the GOP, the method also includes partitioning the frame into a plurality of macroblocks, identifying macroblocks in the plurality of macroblocks as having regions of interest (ROI), and performing a macroblock level bit-allocation for the frame based on macroblocks identified as having ROI. The method further includes encoding the image sequence based on the bit-allocations, thereby producing an encoded image sequence, and outputting the encoded image sequence.

Data hiding in communication

Signature information, representing important content of the data, is extracted from a first data block and then embedded in a different block. Data hiding techniques are used to minimize perception of the hidden data. Thereafter, if the first data block is lost or damaged during communication, the hidden data is extracted from the other data block and used to reconstruct the lost or damaged block. If desired, the signature information can be used along with information obtained from neighboring blocks adjacent or proximate to the lost or damaged block.

Human visual model for data hiding

A method and apparatus of hiding identification data in visual media. When image or video data is received, frequency masking is performed to divide the image or video data into blocks of smooth regions and blocks of non-smooth regions and to obtain preliminary just-noticeable-difference. Edge detection is performed to divide the non-smooth region of the image or video data into texture blocks and edge blocks. Then blocks of regions that are substantially proximate to blocks of smooth regions of the image or video data are determined. The image or video data is then adjusted by applying different strength of watermark in association with the type of each block.

System and method for differentiated services in adaptive streaming

A system and method for differentiated services in adaptive streaming are provided. A method for server operations includes: determining an optimization of aggregated quality of experience scores for a set of candidate subscribers served by a server; adjusting a service rate of at least one subscriber based on the determined optimization of aggregated quality of experience scores; and streaming information to the at least one subscriber based on the adjusted service rate. The optimization is based on one or more of: a subscriber level for one or more of the plurality of subscribers; a current service rate; and available service rates.

System and Method for Quality of Experience Aware Media Search and Recommendation with Unified Portal

A network element comprising a processor configured to receive a plurality of search responses from a plurality of media content service providers associated with a search request triggered by the search request, and rank the search responses based on maximizing an end user's quality of experience (QoE). Included is a network element comprising a processor configured to receive a plurality of media content from a plurality of media content service providers, store the plurality of media content for a plurality of end users, receive a media content search request from a user terminal, rank the media content based upon maximizing the user terminal's QoE. Also included is a method comprising requesting media content from a plurality of media content service providers on behalf of a user terminal, receiving data associated with the media content from the plurality of media content service providers and aggregating the media content data. 1. A network element (NE) comprising:a plurality of ports; and receive a plurality of search responses from a plurality of media content service providers, wherein the search responses identify available media associated with a search request;', "filter the search responses to remove search responses that are incompatible with an end user's quality of experience (QoE); and", "rank the filtered search responses based on enhancing the end user's QoE."], 'a processor coupled to the ports and configured to2. The NE of claim 1 , wherein the QoE is based on at least one QoE factor claim 1 , and wherein the QoE factor comprises an end user terminal capability.3. The NE of claim 2 , wherein the QoE factor further comprises an end user available network bandwidth.4. The NE of claim 3 , wherein the QoE factor further comprises a requested media monetization method.5. The NE of claim 4 , wherein the QoE factor further comprises a search request key word matching claim 4 , a requested media popularity among a plurality of prior end users claim 4 , ...

Method and apparatus for multimedia queue management

Methods and systems for a multimedia queue management solution that maintaining graceful Quality of Experience (QoE) degradation are provided. The method selects a frame from all weighted queues based on a gradient function indicating a network performance rate change and a distortion rate caused by the frame and its related frames in the queue, and dropping the selected frame and all its related frames, and continues to drop similarly chosen frame until a network performance rate change caused by the dropping frame and its related frames meets a predetermined performance metric. A frame gradient is a distortion rate divided by a network performance rate change caused by the frame and its related frames, and a distortion rate is based on a sum of each individual frame distortion rate when the frame and its related frames are replaced by some other frames derived from remaining frames based on a replacement method.

Active data hiding for secure electronic media distribution

A method is provided for distributing multimedia content in an electronic media distribution system. The method includes the steps of: (a) providing active hidden data, where the active hidden data includes a plurality of executable machine instructions; (b) embedding active hidden data into the host data stream, thereby forming an embedded data stream; (c) transmitting the embedded data stream from a content provider device to a player device; (d) extracting the active hidden data from the embedded data stream on the player device; and (e) executing the active hidden data on the player device.

Methods and apparatus for multi-layer data hiding

A data hiding system and method for providing a method of embedding multiple layers of hidden data into multimedia data. First, a media unit of the multimedia data is evaluated to determine an appropriate embedding procedure. Next during a first embedding pass, a ruling layer of primary hidden data is embedded into the media unit. In another embedding pass, a governing layer of secondary hidden data is embedded on top of the ruling layer. The secondary hidden data provides control information for controlling the primary hidden data and the host data. Control information such as error correction data, synchronization data, decoding data, and authentication data is embedded in the governing layer. Embedding schemes such as base domain and spectrum domain embedding are employed.

System and Method for Video Detection and Tracking

System and method embodiments are provided to enable features and functionalities for automatically detecting and localizing the position of an object in a video frame and tracking the moving object in the video over time. One method includes detecting a plurality of objects in a video frame using a combined Histograms of Oriented Gradients (HOG) and Local Binary Pattern (LBP) algorithm, highlighting the detected objects, and tracking one of the detected objects that is selected by a user in a plurality of subsequent video frames. Also included is a user device configured to detect a plurality of objects in a video frame displayed on a display screen coupled to the user device using a combined HOG and LBP algorithm, highlight the detected objects, and track one of the detected objects that is selected by a user in a plurality of subsequent video frames on the display screen. 1. A method for video detection and tracking , the method comprising:detecting a plurality of objects in a video frame using a combined Histograms of Oriented Gradients (HOG) and Local Binary Pattern (LBP) algorithm;highlighting the detected objects; andtracking one of the detected objects that is selected by a user in a plurality of subsequent video frames.2. The method of further comprising:training the combined HOB and LBP algorithm by extracting HOG and LBP features on a manually labeled soccer player dataset and a National Institute for Research in Computer Science and Control (INRIA) dataset;combining the manually labeled soccer player dataset and the INRIA data sat to obtain a combined dataset; andlearning a Support Vector Machine (SVM) algorithm on the combined dataset for a half body model to detect moving video objects.3. The method of claim 1 , wherein detecting the objects in the video frame using the combined HOG and LBP algorithm comprises:extracting HOG and LBP features from a plurality of scanning windows in the video frame;concatenating the HOG and LBP features;classifying the ...

High resolution free-view interpolation of planar structure

A method and system is proposed to create a generative model to interpolate any view of a planar scene given a sequence of reference views and a synthesis view that is optimized by the marginalization of photometric regulation, and geometric registration parameters. According to one aspect of the claimed subject matter, a technique is proposed to combine information from varying input camera poses. Planar homography based image super resolution in free view interpolation for planar structure is applied to the combined information. Non-redundant information is combined in such a manner that the high resolution and free view problems in traditional 2D based image-based rendering techniques are overcome.

System and Method for Media Adaptation

A system and method for media adaptation are provided. A method for providing media to an electronic device includes receiving a request for a media with a set of characteristics, and determining if the media with the set of characteristics resides in a media storage. The method also includes if the media with the set of characteristics resides in the media storage, retrieving the media with the set of characteristics from the media storage. The method further includes if the media with the set of characteristics does not reside in the media storage, transcoding an alternate media with an alternate set of characteristics to produce a transcoded media with the set of characteristics. The method additionally includes providing the media with the set of characteristics from the media storage or the transcoded media with the set of characteristics to the electronic device.

Photographic Picture Quality Improvement Recommendation System Using Objects

A computer program product comprising computer executable instructions stored on a non-transitory computer readable medium such that when executed by a processor, causes the processor to identify an object of interest in a visual media element, analyze the object of interest according to a defined set of rules to form a recommendation for improvement of the visual media element, and recommend the improvement to the visual media element to a user. A method comprising receiving a visual media element as an input, determining a relevant object of interest within the visual media element, analyzing an aesthetic appearance of the relevant object of interest according to a guideline, and recommending a change to the visual media element for conforming to the guideline. 1. A computer program product comprising computer executable instructions stored on a non-transitory computer readable medium such that when executed by a processor , causes the processor to:identify an object of interest in a visual media element;analyze the object of interest according to a defined set of rules to form a recommendation for improvement of the visual media element; andrecommend the improvement to the visual media element to a user.2. The computer program product of claim 1 , wherein identifying the object of interest comprises automatically identifying the object of interest for analysis based on aesthetic criteria comprising an angle between the object of interest and a horizontal plane from a camera claim 1 , an orientation of the object of interest relative to the camera claim 1 , a location of the object of interest in a picture claim 1 , a size of the object of interest in the picture claim 1 , or combinations thereof.3. The computer program product of claim 1 , wherein identifying the object of interest comprises interactively identifying the object for analysis based on input received from a user.4. The computer program product of claim 1 , wherein identifying the object comprises a ...

Partial encryption of stream-formatted media

A method of partially encrypting streaming media according to an embodiment of the invention comprises: receiving media in a streaming-media format; partitioning the stream-formatted media into cloak data and non-cloak data; and encrypting the cloak data such that less than all of the stream-formatted media is encrypted.

System and method for transmission control protocol service delivery in wireless communications systems

A method for delivering packets in a wireless communications system includes determining a cause of loss for a previously transmitted packet based on a packet acknowledgement corresponding to the previously transmitted packet, the packet acknowledgement including at least one of a wireless loss indicator and a congestion warning indicator for the wireless communications system. The method also includes adjusting a transmission parameter in a packet transmission protocol according to the cause of loss, and retransmitting the previously transmitted packet.

Media Processing Devices With Joint Encryption-Compression, Joint Decryption-Decompression, And Methods Thereof

In one embodiment, a method of adaptive media streaming includes receiving a cipher media stream at a media device. The cipher media stream is compliant with a media compression standard. The cipher media stream is decrypted and decoded using an inverse stream cipher algorithm and a compressed media stream is generated by combining the cipher media stream with a keystream.

System and method for retargeting video sequences

A system and method for retargeting video sequences are provided. A method for retargeting a video includes a plurality of frames includes determining saliency information for the plurality of frames, determining a cost metric for the video, and retargeting the video based on the cost metric to produce a retargeted video. The cost metric considers loss due to cropping, scaling, temporal factors, and spatial factors. The retargeting makes use of a crop window for each frame in the plurality of frames.

Method and System for Image Processing to Classify an Object in an Image

In an image processing method, an object is located within an image. An area around the object is determined and divided into at least first and second portions based upon image information within the area. The object can then be classified based upon both image information in the first portion of the area and image information in the second portion of the area.

Systems and Methods for Connection Pooling for Video Streaming in Content Delivery Networks

System and methods for connection pooling for video streaming in content delivery networks (CSNs) are provided. An embodiment method for connection pooling in a content delivery network (CDN) by a proxy server includes receiving, from a client, a request for media content, sending, to a control server, a query to locate an origin media server having the media content if the media content is cache-missing, receiving, from the control server, information regarding the origin media server having the media content requested by the client, and forwarding the request for the media content to the origin media server having the media content using a reusable connection from a pool of the reusable connections between the proxy server and the origin media server if the reusable connection is unoccupied. 1. A method for connection pooling in a content delivery network (CDN) by a proxy server , the method comprising:receiving, from a client, a request for media content;sending, to a control server, a query to locate an origin media server having the media content if the media content is cache-missing;receiving, from the control server, information regarding the origin media server having the media content requested by the client;determining whether to use connection pool between a proxy server and the origin media server or to use a caching server to accommodate the request for the media content; andforwarding the request for the media content to the origin media server having the media content using a first reusable connection or a newly created connection in the connection pool between the proxy server and the origin media server if the connection pool between a proxy server and origin media server is available.2. The method of claim 1 , wherein the connection pool between a proxy server and origin media server is available when at least one reusable connection is unoccupied or a new connection can be created in accordance with a connection pool management criteria.3. The ...

Methods and apparatus for media navigation

In accordance with an embodiment of the present invention, an apparatus for streaming a media includes a server side receiver for receiving a request to stream a media from a media player. The apparatus further includes a content generator, a server side transmitter, and a media stream generator. The content generator is configured to generate content information providing a plurality of presentation options to consume the media. The server side transmitter is configured to send the content information. The server side receiver is further configured to receive a selected presentation option from amongst the plurality of presentation options. The media stream generator is configured to generate a media stream comprising the media based on the selected presentation option.

Method and apparatus for scrub preview services

In accordance with an embodiment of the present invention, a method of streaming a media preview includes delivering a preview data having preview information from a media file to be streamed. The preview data has a multi-dimensional hierarchical data structure has a plurality of layers with increasing content of the preview information in each layer of the plurality of layers. The preview data is configured to provide an adaptive and scalable preview service.

Scalable streaming media authentication

Consumer networks, increasingly used for multimedia information and commercial content delivery, are destined to be heterogeneous. To provide QoS, it is necessary to adapt the multimedia stream to the heterogeneous network channel conditions and device capabilities. Meanwhile, security is an important component to restrict unauthorized multimedia content access and distribution. This suggests the need for new cryptography system implementations that can operate at different data rates, i.e., be scaled to various multimedia content, different network topology, changing bandwidth, and diverse receiver device capabilities. Content authentication is one important security tool for secure multimedia content communication. Conventional message authentication schemes do not offer suitable scalability for this new set of applications. The present invention addresses design of scalable media data stream authentication and presents a framework for multimedia authentication that supports various kinds ...

Video Skimming Methods and Systems

In an embodiment, a method of creating a skimming preview of a video includes electronically receiving a plurality of video shots, analyzing each frame in a video shot from the plurality of video shots, where analyzing includes determining a saliency of each frame of the video shot. The method also includes determining a key frame of the video shot based on the saliency of each frame the video shot, extracting visual features from the key frame, performing shot clustering of the plurality of video shots to determine concept patterns based on the visual features, and generating a reconstruction reference tree based on the shot clustering. The reconstruction reference tree includes video shots categorized according to each concept pattern. 1. A method of creating a skimming preview of a video , the method comprising:electronically receiving a plurality of video shots;analyzing each frame in a video shot from the plurality of video shots, analyzing comprising determining a saliency of each frame of the video shot;determining an effective visual saliency based on the determined saliency and a human attention model of the video shot;selecting a key frame of the video shot based on the effective visual saliency of each frame the video shot;extracting visual features from the key frame;performing shot clustering of the plurality of video shots to determine concept patterns based on the visual features; andgenerating a hierarchical reconstruction based on the shot clustering.2. The method of claim 1 , wherein the human attention model is based on camera motion.3. The method of claim 2 , wherein:the human attention model comprises a camera attenuation factor based on the camera motion;the method further comprises determining the camera attenuation factor; anddetermining the effective visual saliency comprises multiplying the determined saliency with the determined camera attenuation factor.4. The method of claim 3 , wherein the determined camera attenuation factor is ...

Compressed domain video watermarking

In accordance with an embodiment, a method of watermarking encoded video frames includes electronically receiving a bitstream comprising a plurality of encoded video frames that are divided into a plurality of macro-blocks, determining macro-block dependencies based on prediction information in the received bitstream, determining a set of macro-blocks having a minimal number of macro-block dependencies, and embedding a watermark in a plurality of macro-blocks selected from the set of macro-blocks having the minimal number of macro-block dependencies.

Methods and apparatus for media navigation

In accordance with an embodiment of the present invention, a method of playing a media includes receiving a first media stream of the media and displaying the first media stream in a first window of a media player. The first media stream includes navigable parts configured to be selected for higher resolution streaming. A request to stream a selected navigable part of the first media stream is sent. A second media stream with the selected navigable part is received and displayed. The resolution of the selected navigable part in the second media stream is higher than the resolution of the selected navigable part in the first media stream.

System and method for organizing multimedia content

In one embodiment, a method including receiving, by a server, an input video and extracting features of the input video to produce extracted features. The method also includes comparing the extracted features of the input video with metadata stored in a metadata database storage and incorporating the input video into a matched video corresponding to metadata that matches the extracted features of the input video upon determining that the extracted features of the input video match metadata in the metadata database storage.

Systems and Methods for Video Denoising

A method for video denoising, the method includes extracting a current pixel from a current video frame and n-1 pixels from respective n-1 previous video frames to form an n-point pixel data set, wherein the current pixel has an initial value; temporally filtering the current pixel using the n-point pixel data set to generate a temporal estimated true value for the pixel; estimating a quantity of outliers in the n-point pixel data set; if the quantity of outliers is greater than or equal to a threshold, spatially filtering the current pixel using neighboring pixels in the current video frame to generate an spatial estimated true value for the pixel, and using the spatial estimated true value for the pixel as a final estimated value for the pixel; if the quantity of outliers is less than the threshold, using the temporal estimated true value for the pixel as the final estimated value for the pixel.

System and Method for Video Caption Re-Overlaying for Video Adaptation and Retargeting

In accordance with an embodiment, a method of processing an electronic image having caption text includes receiving the electronic source image, detecting the caption text in the electronic source image, reformatting the electronic source image, reformatting the caption text, and overlaying the reformatted caption text on the reformatted electronic image to form a resultant image.

Methods and Apparatus for Media Navigation

In accordance with an embodiment of the present invention, an apparatus for streaming a media includes a server side receiver for receiving a request to stream a media from a media player. The apparatus further includes a content generator, a server side transmitter, and a media stream generator. The content generator is configured to generate content information providing a plurality of presentation options to consume the media. The server side transmitter is configured to send the content information. The server side receiver is further configured to receive a selected presentation option from amongst the plurality of presentation options. The media stream generator is configured to generate a media stream comprising the media based on the selected presentation option.

Systems and methods for video denoising

A method for video denoising, the method includes extracting a current pixel from a current video frame and n1 pixels from respective n1 previous video frames to form an n-point pixel data set, wherein the current pixel has an initial value; temporally filtering the current pixel using the n-point pixel data set to generate a temporal estimated true value for the pixel; estimating a quantity of outliers in the n-point pixel data set; if the quantity of outliers is greater than or equal to a threshold, spatially filtering the current pixel using neighboring pixels in the current video frame to generate an spatial estimated true value for the pixel, and using the spatial estimated true value for the pixel as a final estimated value for the pixel; if the quantity of outliers is less than the threshold, using the temporal estimated true value for the pixel as the final estimated value for the pixel.

System and Method for Securing Media Content

A system and method for securing media content are provided. A method for distributing security media content includes embedding a marking payload into media content, thereby producing embedded media content, applying a transform to the embedded media content, thereby producing secured media content, and distributing the secured media content. The marking payload is embedded based on perceptual information regarding the media content.

Methods for digital watermarking of images and images produced thereby

The computer analyzes a representation of a digitized image to determine contiguous edges of the image; select edges for modulation in accordance with a data hiding criterion; apply a watermark-dependent edge point modulation to pixels on the selected edges; and wherein said analyzing to determine contiguous edges produces lists of pixel pointers, each list containing pointers to pixel locations of a contiguous edge; and wherein said criterion selects lists corresponding to low contrast, low smoothness edges.

System and Method for Transmission Control Protocol Service Delivery in Wireless Communications Systems

A method for delivering packets in a wireless communications system includes determining a cause of loss for a previously transmitted packet based on a packet acknowledgement corresponding to the previously transmitted packet, the packet acknowledgement including at least one of a wireless loss indicator and a congestion warning indicator for the wireless communications system. The method also includes adjusting a transmission parameter in a packet transmission protocol according to the cause of loss, and retransmitting the previously transmitted packet.

Digital watermarking of binary document using halftoning

The present invention is a method for hiding data in document contents. The method comprises receiving information relating to the document contents, wherein at least part of the document contents are of a binary nature, converting the data to halftone pixel groups according to predefined binary classifications associated with combinations of halftone pixels, and embedding the halftone pixel groups into a binary portion of the document contents. Further, the present invention is a method for extracting data hidden in document contents. The method comprises receiving information relating to the document contents, wherein the document contents include halftone pixel groups, extracting the halftone pixel groups from the document contents, and converting the halftone pixel groups to the data according to predefined binary classifications associated with combinations of halftone pixels.

One-Pass Video Stabilization

A method of stabilizing a video in real time using a single pass including receiving consecutive video frames, where the consecutive video frames include a current video frame and previous video frames, storing the consecutive video frames in a buffer, estimating a global motion for the current video frame by describing a camera's relative motion between the current video frame and one of the previous video frames adjacent to the current video frame, estimating a long-term camera motion for the current video frame by determining a geometric mean of an accumulation of the estimate of the global motion for the current video frame and an estimate of global motion for each of the previous video frames, and displaying the current video frame on a display of an electronic device, the current video frame stabilized based on the estimate of the long-term camera motion. 1. A device configured to provide one-pass , real-time video stabilization , comprising:a memory including a buffer and instructions; and store consecutive video frames in the buffer of the memory after receipt, the consecutive video frames including a current video frame and previous video frames;', "estimate a global motion for the current video frame by describing a camera's relative motion between the current video frame and one of the previous video frames adjacent to the current video frame;", 'estimate a long-term camera motion for the current video frame by determining a geometric mean of an accumulation of the estimated global motion for the current video frame and an estimate of global motion for each of the previous video frames; and', 'stabilize the current video frame based on the estimated long-term camera motion; and, 'a processor coupled to the memory, the processor configured to execute the instructions stored in the memory to cause the processor toa display device coupled to the processor, the display device configured to display the current video frame as stabilized.2. The device of claim 1 ...

Semi-fragile watermarking system for MPEG video authentication

The semi-fragile watermark comprises a fragile watermark component and a robust watermark component. Features are extracted from the video stream and subsequent hashing and encryption processes are performed to generate the fragile watermark. The fragile watermark includes control data information at the block level as well as frame and group level information. The fragile watermark is added on top of the robust watermark, giving the system the ability to detect alteration at the block level as well as the group level. The resulting semi-fragile watermark has the advantage of being both sensitive to malicious attack while being robust enough to survive bit rate reduction and other types of manipulation typically performed on digital multimedia signals.

Methods and Apparatus for Media Navigation

In accordance with an embodiment of the present invention, a method of playing a media includes receiving a first media stream of the media and displaying the first media stream in a first window of a media player. The first media stream includes navigable parts configured to be selected for higher resolution streaming. A request to stream a selected navigable part of the first media stream is sent. A second media stream with the selected navigable part is received and displayed. The resolution of the selected navigable part in the second media stream is higher than the resolution of the selected navigable part in the first media stream.

System and method to support different ingest and delivery schemes for a content delivery network

In accordance with an embodiment, a method of operating a computer server includes receiving streaming media data. The streaming media data includes content fragments and a media description file, and the media description file includes metadata describing the content fragments. The method also includes storing the content fragments in a cache.

Method and Apparatus for Multimedia Queue Management

Methods and systems for a multimedia queue management solution that maintaining graceful Quality of Experience (QoE) degradation are provided. The method selects a frame from all weighted queues based on a gradient function indicating a network performance rate change and a distortion rate caused by the frame and its related frames in the queue, and dropping the selected frame and all its related frames, and continues to drop similarly chosen frame until a network performance rate change caused by the dropping frame and its related frames meets a predetermined performance metric. A frame gradient is a distortion rate divided by a network performance rate change caused by the frame and its related frames, and a distortion rate is based on a sum of each individual frame distortion rate when the frame and its related frames are replaced by some other frames derived from remaining frames based on a replacement method. 1. A method for managing a first number of queues each having a queue weight , the method comprising:selecting a set of candidate frames comprising a candidate frame for each queue among the first number of queues, wherein each frame in a queue has a frame gradient based on a gradient function indicating a network performance rate change and a distortion rate caused by the frame and its related frames in the queue, and wherein each candidate frame of a queue has a minimal frame gradient among all frames in the queue;selecting a first dropping frame from the set of candidate frames, based on the candidate frame gradients of the queues and the queue weights of the queues; anddropping the first dropping frame and all its related frames.2. The method of claim 1 , further comprising:selecting a second dropping frame from the set of candidate frames, based on a candidate frame gradient of a queue and a queue weight of the queue, when a network performance rate change caused by the first dropping frame and its related frames does not meet a predetermined ...

Universal multimedia optic disc player and its application for revocable copy protection

The media player employs an operating system that supports a virtual machine into which auto-run playback programs may be loaded and run. The auto run playback program is stored on the media containing the program content, such as on an optical disc medium. When the medium is inserted in the player, the auto run playback program automatically launches and is thereafter used to access playback of the media content. Support for legacy media is provided to allow the player to playback compact discs and DVD discs that were manufactured without the auto run playback program.

One-pass video stabilization

A method of stabilizing a video in real time using a single pass including receiving consecutive video frames, where the consecutive video frames include a current video frame and previous video frames, storing the consecutive video frames in a buffer, estimating a global motion for the current video frame by describing a camera's relative motion between the current video frame and one of the previous video frames adjacent to the current video frame, estimating a long-term camera motion for the current video frame by determining a geometric mean of an accumulation of the estimate of the global motion for the current video frame and an estimate of global motion for each of the previous video frames, and displaying the current video frame on a display of an electronic device, the current video frame stabilized based on the estimate of the long-term camera motion.

Multicast tree packing for multi-party video conferencing under SDN environment

Method, device and apparatus for delivering video telephony by using a media controller and a software defined networking (SDN) controller to enable multicasting for multi-party video conferencing. A media controller generates a video sending rate for each of the plurality of client devices based on a received video conference request and received network information. The media controller determines and independently constructs a maximum-rate delay-bounded multicast tree for each of the plurality of client devices that supports the largest possible multicast rate. The media controller determines a common congested link in the multicast trees, re-routes the multicast tree with the common congested link for the client device with the lowest weight of utility divided by its video sending rate and creating two subtrees, and iteratively re-routes the multicast trees until an aggregate video sending rate of the multicast trees sharing the common congested link meets a link capacity of the common ...

System and method for compressing images and video

A system and method for image and video compression using compressive sensing is provided. An embodiment method for compressing an image having a plurality of image blocks includes selecting an image block from the plurality of image blocks to compress, computing a sum of sinusoidal signals at different frequencies and amplitudes representation for the selected image block, quantizing the amplitudes of the sinusoidal signals at different frequencies, and saving the quantized amplitudes as a first compressed image block. The method also includes truncating the quantized amplitudes, thereby producing truncated quantized amplitudes, saving the truncated quantized amplitudes as a second compressed image block, and selecting either the first compressed image block or the second compressed image block as a final compressed image block. The selecting is based on a measure of the quality of the first compressed image block and the second compressed image block.

Content-based authentication of graph presented in text documents

A system and method provide for content-based authentication of binary graphs. The method includes the step of receiving an electronic file having a graphical content. An object level representation of the graphical content is then generated and authentication information is added to the electronic file based on the object level representation. The method further provides for authenticating the object level representation with a text authentication algorithm. Thus, by building a bridge from graphs to text at the character level, the present invention allows authentication of graphs using suitable text document authentication algorithms. When pixel level precision of the graph is required, a pixel level authentication can be added. This layer lets the owner detect as well as localize changes in the graph at the pixel level. Both levels of authentication are optional depending on the application.

System and method for organizing multimedia content

In one embodiment, a method of organizing multimedia content includes obtaining, by a server, a first video program. Also, the method includes selecting a first video, where the first video is a first subset of the first video program, and where the first video forms a first branch of the first video program and selecting a second video, where the second video is a second subset of the first video program. Additionally, the method includes selecting a first partial video, where the first partial video is a first subset of the first video and selecting a second partial video, where the second partial video is a second subset of the first video. The method also includes establishing a multi-dimensional index tree including a first video program level, a first video level, a first partial video level.

System and Method for Retargeting Video Sequences

A system and method for retargeting video sequences are provided. A method for retargeting a video includes a plurality of frames includes determining saliency information for the plurality of frames, determining a cost metric for the video, and retargeting the video based on the cost metric to produce a retargeted video. The cost metric considers loss due to cropping, scaling, temporal factors, and spatial factors. The retargeting makes use of a crop window for each frame in the plurality of frames. 1. A method for retargeting a video comprising a plurality of frames , the method comprising:determining saliency information for the plurality of frames;determining a cost metric for the video, wherein the cost metric considers loss due to cropping, scaling, temporal factors, and spatial factors; andretargeting the video based on the saliency information and the cost metric to produce a retargeted video, wherein the retargeting makes use of a crop window for each frame in the plurality of frames.2. The method of claim 1 , wherein the spatial factors comprise cropping loss and scaling loss for each frame in the plurality of frames.3. The method of claim 1 , wherein the temporal factors comprise motion information between frames in the plurality of frames.4. The method of claim 1 , wherein the saliency information comprises spatial saliency information claim 1 , temporal saliency information claim 1 , a fusion of spatial saliency information and temporal saliency information claim 1 , or combinations thereof.5. The method of claim 1 , wherein determining saliency information comprises:applying a spatial processing algorithm to the video to produce spatial saliency information; andapplying a motion processing algorithm to the video to produce temporal saliency information.6. The method of claim 1 , wherein determining saliency information comprises applying a domain fusion technique to spatial saliency information and temporal saliency information.7. The method of claim 6 ...

System and Method for Transmission Control Protocol Slow-Start

An embodiment of a system and method that uses inline measurements to probe available bandwidth for a transmission control protocol, and adaptively sets a slow-start threshold according to the available bandwidth. The method includes initializing a congestion window “cwnd,” sending cwnd packets, estimating an available bandwidth for the cwnd packets. The congestion window cwnd is set to a higher number, and the higher number of further packets is sent if the available bandwidth is greater than a first threshold level. The available bandwidth is re-estimated for the higher number of the further packets, and a soft start threshold “ssthresh” is set to the re-estimated available bandwidth. A statistical measure is calculated for the re-estimated available bandwidth, and the congestion window cwnd is set equal to ssthresh if a ratio of the statistical measure to the re-estimated available bandwidth is less than a second threshold level.

System and Method for Quality of Experience Estimation

A system and method for quality of experience estimation are provided. A method for communications device operations includes selecting a portion of a media content stream, processing the portion to produce a processed portion, generating a signature from the processed portion, transmitting the signature, and transmitting the media content stream. 1. A method for communications device operations , the method comprising:selecting a portion of a media content stream;processing the portion to produce a processed portion;generating a signature from the processed portion;transmitting the signature; andtransmitting the media content stream.2. The method of claim 1 , wherein processing the portion comprises scaling the portion.3. The method of claim 1 , wherein processing the portion comprises reducing a bit-depth of the portion claim 1 , reducing a color depth of the portion claim 1 , reducing a dimension of the portion claim 1 , compressing the portion claim 1 , or combinations thereof.4. The method of claim 1 , wherein generating a signature comprises providing the processed portion to a transformation function.5. The method of claim 4 , wherein the transformation function comprises a wavelet filterbank decomposition function claim 4 , a singular value decomposition function claim 4 , a discrete cosine transform function claim 4 , or combinations thereof.6. The method of claim 4 , wherein the transformation function produces an output claim 4 , and wherein the signature comprises a portion of the output.7. The method of claim 6 , wherein the signature comprises a statistically significant portion of the output.8. The method of claim 1 , wherein the selecting claim 1 , the processing claim 1 , the generating claim 1 , and the transmitting the signature are performed in response to receiving an instruction to generate a signature.9. The method of claim 1 , wherein the selecting claim 1 , the processing claim 1 , the generating claim 1 , and the transmitting the signature ...

UNIVERSAL MULTIMEDIA OPTIC DISC PLAYER AND ITS APPLICATION FOR REVOCABLE COPY PROTECTION

The media player employs an operating system that supports a virtual machine into which auto-run playback programs may be loaded and run. The auto run playback program is stored on the media containing the program content, such as on an optical disc medium. When the medium is inserted in the player, the auto run playback program automatically launches and is thereafter used to access playback the media content. Support for legacy media is provided to allow the player to playback compact discs and DVD discs that were manufactured without the auto run playback program

Method and apparatus for performing a video conference

A method for performing a video conference in a mobile phone is provided. The video conference involves a plurality of conferencing devices that display presentation content and a video image of one or more participants in the video conference. The mobile phone receives a first and second real-time transport protocol (RTP) packets including a video image of a participant and presentation content in the video conference, respectively. The video image of the participant includes a face portion of the participant and a background portion. The mobile phone decodes the video image of the participant and the presentation content, extracts the face portion of the participant from the video image of the participant, overlays the face portion of the participant over a portion of the presentation content to form a composite image, and displays the composite image on a display device of the mobile phone.

System and method for encoder-integrated media denoising

Embodiments are provided herein to achieve video or image sequence encoding with an improved denoising algorithm that is both efficient computationally and has acceptable overhead cost in comparison to other denoising schemes for video encoding. The embodiments include using recursive bilateral filtering as part of the denoising algorithm, which is integrated into a video encoder to overcome limitations of other encoder-integrated denoising algorithms. An embodiment method includes receiving, at a filtering and residual computation function at the encoder, a macro block comprising a plurality of pixels. The filtering and residual computation function also receives, from a motion estimation function at the encoder, a reference block. The reference block comprises a plurality of reference pixels corresponding to the macro block. The filtering and residual computation function further applies a recursive bilateral filter function to each of the pixels of the macro block using the reference ...

Class coalescence for obfuscation of object-oriented software

A method of obfuscating an object-oriented program is provided. A program is provided that is defined in terms of a plurality of classes. Each of the classes has at least one of a field and a method. At least two of the plurality of classes are combined into a combined class. When the at least two classes are combined, at least one field from at least one of the two classes is included in the combined class, and/or at least one method from at least one of the two classes is included in the combined class. After the at least two classes are combined, the program is transmitted.

DYNAMIC PRIORITY QUEUE MAPPING FOR QOS ROUTING IN SOFTWARE DEFINED NETWORKS

A QoS management scheme for SDN. Network resource availability of routers and switches are maintained in a central resource database of a SDN controller. The SDN controller performs resource reservation, admission control and route calculation. When a flow is admitted or completed, the resource database is updated accordingly. Dynamic queue mapping for QoS routing in SDN is also provided. For a traffic flow with a certain traffic description and delay requirement, the queue mapping protocol dynamically assigns the flow to different priority queues at different switches along its routing path. Compared with the static mapping of a flow to a specified priority queue, the disclosed mapping is more flexible and uses network resources more efficiently. 1. In software defined networking (SDN) , a method of queue mapping for quality of service (QoS) routing , the method comprising:obtaining network topology information of the SDN;receiving a request for an application flow, the application flow having associated therewith a QoS requirement;admitting the application flow and assigning the application flow to a plurality of nodes along a routing path; anddynamically assigning the application flow to different queues at different nodes of the plurality of nodes.2. The method as specified in comprising maintaining network resource availability of routers and switches in a resource database.3. The method as specified in further comprising updating the resource database when the application flow is admitted or completed.4. The method as specified in wherein the resource database is associated with a SDN controller.5. The method as specified in further comprising dynamically mapping the application flow to different priority queues at different nodes based on local traffic conditions claim 1 , at the same time claim 1 , satisfying an end-to-end QoS requirement of the application flow.6. The method as specified in wherein all the nodes are put into a priority queue according to ...

Media Distribution with Service Continuity

System and methods for media distribution are described. In one embodiment, a method of media distribution includes rendering of a media to a user, stopping the rendering of the media, and storing remaining media not rendered to the user in a user server. The method further includes receiving a request to stream the remaining media to the user, dividing the remaining media into segments, and assigning a priority to each segment. The remaining media is streamed, leaving out segments with priority lower than a threshold priority.

System and Method for Matching Targeted Advertisements for Video Content Delivery

In accordance with an embodiment, a method of matching video content to advertising content includes electronically receiving a video content metadata from a content provider, and matching the video content metadata to advertising content metadata of a global list of advertisements. The video content metadata corresponds to video content being sent to a user device and includes at least one keyword. Furthermore, the advertising content metadata corresponds to advertising content and includes at least one keyword. Matching the video content metadata to advertising content metadata includes comparing the at least one keyword of the video content metadata to the at least one keyword of the advertising content metadata.

Combined Binary String for Signaling Byte Range of Media Fragments in Adaptive Streaming

A system and method for providing media streaming are provided. A media description file having a range string indicator is used to specify location offsets of a plurality of media fragments within a media file. The range string may be stored directly in the media description file or the media description file may contain an indicator specifying a file containing the range string. The media description file may also include a range unit specifying the size of the offsets in the range string. In an embodiment, offsets within the individual media fragments may also be provided, either in the media description file or in a different file.

System and Method for Organizing Multimedia Content

In one embodiment, a method of organizing multimedia content includes obtaining, by a server, a first video program. Also, the method includes selecting a first video, where the first video is a first subset of the first video program, and where the first video forms a first branch of the first video program and selecting a second video, where the second video is a second subset of the first video program. Additionally, the method includes selecting a first partial video, where the first partial video is a first subset of the first video and selecting a second partial video, where the second partial video is a second subset of the first video. The method also includes establishing a multi-dimensional index tree including a first video program level, a first video level, a first partial video level. 1. A method of organizing multimedia content , the method comprising:obtaining, by a server, a first video program;selecting a first video, wherein the first video is a first subset of the first video program, and wherein the first video forms a first branch of the first video program;selecting a second video, wherein the second video is a second subset of the first video program, and wherein the second video forms a second branch of the first video program;selecting a first partial video, wherein the first partial video is a first subset of the first video, and wherein the first partial video forms a first branch of the first video;selecting a second partial video, wherein the second partial video is a second subset of the first video, and wherein the second partial video forms a second branch of the first video; andestablishing a first multi-dimensional index tree including a first video program level for the first video program, a first video level for the first video and the second video, a first partial video level for the first partial video and the second partial video.2. The method of claim 1 , further comprising determining a video program index in accordance ...

Feature based hierarchical video segmentation

Systems and methods for detecting robust fade and dissolve and video sequences. The systems and methods use a two step approach to detect both discontinuous cuts and gradual changes in a video sequence. Specifically, an input video signal is first divided into video segments based on the location of the discontinuous cut. A gradual change detector is then applied to the discontinuous cut segments to determine further cuts based on editing characteristics. By using this two part approach, the systems and methods of this invention can robustly detect scene breaks within a video.

System and Method for Adaptive Differentiated Streaming

A system and method for adaptive differentiated streaming are provided. A method for server operations includes establishing a connection for streaming media to a subscriber, receiving a request for a selected media content alternative, and streaming the selected media content alternative to the subscriber. The media content alternative to be streamed is selected based on a classification of the subscriber.

Method and Apparatus for Scrub Preview Services

In accordance with an embodiment of the present invention, a method of streaming media with a media preview includes generating a preview data by extracting preview information from a media file to be streamed. The preview data has a multi-dimensional hierarchical data structure having a plurality of layers with increasing content of the preview information in each layer of the plurality of layers. The preview data is configured to provide a differentiated preview service. 1. A method of generating a media preview of a media stream , the method comprising:generating a preview data by extracting preview information from a media file to be streamed, wherein the preview data comprises a multi-dimensional hierarchical data structure having a plurality of layers with increasing content of the preview information in each layer of the plurality of layers, wherein the preview data is configured to provide an adaptive and scalable preview service.2. The method of claim 1 , wherein the adaptive and scalable preview service provides a differentiated preview service.3. The method of claim 1 , wherein the multi-dimensional hierarchical data structure comprises a plurality of time segments in one dimension and the plurality of layers in another dimension.4. The method of claim 1 , wherein a first dimension of the multi-dimensional hierarchical data structure comprises degrees of freedom for a number of alternate previews claim 1 , wherein a second dimension of the multi-dimensional hierarchical data structure comprises a plurality of time segments in one dimension claim 1 , and wherein a third dimension of the multi-dimensional hierarchical data structure comprises the plurality of layers.5. The method of claim 1 , wherein the preview data comprises preview data type information.6. The method of claim 5 , wherein the preview data type information comprises a data type from the group consisting of preview video data claim 5 , preview audio data claim 5 , keyframe images claim 5 , ...

Video Skimming Methods and Systems

In an embodiment, a method of creating a skimming preview of a video includes electronically receiving a plurality of video shots, analyzing each frame in a video shot from the plurality of video shots, where analyzing includes determining a saliency of each frame of the video shot. The method also includes determining a key frame of the video shot based on the saliency of each frame the video shot, extracting visual features from the key frame, performing shot clustering of the plurality of video shots to determine concept patterns based on the visual features, and generating a reconstruction reference tree based on the shot clustering. The reconstruction reference tree includes video shots categorized according to each concept pattern. 1. A method of creating a skimming preview of a video , the method comprising:electronically receiving a plurality of video shots;analyzing each frame in a video shot from the plurality of video shots, analyzing comprising determining a saliency of each frame of the video shot;determining a key frame of the video shot based on the saliency of each frame the video shot;extracting visual features from the key frame;performing shot clustering of the plurality of video shots to determine concept patterns based on the visual features; andgenerating a reconstruction reference tree based on the shot clustering, the reconstruction reference tree comprising video shots categorized according to each concept pattern.2. The method of claim 1 , further comprising generating a video skimming preview based on the reconstruction reference tree.3. The method of claim 1 , further comprising extracting audio features from the video shot.4. The method of claim 3 , wherein extracting audio features comprises:determining audio words from the video shot; andperforming clustering on the audio words.5. The method of claim 4 , wherein determining audio words comprises:deriving a first set of audio words;calculating a saliency measure for each of the audio ...

Methods and systems for real-time storyboarding with a web page and graphical user interface for automatic video parsing and browsing

Systems and methods to enable real-time and near real-time storyboarding on the World Wide Web in addition to a graphical user interface for video parsing and browsing the of the storyboard. Specifically, storyboarding can be accomplished on the World Wide Web by parsing an input video into representative or key frames. These frames then can be posted to a web document, or the like, for subsequent viewing by a user. This allows a video to be distilled down to the essential frames thus eliminating storage and bandwidth problems as well as eliminating the need for a user to view the entirety of the video. Furthermore, the graphical user interface allows a user to visually interact with an input video signal to determine the key or representative frames, or to retrieve video segments associated with already determined key frames. Furthermore, the interface allows manipulation of these frames including, but not limited to, playing of the entire segment represented by that key or significant ...

Video signature based on image hashing and shot detection

In accordance with an embodiment, a method of comparing a first group of frames to a second group of frames includes electronically receiving the first group of frames, selecting a group of frames from the first group of frames as a first key frame set, calculating a hash distance between an image hash for each frame in the first key frame set to an image hash of each frame of a second key frame set taken from second group of frames, and choosing frames in the first group of frames with a minimum hash distances to respective reference frames to form a series of minimum hash distances.

Computer-implemented method and apparatus for audio data hiding

A computer-implemented method and apparatus for embedding hidden data in an audio signal. An audio signal is received in a base domain and then transformed into a non-base domain, such as cepstrum domain or LP residue domain. The statistical mean manipulation is employed on selected transform coefficients to embed hidden data. The introduced distortion is controlled by psychoacoustic model to ensure the imperceptibility of the embedded hidden data. Scrambling techniques can be plugged in to further increase the security of the data hiding system. The present new audio data hiding scheme provides transparent audio quality, sufficient embedding capacity, and high survivability over a wide range of common signal processing attacks.

System and method for transmission control protocol slow-start

An embodiment of a system and method that uses inline measurements to probe available bandwidth for a transmission control protocol, and adaptively sets a slow-start threshold according to the available bandwidth. The method includes initializing a congestion window “cwnd,” sending cwnd packets, estimating an available bandwidth for the cwnd packets. The congestion window cwnd is set to a higher number, and the higher number of further packets is sent if the available bandwidth is greater than a first threshold level. The available bandwidth is re-estimated for the higher number of the further packets, and a soft start threshold “ssthresh” is set to the re-estimated available bandwidth. A statistical measure is calculated for the re-estimated available bandwidth, and the congestion window cwnd is set equal to ssthresh if a ratio of the statistical measure to the re-estimated available bandwidth is less than a second threshold level.

Video Signature Based on Image Hashing and Shot Detection

In accordance with an embodiment, A method of comparing a first group of frames to a second group of frames includes electronically receiving the first group of frames, selecting a group of frames from the first group of frames as a first key frame set, calculating a hash distance between an image hash for each frame in the first key frame set to an image hash of each frame of a second key frame set taken from second group of frames, and choosing frames in the first group of frames with a minimum hash distances to respective reference frames to form a series of minimum hash distances.

System and Method to Support Different Ingest and Delivery Schemes for a Content Delivery Network

In accordance with an embodiment, a method of operating a computer server includes receiving streaming media data. The streaming media data includes content fragments and a media description file, and the media description file includes metadata describing the content fragments. The method also includes storing the content fragments in a cache.

Method and system for video summarization

A video summary method comprises dividing a video into a plurality of video shots, analyzing each frame in a video shot from the plurality of video shots, determining a saliency of each frame of the video shot, determining a key frame of the video shot based on the saliency of each frame of the video shot, extracting visual features from the key frame and performing shot clustering of the plurality of video shots to determine concept patterns based on the visual features. The method further comprises fusing different concept patterns using a saliency tuning method and generating a summary of the video based upon a global optimization method.

System and Method for Differentiated Services in Adaptive Streaming

A system and method for differentiated services in adaptive streaming are provided. A method for server operations includes: determining an optimization of aggregated quality of experience scores for a set of candidate subscribers served by a server; adjusting a service rate of at least one subscriber based on the determined optimization of aggregated quality of experience scores; and streaming information to the at least one subscriber based on the adjusted service rate. The optimization is based on one or more of: a subscriber level for one or more of the plurality of subscribers; a current service rate; and available service rates.

Method and Apparatus for Scrub Preview Services

In accordance with an embodiment of the present invention, a method of streaming a media preview includes delivering a preview data having preview information from a media file to be streamed. The preview data has a multi-dimensional hierarchical data structure has a plurality of layers with increasing content of the preview information in each layer of the plurality of layers. The preview data is configured to provide an adaptive and scalable preview service. 1. A method of streaming a media preview of a media , the method comprising:delivering a preview data comprising preview information for a media file being streamed, wherein the preview data comprises a multi-dimensional hierarchical data structure having a plurality of layers with increasing content of the preview information in each layer of the plurality of layers, and wherein the preview data is configured to provide an adaptive and scalable preview service.2. The method of claim 1 , wherein the adaptive and scalable preview service provides a differentiated preview service.3. The method of claim 1 , wherein the preview data comprises preview data type information.4. The method of claim 3 , wherein delivering a preview data comprises:receiving a service request from a client;generating an instantaneous user service profile identifying a layer of preview data for each type of preview data;identifying the layer of the preview data in the instantaneous user service profile to be transmitted;extracting a specific preview information in the layer of the preview data; andsending the specific preview information to the client.5. The method of claim 3 , wherein delivering a preview data comprises:receiving a user parameter from a client;defining a preview description data and/or network transmission parameters based on the user parameter; andusing the defined preview description data and/or network transmission parameters, sending the preview description data to the client.6. The method of claim 1 , wherein the ...

Compressed Domain Video Watermarking

In accordance with an embodiment, a method of watermarking encoded video frames includes electronically receiving a bitstream comprising a plurality of encoded video frames that are divided into a plurality of macro-blocks, determining macro-block dependencies based on prediction information in the received bitstream, determining a set of macro-blocks having a minimal number of macro-block dependencies, and embedding a watermark in a plurality of macro-blocks selected from the set of macro-blocks having the minimal number of macro-block dependencies. 1. A method of watermarking encoded video frames , the method comprising:electronically receiving a bitstream comprising a plurality of encoded video frames, each video frame being divided into a plurality of macro-blocks;determining macro-block dependencies based on prediction information in the received bitstream;determining a set of macro-blocks having a minimal number of macro-block dependencies; andembedding a watermark in a plurality of macro-blocks selected from the set of macro-blocks having the minimal number of macro-block dependencies.2. The method of claim 1 , wherein determining the macro-block dependencies comprises:analyzing the prediction information; andbuilding a link-list of macro-block dependencies based on analyzing the prediction information.3. The method of claim 2 , wherein determining the set of macro-blocks having the minimal number of macro-block dependencies comprises:sorting the link list by dependency layers;determining a number of available macro-blocks per dependency layer; andcomputing a start layer based on the number of macro-blocks per dependency layer and a bit rate of a watermark signal; andselecting the set of macro-blocks having a minimal number of macro-block dependencies based on the computed start layer.4. The method of claim 3 , wherein each dependency layer comprises macro-blocks having a same number of macro-blocks referring to them.5. The method of claim 3 , wherein ...

Cloud-Based Transcoding Platform Systems and Methods

Methods and systems for transcoding in a cloud computing platform are disclosed. According to an embodiment, a receiver receives an uploading file by one data block at a time, and stores the received data blocks in various storage modules. Small segment files are then generated when the size of the received data blocks is larger than a threshold. A transcoder transcodes the small segment files from one format such as a bit rate or a frame size to another while the receiver is still receiving a new data block. The transcoded small segment files may be stitched together to form a stitched file, which may be stored in a storage module to be downloaded through a content distribution network (CDN). The transcoded small segment files may be passed to streaming servers for streaming over a network while the receiver is still receiving a new data block of the uploading file. 1. A method for transcoding in a cloud computing platform , the method comprising:receiving a first uploading file by a receiver one data block at a time;storing a plurality of received data blocks of the first uploading file;generating a first small segment file from the plurality of received data blocks while still receiving a new data block of the first uploading file; andtranscoding by a transcoder the first small segment file while the receiver is still receiving a new data block of the first uploading file.2. The method of claim 1 , further comprising:transcoding by the transcoder a plurality of small segment files generated by the receiver; andstitching the plurality of transcoded small segment files together to form a stitched file which is a transcoded file of the first uploading file.3. The method of claim 2 , further comprising:storing the stitched file in a file storage module to be downloaded through a content distribution network (CDN).4. The method of claim 1 , further comprising:receiving by a first streaming server the transcoded first small segment file for streaming over a network ...

System and Method for Content Protection in a Content Delivery Network

An embodiment of an apparatus to authenticate a sequence of video frames includes a process to choose intra-frames of the sequence and sample DC components thereof to produce a set of test fingerprints. To reduce a dimensionality of the test fingerprints, the DC components of the chosen intra-frames are multiplied by a projection matrix formed of eigenvectors associated with the larger eigenvalues of a covariance matrix for a library of frames. The projected test fingerprints are compared against a reference set of fingerprints for authentication. Time-stamp spacings of the chosen intra-frames are determined, and these spacings are employed to select candidate frames for authentication in the reference set of fingerprints. 1. A method of authenticating a sequence of frames , comprising:choosing one or more intra-frames from a sequence of frames; andsampling a near zero-frequency (“DC”) component of the chosen one or more intra-frames to produce a set of one or more test fingerprints.2. The method as recited in further comprising comparing the set of one or more test fingerprints against a reference set of one or more fingerprints correspondingly produced to authenticate the sequence of frames.3. The method as recited in further comprising identifying a set of one or more nearest neighbor fingerprints in the reference set of one or more fingerprints to authenticate the sequence of frames.4. The method as recited in further comprising:determining spacings of the chosen one or more intra-frames; andemploying the spacings to select candidate frames in the reference set of one or more fingerprints to authenticate the sequence of frames.5. The method as recited in wherein the spacings are time stamps.6. The method as recited in wherein the comparing the set of one or more test fingerprints against the reference set of one or more fingerprints comprises:identifying members of the reference set of one or more fingerprints having spacings that match spacings of the set of ...

Systems and Methods for Selective Data Redundancy Elimination for Resource Constrained Hosts

System and method embodiments are provided for selective data redundancy elimination. In an embodiment, the method includes receiving, at a transmission point, an incoming data packet containing content, wherein the content comprises a content type, eliminating, with the transmission point, redundant data elements from the data packet when the content type matches a selective data redundancy elimination type, and bypassing, with the transmission point, selective data redundancy elimination when the content type matches a bypass-elimination type. 1. A method for selective redundancy elimination , the method comprising:receiving, at a transmission point, an incoming data packet containing content, wherein the content comprises a content type;eliminating, with the transmission point, redundant data elements from the data packet when the content type matches a selective redundancy elimination type; andbypassing, with the transmission point, selective redundancy elimination when the content type matches a bypass-elimination type.2. The method of claim 1 , further comprising bypassing selective redundancy elimination when a length of the data packet is less than a threshold.3. The method of claim 2 , wherein a size of the threshold is equal to a size of a Rabin sliding window.4. The method of claim 1 , wherein the content type is identified from a hypertext transfer protocol (HTTP) header in the data packet.5. The method of claim 1 , wherein the bypass-elimination type comprises at least one of an image claim 1 , video claim 1 , and audio.6. The method of claim 1 , wherein the selective redundancy elimination type comprises at least one of text and application.7. The method of claim 1 , maintaining a packet classifier claim 1 , wherein the packet classifier maintains a content-type table according to transfer control protocol flow tuples.8. The method of claim 7 , wherein the content-type table comprises at least one of a source internet protocol (IP) address claim 7 , a ...

Using Depth Information to Assist Motion Compensation-Based Video Coding

An apparatus comprising a plurality of ports, and a processor coupled to the ports and configured to receive a plurality of video frames from any of the ports, wherein the video frames comprise an object and a background, and wherein the video frames comprise a plurality of color pixels for the object and the background, receive a plurality of depth frames from any of the ports, wherein the depth frames comprise the object and the background, and wherein the depth frames comprise an indication of an object depth relative to a background depth, and encode the video frames using the indication of the object depth relative to the background depth. 1. An apparatus comprising:a plurality of ports; and receive a plurality of video frames from any of the ports, wherein the video frames comprise an object and a background, and wherein the video frames comprise a plurality of color pixels for the object and the background;', 'receive a plurality of depth frames from any of the ports, wherein the depth frames comprise the object and the background, and wherein the depth frames comprise an indication of an object depth relative to a background depth; and', 'encode the video frames using the indication of the object depth relative to the background depth., 'a processor coupled to the ports and configured to2. The apparatus of claim 1 , wherein encoding the video frame comprises:extracting the color pixels from the video frames;extracting the indication of an object depth relative to a background depth from the depth frames;segmenting the object from the background using the indication of the object depth relative to the background depth;calculating a motion of the object; andencoding the object.3. The apparatus of claim 2 , wherein calculating the motion of the object comprises:determining that the object is not rigid; andperforming a motion estimation for the object.4. The apparatus of claim 2 , wherein calculating the motion of the object comprises:determining that the object ...

MULTICAST TREE PACKING FOR MULTI-PARTY VIDEO CONFERENCING UNDER SDN ENVIRONMENT

Method, device and apparatus for delivering video telephony by using a media controller and a software defined networking (SDN) controller to enable multicasting for multi-party video conferencing. A media controller generates a video sending rate for each of the plurality of client devices based on a received video conference request and received network information. The media controller determines and independently constructs a maximum-rate delay-bounded multicast tree for each of the plurality of client devices that supports the largest possible multicast rate. The media controller determines a common congested link in the multicast trees, re-routes the multicast tree with the common congested link for the client device with the lowest weight of utility divided by its video sending rate and creating two subtrees, and iteratively re-routes the multicast trees until an aggregate video sending rate of the multicast trees sharing the common congested link meets a link capacity of the common congested link. 1. A method of multicast video telephony , the method comprising:receiving, at a media controller, video conference request from each of a plurality of client devices;receiving, at the media controller, network information from a network controller; andgenerating, by the media controller, a video sending rate for each of the plurality of client devices, wherein the video sending rate is based on the received video conference request and the received network information.2. The method of claim 1 , wherein the network controller is a software defined networking (SDN) controller.3. The method of claim 1 , wherein generating the video sending rate comprises:determining, at the media controller, a maximum-rate delay-bounded multicast tree for each of the plurality of client devices that supports the largest possible multicast rate.4. The method of claim 3 , further comprising independently constructing the maximum-rate delay-bounded multicast tree for each of the ...

Method and Apparatus for Performing a Video Conference

A method for performing a video conference in a mobile phone is provided. The video conference involves a plurality of conferencing devices that display presentation content and a video image of one or more participants in the video conference. The mobile phone receives a first and second real-time transport protocol (RTP) packets including a video image of a participant and presentation content in the video conference, respectively. The video image of the participant includes a face portion of the participant and a background portion. The mobile phone decodes the video image of the participant and the presentation content, extracts the face portion of the participant from the video image of the participant, overlays the face portion of the participant over a portion of the presentation content to form a composite image, and displays the composite image on a display device of the mobile phone.

HIGH RESOLUTION FREE-VIEW INTERPOLATION OF PLANAR STRUCTURE

A method and system is proposed to create a generative model to interpolate any view of a planar scene given a sequence of reference views and a synthesis view that is optimized by the marginalization of photometric regulation, and geometric registration parameters. According to one aspect of the claimed subject matter, a technique is proposed to combine information from varying input camera poses. Planar homography based image super resolution in free view interpolation for planar structure is applied to the combined information. Non-redundant information is combined in such a manner that the high resolution and free view problems in traditional 2D based image-based rendering techniques are overcome. 1. A computer implemented method of rendering a free view image of a captured scene , said method comprising:accessing a plurality of input images stored in a memory of a computing device and corresponding to a plurality of reference view points, wherein an input image represents a planar image of said captured scene at a respective reference view point;receiving a requested view point;generating, by a processor of the computing device, an initial synthesis image based on said plurality of input images;calculating, by the processor of the computing device, geometric registration parameters and photometric regulation parameters corresponding to said plurality of input images; andgenerating, by the processor of the computing device, a new synthesis image representing a planar image of said captured scene in said request view point based on an interpolation of said plurality of input images, said geometric registration parameters, and said photometric regulation parameters.2. The computer implemented method of claim 1 , wherein calculating said geometric registration parameters comprises determining a positional relativity between pixels comprised in said initial synthesis image and pixels comprised in said plurality of input images.3. The computer implemented method of ...

Bilateral Denoising for Digital Camera Images

An apparatus comprising one or more processors configured to receive a digital image comprising a current pixel and a plurality of nearby pixels, determine a pixel intensity of the current pixel, wherein the pixel intensity comprises a noise component, and reduce the noise component by applying a bilateral filter as a combination of a domain filter and a range filter on the current pixel, wherein the domain filter is dependent on the pixel intensity and geometric closeness between the current pixel and the nearby pixels, and wherein the range filter is dependent on the pixel intensity and photometric similarity between the current pixel and the nearby pixels. 1. An apparatus comprising one or more processors configured to:receive a digital image comprising a current pixel and a plurality of nearby pixels;determine a pixel intensity of the current pixel, wherein the pixel intensity comprises a noise component; andreduce the noise component by applying a bilateral filter as a combination of a domain filter and a range filter on the current pixel, wherein the domain filter is dependent on the pixel intensity and geometric closeness between the current pixel and nearby pixels, and wherein the range filter is dependent on the pixel intensity and photometric similarity between the current pixel and the nearby pixels.2. The apparatus of claim 1 , further comprising one or more complementary metal-oxide semiconductor (CMOS) image sensors coupled to the one or more processors and configured to:generate the digital image under low-light conditions; andsend the digital image to the one or more processors.3. The apparatus of claim 2 , wherein the apparatus is a smartphone comprising a digital camera coupled to the one or more processors claim 2 , wherein the digital camera comprises the one or more CMOS image sensors claim 2 , wherein the pixel intensity represents one color component in a red claim 2 , green claim 2 , and blue (RGB) color space claim 2 , and wherein the one or ...

EMOTION MODIFICATION FOR IMAGE AND VIDEO CONTENT

Apparatus and method for modification of emotion conveyed by an image. In one aspect, a metric corresponding to the emotion conveyed by an image is generated, and a command for modifying the emotion of the image causes the emotion conveyed by the image to be changed according to the specified change to emotion. The command to modify the image emotion can be made via an emotion keyword, and can include an indicated magnitude of emotion change. Emotion conveyed by an image can be specified via an emotion vector, where elements of the vector correspond with emotions arranged along orthogonal dimensions in an emotion space. In one aspect, an emotion predictor is trained to predict the emotion conveyed by an image via determining characteristic values for a set of image feature categories, based on a set of images associated with emotion keywords of the emotion space. 1. A method of modifying an image to change an emotion conveyed by the image , the method comprising:accessing an image stored in a memory;generating a metric corresponding to emotions conveyed by the image, the emotions arranged along a plurality of emotion dimensions;receiving a command to modify the image according to a specified change to a particular emotion;transforming the image by modifying the image according to predefined image features corresponding to the emotion, in accordance with the specified change to the particular emotion;displaying a transformed image with the change in the particular emotion.2. The method according to claim 1 , wherein the metric comprises values corresponding to magnitudes of the emotions conveyed.3. The method according to claim 2 , wherein the specified change to the particular emotion comprises a magnitude of change.4. The method according to claim 2 , wherein the metric is arranged in a vector comprising elements corresponding to the plurality of emotion dimensions.5. The method according to claim 1 , wherein the plurality of emotion dimensions comprises orthogonal ...

Utility-Maximization Framework For Dynamic Adaptive Video Streaming Over Hypertext Transfer Protocol In Multiuser-Multiple Input Multiple Output Long-Term Evolution Networks

A method for scheduling user equipment (UE) devices comprising sorting the plurality of UE devices based on a weight of priority associated with each of the UE devices with respect to a plurality of subbands, and assigning one or more of the UE devices to each of the subbands using the weight of priority associated with the UE devices, wherein the weight of priority is based on one or more network utility functions associated with the UE devices. A computer program product comprising computer executable instructions to receive a media content segment using a dynamic adaptive video streaming over hypertext transfer protocol (HTTP) (DASH) protocol, monitor a playback buffer size of a UE device, monitor a battery energy level of the UE device, and adjust a representation quality level in a segment request based on the target requested video rate, the playback buffer size and the battery energy level. 1. A method for scheduling user equipment (UE) devices , the method comprising:sorting the plurality of UE devices based on a weight of priority associated with each of the UE devices with respect to a plurality of subbands; andassigning one or more of the UEs to each of the subbands using the weight of priority associated with the UE devices,wherein the weight of priority is based on one or more network utility functions associated with the UE devices, andwherein a plurality of media content segments are communicated using a dynamic adaptive video streaming over hypertext transfer protocol (HTTP) (DASH) protocol when the UE devices are assigned to the subbands.2. The method of claim 1 , wherein the one or more network utility functions are functions of an average video rate claim 1 , a playback buffer size claim 1 , and a battery energy level associated with one of the UE devices.4. The method of claim 1 , wherein assigning one or more of the UE devices to each of the subbands comprises assigning UE devices having a larger weight of priority before UE devices having a ...

ONE-PASS VIDEO STABILIZATION

A device is disclosed comprising a memory configured for holding video and a processor coupled to the memory. The memory contains computer-executable instructions that, when executed by the processor, cause the device to perform operations to stabilize the video, the operations comprising buffering consecutive original video frames, determining transformation matrices from subsets of the original video frames, wherein the transformation matrices represent estimates of stable camera motion, using the transformation matrices to warp the original video frames and generate video that is stabilized relative to the original video frames, and adjusting a size of a subset of original video frames in response to detecting a condition. 1. A device , comprising:memory configured for holding video; and buffering consecutive original video frames;', 'determining transformation matrices from subsets of the original video frames, wherein the transformation matrices represent estimates of stable camera motion;', 'using the transformation matrices to warp the original video frames and generate video that is stabilized relative to the original video frames; and', 'adjusting a size of a subset of original video frames in response to detecting a condition., 'a processor coupled to the memory, the memory containing computer-executable instructions that, when executed by the processor, cause the device to perform operations to stabilize the video, the operations comprising2. The device of claim 1 , wherein the instructions claim 1 , when executed by the processor claim 1 , further cause the device to perform operations comprising:accessing global motion estimates that describe a relative camera motion between two consecutive video frames;determining the geometric mean of the global motion estimates for each of the subsets;applying Kalman filtering to the geometric mean for each of the subsets to produce smoothed versions of the geometric means; anddetermining the transformation matrices ...

Media processing devices for adaptive delivery of on-demand media, and methods thereof

In one embodiment, a method of streaming media includes partitioning a media stream to be transmitted into a first stream of media segments at a media server. The first stream of the media segments has a first sequence. An index table is generated to identify the first sequence of the first stream of the media segments. The index table is encrypted using a key. A second stream of the media segments is generated. The second stream has a second sequence, which is random relative to the first sequence. The encrypted index table and a transcoded media stream having the second stream of the media segments are transmitted.

System and method for video detection and tracking

System and method embodiments are provided to enable features and functionalities for automatically detecting and localizing the position of an object in a video frame and tracking the moving object in the video over time. One method includes detecting a plurality of objects in a video frame using a combined Histograms of Oriented Gradients (HOG) and Local Binary Pattern (LBP) algorithm, highlighting the detected objects, and tracking one of the detected objects that is selected by a user in a plurality of subsequent video frames. Also included is a user device configured to detect a plurality of objects in a video frame displayed on a display screen coupled to the user device using a combined HOG and LBP algorithm, highlight the detected objects, and track one of the detected objects that is selected by a user in a plurality of subsequent video frames on the display screen.

Dynamic priority queue mapping for QoS routing in software defined networks

A QoS management scheme for SDN. Network resource availability of routers and switches are maintained in a central resource database of a SDN controller. The SDN controller performs resource reservation, admission control and route calculation. When a flow is admitted or completed, the resource database is updated accordingly. Dynamic queue mapping for QoS routing in SDN is also provided. For a traffic flow with a certain traffic description and delay requirement, the queue mapping protocol dynamically assigns the flow to different priority queues at different switches along its routing path. Compared with the static mapping of a flow to a specified priority queue, the disclosed mapping is more flexible and uses network resources more efficiently.

Method and system for video summarization

Media distribution with service continuity

System and methods for media distribution are described. In one embodiment, a method of media distribution includes rendering of a media to a user, stopping the rendering of the media, and storing remaining media not rendered to the user in a user server. The method further includes receiving a request to stream the remaining media to the user, dividing the remaining media into segments, and assigning a priority to each segment. The remaining media is streamed, leaving out segments with priority lower than a threshold priority.

Device having optical see-through 3d display

In accordance with an embodiment, a device includes an eyeglasses frame and a three-dimensional display coupled to the eyeglasses frame. The three-dimensional display includes: a display panel having a first emitting region, a second emitting region, and a transparent region between the first emitting region and the second emitting region; a first microlens overlapping the first emitting region of the display panel; and a second microlens overlapping the second emitting region of the display panel, the second microlens spaced apart from the first microlens.

Verfahren zur Erzeugung eines Wasserzeichens für Audiosignale

Device having combination 2d-3d display

In accordance with an embodiment, a device includes: a frame and an autostereoscopic display (104) coupled to the frame. The autostereoscopic display (104) includes: a display panel including light-emitting diodes (602) in a first far-field region (402), in a second far-field region (402), and in a near-field region (1902), the near-field region (1902) disposed between the first far-field region (402) and the second far-field region (402); a first microlens (604) overlapping the first far-field region (402) of the display panel; and a second microlens (604) overlapping the second far-field region (402) of the display panel, the second microlens (604) spaced apart from the first microlens (604), where the near-field region (1902) of the display panel is free of microlenses (604).

Device having optical see-through 3d display

In accordance with an embodiment, a device (1500) includes: a frame (102) and an autostereoscopic display (104) coupled to the frame (102). The autostereoscopic display (104) includes: a display panel having a first emitting region (402), a second emitting region (402), and a transparent region (612) between the first emitting region (402) and the second emitting region (402); a first microlens (604) overlapping the first emitting region (402) of the display panel (104); and a second microlens (604) overlapping the second emitting region (402) of the display panel (104), the second microlens (604) spaced apart from the first microlens (604).

Quality-of-experience assured networking via application-specific integrated network

A method for providing quality of experience (QoE) for an application includes obtaining application specific integrated network (ASIN) information of the application for providing the QoE; configuring a network segment of an end-to end (E2E) ASIN based on the ASIN information to provide the QoE; and communicating data for the application using the network segment.

Method and apparatus for scalable semantically aware augmented reality (ar)+ internet system

According to embodiments, a computing device performs objection detection on media content of a physical object to match features of the physical object. The computing device sends to a space object name service (SONS) server a SONS query request. The SONS query request includes the features of the physical object. The computing device receives, from the SONS server, a SONS query response. The SONS query response includes a domain name system (DNS) domain name for retrieving augmented reality (AR) content corresponding to the physical object, and the DNS domain name is based on the features of the physical object. The computing device obtains an Internet Protocol (IP) address by resolving the DNS domain name. The computing device obtains the AR content corresponding to the physical object based on the IP address and the SONS query response. The computing device renders at least a part of the AR content corresponding to the physical object.

Systems and methods for selective data redundancy elimination for resource constrained hosts

Device having optical see-through 3d display

In accordance with an embodiment, a device includes: a frame and an autostereoscopic display coupled to the frame. The autostereoscopic display includes: a display panel having a first emitting region, a second emitting region, and a transparent region between the first emitting region and the second emitting region; a first microlens overlapping the first emitting region of the display panel; and a second microlens overlapping the second emitting region of the display panel, the second microlens spaced apart from the first microlens.

Adaptive lecture video conferencing

A system and method or rendering an online presentation having a live component and a stored component. Pre-fetch content in the stored component is determined and distributed to client, network nodes or cloud services devices. Synchronization data is included in the distributed content. Upon presentation of the live component of the online presentation, the presentation is rendered at client devices using both data from the live component and the pre-fetch content. Pre-fetch content is synchronized to the live content using the synchronization data.

Real-time meeting data recovery after proactive participant interruption

A system and method of rendering real-time online meeting content which is paused by a participant is described. Teal-time meeting data including meeting content from participant devices is received at a participant's device in a data format during a real-time online meeting. The real-time meeting data is rendered in real time. A participant may generate a pause in the rendering after which the participant may re-start the rendering. Real-time recovery data is accessed from a local cache or a network device, and the recovery data is rendered to replace the real-time meeting content which was paused. The recovery data may be in the same format as the meeting data or in a different format, and rendered up to a catch-up point when the rendering at the participant's device is synchronized with other participant devices in the meeting.

Device having optical see-through 3d display

In accordance with an embodiment, a device includes an eyeglasses frame (102) and a three-dimensional display (104) coupled to the eyeglasses frame (102). The three-dimensional display (104) includes: a display panel (602) having a first emitting region (402, 602E), a second emitting region (402, 602E), and a transparent region (612) between the first emitting region (402, 602E) and the second emitting region (402, 602E); a first microlens (604) overlapping the first emitting region )(402, 612E) of the display panel (602); and a second microlens (604) overlapping the second emitting region (402, 602E) of the display panel (602), the second microlens (604) spaced apart from the first microlens (604).

Device having optical see-through 3d display and methods for adapting the same

In accordance with an embodiment, a method includes: obtaining operating conditions (1702) of a wearable device, the operating conditions including visual operating conditions, auditory operating conditions, positional operating conditions, or environmental operating conditions, the wearable device including a memory and a three-dimensional display, the three-dimensional display being optical see-through; obtaining operating preferences (1704) of the wearable device from the memory of the wearable device, the operating preferences including a radius of curvature of an eye of a user of the wearable device; and calculating exit angles and intensity of light rays that will be emitted by the three-dimensional display, the exit angles being calculated according to the operating preferences of the wearable device, the intensity being calculated according to the operating conditions of the wearable device.

Media adaptation for lost content recovery in real-time online meetings

An apparatus and method computer implemented method of recovering real-time online meeting content which is lost. Real-time meeting data including meeting content is transmitted between participant devices in a data format during a real-time online meeting. Some data may be lost during transmission between the devices. When a loss in loss real-time meeting data occurs, real-time recovery data in a different data format is acquired. The real-time recovery data replaces meeting content in the lost real-time meeting data. The recovery data is rendered at the participant device where data was lost to replace real-time meeting content in the lost data.

Methods and apparatus for digital content protection

A multilayer digital content protection system, particularly for a digital cinema application is provided. Detection of unauthorized activity at the time it is occurring is provided using a first protection layer. Two layers of imperceptible watermarks, one camcorder viewable and one camcorder invisible are inserted into unauthorized copies of the digital content with second and third protection layers. Strong near infrared is also used to degrade the quality of any attempted unauthorized recording of digital content using a camcorder.

Method and apparatus for scalable semantically aware augmented reality (ar)+ internet system

According to embodiments, a computing device performs objection detection on media content of a physical object to match features of the physical object. The computing device sends to a space object name service (SONS) server a SONS query request. The SONS query request includes the features of the physical object. The computing device receives, from the SONS server, a SONS query response. The SONS query response includes a domain name system (DNS) domain name for retrieving augmented reality (AR) content corresponding to the physical object, and the DNS domain name is based on the features of the physical object. The computing device obtains an Internet Protocol (IP) address by resolving the DNS domain name. The computing device obtains the AR content corresponding to the physical object based on the IP address and the SONS query response. The computing device renders at least a part of the AR content corresponding to the physical object.

Reduced-latency communication using behavior prediction

A system and method for low latency communication in networked applications. User behaviors of participants in a networked meeting or virtual environment application is captured at a time T for use in the networked application. A next or future behavior at a time greater than T is predicted and the prediction data forwarded to the processing devices of other users in the application. The prediction data is used to render the behaviors of the user on the processing devices of other users. The capture and creation of prediction data can be performed continuously or limited to cases where large amounts of latency are detected.

Reduced-latency communication using behavior prediction

A system and method for low latency communication in networked applications. User behaviors of participants in a networked meeting or virtual environment application is captured at a time T for use in the networked application. A next or future behavior at a time greater than T is predicted and the prediction data forwarded to the processing devices of other users in the application. The prediction data is used to render the behaviors of the user on the processing devices of other users. The capture and creation of prediction data can be performed continuously or limited to cases where large amounts of latency are detected.

Client adaptation for real-time meeting data recovery

A system and method of recovering real-time online meeting content at a processing device of a participant in the real-time online meeting. Real-time meeting data in a sequence is received during a real-time online meeting, in synchronization with other participants of the real-time online meeting. When one or more segments of data in the real-time meeting data is lost, the lost data may subsequently be received but rendering is no longer synchronized with other participants. A catch-up point in the sequence following the period of lost real-time meeting data is determined. Real-time meeting data received after the lost real-time meeting data is rendered in the sequence by at least one of skipping at least a portion of the lost real-time meeting data to advance to the catch-up point and rendering at least a portion of the lost real-time meeting data up to the catch-up point in the sequence.

Multi-view video streaming with fast and smooth view switch

A video server comprises memory to store video content obtained from multiple camera views; one or more streaming components configured to stream video content to a client application; and one or more frame feeder components. A frame feeder component is configured to access first video content corresponding to a first camera view and provide the first video content to a streaming component; access, in response to a request received at the video server to stream second video content corresponding to a second camera view, intermediate video content corresponding to one or more camera views intermediate to the first and second camera views; and access the second video content, and provide the intermediate video content and the second intermediate video to the streaming component.

Systems and methods for selective data redundancy elimination for resource constrained hosts

System and method to support different ingest and delivery schemes for a content delivery network

In accordance with an embodiment, a method of operating a computer server includes receiving streaming media data. The streaming media data includes content fragments and a media description file, and the media description file includes metadata describing the content fragments. The method also includes storing the content fragments in a cache.

Método de operar um servidor de computador e sistema de servidor

sistema e método para suportar diferentes esquemas de ingestão para para uma rede de entrega de conteúdo. de acordo com uma modalidade, um método de operar, um computador servidor inclui receber dados de mídias de fluxo contínuo. os dados de mídia de fluxo continuo incluem fragmentos de conteúdo e um arquivo de descrição de mídia, e o arquivo de descrição de mídia inclui metadados descrevendo os fragmentos de conteúdo. o método também inclui armazenar os fragmentos de conteúdo em um cache.

System and method to support different ingest and delivery schemes for a content delivery network

System and method to support different ingest and delivery schemes for a content delivery network

In accordance with an embodiment, a method of operating a computer server includes receiving streaming media data. The streaming media data includes content fragments and a media description file, and the media description file includes metadata describing the content fragments. The method also includes storing the content fragments in a cache.

Digital watermarking of binary document using halftoning

Methods and apparatus for digital content protection

A multilayer digital content protection system, particularly for a digital cinema application is provided. Detection of unauthorized activity at the time it is occurring is provided using a first protection layer. Two layers of imperceptible watermarks, one camcorder viewable and one camcorder invisible are inserted into unauthorized copies of the digital content with second and third protection layers. Strong near infrared is also used to degrade the quality of any attempted unauthorized recording of digital content using a camcorder.

Content recovery in real-time online meetings

An apparatus and method for recovering real-time meeting content which is lost during an online meeting. Lost real-time meeting data transmitted between a source device and at least one participant processing device during a real-time online meeting is determined. Real-time recovery data replacing information in the real-time meeting data is provided and the real-time recovery data is rendered to replace the real-time meeting content in the lost real time meeting data at the at least one participant device. The recovery data may be provided in the same or different formats and the technology may be implemented in a network environment where recovery is initiated by a participant processing device or a network device upon detection of lost meeting data.

Digital watermarking of binary document using halftoning

The present invention is a method (Fig. 1) for hiding data in document contents. The method comprises receiving information relating to the document contents, (102) , wherein at least part of the document contents are of a binary nature, converting the data to halftone pixel groups according to predefined binary classifications associated with combinations of halftone pixels, (104), and embedding the halftone pixel groups into a binary portion of the document contents (104 and 114). Further, the present invention is a method for extracting data hidden in document contents (Fig. 7) The method comprises receiving information relating to the document contents (702), wherein the document contents include halftone pixel groups, extracting the halftone pixel groups from the document contents (712), and converting the halftone pixel groups to the data according to predefined binary classifications associated with combinations of halftone pixels (714).

Digital watermarking of binary document using halftoning

The present invention is a method (Fig. 1) for hiding data in document contents. The method comprises receiving information relating to the document contents, (102) , wherein at least part of the document contents are of a binary nature, converting the data to halftone pixel groups according to predefined binary classifications associated with combinations of halftone pixels, (104), and embedding the halftone pixel groups into a binary portion of the document contents (104 and 114). Further, the present invention is a method for extracting data hidden in document contents (Fig. 7) The method comprises receiving information relating to the document contents (702), wherein the document contents include halftone pixel groups, extracting the halftone pixel groups from the document contents (712), and converting the halftone pixel groups to the data according to predefined binary classifications associated with combinations of halftone pixels (714).

Digital watermarking of binary document using halftoning

The present invention is a method (Fig. 1) for hiding data in document contents. The method comprises receiving information relating to the document contents, (102) , wherein at least part of the document contents are of a binary nature, converting the data to halftone pixel groups according to predefined binary classifications associated with combinations of halftone pixels, (104), and embedding the halftone pixel groups into a binary portion of the document contents (104 and 114). Further, the present invention is a method for extracting data hidden in document contents (Fig. 7) The method comprises receiving information relating to the document contents (702), wherein the document contents include halftone pixel groups, extracting the halftone pixel groups from the document contents (712), and converting the halftone pixel groups to the data according to predefined binary classifications associated with combinations of halftone pixels (714).

Human visual model for data hiding

A method and apparatus of hiding identification data (12) in visual media. When image or video data is received, frequency masking (14) is performed to divide the image or video data into blocks of smooth regions and blocks of non-smooth regions and to obtain preliminary just-noticeable-difference. Edge detection is performed to divide the non-smooth region of the image or video data into texture blocks and edge blocks (16). The image or video data is then adjusted by applying different strength of watermark in association with the type of each block.

Human visual model for data hiding

A method and apparatus of hiding identification data (12) in visual media. When image or video data is received, frequency masking (14) is performed to divide the image or video data into blocks of smooth regions and blocks of non-smooth regions and to obtain preliminary just-noticeable-difference. Edge detection is performed to divide the non-smooth region of the image or video data into texture blocks and edge blocks (16). The image or video data is then adjusted by applying different strength of watermark in association with the type of each block.

High-capacitance ionic liquid gel/polymer matrix biocompatible materials for flexible pressure sensor

High-capacitance flexible pressure sensors for applications such as flexible keyboards and human-machine augmented reality/virtual reality interfaces have a dielectric of an ionic liquid gel within a flexible polymer matrix. The ionic liquid gel/polymer matrix dielectric is between a pair of flexible transparent electrodes, all of which are in a biocompatible encapsulation layer

Emotion modification for image and video content

High-capacitance ionic liquid gel/polymer matrix biocompatible materials for flexible pressure sensor

High-capacitance flexible pressure sensors for applications such as flexible keyboards and human-machine augmented reality/virtual reality interfaces have a dielectric of an ionic liquid gel within a flexible polymer matrix. The ionic liquid gel/polymer matrix dielectric is between a pair of flexible transparent electrodes, all of which are in a biocompatible encapsulation layer

Virtual conferencing system using multi-neural-radiance-field synchronized rendering

A system and method for generating and displaying a photorealistic virtual environment which may act as an online conferencing system or a metaverse environment using neural rendering. A user's position in a real-world environment is translated the virtual environment, and motions of the user along with audio data are rendered in the virtual environment for perception by other users in the virtual environment. User position and motion is relayed using encoded and compressed user data from an associated user processing device to a service host. The service host uses neural rendering processing to render a representation of each user in the virtual environment, providing dynamic lighting and physically plausible placement of representations of users and objects in the virtual environment. Data to render the dynamic scene is returned to each processing device associated with a user to allow rendering of the dynamic scene on the user processing device.

Emotion modification for image and video content

Apparatus and method for modification of emotion conveyed by an image. In one aspect, a metric corresponding to the emotion conveyed by an image is generated, and a command for modifying the emotion of the image causes the emotion conveyed by the image to be changed according to the specified change to emotion. The command to modify the image emotion can be made via an emotion keyword, and can include an indicated magnitude of emotion change. Emotion conveyed by an image can be specified via an emotion vector, where elements of the vector correspond with emotions arranged along orthogonal dimensions in an emotion space. In one aspect, an emotion predictor is trained to predict the emotion conveyed by an image via determining characteristic values for a set of image feature categories, based on a set of images associated with emotion keywords of the emotion space.