СПОСОБ И УСТРОЙСТВО КАТЕГОРИЗАЦИИ ВИДЕО

Изобретение относится к средствам категоризации видео. Технический результат заключается в улучшении точности категоризации видео. Получают ключевой кадр, содержащий лицо на видео. Получают черты лица в ключевом кадре. Получают одно или нескользкого черт лица, соответствующих одной или нескольким категориям изображений; в соответствии с чертой лица в ключевом кадре и одной или несколькими чертами лица, соответствующими одной или нескольким категориям изображений. Определяют категорию изображений, к которой принадлежит данное видео. Присваивают видео категории изображения, к которой принадлежит видео. 3 н. и 8 з.п. ф-лы, 9 ил.

ОСНОВАННЫЙ НА ПРАВИЛАХ АНАЛИЗ ВАЖНОСТИ ВИДЕО

Machine learning models for identifying objects depicted in image or video data

Systems and methods are described for identifying sports-related objects in media content, such as image or video data, using machine learning models. Features of the media content may be provided as input to classification models trained to detect depiction of various sports-related objects and scenes in order to generate various metrics associated with an underlying sporting event depicted in the media content.

Method, system, and apparatus for acquiring information concerning broadcast information

Video description system and method

Image description system and method

Method of image feature encoding and method of image search

SYSTEMS AND METHODS FOR IMPROVING ACCURACY OF DEVICE MAPS USING MEDIA VIEWING DATA

Provided are methods, devices, and computer-program products for determining an accuracy score for a device mapping system. In some examples, the accuracy score can be based on a device map of the device mapping system and viewing data from an automated content recognition component. In such examples, the accuracy score can indicate whether the device mapping system is assigning similar categories to devices that have similar player of media content. In some examples, a device map can be determined to be random, indicating that the device mapping system is inaccurate. In contrast, if the device map is determined to have a sufficiently low probability of being merely random in nature, the device mapping system can be determined to be accurate.

PREPROCESSING VIDEO TO INSERT VISUAL ELEMENTS AND APPLICATIONS THEREOF

Embodiments of this invention relate to preprocessing video such that visual elements, such as advertisements, can be inserted at a later point in time when the video is requested by a user. In an embodiment, a video and target data is received. The video is analyzed to determine how a target moves and changes over time. Metadata describing how the target moves and changes over time is stored. When a user requests an on-demand video such as from a video sharing site, a visual element is inserted into the video. The visual elements move and change as defined in the stored metadata. In this way, advertisements can be inserted into on-demand video such as video from a video sharing website.

Capturing Objects in an Unstructured Video Stream

A method includes obtaining a first unstructured video stream that provides pixel values for a plurality of pixels and corresponds to a portion of a second unstructured video stream being displayed on a second electronic device different from the first electronic device. Obtaining the first unstructured video stream includes obtaining pass-through image data including the portion of a second unstructured video stream. The method includes generating respective pixel characterization vectors for a first portion of the plurality of pixels. Generating each of the respective pixel characterization vectors includes determining a respective instance label value. The method includes identifying a first object within the first portion of the plurality of pixels associated with a particular instance label value. The method includes generating respective semantic label values corresponding to pixels associated with the first object. The respective semantic label values are added to pixel characterization ...

SERVICE SIGNALING RECOVERY FOR MULTIMEDIA CONTENT USING EMBEDDED WATERMARKS

Methods, devices, systems and computer program products facilitate accessing metadata associated with a primary audio visual content. Upon reception of a primary content, one or more watermark messages are extracted from the primary content obtain a server code and an interval code. A query to a metadata server is initiated based on the information obtained from the extracted watermark messages. In response to the query, service recovery information is received that includes information identifying one or more timed events, where each timed event identifies an operation to be performed at a corresponding instance in time as the primary content is being presented by the receiver device. One or more operations identified the timed events are initiated at the corresponding instance(s) in time.

Video data management using encapsulation assets

An improved solution for managing video data is provided. In particular, for each instance of a tracking object in video, an encapsulation asset is generated. The encapsulation asset includes a set of tracking object metadata, a set of background images from the video, a set of object images for the tracking object, and a set of reconstruction data that can be used to approximate the video using the sets of background images and object images. The encapsulation assets and/or video can be stored in a computer architecture, such as an enterprise information system, and searches can be performed on the encapsulation assets.

RGB-D Camera Based Tracking System and Method Thereof

A visual SLAM system comprises a plurality of keyframes including a keyframe, a current keyframe, and a previous keyframe, a dual dense visual odometry configured to provide a pairwise transformation estimate between two of the plurality of keyframes, a frame generator configured to create keyframe graph, a loop constraint evaluator adds a constraint to the receiving keyframe graph, and a graph optimizer configured to produce a map with trajectory.

ASSOCIATING STILL IMAGES AND VIDEOS

Methods, systems, and apparatus, including computer programs encoded on computer storage media, for associating still images and videos. One method includes receiving a plurality of images and a plurality of videos and determining whether the images are related to the videos. The determining includes, for an image and a video, extracting features from the image and extracting features frames of the video, and comparing the features to determine whether the image is related to the video. The method further includes maintaining a data store storing data associating each image with each video determined to be related to the image.

QUERY-BASED GRANULARITY SELECTION FOR PARTITIONING RECORDINGS

A processor may receive a query from a user. The processor may identify one or more subjects in the query. The one or more subjects may include a particular subject. The processor may identify one or more sections of a recording. The processor may group the one or more sections into one or more subdivisions. The processor may determine that the particular subject is in at least one of the one or more sections. The processor may display the one or more subdivisions of the one or more sections that include the particular subject to the user.

Adaptive search results for multimedia search queries

A system identifies a video comprising frames associated with content tags. The system detects features for each frame of the video. The system identifies, based on the detected features, scenes of the video. The system determines, for each frame for each scene, a frame score that indicates a number of content tags that match the other frames within the scene. The system selects, for each scene, a set of key frames that represent the scene based on the determined frame scores. The system receives a search query comprising a keyword. The system generates, for display, search results responsive to the search query including a dynamic preview of the video. The dynamic preview comprises an arrangement of frames of the video corresponding to each scene of the video. Each of the arrangement of frames is selected from the selected set of key frames representing the respective scene of the video.

METHOD AND APPARATUS FOR RECOGNIZING OBJECTS IN MEDIA CONTENT

An approach is provided for recognizing objects in media content. The capture manager determines to detect, at a device, one or more objects in a content stream. Next, the capture manager determines to capture one or more representations of the one or more objects in the content stream. Then, the capture manager associates the one or more representations with one or more instances of the content stream.

НАВИГАЦИЯ ПО ВИДЕОПОСЛЕДОВАТЕЛЬНОСТИ ЧЕРЕЗ МЕСТОПОЛОЖЕНИЕ ОБЪЕКТА

Изобретение относится к области навигации в последовательности изображений. Технический результат – обеспечение осуществления навигации в последовательности изображений в соответствии с контентом изображений. Способ навигации в последовательности изображений содержит этапы, на которых отображают изображение на экране; выбирают первый объект отображенного изображения в первом положении в соответствии с первым вводом; перемещают первый объект во второе положение в соответствии со вторым вводом; идентифицируют по меньшей мере одно изображение в последовательности изображений, где первый объект расположен близко ко второму положению, и начинают воспроизведение последовательности изображений с одного из идентифицированных изображений; причем на этапе перемещения первого объекта во второе положение выбирают второй объект отображенного изображения в третьем положении в соответствии с дополнительным вводом; определяют целевое положение перемещения первого объекта относительно данного второго объекта ...

Verfahren zum Detektieren und Identifizieren von Objekten sowie System hierzu

Ein Verfahren zum gemeinsamen Detektieren und Identifizieren eines vorbestimmten Objektes in einer Videobildsequenz mit einem trainierten computerimplementierten Netzwerk, umfasst ein Erzeugen einer Merkmalskarte für das Referenzbild und für das wenigstens eine Galeriebild, wobei die Merkmalskarten durch ein in ein BaseNet integriertes abfrage-geführtes Siamese Squeeze and Excitation Netzwerk, QSSE-Net erzeugt werden, welche das Referenzbild und das Galeriebild zugeführt wird. Daraus wird ein eines Bereichsvorschlag basierend auf der aus dem Galeriebild bereitgstellten Merkmalskarte mittels eines RP Netzwerkes, und Informationen aus dem Referenzbild, insbesondere einer bounding box mittels eines abfrage-geführten RPN, QRPN erzeugt. Eine Ähnlichkeit zwischen dem zu identifizierenden Objekt und den Objektvorschlägen kann durch Vergleich basierend auf den jeweiligen Klassenidentifikationsvektoren erfolgen.

Device for providing hits through internet, comprises database with multiple data sets and server with search engine for producing hits corresponding to search criteria

The device comprises a database (16) with multiple data sets and a server (14) with a search engine for producing hits corresponding to the search criteria. The search criteria of a digital image or a digital video sequence is formed, which provides the search engine through Internet(10). A search engine medium is provided for the production of a correlation, which assigns one or multiple data sets to the image or the video sequence. The image or the video sequence is taken with a camera, which is directed through a Global positioning system. An independent claim is also included for a method for providing hits through internet.

A META-CLASSIFIER SYSTEM FOR VIDEO ANALYTICS

A system for meta-classification for video data has training phase (20) and operational phase (30). In the training phase, detection and tracking module 12 receives input video sequences (33) and a bounding box (31) may be drawn around objects of interest in each image (32). In classifier section 13, the images (32) go through two or more different classifier channels 14, 15, 16 having different classifier methods 21, 22, 23 and producing classifier descriptors 24, 25, 26. The output of each descriptor output 24, 25, 26 is a feature vector providing probability values x for a set of N activities of the one or more objects in the video data. The classifier descriptors are combined in feature synthesis module 27, and the data is provided with a label Y by an operator (35, fig. 2A). Finally, weight values (41) associated with the classifier descriptors are determined and provided as training data 42. In the operational phase, a video sequence 11 is supplied to modules 12 and 13 and resultant ...

Detection of irregularities using registration

SYSTEM AND PROCEDURE FOR THE DESCRIPTION OF PICTURE

METHOD AND APPARATUS FOR CONTENT REPRESENTATION AND RETRIEVAL IN CONCEPT MODEL SPACE

AUTOMATIC SOCCER VIDEO ANALYSIS AND SUMMARIZATION

SITUATION RECORDING/SEARCH DEVICE

QUERY SYSTEM WITH SPOILER PREVENTION

Systems and methods for generating a reply to a query are provided. A query about an event in a content recording during playback of the content recording is received. A type of the event based on the query is detemiined. A playback position in a timeline of the content recording is determined. Based on the type of the event, an event distribution table is obtained, the table comprising one or more event identifiers and one or more corresponding occurrence times for the one or more event identifiers in the timeline of the content recording. The playback position of the content recording to the one or more occurrence times is compared. A reply to the query is generated, for aural or visual presentation, the reply being based on a result of the comparing, the reply comprising data about at least one event corresponding to the one or more event identifiers.

VIDEO NAVIGATION THROUGH OBJECT LOCATION

The present invention relates to a method for navigating in a sequence of images. An image is displayed on a screen. A first object of the displayed image is selected at a first position according to a first input. The first object is moved to a second position according to a second input. At least one image is identified in the sequence of images where the first object is close to the second position. Playback of the sequence of images is started beginning at one of the identified images.

Image processing apparatus and method, and program

SYSTEM, METHOD AND PROGRAM FOR ACQUIRING USER INTEREST BASED ON INPUT IMAGE DATA

INTELLIGENT VIDEO ANALYSIS

SYSTEMS AND METHODS FOR IDENTIFYING ELECTRONIC CONTENT USING VIDEO GRAPHS

Systems and methods are provided for identifying and recommending electronic content to consumers. In accordance with an implementation, one or more elements of electronic content are identified based on video graph data. In an exemplary method, information associated with a first element of video content is received, and corresponding video graph data is obtained. One or more second elements of video content that are similar to the first element of video content are identified based on the obtained video graph data. A subset the first and second elements of video content is subsequently identified for delivery to the user.

System and method for processing image objects in video data

A system, method and computer program product are disclose for processing an object in a video data stream. The method runs on a processor programmed to execute the method and includes but is not limited to receiving input data at the client device for rendering on the client device display a first functional indicator indicating one of a plurality of functions and surrounding a first region of pixel locations representing a first image object in the video data stream; and performing a function indicated by the first functional indicator on meta data for the first image object in the first region of pixel locations.

Motion event recognition and video synchronization system and method

Enables recognition of events within motion data obtained from portable wireless motion capture elements and video synchronization of the events with video as the events occur or at a later time, based on location and/or time of the event or both. May use integrated camera or external cameras with respect to mobile device to automatically generate generally smaller event videos of the event on the mobile device or server. Also enables analysis or comparison of movement associated with the same user, other user, historical user or group of users. Provides low memory and power utilization and greatly reduces storage for video data that corresponds to events such as a shot, move or swing of a player, a concussion of a player, or other medical related events or events, such as the first steps of a child, or falling events.

Image processing apparatus, image processing system, and filter setting method

Disclosed herein is an image processing apparatus including an image data acquisition section, a metadata acquisition section, a display section, a filter setting section, and a combination setting section. The image data acquisition section is configured to acquire image data from a camera. The metadata acquisition section is configured to acquire, from the camera, metadata representing information concerning an object of surveillance. The display section is configured to display a setting screen usable for setting a plurality of filters. The filter setting section is configured to perform filter setting using the information of the metadata. The combination setting section is configured to set a combination of the plurality of filters. The filter setting section and the combination setting section are provided on the same setting screen.

Authenticating and presenting video evidence

A method for automatically authenticating unknown video data based on known video data stored at a client server is provided, wherein, unknown and known video data each are made up of segments and include metadata, a hash message digest, and a serial code. The method involves selecting a first segment of the unknown video and locating the serial code within the first segment of the unknown video data. The serial code is used to locate a corresponding first segment in the known video data. The first segment may include a known hash message digest. A new hash message digest for the first segment of the unknown video data is generated and compared with the known hash message digest. If they match, the segment of unknown video data is authentic.

SYSTEM FOR PERFORMING INTERSECTION SCENARIO RETRIEVAL AND METHOD THEREOF

A system and method for performing intersection scenario retrieval that includes receiving a video stream of a surrounding environment of an ego vehicle. The system and method also include analyzing the video stream to trim the video stream into video clips of an intersection scene associated with the travel of the ego vehicle. The system and method additionally include annotating the ego vehicle, dynamic objects, and their motion paths that are included within the intersection scene with action units that describe an intersection scenario. The system and method further include retrieving at least one intersection scenario based on a query of an electronic dataset that stores a combination of action units to operably control a presentation of at least one intersection scenario video clip that includes the at least one intersection scenario.

Computer program and apparatus for motion-based object extraction and tracking in video

A computer program and apparatus function to extract objects from a video by identifying regions to be tracked, tracking the regions across several frames, calculating motions of the regions, and identifying new regions to be tracked. Regions of a selected frame of the video that are appropriate for tracking are selected. Tracking of the identified regions is then performed across frames subsequent to the selected frame of the video. Motions of the identified regions are calculated, and new regions for tracking are identified.

Machine learning in video classification

Described herein are systems and methods that search videos and other media content to identify items, objects, faces, or other entities within the media content. Detectors identify objects within media content by, for instance, detecting a predetermined set of visual features corresponding to the objects. Detectors configured to identify an object can be trained using a machine learned model (e.g., a convolutional neural network) as applied to a set of example media content items that include the object. The systems provide user interfaces that allow users to review search results, pinpoint relevant portions of media content items where the identified objects are determined to be present, review detector performance and retrain detectors, providing search result feedback, and/or reviewing video monitoring results and analytics.

Video segments for a video related to a task

Methods and apparatus related to identifying a video for completing a task and determining a plurality of video segments of the identified video based on one or more attributes of the task. A task and a plurality of how-to videos related to the task may be identified. A how-to video may be selected and a plurality of video segments of the selected how-to video may be determined. One or more video segments may be associated with one or more task attributes that relate to performing the task. The selected video may be provided to a user and segmented, indexed, and/or annotated based on the associated video segments. In some implementations a given object utilized in performing the task may be identified and one or more video segments corresponding to the given object may be identified and/or provided to the user.

Infection risk prediction

An infection risk prediction system may receive a query associated with an infection risk assessment for a geographic location for an infectious disease and obtain associated infectious disease data. The system detects a plurality of objects at the geographical location and a plurality of material categories for the plurality of objects associated. The system determines a usage frequency indicator and spatial-temporal features for each object and creates a risk prediction model based on the lifespan of the virus on the plurality of material categories for each of the plurality of objects based on the viral disease data and the spatial-temporal features for each object. A risk assessment score for each object is determined and an associated heat map is provided to alert a user of potential virus exposures or to provide a routing application to generate a route that minimizes potential pathogen exposure.

Detecting content in a real-time video stream recorded by a detection unit

Described herein are systems and methods that search videos and other media content to identify items, objects, faces, or other entities within the media content. Detectors identify objects within media content by, for instance, detecting a predetermined set of visual features corresponding to the objects. Detectors configured to identify an object can be trained using a machine learned model (e.g., a convolutional neural network) as applied to a set of example media content items that include the object. The systems comprise an integrated detection unit configured to record media content, identify preferred content, and communicate the identifications of preferred content for storage in a computationally efficient manner.

МЕТОДЫ ПОТРЕБЛЕНИЯ КОНТЕНТА И МЕТАДАННЫХ

Изобретение относится к области приема видео или аудио контента. Техническим результатом является предоставления контента и метаданных связанных с потреблением самого контента, а также предоставления контента и метаданных не препятствующие потреблению самого контента. Контент и метаданные, связанные с контентом, могут быть предоставлены некоторому числу пользователей. Контент может быть отображен на устройстве отображения, в то время как метаданные могут быть переданы в дистанционное устройство, соответствующее принимающему пользователю. Пользователь дополнительно может запрашивать желаемую информацию или метаданные, относящиеся к контенту, и запрошенная информация или метаданные могут быть переданы в дистанционное устройство пользователя. Разные пользователи могут запрашивать разную информацию об одном и том же объекте или о разных объектах, отображаемых или представляемых на устройстве отображения. Каждый запрашивающий пользователь может принимать запрошенную информацию об одном и том ...

СПОСОБ (ВАРИАНТЫ) И СИСТЕМА ОБРАБОТКИ МУЛЬТИМЕДИЙНОЙ ИНФОРМАЦИИ И СПОСОБ ФОРМИРОВАНИЯ НАЗНАЧАЕМОЙ ОБЛАСТИ (ВАРИАНТЫ)

... 1. Способ обработки мультимедийной информации, характеризующийся наличием мультимедийного приложения, выполняемого путем демонстрации мультимедийной информации в виде последовательных порций или непрерывным потоком, на демонстрационной среде, возможностью получения сигналов от пользователя в процессе выполнения приложения, отличающийся тем, что на демонстрационной среде назначают по крайней мере одну область, приспособленную для получения сигналов пользователя в процессе демонстрации мультимедийной информации и/или для установления логической связи с внешними приложениями и/или информацией текущего исполняемого (демонстрируемого) приложения, и/или размещения информации и/или результатов работы внешнего приложения. 2. Способ обработки мультимедийной информации, характеризующийся наличием мультимедийного приложения, выполняемого путем демонстрации мультимедийной информации в виде последовательных порций или непрерывным потоком, на демонстрационной среде, наличием заранее назначенного объекта ...

СПОСОБ И УСТРОЙСТВО КАТЕГОРИЗАЦИИ ВИДЕО

НАВИГАЦИЯ ПО ВИДЕОПОСЛЕДОВАТЕЛЬНОСТИ ЧЕРЕЗ МЕСТОПОЛОЖЕНИЕ ОБЪЕКТА

... 1. Способ навигации в последовательности изображений, содержащий этапы, на которых:- отображают изображение на экране,- выбирают первый объект отображенного изображения в первом положении в соответствии с первым вводом,- перемещают первый объект во второе положение в соответствии со вторым вводом,- идентифицируют по меньшей мере одно изображение в последовательности изображений, где первый объект расположен близко ко второму положению, и- начинают воспроизведение последовательности изображений с одного из идентифицированных изображений, отличающийся тем, чтоэтап перемещения первого объекта во второе положение включает в себя этапы, на которых:- выбирают второй объект отображенного изображения в третьем положении в соответствии с дополнительным вводом,- определяют целевое положение перемещения первого объекта относительно данного второго объекта,- перемещают первый объект в целевое положение, и в которомэтап идентификации включает в себя этап, на котором идентифицируют по меньшей мере одно ...

A META-CLASSIFIER SYSTEM FOR VIDEO ANALYTICS

Cognitive video and audio search aggregation

A method, computer program product, and a system where a processor(s) obtains a video from a user, via a client, and segments the video into temporal shots that comprise a timeline of the video. The processor(s) cognitively analyze the video, by applying an image recognition algorithm to identify image entities in each temporal shot of the video and by applying a data structure comprising a user profile of the user to the temporal shots, to identity personal entities in each temporal shot of the video. The program code generates a search index for the video, utilizing the user entities (image entities and personal entities), where each entry of the search index is a given user entity and a linkage to a given temporal shot and the linkage indicates a location of the given user entity in the timeline of the video.

Graph convolutional networks for video grounding

Method and apparatus that includes receiving a query describing an aspect in a video, the video including a plurality of frames, identifying multiple proposals that potentially correspond to the query where each of the proposals includes a subset of the plurality of frames, ranking the proposals using a graph convolution network that identifies relationships between the proposals, and selecting, based on the ranking, one of the proposals as a video segment that correlates to the query.

A video processing apparatus, method and computer program

Method and apparatus for content representation and retrieval in concept model space

Method and system for retrieving video temporal segments

A method and a system for retrieving video temporal segments are provided. In the method, a video is analyzed to obtain frame feature information of the video; the frame feature information is input into an encoder to output first data relating to temporal information of the video; the first data and a retrieval description for retrieving video temporal segments of the video are input into a decoder to output second data; attention computation training is conducted according to the first data and the second data; video temporal segments of the video corresponding to the retrieval description are determined according to the attention computation training.

METHODS AND SYSTEMS FOR PERFORMING CONTENT RECOGNITION FOR A SURGE OF INCOMING RECOGNITION QUERIES

Methods and systems for performing content recognition for a surge of incoming recognition queries are provided. Within examples, methods comprise receiving, by one or more computing devices, a stream of incoming content recognition queries, and a given content recognition query includes a sample of media content and a request to identify the sample of media content. Methods also comprise filtering, by the one or more computing devices, a plurality of content recognition queries from the stream of incoming content recognition queries belonging to a surge event, and the surge event is associated with content recognition queries received within a time window and including common samples of media content.

PREPROCESSING VIDEO TO INSERT VISUAL ELEMENTS AND APPLICATIONS THEREOF

Embodiments of this invention relate to preprocessing video such that visual elements, such as advertisements, can be inserted at a later point in time when the video is requested by a user. In an embodiment, a video and target data is received. The video is analyzed to determine how a target moves and changes over time. Metadata describing how the target moves and changes over time is stored. When a user requests an on-demand video such as from a video sharing site, a visual element is inserted into the video. The visual elements move and change as defined in the stored metadata. In this way, advertisements can be inserted into on-demand video such as video from a video sharing website.

Content identification device, content identification method and recording medium

Metod och system för sökningar i digitalt innehåll

Method of providing service for recommending game video

It is distinguished that, to achieve the purpose above, the game video recommendation service in this invention is provided through the following phases in presenting the service of recommending to a game user another user's' game video: (a) the phase where, based on the object information including 3D shape information of the characters, props and backgrounds constituting game videos, the script information is saved in the video server for form a video list for game play video rendering, which records data on the appearance and disappearance points of time of characters, props and backgrounds included in the above-mentioned object information as well as their movements according to time; (b) the phase where users' in-game failures are detected and sent by the above game device the server; (c) the phase where the video lists saved in the said server are searched and videos (failure videos) including the foresaid failure situations or success videos resolving such situations are extracted ...

AUTOMATED ASSESSMENT

A system for automated assessments is provided. The system includes a processing device and a memory device. The memory device stores instructions that when executed by the processing device may result in receiving a video stream including image frames from an imaging source. Image data from one or more of the image frames can be compared with an image profile database to determine whether at least one item in one or more of the image frames is identifiable. A lookup operation can be initiated in a secondary data source to determine one or more item attributes of the one or more identified items. The video stream can be modified to add an item identifier for each of the identified items to the video stream as an annotated video. A record can be stored of the one or more item attributes of the identified items in the annotated video.

Video search system and method

Provided is a video search system and method. The video search system includes: a search engine configured to extract video data matching a search condition from an original video; and a browsing engine configured to generate a summarized video based on the extracted video data, render a plurality of objects in the summarized video on a background model in an overlapping manner in an object appearing order in the original video, and display the rendered objects.

Systems and methods for queryable graph representations of videos

In one aspect, the present disclosure relates to a method which, in one embodiment, includes: receiving video data for a first video; deconstructing the video data of the first video into a plurality of context windows; performing, on each context window that includes an image frame, a video analytic function on the image frame to identify one or more characteristics of the context window; performing, on each context window that includes an audio frame, a video analytic function on the audio frame to identify one or more characteristics of the context window; generating, for each context windows, a respective local atomic unit comprising attributes derived from the identified one or more characteristics of the respective context window, to form a plurality of local atomic units; and generating a local graph representation of the first video, comprising a plurality of nodes corresponding to the plurality of local atomic units.

Machine Learning in Video Classification

Described herein are systems and methods that search videos and other media content to identify items, objects, faces, or other entities within the media content. Detectors identify objects within media content by, for instance, detecting a predetermined set of visual features corresponding to the objects. Detectors configured to identify an object can be trained using a machine learned model (e.g., a convolutional neural network) as applied to a set of example media content items that include the object. The systems provide user interfaces that allow users to review search results, pinpoint relevant portions of media content items where the identified objects are determined to be present, review detector performance and retrain detectors, providing search result feedback, and/or reviewing video monitoring results and analytics.

METHOD AND APPARATUS FOR ANNOTATING MEDIA STREAMS

In one embodiment, the invention is a method and apparatus for annotating media streams. One embodiment of a method for facilitating creation of an annotated media stream by a user includes receiving the media stream from the user, mapping at least one item of supplemental content to at least a portion of the media stream to produce the annotated media stream, and storing the annotated media stream. In another embodiment, a method for distributing an annotated media stream provided by a user includes receiving the annotated media stream from the user, where the annotated media stream includes at least one item of supplemental content mapped to at least a portion of a media stream to produce the annotated media stream, storing the annotated media stream, receiving a request from a viewer to view the annotated media stream, and distributing the annotated media stream to the viewer. In another embodiment, a method for distributing an annotated media stream provided by a user includes distributing ...

SYSTEMS AND METHODS FOR DEFINING OBJECTS OF INTEREST IN MULTIMEDIA CONTENT

Methods and systems for detecting objects of interest in multimedia content are disclosed. One method includes receiving multimedia content at one or more computing systems, and generating a plurality of scenes from the multimedia content, each of the plurality of scenes including one or more candidate objects of interest. The method also includes receiving selection of one or more of the candidate objects of interest as objects of interest, and defining one or more actions to be taken with respect to one or more of the objects of interest. The method further includes generating metadata associated with each of the objects of interest, the metadata defining actions to be taken with respect to the one or more of the objects of interest.

Method and system for generating a virtual user interface related to a totem

A waveguide apparatus includes a planar waveguide and at least one optical diffraction element (DOE) that provides a plurality of optical paths between an exterior and interior of the planar waveguide. A phase profile of the DOE may combine a linear diffraction grating with a circular lens, to shape a wave front and produce beams with desired focus. Waveguide apparati may be assembled to create multiple focal planes. The DOE may have a low diffraction efficiency, and planar waveguides may be transparent when viewed normally, allowing passage of light from an ambient environment (e.g., real world) useful in AR systems. Light may be returned for temporally sequentially passes through the planar waveguide. The DOE(s) may be fixed or may have dynamically adjustable characteristics. An optical coupler system may couple images to the waveguide apparatus from a projector, for instance a biaxially scanning cantilevered optical fiber tip.

Video object retrieval system and method

A video object retrieval method is provided. The method includes dividing an input video into a number of video shots and detecting target-class object occurrences and related-class object occurrences in each video shot. The method also includes pre-processing object bounding box images and performing automatic object extraction. Further, the method includes performing object-level feature extraction and integration and generating visual search results based on similarity scores.

Video analytics for retail business process monitoring

A system for video monitoring a retail business process includes a video analytics engine to process video obtained by a video camera and generate video primitives regarding the video, A user interface is used to define at least one activity of interest regarding an area being viewed, each activity of interest identifying at least one of a rule or a query regarding the area being viewed. An activity inference engine processes the generated video primitives based on each defined activity of interest to determine if an activity of interest occurred in the video.

APPARATUS AND SOFTWARE SYSTEM FOR AND METHOD OF PERFORMING A VISUAL-RELEVANCE-RANK SUBSEQUENT SEARCH

A method analyzes the visual content of media such as videos for collecting together visually-similar appearances in their constituent images (e.g. same scenes, same objects, faces of the same people.) As a result, the most relevant and salient (of clearest and largest presence) visual appearances depicted in the videos are presented to the user, both for the sake of summarizing the video content for the users to see before they watch (that is, judge by the depicted video content in a filmstrip-like summary whether they want to mouse-click on the video and actually spend time watching it), as well as for allowing to users to further refine their video search result set according to the most relevant and salient video content returned (e.g. largest screen-time faces).

METHOD AND APPARATUS OF PROCESSING MULTIMEDIA DATA, DEVICE, MEDIUM, AND PRODUCT

A method and an apparatus of processing multimedia data, a device, a medium, and a product, which relates to a field of an artificial intelligence technology, in particular to fields of knowledge graph and deep learning. The method of processing the multimedia data includes: recognizing the multimedia data so as to obtain at least one key information of the multimedia data; querying a predetermined knowledge base according to the at least one key information, so as to determine a multimedia name associated with the at least one key information and an association degree between the multimedia name and the at least one key information; and determining, in the multimedia name, a name of the multimedia data based on a similarity between alternative multimedia data for the multimedia name and the multimedia data, in response to the association degree being less than a first threshold value.

МЕТОДЫ ПОТРЕБЛЕНИЯ КОНТЕНТА И МЕТАДАННЫХ

... 1. Способ, содержащий этапы, на которых в клиентском устройстве (104): ! принимают контент (114(n)) и связанные метаданные (116) в широковещательной передаче, ! идентифицируют запрос метаданных относительно текущей широковещательной передачи из дистанционного устройства (126), которое соединено с возможностью связи с клиентским устройством (104), ! анализируют запрос для идентификации метаданных (116), которые являются релевантными запросу, и ! выводят метаданные (116), которые соответствуют идентифицированному запросу, в дистанционное устройство (126), чтобы побудить дистанционное устройство (126) отобразить метаданные, которые являются релевантными запросу. !2. Способ по п.1, в котором этапы, на которых идентифицируют запрос метаданных и выводят метаданные, выполняют в режиме реального времени, когда принимается контент и связанные метаданные. ! 3. Способ по п.1, дополнительно содержащий этап, на котором сохраняют контент и связанные метаданные в запоминающем устройстве в клиентском устройстве ...

Bereitstellen von relevanten Videoszenen in Reaktion auf eine Videosuchabfrage

Die vorliegende Offenbarung betrifft Verfahren und Systeme zur Bereitstellung von relevanten Videoszenen in Reaktion auf eine Videosuchabfrage. Die Systeme und Verfahren identifizieren eine Mehrzahl von Keyframes eines Medienobjektes und detektieren ein oder mehrere in der Mehrzahl von Keyframes dargestellte Contentmerkmale. Auf Grundlage des einen oder der mehreren detektierten Contentmerkmale verknüpfen die Systeme und Verfahren die detektierten Contentmerkmale angebende Tags mit der Mehrzahl von Keyframes des Medienobjektes. Die Systeme und Verfahren vergleichen in Reaktion auf ein Empfangen einer Suchbegriffe beinhaltenden Suchabfrage die Suchbegriffe mit den Tags der ausgewählten Keyframes, identifizieren einen ausgewählten Keyframe, der wenigstens ein Contentmerkmal im Zusammenhang mit den Suchbegriffen abbildet, und stellen ein Vorschaubild des Medienobjektes, das das wenigstens eine Contentmerkmal abbildet, bereit.

Methods and systems for identifying an object in a video image

Method and apparatus for searching for an object using shape

Representing and searching for an object using shape

A method of representing an object appearing in a still or video image for use in searching, wherein the object appears in the image with a first two-dimensional outline comprises deriving a view descriptor of the first outline of the object and deriving at least one additional view descriptor of the outline of the object in a different view, and associating the two or more view descriptors to form an object descriptor. A global parameter, such as the volume of the object may also be derived.

Image capture using client device

Methods, operable on client devices, for capturing an image of a document. One method comprises: receiving one or more frames; processing each frame by emphasising horizontal and vertical structures to produce an edge image; using an edge detection algorithm on each edge image to detect edges of the document; and automatically capturing a still image of the document once its edges have been located. Another method comprises: receiving a video stream comprising a sequence of frames; generating a focus metric indicating the sharpness of each frame; establishing and varying an adaptive threshold of the focus metric based on the variation of the focus metric over a number of frames; and capturing a still image of the document once it is determined that the focus metric of a current frame is above the adaptive threshold. Another method comprises: receiving a frame containing an image of the document; using an edge detector to detect candidate edges and produce an edge image; detecting corner ...

Method and apparatus for representing and searching for an object using shape

VIDEO DESCRIPTION SYSTEM AND - PROCEDURES

Inference engine for video analytics metadata-based event detection and forensic search

Embodiments of the disclosure provide for systems and methods for searching video data for events and/or behaviors. An inference engine can be used to aide in the searching. In some embodiments, a user can specify various search criteria, for example, a video source(s), an event(s) or behavior(s) to search, and an action(s) to perform in the event of a successful search. The search can be performed by analyzing an object(s) found within scenes of the video data. An object can be identified by a number of attributes specified by the user. Once the search criteria has been received from the user, the video data can be received (or extracted from storage), the data analyzed for the specified events (or behaviors), and the specified action performed in the event a successful search occurs.

Systems and methods for interoperable multimedia content descriptions

VOICE QUERY REFINEMENT TO EMBED CONTEXT IN A VOICE QUERY

Systems and methods are described for providing contextual search results. The system may receive a search query during presentation of a video. If the query is ambiguous, the system accesses some of the frames of the video. The frames are analyzed to identify a performed action depicted in the frames. The system retrieves a keyword related to the identified action. The ambiguous query is augmented with the keyword. The augmented search query is used to search for and output relevant search results.

MACHINE LEARNING MODELS FOR IDENTIFYING OBJECTS DEPICTED IN IMAGE OR VIDEO DATA

Systems and methods are described for identifying sports-related objects in media content, such as image or video data, using machine learning models. Features of the media content may be provided as input to classification models trained to detect depiction of various sports-related objects and scenes in order to generate various metrics associated with an underlying sporting event depicted in the media content.

METHOD AND DEVICE FOR RENDERING VIDEO CONTENT ON A DISPLAY

The invention relates to a method and device for rendering video content on a display. In an aspect of the invention, a device (20, 40) configured to render video content on a display is provided. The device comprises a processing unit (41) and a memory (42), which memory contains instructions (43) executable by the processing unit, whereby the device is operative to render the video content in one (30) of a number of surfaces designated for displaying visual content on the display, while rendering at least one image extracted from the video content in at least another one (31) of the surfaces; and render, when the video content reaches a point in time (t4) corresponding to a position where said at least one image is extracted from the video content, the video content in said another one (31) of the surfaces thereby replacing said at least one image.

METHODS AND ARCHITECTURE FOR INDEXING AND EDITING COMPRESSED VIDEO OVER THE WORLD WIDE WEB

Techniques for detecting moving video objects in a compressed digital bitstream (111) and for tools for editing compressed video are disclosed. Video objects (117) are detected and indexed by analyzing a compressed bitstream to locate scene cuts (112), estimating operating parameters for a camera which initially viewed the video (114), and detecting one or more moving video objects represented in the compressed bitstream by applying global motion compensation which account for the estimated operating parameters. Tools are provided for permitting dissolve, masking, freeze frame, slow and variable speed playback, and strobe motion special effects to compressed video. The tools may be implemented in a system for editing (130) compressed video information over a distributed network.

For generating a non-uniform size closestool related metadata system, method and apparatus

Sistemas y métodos para mejorar la precisión de los mapas de dispositivos utilizando datos de visualización de medios.

SE PROPORCIONAN MÉTODOS, DISPOSITIVOS Y PRODUCTOS DE PROGRAMAS DE COMPUTADORA PARA DETERMINAR UN PUNTAJE DE PRECISIÓN PARA UN SISTEMA DE MAPEO DE DISPOSITIVOS. EN ALGUNOS EJEMPLOS, LA PUNTUACIÓN DE PRECISIÓN SE PUEDE BASAR EN UN MAPA DE DISPOSITIVOS DEL SISTEMA DE MAPEO DE DISPOSITIVOS Y EN LA VISUALIZACIÓN DE DATOS DE UN COMPONENTE DE RECONOCIMIENTO DE CONTENIDO AUTOMATIZADO. EN TALES EJEMPLOS, LA PUNTUACIÓN DE PRECISIÓN PUEDE INDICAR SI EL SISTEMA DE MAPEO DE DISPOSITIVOS ESTÁ ASIGNANDO CATEGORÍAS SIMILARES A DISPOSITIVOS QUE TIENEN UN REPRODUCTOR DE CONTENIDO MULTIMEDIA SIMILAR. EN ALGUNOS EJEMPLOS, SE PUEDE DETERMINAR QUE UN MAPA DE DISPOSITIVOS ES ALEATORIO, LO QUE INDICA QUE EL SISTEMA DE MAPEO DE DISPOSITIVOS ES INEXACTO. POR EL CONTRARIO, SI SE DETERMINA QUE EL MAPA DE DISPOSITIVOS TIENE UNA PROBABILIDAD SUFICIENTEMENTE BAJA DE SER DE NATURALEZA MERAMENTE ALEATORIA, SE PUEDE DETERMINAR QUE EL SISTEMA DE MAPEO DE DISPOSITIVOS ES PRECISO.

Content information processing device for showing times at which objects are displayed in video content

An information processing apparatus comprising that includes a reproduction unit to reproduce video content comprising a plurality of frames; a memory to store a table including object identification information identifying an object image, and frame identification information identifying a frame of the plurality of frames that includes the object image; and a processor to extract the frame including the object image from the video content and generate display data of a reduced image corresponding to the frame for display.

Security system operator efficiency

Systems and methods for increasing an efficiency of an operator of a security system are discussed generally herein. A system can include a memory including ontology data saved thereon, the ontology data can define interrelationships between a scanner associated with access to a room of an area under surveillance, a camera with a field of view at least partially overlapping a footprint of the room, an identifier configured to be scanned by the scanner and associated with a person, and a security policy including one or more predefined conditions, which when satisfied, indicate when a security threat exists, the security policy includes a response an operator can perform if the conditions are satisfied, and the system can include a query module configured to receive a query and search the ontology data and temporal and spatial data associated with the area under surveillance in response to receiving the query.

Modeling method and apparatus using fluid animation graph

A modeling method searches for a sequence matched to a user input using a fluid animation graph generated based on similarities among frames included in sequences included in the fluid animation graph and models a movement corresponding to the user input based on a result of the searching. Provided also is a corresponding apparatus and a method for preprocessing for such modeling.

Systems and methods for identifying electronic content using video graphs

Systems and methods are provided for identifying and recommending electronic content to consumers. In accordance with an implementation, one or more elements of electronic content are identified based on video graph data. In an exemplary method, information associated with a first element of video content is received, and corresponding video graph data is obtained. One or more second elements of video content that are similar to the first element of video content are identified based on the obtained video graph data. A subset the first and second elements of video content is subsequently identified for delivery to the user.

Media-object binding for displaying real-time play data for live-streaming media

A system and method for media-object binding and displaying real-time play data for live-streaming media is provided. At least one set of object data may be associated with a live-streaming media. One or more media-object bindings between the at least one set of object data and the live-streaming media may be formed and stored in memory or one or more databases. The at least one set of object data may include data about one or more objects displayed in real-time during the live-streaming media.

Method and apparatus for multi-dimensional content search and video identification

A multi-dimensional database and indexes and operations on the multi-dimensional database are described which include video search applications or other similar sequence or structure searches. Traversal indexes utilize highly discriminative information about images and video sequences or about object shapes. Global and local signatures around keypoints are used for compact and robust retrieval and discriminative information content of images or video sequences of interest. For other objects or structures relevant signature of pattern or structure are used for traversal indexes. Traversal indexes are stored in leaf nodes along with distance measures and occurrence of similar images in the database. During a sequence query, correlation scores are calculated for single frame, for frame sequence, and video clips, or for other objects or structures.

VIDEO RETRIEVAL SYSTEM USING OBJECT CONTEXTUALIZATION

A search system using object contextualization according to an aspect of the present disclosure stores object contextualization data obtained by contextualizing a detected object and attribute information of the object with respect to one or more video files for each frame, in the form of a text file in a big data storage, and searches for a video that meets a search condition with respect to the stored object contextualization data.

ОБНАРУЖЕНИЕ ОБЪЕКТОВ ИЗ ЗАПРОСОВ ВИЗУАЛЬНОГО ПОИСКА

Method and system for indexing and searching objects of interest across a plurality of video streams

Method and system for indexing and searching objects of interest across a plurality of video streams

Representing and searching for an object using shape

A method of representing an object appearing in a still or video image for use in searching, wherein the object appears in the image with a first two-dimensional outline comprises deriving a view descriptor of the first outline of the object and deriving at least one additional view descriptor of the outline of the object in a different view, and associating the two or more view descriptors to form an object descriptor. A global parameter, such as the volume of the object, may also be derived.

MULTIMEDIA DATA PROCESSOR

Searching recorded video

Embodiments of the disclosure provide for systems and methods for creating metadata associated with a video data. The metadata can include data about objects viewed within a video scene and/or events that occur within the video scene. Some embodiments allow users to search for specific objects and/or events by searching the recorded metadata. In some embodiments, metadata is created by receiving a video frame and developing a background model for the video frame. Foreground object(s) can then be identified in the video frame using the background model. Once these objects are identified they can be classified and/or an event associated with the foreground object may be detected. The event and the classification of the foreground object can then be recorded as metadata.

Mobile terminal and method of managing video using metadata therein

A mobile terminal and method of managing a video using metadata therein are disclosed, by which videos matching search conditions of various types can be found. The present invention includes searching for metadata set on each of at least one partial section included in each of at least one video, obtaining an identification information on each of the at least one partial section having the found metadata set thereon, obtaining a section information on each of the at least one partial section having the found metadata set thereon, and displaying the obtained identification or section information.

Computer-readable storage medium storing image processing program, image processing method, and image processing device

A computer-readable storage medium storing an image processing program that causes a computer to execute a process includes acquiring the same object identification information included in a plurality of image data items by referring to a storage unit that stores each of the image data items, object identification information that identifies an object included in the image data item, and a location information item that identifies a location of the object in the image data item in association with one another; acquiring the location of the object identified by the acquired object identification information in each of the image data items by referring to the storage unit; computing a difference between the acquired location information items; comparing the difference between the location information items with a predetermined location threshold value; and determining whether the image data items are to be in the same group.

Online environment mapping

A system and method are disclosed for online mapping of large-scale environments using a hybrid representation of a metric Euclidean environment map and a topological map. The system includes a scene module, a location recognition module, a local adjustment module and a global adjustment module. The scene flow module is for detecting and tracking video features of the frames of an input video sequence. The scene flow module is also configured to identify multiple keyframes of the input video sequence and add the identified keyframes into an initial environment map of the input video sequence. The location recognition module is for detecting loop closures in the environment map. The local adjustment module enforces local metric properties of the keyframes in the environment map, and the global adjustment module is for optimizing the entire environment map subject to global metric properties of the keyframes in the keyframe pose graph.

Techniques to Consume Content and Metadata

A client device may receive a request from a remote control device to capture a still image from content in a broadcast received at the client device. The client device may capture the still image from the content in the broadcast responsive to the request. The still image is transmitted for receipt and display at the remote control device. Image data is received from the remote control device that includes a portion of the still image displayed at the remote control device. The portion of the still image is selected by a user via a user interface output at the remote control device and includes an object to be identified using image recognition.

Method and system for video indexing and video synopsis

In a system and method for generating a synopsis video from a source video, at least three different source objects are selected according to one or more defined constraints, each source object being a connected subset of image points from at least three different frames of the source video. One or more synopsis objects are sampled from each selected source object by temporal sampling using image points derived from specified time periods. For each synopsis object a respective time for starting its display in the synopsis video is determined, and for each synopsis object and each frame a respective color transformation for displaying the synopsis object may be determined The synopsis video is displayed by displaying selected synopsis objects at their respective time and color transformation, such that in the synopsis video at least three points that each derive from different respective times in the source video are displayed simultaneously.

Social media fact checking method and system

A fact checking system verifies the correctness of information and/or characterizes the information by comparing the information with one or more sources. The fact checking system automatically monitors, processes, fact checks information and indicates a status of the information.

Automatic Photo Capture Based on Social Components and Identity Recognition

In one embodiment, a mobile device automatically captures image frames by acquiring a real-time video sequence, selecting one or more frames from the real-time video sequence based on social network information and identity recognition, and storing the selected one or more frames in a local storage of the mobile device.

Method of and system for fact checking email

A fact checking system verifies the correctness of information and/or characterizes the information by comparing the information with one or more sources. The fact checking system automatically monitors, processes, fact checks information and indicates a status of the information.

Feeling-expressing-word processing device, feeling-expressing-word processing method, and feeling-expressing-word processing program

The present approach enables an impression of the atmosphere of a scene or an object present in the scene at the time of photography to be pictured in a person's mind as though the person were actually at the photographed scene. A feeling-expressing-word processing device has: a feeling information calculating unit 11 for analyzing a photographed image, and calculating feeling information which indicates a temporal change in a scene shown in the photographed image or a movement of an object present in the scene; and a feeling-expressing-word extracting unit 12 for extracting, from among feeling-expressing words which express feelings and are stored in a feeling-expressing-word database 21 in association with the feeling information, a feeling-expressing word which corresponds to the feeling information calculated by the feeling information calculating unit 11.

Method of and system for indicating a validity rating of an entity

A fact checking system verifies the correctness of information and/or characterizes the information by comparing the information with one or more sources. The fact checking system automatically monitors, processes, fact checks information and indicates a status of the information.

METADATA GENERATION FOR VIDEO INDEXING

A video indexing system identifies groups of frames within a video frame sequence captured by a static camera during a same scene. Context metadata is generated for each frame in each group based on an analysis of fewer than all frames in the group. The frames are indexed in a database in association with the generated context metadata. 1. A method comprising:analyzing a sequence of video frame to determine whether the sequence was captured by a static camera; andresponsive to determining that the sequence of frames was captured by the static camera, generating context metadata for each frame in the sequence based on an analysis of fewer than all frames in the sequence.2. The method of claim 1 , further comprising:determining that a select frame of the sequence was captured by a moving camera, andresponsive to the determination, subjecting the select frame to a first series of processing operations for generating the context metadata that is different than a second series of processing operations used to generate the context metadata for the frames in the sequence captured by the static camera.3. The method of claim 2 , wherein the first series of processing operations generates context metadata for the select frame based on an image analysis that is limited to the select frame.4. The method of claim 1 , wherein generating context metadata for each frame in the sequence based on the analysis of fewer than all frames in the sequence further comprises:selecting a keyframe from the sequence;generating at least a portion of the context metadata based on an analysis of the keyframe without analyzing other frames of the sequence; andindexing the other frames of the sequence in association with the generated context metadata.5. The method of claim 4 , wherein generating the context metadata further comprises:generating descriptors for multiple objects present in the keyframe.6. The method of claim 5 , wherein generating the context metadata further comprises:generating a ...

Method for making music recommendations and related computing device, and medium thereof

This application discloses a method for making music recommendations. The method for making music recommendations is performed by a server device. The method includes obtaining a material for which background music is to be added; determining at least one visual semantic tag of the material, the at least one visual semantic tag describing at least one characteristic of the material; identifying a matched music matching the at least one visual semantic tag from a candidate music library; sorting the matched music according to user assessing information of a user corresponding to the material; screening the matched music based on a sorting result and according to a preset music screening condition; and recommending matched music obtained through the screening as candidate music of the material.

Method and Apparatus for Multi-Dimensional Content Search and Video Identification

A multi-dimensional database and indexes and operations on the multi-dimensional database are described which include video search applications or other similar sequence or structure searches. Traversal indexes utilize highly discriminative information about images and video sequences or about object shapes. Global and local signatures around keypoints are used for compact and robust retrieval and discriminative information content of images or video sequences of interest. For other objects or structures relevant signature of pattern or structure are used for traversal indexes. Traversal indexes are stored in leaf nodes along with distance measures and occurrence of similar images in the database. During a sequence query, correlation scores are calculated for single frame, for frame sequence, and video clips, or for other objects or structures. 1. A computer-implemented method for storing information associated with videos in a reference database using hash values as traversal indexes , the computer-implemented method comprising: obtaining, by a processor, data associated with the video sequence,', 'determining, by the processor, a multi-dimensional vector signature of a region of a frame of the video sequence,', 'determining, by the processor, a hash value based on the multi-dimensional vector signature, and', 'storing the data associated with the video sequence at a leaf node of a plurality of leaf nodes, wherein the leaf node is addressable by the hash value., 'for each of multiple video sequences2. The computer-implemented method of claim 1 , wherein the region comprises multiple sectors claim 1 , and wherein the multi-dimensional vector signature represents each sector.3. The computer-implemented method of claim 2 , wherein determining the multi-dimensional vector signature comprises comparing features within each sector to a threshold value to generate a value for the sector.4. The computer-implemented method of claim 2 , wherein the region is a rectangular ...

Method and Apparatus for Multi-Dimensional Content Search and Video Identification

A multi-dimensional database and indexes and operations on the multi-dimensional database are described which include video search applications or other similar sequence or structure searches. Traversal indexes utilize highly discriminative information about images and video sequences or about object shapes. Global and local signatures around keypoints are used for compact and robust retrieval and discriminative information content of images or video sequences of interest. For other objects or structures relevant signature of pattern or structure are used for traversal indexes. Traversal indexes are stored in leaf nodes along with distance measures and occurrence of similar images in the database. During a sequence query, correlation scores are calculated for single frame, for frame sequence, and video clips, or for other objects or structures. 1. A computer-implemented method for storing information associated with a video sequence in a reference database , the computer-implemented method comprising:obtaining, by a processor, data associated with the video sequence; and determining, by the processor, respective global features of a global region of interest,', 'determining, by the processor, respective local features of a respective keypoint within the global region of interest, wherein, for multiple frames of the set of frames of the video sequence, the respective keypoints correspond to different respective locations within the global region of interest,', 'generating, by the processor, a respective signature using both the global features for the frame and the local features for the frame,', 'determining, by the processor, a respective hash value for the frame based on the signature for the frame, and', 'storing, by the processor, the data associated with the video sequence in the reference database in association with the hash value for the frame., 'for each frame of a set of frames of the video sequence2. The computer-implemented method of claim 1 , wherein ...

Method and Apparatus for Multi-Dimensional Content Search and Video Identification

A multi-dimensional database and indexes and operations on the multi-dimensional database are described which include video search applications or other similar sequence or structure searches. Traversal indexes utilize highly discriminative information about images and video sequences or about object shapes. Global and local signatures around keypoints are used for compact and robust retrieval and discriminative information content of images or video sequences of interest. For other objects or structures relevant signature of pattern or structure are used for traversal indexes. Traversal indexes are stored in leaf nodes along with distance measures and occurrence of similar images in the database. During a sequence query, correlation scores are calculated for single frame, for frame sequence, and video clips, or for other objects or structures. 1. A computer-implemented method comprising:obtaining, by a processor, a first query index and a second query index that are derived from different respective features of a frame of a query video;determining, by the processor, that a distance measure between the first query index and a candidate database index of a reference database satisfies a threshold condition, wherein the candidate database index corresponds to a frame of an original video;determining, by the processor, a correlation score for the frame of the query video and the frame of the original video based on a comparison of the second query index and an additional candidate database index corresponding to the frame of the original video;based at least on the correlation score, determining, by the processor, a video sequence likelihood indicative of a confidence of match between the query video and the original video; andbased on the video sequence likelihood, providing, by the processor, a results list that includes a name of the original video.2. The computer-implemented method of claim 1 , wherein the second query index corresponds to a texture signature of a ...

Method and Apparatus for Multi-Dimensional Content Search and Video Identification

A multi-dimensional database and indexes and operations on the multi-dimensional database are described which include video search applications or other similar sequence or structure searches. Traversal indexes utilize highly discriminative information about images and video sequences or about object shapes. Global and local signatures around keypoints are used for compact and robust retrieval and discriminative information content of images or video sequences of interest. For other objects or structures relevant signature of pattern or structure are used for traversal indexes. Traversal indexes are stored in leaf nodes along with distance measures and occurrence of similar images in the database. During a sequence query, correlation scores are calculated for single frame, for frame sequence, and video clips, or for other objects or structures.

Method and System for Retrieving Video Temporal Segments

A method and a system for retrieving video temporal segments are provided. In the method, a video is analyzed to obtain frame feature information of the video; the frame feature information is input into an encoder to output first data relating to temporal information of the video; the first data and a retrieval description for retrieving video temporal segments of the video are input into a decoder to output second data; attention computation training is conducted according to the first data and the second data; video temporal segments of the video corresponding to the retrieval description are determined according to the attention computation training. 1. A method for retrieving video temporal segments , comprising:analyzing a video to obtain frame feature information of the video;inputting the frame feature information into an encoder to output first data relating to temporal information of the video;inputting the first data and a retrieval description for retrieving video temporal segments of the video into a decoder to output second data;conducting attention computation training according to the first data and the second data; anddetermining video temporal segments of the video corresponding to the retrieval description according to the attention computation training.2. The method of claim 1 , wherein conducting the attention computation training according to the first data and the second data comprises:inputting the first data and the second data into an attention layer coupled with the encoder and the decoder;obtaining, at the attention layer, temporal attention weight data for each video temporal segment of the video based on correlation of each video temporal segment with each description term contained in the retrieval description;obtaining, at the attention layer, weighted average data, based on the first information and the temporal attention weight data, and outputting the weighted average data to a fully connected (FC) layer coupled with the attention ...

METHOD FOR VIDEO INTERACTION AND ELECTRONIC DEVICE

A method for video interaction includes: displaying an information input interface in response to an information input instruction from a first user account for a target video in a playing state; acquiring, via the information input interface, target information input by the first user account, and generating corresponding interaction information based on the target information and a target video frame picture corresponding to the target information; and sending the interaction information to a second user account. 1. A method for video interaction , comprising:displaying an information input interface in response to an information input instruction from a first user account for a target video in a playing state;acquiring, via the information input interface, target information input by the first user account, and generating corresponding interaction information based on the target information and a target video frame picture corresponding to the target information; andsending the interaction information to a second user account.2. The method according to claim 1 , further comprising:acquiring, from the target video, a video frame picture corresponding to a time point at which the information input instruction is received, and determining the video frame picture as the target video frame picture.3. The method according to claim 1 , further comprising:acquiring target playing progress information of the target video, and reading, from the target video, the target video frame picture corresponding to the target playing progress information.4. The method according to claim 1 , wherein said acquiring claim 1 , via the information input interface claim 1 , the target information input by the first user account comprises:receiving input content via the information input interface;acquiring and presenting interaction association information matching the input content; anddetermining, in response to a received selection instruction, the corresponding target information from ...

Method, apparatus and arrangement for summarizing and browsing video content

A method, apparatus and arrangement for the summarizing and browsing of video sequences are provided and include at least one horizontal strip having time-sequenced video frames belonging to a single video sequence and at least one vertical strip having a plurality of video frames belonging to different video sequences, each of the plurality of video frames of the at least one vertical strip having at least one feature in common. In one instance, the at least one horizontal strip and the at least one vertical strip are arranged to intersect at a video frame of the at least one horizontal video strip having the least one feature in common with the video frames in the at least one vertical strip.

Systems and methods for recording media assets

Systems and methods are provided to record portions of media assets. User request is received to record a media asset together with a criterion for recording portions of that media asset. A content recognition algorithm is executed against segments of the media asset to determine a set of keywords associated with those segments. Separately a set of keywords associated with the criterion is generated. Sets of keywords are compared and segments that match the criterion are discovered. If it is determined that a first segment and third segment each match the criterion and a second segment does not, a delete indicator is added to the second segment and the third and first segments are compared. If those segments match the delete indicator is removed from the second segment.

SYSTEMS AND METHODS FOR CONTROLLING DISPLAY OF SUPPLEMENTARY DATA FOR VIDEO CONTENT

A processor-implemented method is disclosed. The method includes: obtaining metadata associated with a video; identifying one or more tradeable objects associated with video content of the video based on performing textual comparison between text of the metadata and a defined list of tradeable objects; determining one or more segments of the video corresponding to the one or more identified tradeable objects, the one or more video segments having respective playback start timestamps; receiving, via a client device during playback of the video, a user selection of a first one of the video segments; in response to receiving the user selection: generating supplementary display data associated with a first tradeable object corresponding to the first video segment; and sending, to the client device, the supplementary display data. 1. A computer system , comprising:a processor;a communications module coupled to the processor; and obtain metadata associated with a video;', 'identify one or more tradeable objects associated with video content of the video based on performing textual comparison between text of the metadata and a defined list of tradeable objects;', 'determine one or more segments of the video corresponding to the one or more identified tradeable objects, the one or more video segments having respective playback start timestamps;', 'receive, via a client device during playback of the video, a user selection of a first one of the video segments;', generate supplementary display data associated with a first tradeable object corresponding to the first video segment; and', 'send, to the client device, the supplementary display data., 'in response to receiving the user selection], 'a memory coupled to the processor, the memory storing instructions that, when executed, configure the processor to2. The computer system of claim 1 , wherein the supplementary display data comprises graphical user interface data associated with the first tradeable object for displaying ...

Filtering video content items

Methods and systems for filtering video content items are described herein. The system identifies a plurality of video content items that are linked to respective image content items. The system determines, for each of the plurality of video content items, whether a video content item corresponds to a respective image content item. In response to the determining, the system causes to be provided information identifying the plurality of video content items excluding video content items that do not correspond to respective image content items.

FILTERING VIDEO CONTENT ITEMS

Methods and systems for filtering video content items are described herein. The system identifies a plurality of video content items that are linked to respective image content items. The system determines, for each of the plurality of video content items, whether a video content item corresponds to a respective image content item. The system causes to be provided information identifying the plurality of video content items. For each video content item of the plurality of video content items that corresponds to a respective image content item, the system causes to be provided an indicator that correspondence has been verified. 1. A computer-implemented method for filtering video content items comprising:in response to a request for video content items matching at least one criterion, identifying, using the control circuitry, a plurality of video content items that are linked to respective image content items;determining, using the control circuitry, for each of the plurality of video content items whether a video content item corresponds to a respective image content item;causing, using the control circuitry, to be provided information identifying the plurality of video content items; andfor each video content item of the plurality of video content items that corresponds to a respective image content item, causing, using the control circuitry, to be provided an indicator that correspondence has been verified.2. The method of claim 1 , wherein determining for each of the plurality of video content items whether a video content item corresponds to a respective image content item comprises determining whether the video content item and the respective image content item both depict a particular subject.3. The method of claim 1 , wherein determining for each of the plurality of video content items whether the video content item corresponds to a respective image content item comprises determining whether the respective image content items comprises at least a portion of ...

RETRIEVAL DEVICE, TRAINING DEVICE, RETRIEVAL SYSTEM, AND RECORDING MEDIUM

The retrieval device extracts a feature corresponding to search text by inputting the search text into a pre-trained text feature extraction model. The retrieval device then, for plural combinations stored in a database associating a text description including plural sentences, with a vehicle-view video, and with vehicle behavior data representing temporal vehicle behavior, computes a text distance represented by a difference between a feature extracted from each sentence of the text description associated with the video and vehicle behavior data, and the feature corresponding to the search text. The retrieval device outputs as the search result a prescribed number of pairs of video and vehicle behavior data pairs in sequence from the smallest text distance according to the text distances. 1. A retrieval device , comprising:a memory, anda processor coupled to the memory, the processor being configured to:acquire a search text,extract a feature corresponding to the search text by inputting the search text to a text feature extraction model configured to extract features from input sentences, the text feature extraction model being pre-trained so as to reduce a loss represented by a difference between a feature extracted from a sentence and a feature extracted from a correctly matched vehicle-view video, and also being pre-trained so as to reduce a loss represented by a difference between a feature extracted from the sentence and a feature extracted from correctly matched vehicle behavior data representing temporal vehicle behavior,compute a text distance for each of a plurality of combinations stored in the memory, each combination associating a text description, including a plurality of sentences, with a vehicle-view video and with vehicle behavior data representing temporal vehicle behavior, the text distance being represented by a difference between a feature extracted from each sentence of the text description associated with the video and the vehicle behavior ...

Video processing device for embedding time-coded metadata and methods for use therewith

A video processing device includes a content analyzer that receives a video signal and generates content recognition data based on the video signal, wherein the content recognition data is associated with at least one timestamp included in the video signal. A metadata search device generates time-coded metadata in response to content recognition data and in accordance with the at least one time stamp. A metadata association device generates a processed video signal from the video signal, wherein the processed video signal includes the time-coded metadata.

Determining rate of video feed stories in a feed provided to users

A social networking system provides feed to users in response to requests from users. The feed comprises feed stories that comprise one or more of text, image, or videos. The social networking system generates a feed in which the number of video feed stories is determined based on the video feed story rate determined for each specific request. The social networking system determines the video feed story rate based on various features including features describing the request, for example, the time of the day that the request is received. The social networking system may include other features for determining the video feed story rate, for example, user specific features describing the user that sent the request. The social networking system sends the generated feed to the client device of the target user.

METHOD AND SYSTEM FOR CREATING COMBINED MEDIA AND USER-DEFINED AUDIO SELECTION

A method and system for combining user-defined music, sound effects or other audio content selections with video or other media, an activity or an event experience. Music attributes are associated with music files. A user selects a music category. Video or other media are time segmented. Each segment is associated with the music attributes. Using a time clock, music in the user-selected category is combined with video for a personalized experience. 16-. (canceled)7. A system for combining audio with additional media , activity or an entertainment experience comprising:a database of audio metadata attributes describing audio media files, the audio media files obtained from an audio media repository;a database of soundtrack script metadata associated with a selection from an additional media, activity or entertainment experience repository;a trigger mechanism;a user-driven software application configured for a user to define audio preferences;a processor configure to execute computer code to create a customized audio playlist by interpreting the user-defined audio preferences, soundtrack script metadata, audio metadata attributes and trigger mechanism information;a processor configured to execute computer code to combine the customized audio playlist, audio media files, other media files and trigger mechanism information; anda device for presenting the combined audio with additional media, activity or an entertainment experience and user-defined audio selection, wherein the audio changes based on the trigger mechanism.8. The system of further comprising a processor configured to execute computer code to create the soundtrack script metadata from an item from the additional media claim 7 , activity or entertainment experience repository.9. The system of further comprising a processor configured to execute computer code to create the audio metadata attributes describing audio media files from the audio repository.10. The system of wherein the system is configured to ...

SYSTEMS AND METHODS FOR PRESENTING AUXILIARY VIDEO RELATING TO AN OBJECT A USER IS INTERESTED IN WHEN THE USER RETURNS TO A FRAME OF A VIDEO IN WHICH THE OBJECT IS DEPICTED

Systems and methods are described herein for a media guidance application that detects, and responds to, a user's review of video content on a media device. The media guidance application detects a rewind operation during playback of a video comprising a media asset. In response, the media guidance application determines if the playback position reached during the rewind operation occurs during a first break in the media asset and, if so, identifies objects depicted in the video at the playback position, and presents auxiliary video relating to an object at a second break in the media asset. 1. (canceled)2. A method for presenting , to a user , auxiliary video related to an object in which the user is interested , the object having been depicted in a video , the method comprising:generating for display, using control circuitry, on a media device the video comprising a media asset;receiving from a user input interface, during playback of the video, a rewind command;in response to receiving the rewind command, performing a rewind operation;determining an end point of the rewind operation;identifying a playback position of the video at the end point of the rewind operation;determining whether the playback position is during a first break in the video; accessing metadata associated with the first break;', 'identifying a subset of the metadata describing an object depicted in the video;', 'extracting the identified subset of the metadata; and', 'storing the identified subset of the metadata;, 'in response to determining that the playback position is during the first break in the videodetecting a second break during playback of the video; andin response to detecting the second break, generating for display, based on the metadata, during the second break, the auxiliary video describing the object.3. The method of claim 2 , further comprising claim 2 , further in response to determining that the playback position is during the first break in the video:processing a frame of ...

Video information processing system

There is provided a video information processing system comprising: a target recognition module configured to detect, from among the plurality of still images, still images in which a search target is present based on a determination of a similarity degree with registration data of the search target using a first threshold; and a time band determination module configured to determine, in a case where an interval between the still images in which the search target is determined as being present is a second threshold or less, that the search target is also present in a still image between the still images in which the search target is determined as being present. The video information processing system registers a start time and an end time of the continuous still images in which the search target is determined as being present in association with the registration data of the search target.

Systems and Methods for Authenticating and Presenting Video Evidence

A method for automatically authenticating unknown video data based on known video data stored at a client server is provided, wherein, unknown and known video data each are made up of segments and include metadata, a hash message digest, and a serial code. The method involves selecting a first segment of the unknown video and locating the serial code within the first segment of the unknown video data. The serial code is used to locate a corresponding first segment in the known video data. The first segment may include a known hash message digest. A new hash message digest for the first segment of the unknown video data is generated and compared with the known hash message digest. If they match, the segment of unknown video data is authentic. 1. A computer system for conveying to a viewer of a video comprising a plurality of segments which segments of said plurality of segments are unmodified , said computer system comprising:a processor configured to determine which video segments are unmodified, and further configured to display said plurality of segments of said video onto a display screen, and to generate an authentication graphic on said display screen in response to determining that a segment being displayed is an unmodified video segment.2. (canceled)3. The computer system of claim 1 , wherein the authentication graphic is provided in the form of a colored timeline configured to be positioned near a window configured to show the video when displayed.4. The computer system of claim 3 , wherein the colored timeline corresponds to a length of the video.5. The computer system of claim 4 , wherein the colored timeline shows a first color for a portion of the timeline corresponding to the segments of the plurality of segments that are unmodified claim 4 , and a second color for another portion of the timeline corresponding to other segments of the plurality of segments that are modified.6. The computer system of claim 1 , wherein the processor further is configured ...

AUTOMATIC SWITCHING DEVICE OPERATION DETERMINATION BASED ON RECEIVED NOTIFICATIONS

A switching device is enabled to automatically perform one or more actions based on one or more notifications received thereby. A notification may be received by a device communicatively coupled to the switching device, or alternatively, may be internally-generated. Upon receiving the notification, the switching device utilizes a notification-to-action mapping to determine which action(s) are to be performed based on the notification received. The action(s) include automatically switching the switching device to a device coupled to a port thereof and/or automatically launching an application executing on that device in order to view the notification and/or content associated with the notification. In other example, the action(s) may include sending the notification to another device, such as a user's mobile phone and/or causing an application executing on the mobile phone to be launched in order to view the notification and/or content associated with the notification. 1. A method performed by a first electronic device , comprising:receiving a notification from a cloud-based service via a network interface of a first electronic device;causing a second electronic device to be powered on responsive to receiving the notification; and{'claim-text': ['causing the notification to be displayed via the second electronic device; or', 'causing an application to be automatically launched on at least one of the first electronic device or the second electronic device.'], '#text': 'performing at least one of:'}2. The method of claim 1 , wherein the second electronic device is a mobile device.3. The method of claim 1 , wherein causing the application to be automatically launched comprises:providing a control signal to the second electronic device that causes the application to be automatically launched on the second electronic device.4. The method of claim 3 , wherein the control signal is provided to the second electronic device via the network interface.5. The method of claim 1 , ...

INTEGRATION OF VIDEO CONFERENCING APPLICATIONS WITH ON-DEMAND DATABASE SERVICES

A computing platform may be configurable to cause receiving a request from a video conferencing application while a video conference is in session, the request comprising one or more user parameters identifying one or more participants in the video conference session. The computing platform is also configurable to cause implementing a query of a database system, the query being configured to retrieve one or more user data objects associated with at least one participant, wherein the at least one participant is different from a user of the client device. The computing platform is further configurable to cause generating, a result object based, at least in part, on the retrieved one or more user data objects, the result object being configured to cause display, at a user interface of the video conferencing application, visual information about the at least one participant, and sending the result object to the video conferencing application.

EMULATION SERVICE FOR PERFORMING CORRESPONDING ACTIONS BASED ON A SEQUENCE OF ACTIONS DEPICTED IN A VIDEO

A media casting device detects facial feature points of a beauty advisor and detects the beauty advisor performing a sequence of operations relating to application of cosmetic products on a facial region of the beauty advisor. The media casting device detects a corresponding timestamp for each operation and detects a position of a cosmetic product with respect to facial feature points of the beauty advisor during each of the sequence of operations. The media casting device detects a cosmetic product utilized by the beauty advisor during each of the sequence of operations and generates metadata comprising the sequence of operations, the position of each cosmetic product, the corresponding timestamps, and each detected cosmetic product. The media casting device then transmits the metadata to a client device. 1. A method , comprising:detecting, by a facial region analyzer, facial feature points of a beauty advisor;detecting, by an event detector, the beauty advisor performing a sequence of operations relating to application of cosmetic products on a facial region of the beauty advisor;detecting, by the event detector, a corresponding timestamp for each operation;detecting, by the event detector, a position of a cosmetic product with respect to facial feature points of the beauty advisor during each of the sequence of operations;detecting, by the event detector, a cosmetic product utilized by the beauty advisor during each of the sequence of operations;generating, by a metadata module, metadata comprising the sequence of operations, the position of each cosmetic product, the corresponding timestamps, and each detected cosmetic product; andtransmitting, by a network module, the metadata to a client device.2. The method of claim 1 , wherein detecting claim 1 , by the event detector claim 1 , the position of the cosmetic product comprises determining coordinates of the position of the cosmetic product relative to the facial feature points.3. The method of claim 1 , further ...

Real time video stream processing systems and methods thereof

Real-time image processing and annotation of video streams is provided by a system of plural processors and memory storing executable instructions to cause the processors to execute real-time processing. Different regions are set for frames of the video stream which define objects therein based on the context or content thereof. Skipping intervals are set for each region. Frames are individually selected from the video stream according to each skipping interval of each region. Specific regions are separately processed by different processors in the selected frames which are separated at intervals within the video stream by the frame skipping values. The processing of the regions identifies objects therein and stores descriptions of the objects in an index to facilitate searching of the video content. The activity of the objects in the video stream further cause the frame skipping levels to change thereby causing selected individual frames to be dynamically processed.

AUTOMATIC SWITCHING DEVICE OPERATION DETERMINATION BASED ON RECEIVED NOTIFICATIONS

A switching device is enabled to automatically perform one or more actions based on one or more notifications received thereby. A notification may be received by a device communicatively coupled to the switching device, or alternatively, may be internally-generated. Upon receiving the notification, the switching device utilizes a notification-to-action mapping to determine which action(s) are to be performed based on the notification received. The action(s) include automatically switching the switching device to a device coupled to a port thereof and/or automatically launching an application executing on that device in order to view the notification and/or content associated with the notification. In other example, the action(s) may include sending the notification to another device, such as a user's mobile phone and/or causing an application executing on the mobile phone to be launched in order to view the notification and/or content associated with the notification. 1. A method performed by a switching device that comprises a plurality of audio/video (AV) ports and a switch circuit that is operable to selectively connect any one of a plurality of source devices , each of which is connected to a corresponding one of the plurality of AV ports , to a sink device that is connected to another one of the plurality of AV ports , the method comprising:processing at least one of a notification received via a network interface of the switching device or a notification generated by the switching device;determining one or more actions to be performed by the switching device in response to receiving the notification using a notification-to-action mapping that maps a plurality of different one or more notifications to a plurality of different one or more actions; andperforming the one or more actions.2. The method of claim 1 , wherein the notification is received via one or more data sources configured to provide one or more of:news-related information;sports-related ...

VISUALIZING VEHICLE PART REPLACEMENT INFORMATION USING EXTENDED REALITY

A device having extended reality capabilities receives a video feed including one or more video frames depicting an object. The device provides the one or more video frames to a first machine learning model that identifies the object and one or more parts of the object that are depicted in the one or more video frames, and obtains positional tracking information that represents a position and an orientation associated with the object depicted in the one or more video frames relative to a coordinate space. The device identifies a plurality of parts from the one or more parts of the object that are depicted in the one or more video frames and determines, using one or more second machine learning models, information regarding the plurality of parts and information regarding one or more replacement parts. 1. A method , comprising:capturing, by a device having extended reality capabilities, a video feed including one or more video frames depicting one or more parts of an object;identifying, by the device, a part from the one or more parts of the object that are depicted in the one or more video frames; 'wherein the one or more machine learning models have been trained to predict information regarding a historical life cycle of the part and recommend the one or more replacement parts; and', 'determining, by the device and using one or more machine learning models, information regarding the part and information regarding one or more replacement parts,'} 'wherein the information regarding the one or more replacement parts includes, for a replacement part of the one or more replacement parts, a plurality of options associated with installation of the replacement part.', 'wherein the content identifies the information regarding the part and the information regarding the one or more replacement parts,'}, 'rendering, by the device, content, relative to the part, using the extended reality capabilities of the device,'}2. The method of claim 1 , wherein the content includes two- ...

METHOD FOR SEARCHING VIDEO AND EQUIPMENT WITH VIDEO SEARCH FUNCTION

A method for searching a video and equipment with a video search function are provided. The method for searching a video includes constructing a video DB by analyzing continuity of a tag given to an appearing object and extracting section information about the tag, and detecting video information. An object may be recognized, a video database may be constructed, and a video may be searched on the basis of analysis based on an artificial intelligence (AI) model through a 5G network. 1. A method for searching a video , comprising:constructing a video database (DB) based on video information extracted from the video; anddetecting video information that is matched with a search condition using the video DB,wherein constructing the video DB comprises:recognizing an object appearing in the video based on analysis of video frames of the video;determining a continuity of a tag associated with the recognized object; andextracting section information about the tag included in the video information based on the determination.2. The method of claim 1 , wherein:the object is recognized in a video frame of the video using an artificial intelligence model trained through supervised learning; andthe artificial intelligence model is initially trained using an initial training data set and is further trained using on-device learning using the video corresponding to personal data of a user.3. The method of claim 1 , wherein determining the continuity of the tag comprises extracting a confidence index of the tag claim 1 , and the tag continuity is determined for one or more video frames for which the confidence index is greater than or equal to a threshold value.4. The method of claim 1 , wherein the extracted section information comprises at least:section information about tags having a continuity greater than or equal to a threshold time; orsection information about a tag having a high confidence index among the tags having the continuity greater than or equal to the threshold time.5 ...

Video-Based Data Collection, Image Capture and Analysis Configuration

In a system for video data capture and sharing client devices may include one or more video cameras and sensors to capture video data and to generate associated metadata. A cloud-based component may receive metadata from the client devices and requests for sharing video data captured by other client devices. Client devices with requested video data are identified by matching their provided metadata to the sharing request and by their response to an image search query for an object of interest specified in the request. 122.-. (canceled)23. A method of generating event-based video clips , the method comprising:monitoring an input associated with video being captured by a client device in communication with a cloud-based system configured to receive metadata from a plurality of client devices and to identify a client device, the video being stored in a first buffer;detecting a tagging event based on the input;upon detection of a tagging event, selecting relevant video data for video clip generation;marking the relevant video data for a longer period of buffering; andgenerating a video clip using the relevant video data.24. The method of claim 23 , wherein the video is being captured continuously.25. The method of claim 23 , wherein the selecting the relevant video data comprises identifying a plurality of video files for a predefined period of time before the tagging event and a predefined period of time after the tagging event.26. The method of claim 25 , wherein the predefined period of time before the tagging event and the predefined period of time after the tagging event are between ten and thirty seconds each.27. The method of claim 25 , wherein the predefined period of time before the tagging event differs from the predefined period of time after the tagging event.28. The method of claim 23 , further comprising copying the relevant video data to a second buffer implementing a different buffering policy claim 23 , wherein the different buffering policy retains the ...

Electronic threat assessment system

A system for assessing threats includes a method of detecting a physical location of the system, establish a connection to at least one database, scanning a proximate area, prioritizing a plurality of identified objects, comparing data for at least one of the identified object to data from the at least one database, and outputting at least one notification.

SYSTEMS AND METHODS FOR VIDEO ARCHIVE AND DATA EXTRACTION

Systems and methods for full motion video search are provided. In one aspect, a method includes receiving one or more search terms. The search terms include one or more of a characterization of the amount of man-made features in a video image and a characterization of the amount of natural features in the video image. The method further includes searching a full motion video database based on the one or more search terms. 1. A method of adding a video entity to a full motion video database supporting search capabilities , the method comprising:determining a starting cell in the full motion video database; and splitting the starting cell to create two new child cells, and', 'adding the video entity to one of the two new child cells., 'determining if the starting cell should be split, and if the starting cell should be split2. The method of claim 1 , wherein splitting the starting cell comprises splitting the starting cell along a split axis.3. The method of claim 2 , wherein the split axis is along a line of latitude.4. The method of claim 2 , wherein the split axis is along a line of longitude.5. The method of claim 2 , wherein the two new child cells are created along the split axis.6. The method of claim 1 , further comprising moving one or more video entities stored in the starting cell from the starting cell to the new child cells.7. The method of claim 6 , further comprising adding pointers to the starting cell pointing to the child cells.8. The method of claim 1 , wherein determining if the starting cell should be split comprises determining if the starting cell is full.9. The method of claim 8 , further comprising adding the video entity to the starting cell if the starting cell not full.10. The method of claim 1 , further comprising:determining a child cell from a plurality of child cells of the starting cell if the starting cell contains a plurality of child cells; andadding the video entity to one of the plurality of child cells.11. The method of claim 10 ...

TAGGING AUDIO/VISUAL CONTENT WITH REACTION CONTEXT

An example method includes in response to disseminated audio/visual content, monitoring reactions of a plurality of users to the audio/visual content using data received from audio/visual user devices. The method further includes categorizing the reactions as corresponding to one of a plurality of reaction contexts to tag the audio/visual content with the corresponding reaction context. 1. A method comprising:in response to disseminated audio/visual content, monitoring reactions of a plurality of users to the audio/visual content using reaction-specific data received via communication circuitry from audio/visual user devices; andcategorizing the reactions as corresponding to one of a plurality of reaction contexts to tag the audio/visual content with the corresponding reaction context.2. The method of claim 1 , wherein the plurality of reaction contexts include a positive reaction claim 1 , a negative reaction claim 1 , and a neutral reaction claim 1 , the method further including tagging the audio/visual content by associating text indicative of the corresponding reaction context with the audio/visual content.3. The method of claim 1 , further including:disseminating the audio/visual content over a communication network for accessibility by the plurality of users; andincreasing a tag count associated with the corresponding reaction context for the audio/visual content.4. The method of claim 1 , wherein monitoring reactions by the plurality of users includes extracting facial features from camera input for one of the plurality of users claim 1 , and categorizing the particular reaction of the user using the extracted facial features.5. The method of claim 1 , wherein monitoring reactions by the plurality of users includes extracting speech features from microphone input for one of the plurality of users claim 1 , and categorizing the particular reaction of the user using the extracted speech features.6. The method of claim 1 , wherein the plurality of reaction ...

VIDEO DATA GENERATION APPARATUS, VIDEO DATA GENERATION METHOD, AND PROGRAM

A frame rate determination unit determines a frame rate of video data. A code amount determination unit determines a target code amount that can be used in each frame of the video data. An encoding unit performs generation processing for generating video data according to the frame rate and the code amount. When the frame rate determination unit changes the frame rate from a first frame rate to a second frame rate, the code amount determination unit makes at least a target code amount in a frame immediately before the first frame smaller than when the frame rate is not changed from the first frame rate to the second frame rate in the first frame, and makes a target code amount in the first frame greater than when the frame rate is not changed from the first frame rate to the second frame rate in the first frame. 1. A video data generation apparatus that performs generation processing for generating video data , the video data generation apparatus comprising:a frame rate determination unit configured to determine a frame rate of the video data;a code amount determination unit configured to determine a target code amount that can be used in each frame of the video data; andan encoding unit configured to perform the generation processing for generating the video data according to the frame rate determined by the frame rate determination unit and the code amount determined by the code amount determination unit,wherein when the frame rate determination unit changes, in a first frame, the frame rate of the video data from a first frame rate to a second frame rate lower than the first frame rate,the code amount determination unitmakes at least a target code amount in a frame immediately before the first frame smaller than when the frame rate is not changed from the first frame rate to the second frame rate in the first frame, andmakes a target code amount in the first frame greater than when the frame rate is not changed from the first frame rate to the second frame rate ...

VALIDATING ASSET MOVEMENT USING VIRTUAL TRIPWIRES AND A RFID-ENABLED ASSET MANAGEMENT SYSTEM

Validation of asset movement can begin with the definition of a virtual tripwire for video cameras of a video surveillance system that monitor a defined area of interest through which RFID-identified assets are conveyed. The virtual tripwire can visually define a boundary within the view field of the video camera. The video camera can detect the movement of an asset through a virtual tripwire and an asset management system can be notified of the potential misdirection of the asset. The asset management system can obtain the asset's RFID data from a RFID handling system that monitors the area of interest. The validity of the detected movement can be determined using RFID data and an asset movement specification that defines pathing rules for assets and virtual tripwires. When the movement of the asset is determined to be invalid, a record of suspect movement data can be generated for the asset. 120-. (canceled)21. A method , implemented by an asset management system , for validating a movement of an asset having an attached radio frequency identification (RFID) tag , comprising: a virtual tripwire event associated with the asset,', 'RFID data from the attached RFID tag, and', 'an asset movement specification for the asset; and, 'determining that the movement of an asset is invalid based upon'}generating, based upon the determination that the movement is invalid, a suspect movement data record, wherein the RFID data,', 'information pertaining to the virtual trip event., 'the suspect movement data record includes22. The method of claim 21 , whereinthe information pertaining to the virtual trip event includes video data of the asset.23. The method of claim 22 , whereinthe video data includes video data from a video camera that captured the virtual tripwire event and video data, contemporaneous with the virtual tripwire event, from at least one other neighboring video camera.24. The method of claim 22 , whereinthe video data includes a predefined period of video relative ...

Augmenting video data to present real-time metrics

Systems and methods are described for augmenting video data based on automated identification of one or more objects depicted in the video data. One or more classification models may identify an object of interest in video data. An aggregated duration count may be maintained that reflects a length of time that the object of interest has been depicted in the video data. This duration or additional metric data derived in part from the duration may be displayed in association with display of the video data and continuously updated during playback of the video data.

Video reception device, video recognition method and additional information display system

Video recognition processing regarding a video signal input from an outside is performed. Hence, video reception device configured to perform transmission/reception of data through communication network includes input unit, video extraction unit, storage unit, video recognition unit, and control unit. The video recognition unit performs at least one of: online matching processing for generating second content recognition information from a partial video extracted by the video extraction unit, transmitting the second content recognition information to video recognition device so as to request video recognition device to perform video recognition processing; and local matching processing for collating the second content recognition information with first content recognition information stored in the storage unit.

Machine Learning in Video Classification with Playback Highlighting

Described herein are systems and methods that search videos and other media content to identify items, objects, faces, or other entities within the media content. Detectors identify objects within media content by, for instance, detecting a predetermined set of visual features corresponding to the objects. Detectors configured to identify an object can be trained using a machine learned model (e.g., a convolutional neural network) as applied to a set of example media content items that include the object. The systems provide user interfaces that allow users to review search results, pinpoint relevant portions of media content items where the identified objects are determined to be present, review detector performance and retrain detectors, providing search result feedback, and/or reviewing video monitoring results and analytics. 1. A computer-implemented method , comprising:receiving, from a user, a request to identify a selected object in a selected video;identifying a set of frames of the selected video that include the selected object using a classifier trained to identify frames that have an above-threshold confidence of including the selected object;modifying an interface in which the selected video is played by highlighting the selected object within the frame with an overlaid interface element that moves within the displayed video to follow the selected object as the selected object moves within the video;providing for display to the user a feedback interface element;receiving, via the feedback interface element, an input from the user indicating either that a displayed frame with an overlaid interface element does not include the selected object or that a displayed frame without an overlaid interface element does include the selected object; andretraining the classifier based on the received input.2. The computer-implemented method of claim 1 , wherein the request to identify the selected object comprises a text search query received from the user.3. The ...

Media enhancement with customized add-on content

Methods, computer program products, and systems are presented. The methods include, for instance: obtaining a product video representing a product and review feeds authored by a user. Product features are extracted from the product video and user specific features are extracted from the review feeds. User specific add-on content is generated based on the user specific features and user data. The user specific add-on contents are overlaid onto the product video when the product feature corresponding to a user specific feature of the user specific add-on content.

METHOD AND SYSTEM FOR CHARACTERISTIC-BASED VIDEO PROCESSING

A method and apparatus for characteristic-based video processing include: in response to receiving a region of a picture of a video sequence, determining a characteristic in the region, the region being independent of other regions of the picture for video coding; determining a class associated with the region based on the characteristic, the class being selected from a plurality of classes; and encoding the region using a parameter set associated with the class, the parameter set being selected from a plurality of parameter sets for video coding at different quality levels. 1. A non-transitory computer-readablestorage medium storing a set of instructions that are executable by one or more processors of a device to cause the device to perform a method comprising:decoding a compressed video sequence to obtain a parameter set associated with a region of a picture in the compressed video sequence, wherein the parameter set represents a quality level for video coding and is associated with a class; anddecoding the region using the parameter set, wherein the decoded region comprises a characteristic, the characteristic comprises a content characteristic associated with video contents in the region, and the content characteristic comprises at least one of a scene representing an incident in the region or an environmental event in the region.2. The non-transitory computer-readable storage medium of claim 1 , wherein the region is one of a slice of the picture or a tile of the picture.3. The non-transitory computer-readable storage medium of claim 1 , wherein the content characteristic further comprises an object in the region.4. The non-transitory computer-readable storage medium of claim 1 , wherein the class is associated with an interest level of content characteristics claim 1 , and the interest level is determined based on an application scenario of the compressed video sequence.5. The non-transitory computer-readable storage medium of claim 1 , wherein the ...

INFORMATION PROCESSING SYSTEM, METHOD FOR CONTROLLING INFORMATION PROCESSING SYSTEM, AND STORAGE MEDIUM

Provided is an information processing system, including a processor, a storage device and a display device. The storage device stores images captured by imaging devices. If an image of a moving object is selected as a search query, then the processor executes a similarity search on the images stored in the storage device, with the selected image as the search query. The display device displays images attained as results of the similarity search. If an image of a moving object is added as a search query, then the processor executes a similarity search with all selected images as search queries. The display device updates images to be displayed such that images attained as results of the similarity search performed with all the selected images as the search queries are displayed. 1. An information processing system , comprising:a processor;a storage device coupled to the processor; anda display device coupled to the processor,wherein the storage device stores a plurality of images captured by a plurality of imaging devices,wherein if an image of a moving object is selected as a search query, then the processor executes a similarity search on the plurality of images stored in the storage device, with the selected image as the search query,wherein the display device displays a plurality of images attained as results of the similarity search,wherein if an image of a moving object is added as a search query, then the processor executes a similarity search with all selected images as search queries, andwherein the display device updates images to be displayed such that a plurality of images attained as results of the similarity search performed with all the selected images as the search queries are displayed.2. The information processing system according to claim 1 ,wherein the display device displays the plurality of images attained as the results of the similarity search in chronological order of being captured.3. The information processing system according to claim 2 , ...

SHORT-TERM AND LONG-TERM MEMORY ON AN EDGE DEVICE

Systems and methods are provided for distributed video storage and search over edge computing devices having a short-term memory and a long-term memory. The method may comprise caching a first portion of data on a first device. The method may further comprise determining, at a second device, whether the first device has the first portion of data. The determining may be based on whether the first piece of data satisfies a specified criterion. The method may further comprise sending the data, or a portion of the data, and/or a representation of the data from the first device to a third device. 1. An apparatus comprising:at least one memory unit; and receive visual data at a device, wherein the visual data is captured at a camera that is proximate to the device, wherein the camera is affixed to a first vehicle, and wherein a second vehicle is visible in the visual data;', 'produce, based on the visual data, an observations data, wherein the observations data comprises a descriptor of the second vehicle;', 'determine a priority of the visual data, based at least in part on the descriptor of the second vehicle in the observations data; and', 'store the visual data in the at least one memory unit at a first resolution, at a second resolution, or at both a first resolution and a second resolution based at least in part on the priority., 'at least one processor coupled to the at least one memory unit, in which the at least one processor is configured to2. The apparatus of claim 1 , wherein the descriptor of the second vehicle comprises an indication that the second vehicle was involved in a rare traffic event.3. The apparatus of claim 2 , wherein the rare traffic event is a traffic accident involving the second vehicle.4. The apparatus of claim 2 , wherein claim 2 , in response to the indication that the second vehicle was involved in the rare traffic event claim 2 , the at least one processor is further configured to extend a duration of storage of the visual data in the ...

PROCESSING CONTENT BASED ON NATURAL LANGUAGE QUERIES

Disclosed are systems and methods for summarizing content or preparing missed portions of content based on natural language queries. A natural language query can be received. One or more portions of summarized or missed content can be determined based on the natural language query, and transmitted to a user device. 1. An apparatus comprising:one or more processors; and receive a natural language query associated with output of content by a computing device, wherein the natural language query indicates a request referencing a character or an event associated with the content;', 'determine, based on the request referencing the character or the event, a start time of a portion of the content responsive to the request;', 'determine, based on the start time of the portion of the content, a summary of the portion of the content; and', 'cause output of the summary of the portion of the content., 'memory storing processor executable instructions that, when executed by the one or more processors, cause the apparatus to2. The apparatus of claim 1 , wherein the processor executable instructions claim 1 , when executed by the one or more processors claim 1 , further cause the apparatus to determine one or more keywords associated with the event.3. The apparatus of claim 1 , wherein the processor executable instructions claim 1 , when executed by the one or more processors claim 1 , further cause the apparatus to determine claim 1 , based on the one or more keywords and metadata associated with the content claim 1 , the portion of the content.4. The apparatus of claim 1 , wherein the metadata comprises a plurality of time codes claim 1 , and wherein each time code of the plurality of time codes corresponds to a respective one or more attributes.5. The apparatus of claim 4 , wherein the processor executable instructions that claim 4 , when executed by the one or more processors claim 4 , cause the apparatus to determine the summary of the portion of the content cause the ...

FRAME-ACCURATE AUTOMATED CUTTING OF MEDIA CONTENT BY USING MULTIPLE AIRINGS

At least one aspect of the present disclosure is directed to systems and methods of extracting media segments based on fingerprint matching. The method can include receiving a media stream comprising a plurality of frames and generating a plurality of fingerprints corresponding to each frames. The method can receive a target timestamp and determine a target fingerprint from the plurality that corresponds to the target timestamp. The method can retrieve candidate fingerprints, each of the candidate fingerprints corresponding to a frame in a candidate media stream. The method can compare the target fingerprint to the candidate fingerprints to determine a matching candidate fingerprint. The method can match fingerprints that correspond to media frames before and after the target fingerprint to determine the upper and lower bounds of a segment of interest. The method can extract the segment of interest based on the bounds and provide it to a respective party. 1. A method of extracting media segments based on fingerprint matching , comprising:receiving, by a data processing system having one or more processors, a media stream comprising a plurality of frames; selecting, by the data processing system, a second plurality of frames from the plurality of frames based on a fingerprint window value;', 'hashing, by the data processing system, each of the second plurality of frames to create a plurality of hashes;', 'truncating, by the data processing system, each of the plurality of hashes to generate a plurality of truncated hashes;', 'concatenating, by the data processing system, the plurality of truncated hashes to calculate a frame fingerprint value, the frame fingerprint value associated with the respective frame in the plurality of frames and a timestamp corresponding to the respective frame;, 'for each of the plurality of framesaggregating, by the data processing system, each of the calculated frame fingerprint values to assemble a plurality of fingerprints;receiving, by ...

Importing State Data From A Video Stream Into A Gaming Session

Methods, systems, and apparatuses are described for identifying computer programs/video games that are compatible with a particular content stream and obtaining metadata indicating various different states of the content stream or event depicted in the content stream. The metadata may be supplied as input state information to the computer programs/video games to begin a simulation of the event depicted in the content stream or to initiate a video game session corresponding to the state of the content stream. 1. A method comprising:determining a type of a content item being output;determining, based the type of the content item, a gaming content associated with the content item, wherein the gaming content is executable by a computing device;determining event state information indicating a current event state of the content item; andcausing, based on the event state information, a session of the gaming content to begin using the current event state of the content item.2. The method of claim 1 , wherein the current event state of the content item comprises a scenario in a live event and wherein the event state information comprises statistics associated with the scenario in the live event.3. The method of claim 1 , further comprising:receiving a user input indicating a request for the session of the gaming content to begin, wherein the determining the gaming content is based on the request.4. The method of claim 1 , further comprising:determining the gaming content associated with the content item is not in a list of a plurality of potential gaming contents associated with the content item; andsending a request to cause display of a request to obtain the gaming content.5. The method of claim 4 , further comprising:sending, based on a request to obtain the gaming content, a request to the computing device to download the gaming content from a gaming content repository; andadding the gaming content to the list of the plurality of potential gaming contents available to ...

Systems and methods for querying a distributed inventory of visual data

Systems, methods, and other embodiments described herein relate to using vehicles as mobile observation platforms. In one embodiment, a method includes, in response to receiving, in a selected vehicle that is equipped with at least one camera, a request for locating a target, identifying search parameters from the request that specify the target that is to be identified and a time window for analyzing visual data from the camera. The method includes analyzing the visual data according to the search parameters to identify the target by using at least a machine vision model executing on a processor within the selected vehicle. The visual data includes at least camera data that is currently being acquired. The method includes communicating detection results about whether the visual data includes the target to a remote device from which the request originated.

HYBRID MEDIA VIEWING APPLICATION INCLUDING A REGION OF INTEREST WITHIN A WIDE FIELD OF VIEW

A content delivery and display solution includes a viewing application for displaying immersive images with a region of interest, in addition to conventional fixed-aspect-ratio media. The display can include the layered display of metadata, multiple windows, and images or hotspots embedded into the immersive image. The viewing application can be used for the display of either live or prerecorded images, from local or online sources. 1. A system for the display of media comprising:machine-readable instructions that, when executed by a computing platform, cause the system to provide:a data management service for receiving data comprising requested immersive image media;an application display service for presenting, on a display, a region of interest of the requested immersive image media.2. A system according to wherein the machine-readable instructions claim 1 , when executed by the computing platform claim 1 , cause the system to provide:a playback control service for controlling a speed and a direction of movement of the region of interest within the requested immersive image media presented on the display by the application display service according to user input, the movement of the region of interest comprising spatial movement of the requested region of interest from a first user-selected spatial portion of the requested immersive image media to a second user-selected spatial portion of the requested immersive image media.3. A system according to wherein the machine-readable instructions claim 1 , when executed by the computing platform claim 1 , cause the system to provide: an automatic-control mode wherein a speed and direction of movement of the region of interest within the immersive media image presented on the display by the application display service is pre-determined; and', 'a user-control mode wherein the speed and the direction of movement of the region of interest within the requested immersive image media presented on the display by the application ...

System and method for multi-modal fusion based fault-tolerant video content recognition

A system and a method for multi-modal fusion based fault tolerant video content recognition is disclosed. The method conducts multi-modal recognition on an input video to extract multiple components and their respective appearance time in the video. Next, the multiple components are categorized and recognized respectively via different algorithms. Next, when the recognition confidence of any component is insufficient, a cross-validation with other components is performed to increase the recognition confidence and improve the fault tolerance of the components. Furthermore, when the recognition confidence of an individual component is insufficient, the recognition continues and tracks the component, spatially and temporally when it applies, until frames of high recognition confidence in the continuous time period is reached. Finally, multi-modal fusion is performed to summarize and resolve any recognition discrepancies between the multiple components, and to generate indices for every time frame for the ease of future text-based queries.

Machine Learning in Video Classification

Described herein are systems and methods that search videos and other media content to identify items, objects, faces, or other entities within the media content. Detectors identify objects within media content by, for instance, detecting a predetermined set of visual features corresponding to the objects. Detectors configured to identify an object can be trained using a machine learned model (e.g., a convolutional neural network) as applied to a set of example media content items that include the object. The systems provide user interfaces that allow users to review search results, pinpoint relevant portions of media content items where the identified objects are determined to be present, review detector performance and retrain detectors, providing search result feedback, and/or reviewing video monitoring results and analytics. 1. A computer-implemented method , comprising:receiving, from a user, a search query;classifying frames of a video using a set of detectors each configured to, for each frame of the video, output a confidence score indicating a likelihood that the frame includes one of a set of objects within the frame;identifying sets of consecutive frames of the video, each set of consecutive frames associated with an object of the set of objects and associated with an above-threshold confidence score that the consecutive frames include the object; andmodifying a progress bar interface element to display highlighted locations within the progress bar interface element that correspond to each of the sets of consecutive frames such that the highlighted location for each different object associated with the sets of consecutive frames comprises a different color.2. The method of claim 1 , wherein a set of consecutive frames corresponds to an average confidence score associated with a plurality of detectors that is greater than the threshold confidence score.3. The method of claim 2 , wherein the average confidence score comprises an average of a set of ...

METHODS, SYSTEMS, AND MEDIA FOR DETECTING TWO-DIMENSIONAL VIDEOS PLACED ON A SPHERE IN ABUSIVE SPHERICAL VIDEO CONTENT BY TILING THE SPHERE

Methods, systems, and media for analyzing spherical video content are provided. More particularly, methods, systems, and media for detecting two-dimensional videos placed on a sphere in abusive spherical video content by tiling the sphere are provided. In some embodiments, the method comprises: receiving an identifier of a spherical video content item, wherein the spherical video content item has a plurality of views and wherein the spherical video content item is encoded into a plurality of two-dimensional video frames; selecting a first frame of the plurality of two-dimensional video frames associated with the spherical video content item; dividing the first frame into a plurality of tiles spanning the first frame of the spherical video content item; calculating, for each tile of the plurality of tiles, a probability that the tile includes content of a particular type of content; determining, for each tile, whether the probability exceeds a predetermined threshold; in response to determining, for a particular tile, that the probability exceeds the predetermined threshold, causing the content associated with the tile to be analyzed using a video fingerprinting technique; and in response to determining, using the video fingerprinting technique, that the content associated with the tile matches a reference content item of a plurality of reference content items, generating an indication of the match in association with the identifier of the spherical video content item. 1. A method for analyzing spherical video content , the method comprising:receiving, using a hardware processor, an identifier of a spherical video content item, wherein the spherical video content item has a plurality of views;selecting, using the hardware processor, a frame associated with the spherical video content item;projecting, using the hardware processor, the frame of the spherical video content item to a two-dimensional representation;dividing, using the hardware processor, the two- ...

Learning method and information providing system

The information providing system according to the present invention selects reference information that is appropriate when a user to perform a task related to a nursing care device works on the task, and has a first database that is built on machine learning, using a data structure for machine learning, and the data structure for machine learning includes a plurality of items of training data that each include evaluation target information, including image data, and a meta-ID, the image data includes an image that shows the nursing care device and an identification label for identifying the nursing care device, and the meta-ID is linked with a content ID that corresponds to the reference information.

SYSTEMS AND METHODS FOR EMBEDDING CONTENT INTO VIDEOS

Video information, visual information, and rendering instructions may be obtained. The video information may define spherical video content having a progress length. The spherical video content may define visual content viewable from a point of view as a function of progress through the spherical video content. The visual information may define additional visual content to be presented with the spherical video content. The rendering instructions may define how the additional visual content is to be presented with the spherical video content during playback. Container information defining a container file may be generated. The container information may include the video information, the visual information, and the rendering instructions within a structure corresponding to a type of the container file. A playback of the spherical video content using the container file may include a presentation of the additional visual content with the spherical video content based on the rendering instructions. 1. A system that embeds content into videos , the system comprising: obtain video content, the video content having a progress length, the video content defining visual content as a function of progress through the video content;', 'obtain additional visual content separate from the video content;', 'obtain rendering instructions, the rendering instructions defining how the additional visual content is to be presented with the video content during playback;', 'generate a container file, the container file including the video content, the additional visual content, and the rendering instructions, wherein the additional visual content and the rendering instructions are stored as metadata in the container file, further wherein a playback of the video content using the container file includes a presentation of the additional visual content with the video content based on the rendering instructions; and', 'effectuate storage of the container file in a storage medium., 'one or more ...

EVENT SUMMARIZATION FACILITATED BY EMOTIONS/REACTIONS OF PEOPLE NEAR AN EVENT LOCATION

A method, system and computer program product for event summarization facilitated by emotions/reactions of people near an event location is disclosed. The method includes generating a query based at least in part on reaction information and at least in part on primary video metadata. Based on the query, at least one possible event summarization match for the one or more events is retrieved from a database. 1. A computer-implemented method comprising: primary video metadata that describes objects present within primary video data depicting one or more events; and', 'secondary metadata corresponding to secondary data correlated to the one or more events, wherein the secondary metadata provides reaction information that includes one or more of emotion information and other behavior-specific information;, 'receiving, at an at least one processorgenerating a query based at least in part on the reaction information and at least in part on the primary video metadata;based on the query, retrieving, from a database, at least one possible event summarization match for the one or more events; andstoring the possible event summarization match together with the primary video metadata when the possible event summarization match is confirmed as a correct event summarization.2. The computer-implemented method as claimed in further comprising employing a machine learning module to confirm that the possible event summarization match is the correct event summarization based on further video metadata.3. The computer-implemented method as claimed in wherein the at least one possible event summarization match is a plurality of possible event summarization matches including at least one incorrect event summarization.4. The computer-implemented method as claimed in further comprising employing a machine learning module to confirm that:a first possible event summarization match of the plurality of possible event summarization matches is the correct event summarization; anda second possible ...

Processing Content Based on Natural Language Queries

Disclosed are systems and methods for summarizing content or preparing missed portions of content based on natural language queries. A natural language query can be received. One or more portions of summarized or missed content can be determined based on the natural language query, and transmitted to a user device.

VIDEO ANALYTICS ENCODING FOR IMPROVED EFFICIENCY OF VIDEO PROCESSING AND COMPRESSION

Embodiments are generally directed to video analytics encoding for improved efficiency of video processing and compression. An embodiment of an apparatus includes a memory to store data, including data for video streaming, and a video processing mechanism, wherein the video processing mechanism is to analyze video data and generate video analytics, generate metadata representing the video analytics and insert the generated video analytics metadata into a message, and transmit the video data and the metadata to a succeeding apparatus or system in a video analytics pipeline, the video data being compressed video data. 1. An apparatus comprising:a memory to store data, including data for video streaming; and analyze video data and generate video analytics,', 'generate metadata representing the video analytics and insert the generated video analytics metadata into a message, and', 'transmit the video data and the metadata to a succeeding apparatus or system in a video analytics pipeline, the video data being compressed video data., 'a video processing mechanism, wherein the video processing mechanism is to2. The apparatus of claim 1 , further comprising an imaging mechanism to capture images of a scene and generate the video data.3. The apparatus of claim 2 , wherein the video processing mechanism is to compress the video data prior to transmission of the video data.4. The apparatus of claim 2 , wherein the apparatus is an edge device to provide video imaging.5. The apparatus of claim 4 , wherein the apparatus is one of a smart camera or IP (Internet Protocol) camera.6. The apparatus of claim 1 , wherein the video processing mechanism is further to:receive a compressed video stream from a preceding apparatus or system in the video analytics pipeline; anddecode the compressed video stream to generate the video data for analysis.7. The apparatus of claim 6 , wherein transmitting the video data includes transmitting the received compressed video stream without re- ...

Retrieval device, retrieval method, and computer program product

A retrieval device includes one or more processors. The processors acquire trajectory information indicating a movement trajectory of a target in time-series images. The processors acquire situation information indicating a peripheral situation of the target in the time-series images. The processors acquire a retrieval query containing a movement trajectory and a peripheral situation. The processors retrieve an image matching with the retrieval query among images contained in the time-series images based on the trajectory information and the situation information.

Image Search in Walkthrough Videos

A spatial indexing system receives a set of walkthrough videos of an environment taken over a period of time and receives an image search query that includes an image of an object. The spatial indexing system searches the set of walkthrough videos for instances of the object. The spatial indexing system presents search results in a user interface, displaying in a first portion a 2D map associated with one walkthrough video with marked locations of instances of the object and a second portion with a histogram of instances of the object over time in the set of walkthrough videos. 1. A method comprising:receiving an image search query for a walkthrough video of an environment;searching the walkthrough video to identify portions of frames of the walkthrough video that correspond to the image search query;refining the image search query based on the identified portions of frames of the walkthrough video;searching a set of walkthrough videos of the environment using the refined image search query to identify additional portions of frames within the set of walkthrough videos that correspond to the refined image search query, each of the set of walkthrough videos associated with a timestamp; andgenerating an interface for display including a representation of a floorplan of the environment with marked locations within the representation of the floorplan corresponding to the identified portions of frames of the walkthrough video, and including a histogram, the independent axis of the histogram comprising a timeline corresponding to the timestamps of the set of walkthrough videos, the histogram including bars indicating instances of the identified additional portions of frames within the set of walkthrough videos.2. The method of claim 1 , wherein the received image search query comprises a selection of a portion of a frame of the walkthrough video.3. The method of claim 1 , wherein the received image search query comprises an image of an object or surface.4. The method of ...

EVENT SEARCH SYSTEM, DEVICE, AND METHOD

An event search device includes: a first communication unit configured to receive, from a camera, a plurality of image frames of a surveillance area generated in response to an occurrence of an event; and metadata including time information of the occurrence of the event and location information of an event in the image frames; a user interface configured to receive a search condition for searching for the event, the search condition including an event search area; a screen unit configured to display the event search area on the image frames; and a control unit configured to search for an event satisfying the search condition within the event search area by using the metadata, wherein at least one of a location, a size, and a shape of the event search area is defined through the user interface. 1. An event search system comprising:a sensor configured to detect an occurrence of an event and generate a signal;a camera in response to receiving the signal from the sensor, confiqured to generate a plurality of image frames of a surveillance area and metadata of the image frames, the metadata comprising time information of the occurrence of the event and location information of the event in the plurality of image frames; andan event search device configured to receive the plurality of image frames and the metadata from the camera and search for an event, the event search device comprising:a first communication unit configured to receive the plurality of image frames and the metadata,a user interface configured to receive for searching for the event, the search condition comprising an event search area;a screen unit configured to display the event search area on the image frames; anda control unit configured to search for an event satisfying the search condition within the event search area by using the metadata,wherein at least one of a location, a size, and a shape of the event search area is defined through the user interface.2. The event search system of claim 1 , ...

METHOD AND SYSTEM FOR AUTOMATIC OBJECT-AWARE VIDEO OR AUDIO REDACTION

A system and a method for automatic video and/or audio redaction are provided herein. The method may include the following steps: obtaining an input video; obtaining at least one prespecified object, being a visual or an acoustic object or a descriptor thereof; analyzing the input video, to detect a matched object, being an object having descriptors similar to the descriptors of the at least one prespecified object; and generating a redacted video by removing or replacing the matched objects therefrom. 1. A method of automatic video or audio redaction , the method comprising:obtaining an input video;obtaining at least one prespecified object, being a visual or an acoustic object or a descriptor thereof;analyzing the input video, to detect a matched object, being an object having descriptors similar to the descriptors of the at least one prespecified object; andgenerating a redacted video by removing or replacing the matched objects therefrom.2. The method according to claim 1 , wherein the at least one prespecified object is a visual or acoustic representation of a unique real-life object.3. The method according to claim 2 , wherein said replacing comprises replacing the matched object with an alternative visual or acoustic representation thereof.4. The method according to claim 3 , wherein said alternative visual or acoustic representation comprises a preselected icon or sound.5. The method according to claim 3 , wherein said alternative visual or acoustic representation comprises a degraded visual or acoustic representation thereof.6. The method according to claim 2 , wherein said descriptor includes sounds associated with the object claim 2 , wherein said removing comprises a removal of the said sounds associated with the object.7. The method according to claim 2 , further comprising storing said redacted video on a computer data storage.8. The method according to claim 2 , wherein said obtaining of the input video claim 2 , said obtaining of the at least one ...

IMAGE PRE-PROCESSING METHOD, APPARATUS, AND COMPUTER PROGRAM

The present invention relates to an image pre-processing method, apparatus, and computer program. The present invention relates to a method for processing an arbitrary image, comprising the steps of: dividing the image into scene units including one or more frames; selecting a frame to be searched according to a preset criterion from the scene; identifying an object associated with a preset subject from the frame to be searched; and searching for image corresponding to the object and/or object information and mapping the search result to the object. According to the present invention, the efficiency of an object-based image search can be maximized and resources to be used for image processing can be minimized. 1. A method for processing a video , the method comprising:dividing the video based on a scene comprising at least one frame;selecting a search target frame according to a preset criterion in the scene;identifying an object related to a preset subject in the search target frame; andsearching for at least one of an image or object information corresponding to the object and mapping search results to the object.2. The method as claimed in claim 1 , wherein the dividing of the video based on the scene comprises:identifying a color spectrum of the frame; anddistinguishing between scenes of a first frame and a second frame, which are consecutive, when a change in the color spectrum between the first frame and the second frame is greater than or equal to a preset threshold.3. The method as claimed in claim 1 , wherein the dividing of the video based on the scene comprises:detecting feature information estimated as an object in the frame;determining whether first feature information present in a first frame is present in a consecutive second frame; anddistinguishing between the scenes of the first frame and the second frame when the first feature information is not present in the second frame.4. The method as claimed in claim 1 , wherein the dividing of the video ...

Methods and systems for identifying an object in a video image

A smart phone ( 101 ) captures an image ( 113 ) of a video frame of a movie and sends it to a server ( 107 ) for comparison with data stored in a database ( 112 ) for determining the title of the movie and identifying the particular video frame in the movie. Another database ( 110 ) is interrogated whereby items of merchandise contained in the image of the identified video frame are extracted and displayed on the smartphone along with brand names and a retailer's details. To reduce processing time and the amount of data stored, data relating to only a subset of the total video frames comprising a movie are stored in the database ( 112 ). The user may also request to have displayed on the smartphone's screen ( 102 ), one of several frames preceding or following the captured frame and request information on items of merchandise displayed in such frames.

Method for attaching hash-tag using image recognition process and software distributing server storing software for the same method

A method for attaching a hash tag with image recognition, and a software distributing server recording therein software for performing the method, are provided. When a user creates his or her own post with his or her video to upload to a webpage of social media, the terminal may automatically extract words to be used as the hash tags from the video and insert the extracted words. Because name of object acquired by object recognition on image, or word extracted from the subtitle inserted into the image content are used as the hash tag, the possibility that the image content is searched with the hash tag search greatly increases.

METHOD, ELECTRONIC DEVICE, AND COMPUTER PROGRAM PRODUCT FOR DATA PROCESSING

Embodiments of the present disclosure relate to a method, an electronic device, and a computer program product for data processing. The method for data processing includes: generating, based on a category of a target data content segment, a target tag for the target data content segment; acquiring a reference tag set, a reference tag in the reference tag set being generated based on a category of a historical data content segment; and determining redundancy of the target data content segment based on comparison between the target tag and the reference tag set. In this way, the distribution of a large amount of redundant data from an edge server to a terminal device can be avoided, thereby saving bandwidth, improving delay, and further providing a better user experience for AR/VR content experience. 1. A method for data processing , comprising:generating, based on a category of a target data content segment, a target tag for the target data content segment;acquiring a reference tag set, a reference tag in the reference tag set being generated based on a category of a historical data content segment; anddetermining redundancy of the target data content segment based on comparison between the target tag and the reference tag set.2. The method according to claim 1 , wherein determining the redundancy of the target data content segment comprises:determining, based on the comparison between the target tag and the reference tag set, whether there is a historical data content segment matching the target data content segment in a historical data content segment set corresponding to the reference tag set; anddetermining, when determining that there is no matching historical data content segment, the target data content segment as a non-redundant data content segment.3. The method according to claim 2 , further comprising:sending the target data content segment to a terminal device.4. The method according to claim 2 , further comprising:adding the target tag to the reference ...

SYSTEM AND METHOD FOR OBJECT DETECTION, AND MOVABLE DEVICE

There is a system for object detection, a movable device, and a method for object detection. The system includes: a cloud platform and a movable device communicated with the cloud platform. The cloud platform is configured with an object information database. The movable device is provided with a camera and installed with an object detection client. The camera is configured to capture a surrounding environment to obtain video. The object detection client is downloaded and installed by the movable device from an object detection platform, and is configured to download the object information database from the cloud platform, and perform object recognition processing on the video captured by the camera according to the object information database, obtain object positioning information, and send the object positioning information to the cloud platform. 1. A system for object detection , comprising:a cloud platform, configured with an object information database;a movable device, communicated with the cloud platform, provided with a camera and installed with an object detection client; wherein,the camera is configured to capture a surrounding environment to obtain video;the object detection client is downloaded and installed by the movable device from an object detection platform, and is configured to download the object information database from the cloud platform, and perform object recognition processing on the video captured by the camera according to the object information database, obtain object positioning information, and send the object positioning information to the cloud platform.2. The system according to claim 1 , further comprising an event processing terminal communicated with the cloud platform claim 1 , wherein claim 1 ,the cloud platform is configured to convert the object positioning information into corresponding clue information, and send the clue information to the event processing terminal;the event processing terminal is configured to send an ...

Object Recognition System and Method Using a Search Engine Matching of Index-Mapped Training Feature Description and Input Image Signature

The present invention discloses methods and systems for recognizing an object in an input image based on stored training images. An object recognition system the input image, computes a signature of the input image, compares the signature with one or more stored signatures and retrieves one or more matching images from the set of training images. The matching images are then displayed to the user for further action. 1. An object recognition system using a search engine matching of index-mapped training feature description and input image signature , said system comprising: generate a signature for an input image of an object by an image signature generation unit, whereby the signature of the input image comprises description corresponding to each of one or more feature points in the input image;', 'an index mapping unit configured to create an index mapping based on training feature descriptors and identify a matching image of the set training images by a search engine comparing the signature of the input image with the training feature descriptors using the index mapping; and', 'an option to take at least one of an action on the matching image such as performing a purchase activity, sharing with other users over an online platform or reviewing additional information associated with the matching image., 'a processor, a non-transitory storage element coupled to the processor, encoded instructions stored in the non-transitory storage element, wherein the encoded instructions when implemented by the processor, configure the object recognition system to2. The object recognition system of claim 1 , wherein the object recognition system is a part of at least one of the group comprising a mobile phone claim 1 , a computer and a server.3. The object recognition system of further comprising of a compactor unit configured to compact a size associated with the description of the feature point claim 1 , wherein the size corresponds to memory required to store the description of ...

Annotation method and corresponding device, computer program product and storage medium

The present disclosure relates to a method for annotating a content element of a video stream which has been at least partially received by an electronic device, said method being implemented by said electronic device during a restitution of said video stream. According to the present disclosure, the method comprises:—receiving at least one item of information for identifying an image part in said video stream, comprising a temporal and/or spatial stamping of said image part;—when said identified image part belongs to a portion already restituted of said video stream: analysing said restituted portion, and obtaining a significant content element from said identified image part; searching for the presence of said significant content element in an image, called marked image, of at least one portion remaining to be restituted of said video stream; when a marked image is found, associating an annotation linked to said content item with a marked image; when no marked image is found, restituting said identified image again, while delivering at least one annotation linked to said content element.

VIDEO SEARCHING USING MULTIPLE QUERY TERMS

A method for searching video includes receiving a video query, the video query including a first video query term identifying a first foreground object, a second video query term identifying a second foreground object, and a third video query term identifying a spatiotemporal relationship; searching the video in response to the video query for the first foreground object and the second foreground object within the spatiotemporal relationship; and generating a search result in response to the searching. 1. A method for searching video , the method comprising:receiving a video query, the video query including a first video query term identifying a first foreground object, a second video query term identifying a second foreground object, and a third video query term identifying a spatiotemporal relationship;searching the video in response to the video query for the first foreground object and the second foreground object within the spatiotemporal relationship; andgenerating a search result in response to the searching.2. The method of wherein:the video query includes a fourth video query term identifying a background;wherein the searching includes searching the video in response to the video query for the first foreground object and the second foreground object within the spatiotemporal relationship and within the background.3. The method of wherein:the spatiotemporal relationship includes at least one Boolean operator.4. The method of wherein:the spatiotemporal relationship includes at least one Interval operator.5. The method of wherein:the first foreground object in the first video query term is identified by an image.6. The method of wherein:the first foreground object in the first video query term is identified by text.7. The method of wherein:the background in the fourth video query term is identified by an image.8. The method of wherein:the background in the fourth video query term is identified by text.9. The method of wherein:the search result identifies a ...

DISTRIBUTED VIDEO STORAGE AND SEARCH WITH EDGE COMPUTING

Systems and methods are provided for distributed video storage and search with edge computing. The method may comprise caching a first portion of data on a first device. The method may further comprise determining, at a second device, whether the first device has the first portion of data. The determining may be based on whether the first piece of data satisfies a specified criterion. The method may further comprise sending the data, or a portion of the data, and/or a representation of the data from the first device to a third device. 1. A method for prioritizing video storage resources , comprising:receiving first video data captured by an image sensor of a camera proximate a first device;determining, independent of a specific search query directed to the first video data and dependent on analytics applied to a representation of the first video data, a probability that the first video data meets predefined criteria for interesting video data; andallocating video storage resources for the first video data in an amount that is dependent on the determined probability.2. The method of claim 1 , wherein allocating video storage resources for the first video data comprises allocating a given amount of bandwidth for uploading the first video data to a cloud device claim 1 , the given amount of bandwidth allocated when the determined probability is high being greater than when the determined probability is low.3. The method of claim 1 , wherein allocating video storage resources for the first video data comprises claim 1 , when the determined probability is high claim 1 , storing the first video data in a format with a higher resolution than a resolution of a format in which the first video data is stored when the determined probability is low.4. The method of claim 1 , wherein allocating video storage resources for the first video data comprises storing the first video data for a longer amount of time when the determined probability is high than when the determined ...

SUB-PREDICTION UNIT TEMPORAL MOTION VECTOR PREDICTION (SUB-PU TMVP) FOR VIDEO CODING

Aspects of the disclosure provide a video coding method for processing a current prediction unit (PU) with a sub-PU temporal motion vector prediction (TMVP) mode. The method can include receiving the current PU including sub-PUs, determining an initial motion vector that is a motion vector of a spatial neighboring block of the current PU, performing a searching process to search for a main collocated picture in a sequence of reference pictures of the current PU based on the initial motion vector, and obtaining collocated motion information in the main collocated picture for the sub-PUs of the current PU. The searching process can include turning on motion vector scaling operation for searching a subset of the sequence of reference pictures, and turning off the motion vector scaling operation for searching the other reference pictures in the sequence of reference pictures. 1. A video coding method for processing a current prediction unit (PU) with a sub-PU temporal motion vector prediction (TMVP) mode , comprising:receiving the current PU including sub-PUs;determining a main collocated picture;determining an initial motion vector for said sub-PUs;determining collocated sub-PUs in the main collocated picture according to the initial motion vectors; andobtaining collocated motion information of the collocated sub-PUs in the main collocated picture for the sub-PUs of the current PU.2. The video coding method of claim 1 , wherein the main collocated picture is a temporal collocated picture.3. The video coding method of claim 1 , wherein said collocated sub-PUs are temporal collocated sub-PUs.4. The video coding method of claim 1 , wherein the collocated motion information of the collocated sub-PUs comprises motion vectors and associated reference indexes of said collocated sub-PUs.5. The video coding method of claim 1 , wherein the main collocated picture is determined by an encoder side.6. The video coding method of claim 1 , wherein the main collocated picture is ...

Image display apparatus and method of operating the same

An image display apparatus for automatically determining an image in a video having a best picture of an object selected by a user.

SYSTEM AND METHOD FOR DETECTING REPEATING CONTENT, INCLUDING COMMERCIALS, IN A VIDEO DATA STREAM

Methods and apparatus are provided for detecting potential repeating content, such as commercials, in a video data stream by receiving one or more video data streams, parsing each video data stream into a plurality of segments, creating a representation of each segment such as a segment fingerprint, storing the plurality of segment representations in a database, and identifying any segment representations in the received and parsed one or more video data streams that match segment representations in the database that were previously stored from video data streams that were previously received and parsed. 1. An automated method of detecting potential commercials in a video data stream that contains (i) segments of program type content , and (ii) commercial content , wherein segment representations of the video data stream are maintained in a database , the method comprising:(a) receiving one or more video data streams in a video processing engine;(b) parsing, by the video processing engine, each video data stream into a plurality of segments, each segment having a predefined time length that is less than the time length of an average commercial;(c) creating, by the video processing engine, a representation of each segment;(d) storing the plurality of segment representations in a database, the database including database records, each record including one segment representation and an associated timestamp that represents the time that the segment was aired or streamed;(e) identifying, by a search engine that is in communication with the video processing engine and the database, any segment representations in the received and parsed one or more video data streams that match segment representations in the database that were previously stored from video data streams that were previously received and parsed, wherein the video processing engine designates the content of each of the identified segment representations as being a portion of one or more potential commercials. ...

INTEGRATING VIDEO CONTENT INTO ONLINE PRODUCT LISTINGS TO DEMONSTRATE PRODUCT FEATURES

Techniques are disclosed for identifying and presenting video content that demonstrates features of a target product. The video content can be accessed, for example, from a media database of user-generated videos that demonstrate one or more features of the target product so that a user can see and hear the product in operation via a product webpage before making a purchasing decision. The product functioning videos supplement any static images of the target product and the textual product description to provide the user with additional context for each of the product's features, depending on the textual product description. The user can quickly and easily interact with the product webpage to access and playback the product functioning video to see and/or hear the product in operation. 1. A method for identifying and presenting a product video , the method comprising:identifying, by a product identification module and using a neural network trained to identify a set of one or more products, a target product in a keyframe of one or more user-generated content videos to produce at least one candidate video;labeling, by a feature labeling module and using at least one keyframe of the at least one candidate video, the at least one candidate video with one or more feature keywords extracted from a product description of the target product to produce at least one candidate video labeled with features;selecting, by a video quality module and using a deep learning-based image aesthetics predictor model, at least one best quality candidate video labeled with features from the at least one candidate video labeled with features; andproviding access to at least a portion of the at least one best quality candidate video labeled with features via a product webpage having the one or more feature keywords.2. The method of claim 1 , further comprising extracting claim 1 , by a pre-processing module and using a natural language processor claim 1 , one or more descriptive words from ...

Visual inspection support using extended reality

A device having extended reality capabilities may capture a video feed including one or more video frames depicting an object that is visible in a field of view of the device. The device may provide the one or more video frames to a machine learning model that identifies the object and one or more parts of the object that are depicted in the one or more video frames. The device may obtain positional tracking information that represents a position and an orientation associated with the object relative to a coordinate space that corresponds to the field of view of the device. The device may obtain a workflow including a sequence of content items for visually inspecting the object using the extended reality capabilities of the device. The device may render digital content associated with the workflow using the extended reality capabilities of the device.

Methods and apparatus for identifying objects depicted in a video using extracted video frames in combination with a reverse image search engine

Example systems disclosed herein are to process image frames with a reverse image search engine to generate corresponding search results pages, capture screenshots corresponding respectively to the search results pages, generate base query records corresponding to respective ones of the screenshots that have respective textual information that matches a base search term, the respective ones of the base query records including the base search term and at least portions of the respective textual information from the corresponding screenshots, determine an object search term based on a frequency analysis of the textual information included in the base query records, generate object query records corresponding respectively to ones of the base query records that have respective textual information matching the object search term, and identify a first object depicted in the video based on at least one criteria applied to the object query records.

METHODS, SYSTEMS, AND MEDIA FOR DETECTING AND TRANSFORMING ROTATED VIDEO CONTENT ITEMS

Methods, systems, and media for detecting and transforming rotated video content items are provided. The method comprises: receiving a video having a plurality of frames, wherein the video is associated with a first fingerprint; determining a rotation value associated with at least a portion of the plurality of frames to obtain a plurality of rotation values; determining an overall rotation value associated with the video based on a portion of the plurality of rotation values; determining whether at least one additional fingerprint of the video should be generated based on the overall rotation value; in response to determining that the at least one additional fingerprint of the video should be generated based on the overall rotation value, selecting a rotation transform based on the overall rotation value that rotates the plurality of frames of the video to an initial rotation position; applying the rotation transform to at least a portion of the plurality of frames of the video; generating a second fingerprint that represents the transformed video; and comparing the second fingerprint of the transformed video to a plurality of fingerprints associated with reference videos to determine whether the video corresponding to the transformed video matches one of the reference videos. 1. A computer-implemented method for detecting unauthorized content items , the method comprising:receiving, using a hardware processor, a video having a plurality of frames, wherein the video is associated with a first fingerprint;determining, using the hardware processor, a rotation value associated with at least a portion of the plurality of frames to obtain a plurality of rotation values;determining, using the hardware processor, an overall rotation value associated with the video based on a portion of the plurality of rotation values;determining, using the hardware processor, whether at least one additional fingerprint of the video should be generated based on the overall rotation value; ...

Methods, systems, and media for detecting two-dimensional videos placed on a sphere in abusive spherical video content by tiling the sphere

Methods, systems, and media for analyzing spherical video content are provided. More particularly, methods, systems, and media for detecting two-dimensional videos placed on a sphere in abusive spherical video content by tiling the sphere are provided. In some embodiments, the method comprises: receiving an identifier of a spherical video content item, wherein the spherical video content item has a plurality of views and wherein the spherical video content item is encoded into a plurality of two-dimensional video frames; selecting a first frame of the plurality of two-dimensional video frames associated with the spherical video content item; dividing the first frame into a plurality of tiles spanning the first frame of the spherical video content item; calculating, for each tile of the plurality of tiles, a probability that the tile includes content of a particular type of content; determining, for each tile, whether the probability exceeds a predetermined threshold; in response to determining, for a particular tile, that the probability exceeds the predetermined threshold, causing the content associated with the tile to be analyzed using a video fingerprinting technique; and in response to determining, using the video fingerprinting technique, that the content associated with the tile matches a reference content item of a plurality of reference content items, generating an indication of the match in association with the identifier of the spherical video content item.

DISTRIBUTED VIDEO STORAGE AND SEARCH WITH EDGE COMPUTING

Systems and methods are provided for distributed video storage and search with edge computing. The method may comprise caching a first portion of data on a first device. The method may further comprise determining, at a second device, whether the first device has the first portion of data. The determining may be based on whether the first piece of data satisfies a specified criterion. The method may further comprise sending the data, or a portion of the data, and/or a representation of the data from the first device to a third device. 1. A method , comprising:receiving visual data from a camera at a first device, wherein the first device is proximate to the camera;storing the visual data at a memory of the first device;receiving a search query at a second device;transmitting the search query from the second device to the first device; anddetermining, at the first device, a relevance of the visual data based on the visual data and the search query.2. The method of claim 1 , further comprising:processing the visual data at the first device with a first inference engine to produce an inference data;wherein the determined relevance is based on the inference data and the search query.3. The method of claim 2 , wherein the inference data is a textual representation of the visual data.4. The method of claim 1 , further comprising:transmitting a search result data from the first device to the second device based on the determined relevance; andreceiving the search result data at the second device.5. The method of claim 4 , further comprising:receiving a third visual data from a third camera at a third device, wherein the third device is proximate to the third camera;transmitting the search query from the second device to the third device;determining, at the third device, a relevance of the third visual data based on the third visual data and the search query;transmitting a search result data from the third device to the second device based on the determined relevance; ...

Method, system and apparatus for comparing objects in images

A method of comparing objects in images. A dictionary determined from a plurality of feature vectors formed from a test image and codes formed by applying the dictionary to the feature vectors, is received. The dictionary is based on a modified manifold obtained by determining correspondences for codes using pairwise similarities between codes. Comparison codes are determined for the objects in the images by applying the dictionary to feature vectors of the objects in the images. The objects in the images are compared based on the comparison codes of the objects.

Video-Based Data Collection, Image Capture and Analysis Configuration

In a system for video data capture and sharing client devices may include one or more video cameras and sensors to capture video data and to generate associated metadata. A cloud-based component may receive metadata from the client devices and requests for sharing video data captured by other client devices. Client devices with requested video data are identified by matching their provided metadata to the sharing request and by their response to an image search query for an object of interest specified in the request. 1. A cloud-based system for video data capture and sharing comprising:a plurality of client devices, each client device including one or more video cameras, one or more sensors, a processor, memory, and a cellular communication module, the client device configured to capture video data and to generate metadata associated with the video data and including, at least in part, data derived from the one or more sensors;a cloud-based system in communication with the plurality of client devices, the cloud-based system configured to receive metadata from the plurality of client devices and further configured to receive a request from a first client device for sharing video data captured by one or more other client devices from the plurality of client devices and further configured to identify the one or more other client devices by matching the metadata from a subset of the plurality of client devices to the request, sending to the subset of client devices an image search query for an object of interest specified in the request, and receiving a positive match response from the one or more client devices indicating that the object of interest is found in the video data captured by the one or more identified client devices.2. The system of claim 1 , wherein the cloud-based system is configured to receive metadata from each one of the plurality of client devices periodically claim 1 , upon the capture of a preset amount of video data claim 1 , upon the capture of ...

METHOD AND SYSTEM FOR OBTAINING TEXTURE DATA OF A SPACE

A waveguide apparatus includes a planar waveguide and at least one optical diffraction element (DOE) that provides a plurality of optical paths between an exterior and interior of the planar waveguide. A phase profile of the DOE may combine a linear diffraction grating with a circular lens, to shape a wave front and produce beams with desired focus. Waveguide apparati may be assembled to create multiple focal planes. The DOE may have a low diffraction efficiency, and planar waveguides may be transparent when viewed normally, allowing passage of light from an ambient environment (e.g., real world) useful in AR systems. Light may be returned for temporally sequentially passes through the planar waveguide. The DOE(s) may be fixed or may have dynamically adjustable characteristics. An optical coupler system may couple images to the waveguide apparatus from a projector, for instance a biaxially scanning cantilevered optical fiber tip. 1. A method for generating virtual content in a three-dimensional (3D) physical environment of a user , the method comprising:under control of a hardware processor:analyzing data acquired from a pose sensor to identify a pose of a user;identifying a physical object in a 3D physical world based at least partly on the pose;receiving an indication to initiate an interaction with the physical object;determining a location, orientation, placement, or configuration associated with the physical object;selecting a submenu or a menu or other virtual interface element from a set of available virtual user interfaces associated with the physical object based on the location, orientation, placement, or configuration; andrendering the submenu or a menu or other virtual interface element in a 3D view to the user.2. The method of claim 1 , wherein the pose comprises at least one of: an eye gaze claim 1 , a head pose claim 1 , or a gesture.3. The method of claim 1 , wherein identifying the physical object comprises accessing the passable world model based ...

AUTOMATED DETECTION AND APPROXIMATION OF OBJECTS IN VIDEO

Automated detection and approximation of objects in a video, including: (a) sampling a provided digital video, to obtain a set of sampled frames; (b) applying an object detection algorithm to the sampled frames, to detect objects appearing in the sampled frames; (c) based on the detections in the sampled frames, applying an object approximation algorithm to each sequence of frames that lie between the sampled frames, to approximately detect objects appearing in each of the sequences; (d) applying a trained regression model to each of the sequences, to estimate a quality of the approximate detection of objects in the respective sequence; (e) applying the object detection algorithm to one or more frames in those of the sequences whose quality of the approximate detection is below a threshold, to detect objects appearing in those frames. 1. A method comprising:(a) sampling a provided digital video, to obtain a set of sampled frames;(b) applying an object detection algorithm to the sampled frames, to detect objects appearing in the sampled frames;(c) based on the detections in the sampled frames, applying an object approximation algorithm to each sequence of frames that lie between the sampled frames, to approximately detect objects appearing in each of the sequences;(d) applying a trained regression model to each of the sequences, to estimate a quality of the approximate detection of objects in the respective sequence by the object approximation algorithm;(e) applying the object detection algorithm to one or more frames in those of the sequences whose quality of the approximate detection is below a threshold, to detect objects appearing in those frames;(f) defining multiple sub-sequences that are different from the sequences, wherein each of the multiple sub-sequences comprises frames that lie between every adjacent pair of frames to which the object detection algorithm has been applied in steps (b) and (e); and(g) re-applying the object approximation algorithm to each ...

ELECTRONIC DEVICE AND CONTROL METHOD THEREFOR

An electronic device is disclosed. The electronic device comprises a memory for storing a content, and a processor for: acquiring a probability value for each of a plurality of objects included in each of a plurality of frames configuring the stored content; grouping the plurality of objects into at least one group according to a correlation value between the plurality of objects, the correlation value being obtained on the basis of the acquired probability value; counting, for each of a plurality of frames for each group, a case where the acquired probability value is equal to or greater than a preconfigured threshold value; and acquiring a summary content on the basis of a result of the counting. 1. An electronic device comprising:a memory storing a content; anda processor configured to:obtain a probability value of each of a plurality of objects included in each of a plurality of frames configuring the stored content;group the plurality of objects into at least one group in accordance with a correlation value between the plurality of objects based on the obtained probability value; andcount cases where the obtained probability value is equal to or greater than a predetermined threshold value for each of the plurality of frames for each group, and obtain a summary content based on the counted result.2. The device according to claim 1 , wherein the processor is configured to:obtain the correlation value between the plurality of objects by comparing a difference of the probability values between the plurality of objects for each of the plurality of frames; andgroup objects having the obtained correlation value equal to or greater than a predetermined threshold value into one group.3. The device according to claim 1 , wherein the processor is configured to:obtain a main frame for each group based on the counted result and obtain the summary content based on the main frame included in the predetermined group.4. The device according to claim 3 , further comprising:a ...

Systems and methods for location-based information processing with augmented reality (ar) system

Systems, methods, and non-transitory computer readable media are provided for displaying and annotating map-based geolocation data at an augmented reality (AR) headset. Users with access to the map-based geolocation data can create or confirm annotations for geospatial data that may be sent to the server computer and transmitted back to the headset of the user as well as different AR headsets associated with other users.

Method and apparatus for obtaining video public opinions, computer device and storage medium

The present disclosure provides a method and apparatus for obtaining video public opinions, a computer device and a storage medium, wherein the method comprises: obtaining an information source and a monitored entity; obtaining real-time stream data from the information source; for each video in the real-time stream data, performing predetermined content recognition respectively for the video to obtain a recognition result; determining whether the video matches with the monitored entity according to the recognition result, and generating and storing public opinion information corresponding to the video if the video matches with the monitored entity. The solution of the present disclosure can be employed to obtain video-like public opinion information.

PROVIDING RELEVANT COVER FRAME IN RESPONSE TO A VIDEO SEARCH QUERY

The present disclosure is directed towards methods and systems for providing relevant video scenes in response to a video search query. The systems and methods identify a plurality of key frames of a media object and detect one or more content features represented in the plurality of key frames. Based on the one or more detect content features, the systems and methods associate tags indicating the detected content features with the plurality of key frames of the media object. The systems and methods, in response to receiving a search query including search terms, compare the search terms with the tags of the selected key frames, identify a selected key frame that depicts at least one content feature related to the search terms, and provide a preview image of the media item depicting the at least one content feature. 1. A method of identifying an image to represent relevant content features within a digital video , the method comprising:analyzing, by at least one processor, a media object comprising a plurality of frames of video content to determine a plurality of key frames within the video content;identifying, by the at least one processor, a content feature depicted in each key frame of the plurality of key frames;associating, by the at least one processor, a tag with each key frame of the plurality of key frames, wherein a given tag corresponds to a given content feature depicted in a given key frame of the plurality of key frames;determining to provide the media object as a search result to a search query received from a client device;selecting a key frame from the plurality of key frames as a preview image for the media object based on the search query relating to a particular content feature depicted in the selected key frame as indicated by a particular tag associated with the selected key frame; andproviding, to the client device, the preview image for the media object in response to the search query.2. The method of claim 1 , wherein:the search query ...

VALIDATING OBJECTS IN VOLUMETRIC VIDEO PRESENTATIONS

A method for validating objects appearing in volumetric video presentations includes obtaining a volumetric video presentation depicting a scene, wherein the volumetric video presentation is associated with a metadata file containing identifying information for the scene, identifying user-generated content that depicts the scene, by matching metadata associated with the user-generated content to the metadata file associated with the volumetric video presentation, comparing a first object appearing in the volumetric video presentation to a corresponding second object appearing in the user-generated content, assigning a score to the first object based on the comparing, wherein the score indicates a probability that the first object has not been manipulated, and altering the volumetric video presentation to filter the first object from the volumetric video presentation when the score falls below a threshold. 1. A method comprising:obtaining, by a processor, a volumetric video presentation depicting a scene, wherein the volumetric video presentation is associated with a metadata file containing identifying information for the scene;identifying, by the processor, user-generated content that depicts the scene, by matching metadata associated with the user-generated content to the metadata file associated with the volumetric video presentation;comparing, by the processor, a first object appearing in the volumetric video presentation to a corresponding second object appearing in the user-generated content;assigning, by the processor, a score to the first object based on the comparing, wherein the score indicates a probability that the first object has not been manipulated; andaltering, by the processor, the volumetric video presentation to filter the first object from the volumetric video presentation when the score falls below a threshold.2. The method of claim 1 , wherein the identifying information comprises a location of the scene.3. The method of claim 1 , wherein the ...

CAMERA-TO-CAMERA INTERACTIONS, SYSTEMS AND METHODS

Systems and methods of delegating media capturing functionality from one device to another are presented. A first device configured with an object recognition engine captures a media representation of an environment and identifies an object within that environment. Then based on matched object traits from a database, the engine selects a delegation rules set, and delegates certain media capturing functionality to a second device according to the selected delegation rules set. 124-. (canceled)25. A multi-camera command system comprising:a first camera associated with a real-world scene;a second, distinct camera associated with the real-world scene; and storing in the at least one memory a digital representation of the real-world scene captured by the first camera, wherein the digital representation includes motion data of an object in the real-world scene;', 'obtaining at least one object trait associated with the object based on the digital representation including the motion data;', 'selecting a delegation rule set based on automatic recognition of the at least one object trait, wherein the delegation rule set comprises at least one command for the second camera; and', 'enabling the second camera, via transmitting the at least one command to the second camera, to execute the at least one command, including capturing image data by the second camera and storing the image data in the at least one memory., 'at least one computing device communicatively coupled with the first and the second cameras, and having at least one processor and at least one non-transitory computer readable memory, and upon the at least one processor executing software instructions stored in the at least one memory, performing the operations of26. The system of claim 25 , wherein the real-world scene comprises at least a real-world environment.27. The system of claim 25 , wherein the real-world scene comprises at least a portion of a virtual environment.28. The system of claim 27 , wherein the ...

ACTIVITY RECOGNITION SYSTEMS AND METHODS

An activity recognition system is disclosed. A plurality of temporal features is generated from a digital representation of an observed activity using a feature detection algorithm. An observed activity graph comprising one or more clusters of temporal features generated from the digital representation is established, wherein each one of the one or more clusters of temporal features defines a node of the observed activity graph. At least one contextually relevant scoring technique is selected from similarity scoring techniques for known activity graphs, the at least one contextually relevant scoring technique being associated with activity ingestion metadata that satisfies device context criteria defined based on device contextual attributes of the digital representation, and a similarity activity score is calculated for the observed activity graph as a function of the at least one contextually relevant scoring technique, the similarity activity score being relative to at least one known activity graph. 128-. (canceled)29. An activity recognition method using at least one processor and at least one memory , the method comprising:receiving a digital representation comprising at least video data of an observable activity of at least one object;generating from the digital representation, using at least one feature detection algorithm, a plurality of features related to the observable activity;establishing an observed activity data object based on the plurality of features;determining a similarity for the observed activity data object relative to at least one known activity data object based on a context relevant to the plurality of features;accessing an activity recognition results set based on the similarity; andtriggering an action based on the activity recognition results set.30. The method of claim 29 , wherein the context comprises location data.31. The method of claim 29 , wherein a known activity associated with the at least one known activity data object ...

Activity recognition systems and methods

An activity recognition system is disclosed. A plurality of temporal features is generated from a digital representation of an observed activity using a feature detection algorithm. An observed activity graph comprising one or more clusters of temporal features generated from the digital representation is established, wherein each one of the one or more clusters of temporal features defines a node of the observed activity graph. At least one contextually relevant scoring technique is selected from similarity scoring techniques for known activity graphs, the at least one contextually relevant scoring technique being associated with activity ingestion metadata that satisfies device context criteria defined based on device contextual attributes of the digital representation, and a similarity activity score is calculated for the observed activity graph as a function of the at least one contextually relevant scoring technique, the similarity activity score being relative to at least one known activity graph.

METHODS AND SYSTEMS FOR SHARING A USER INTERFACE OF A SEARCH ENGINE

Systems and methods are described for sharing a user interface between users. The system transmits live video simultaneously to a plurality of users. Then, the system determines a subset of the plurality of users, such that the subset includes two users that have a predetermined relationship. Then, during playback of the video, the system detects an object in a frame of the video corresponding to preferences of the first user. In response, the system determines whether the second user is researching information related to the object during playback of the video. If the second user is researching such information, the system streams a mirror image of a user interface with which the second user is performing the researching to the first user. 151.-. (canceled)52. A method comprising:receiving an indication of a content item displayed on a user interface of a first user device;analyzing a displayed object of the content item to generate a metadata keyword associated with the object;receiving a search query that includes the metadata keyword from a second user device; and transmitting a command to generate a layout on a user interface of the second user device; and', 'transmitting a mirrored image of the user interface of the first user device to be displayed in the layout generated on the second user device., 'in response to receiving the search query53. The method of claim 52 , further comprising:performing a vector analysis to identify distinct objects of the content item that are displayed on the user interface of the first user device; andselecting an object, from the distinct objects, based on the vector analysis performed to analyze and generate the metadata keyword.54. The method of claim 53 , wherein vector analysis includes comparing the distinct objects of the content item with objects stored in a graphical template to determine a match.55. The method of claim 52 , wherein the object is a depiction of a person claim 52 , and analyzing the object comprises ...

Method and system for generating map data from an image

A waveguide apparatus includes a planar waveguide and at least one optical diffraction element (DOE) that provides a plurality of optical paths between an exterior and interior of the planar waveguide. A phase profile of the DOE may combine a linear diffraction grating with a circular lens, to shape a wave front and produce beams with desired focus. Waveguide apparati may be assembled to create multiple focal planes. The DOE may have a low diffraction efficiency, and planar waveguides may be transparent when viewed normally, allowing passage of light from an ambient environment (e.g., real world) useful in AR systems. Light may be returned for temporally sequentially passes through the planar waveguide. The DOE(s) may be fixed or may have dynamically adjustable characteristics. An optical coupler system may couple images to the waveguide apparatus from a projector, for instance a biaxially scanning cantilevered optical fiber tip.