Computer-implemented method for tracking an object, device for tracking an object, and system for tracking an object

A method 500 for tracking an object, such as an vehicle (Fig.4) or person, comprising: receiving video feed 502 from a camera (306, Fig.3); determining a probability of existence (PoE) of an object in a video frame 504; determining whether the PoE falls below a probability threshold 506; determining whether the object is in close proximity to the camera through a set of close-range criteria 508; and adjusting the PoE if the close-range criteria are met 510. Adjusting the PoE may be based upon a difference between a previous frame’s adjusted PoE and the current frame’s PoE (604, Fig.6A). A probability decremental value, that reduces the PoE of an object, may be determined based on the determination of whether the object fulfils the close-range criteria. If the object is near to the camera the PoE is decreased by a first value, if the object is far away from the camera the PoE is decreased by a second larger value. Closer objects are therefore given a higher probability of existence. If the ...

Data processing apparatus and method

A method of data processing comprises receiving an image 400 of a user in an environment, determining a region 402 of the environment in the image in which motion of the user is expected, and identifying one or more attributes of a detected object 300-303 in the image, a portion of said object being within the determined region. An appropriate predetermined process is then selected and performed. The motion of the user is associated with interactive content experienced by the user, such as virtual reality (VR) content, and the determined region may be a play area for the VR system. The attribute(s) may comprise a classification of the detected object and/or one or more physical characteristics of the detected object such as hardness, weight, fragility, etc. (see figure 5). The predetermined process may comprise causing a visual indicator 603A-C to be output to indicate to the user the physical characteristics of the detected object(s) and/or to remove the detected object(s) from the play ...

Event detector training

Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for training an event detector. The methods, systems, and apparatus include actions of obtaining frames of a video, determining whether an object of interest is detected within the frames, determining whether motion is detected within the frames, determining whether the frames correspond to motion by an object of interest, generating a training set that includes labeled inter-frame differences based on whether the frames correspond to motion by an object of interest, and training an event detector using the training set.

VIDEO CAMERA AND DEVICE FOR AUTOMATIC PRE-RECORDED VIDEO OR AUDIO REDACTION OF OBJECTS

A video camera and a device for automatic video or audio redaction are provided herein. The device may include: an image capturing device configured to obtain an input video having a plurality of video frames; a communication interface configured to obtain descriptors of at least one prespecified object, being a visual or an acoustic object; a computer processor configured to: obtain a detected object in the video frame, being an object having descriptors similar to the descriptors of the at least one prespecified object; and generate a redacted video by removing or replacing the matched objects therefrom; and record the redacted video on a data storage device or transmit the redacted video via a video management server, wherein the computer processor is configured to generate the redacted video prior to storing the redacted video on the data storage device or transmitting the redacted video via the video management server.

Technologies for audiovisual communication using interestingness algorithms

Technologies for audiovisual communication include an audiovisual server and a number of audiovisual client devices, including a presenter device and a number of audience devices. Each audience device captures an audiovisual stream and transmits the audiovisual stream to the audiovisual server. Each audience device also captures sensor input data such as eye tracking data or facial expression data and transmits abstracted sensor input data to the audiovisual server. The abstracted sensor input data may be based on the captured audiovisual stream. The audiovisual server determines an interestingness rating associated with each audience device based on the sensor input data, and selects one or more audiovisual streams based on the interestingness ratings. The audiovisual server transmits the selected audiovisual streams to the presenter device. The audiovisual server may update the interestingness rating algorithm based on feedback from the presenter device or the audience devices. Other ...

Systems and methods for door error detection

Systems and methods for monitoring an operation of a door of a public transportation vehicle are disclosed. In an embodiment, the system includes an optical sensor unit and a control unit. The optical sensor is arranged at a distance from the door and configured to record a movement of the door during an opening and/or a closing. The control unit is configured to (1) determine a position of a reference point of the door based on the recorded movement of the door, (2) determine a parameter of the movement of the door during the movement based on the determined position of the reference point, (3) determine a deviation of the parameter of the movement from a predetermined/allowed range of values of the parameter, and (4) determine an error in the operation of the door based on the determined deviation.

Learning system for convolutional neural networks to improve accuracy of object detection in new environments

A method for fine-tuning a convolutional neural network (CNN) and a sensor system based on a CNN are disclosed. The sensor system may be deployed at a deployment location. The CNN may be fine-tuned for the deployment location using sensor data, e.g., images, captured by a sensor device of the sensor system at the deployment location. The sensor data may include objects that are not present in an initial data set used for training the CNN. The sensor data and the initial data set may be input to the CNN to train the CNN and obtain fine-tuned parameters of the CNN. The CNN can thus be fine-tuned to the deployment location of the sensor system, with an increased chance of recognizing objects when using the sensor system and the CNN to recognize objects in captured sensor data.

VIDEO SURVEILLANCE SYSTEM AND VIDEO SURVEILLANCE METHOD

A video surveillance system includes: a detection unit that detects a predetermined event on the basis of an image captured by a first imaging apparatus; and a control unit that controls a second imaging apparatus such that the second imaging apparatus captures an image of a predetermined position after the detection of the predetermined event.

Generative adversarial network implemented digital script modification

A system, method, and computer program product for implementing digital script modification is provided. The method includes generating image sequences associated with textual content of a digital story. Multiple contextual dimensions are identified within the textual content and a group of dimensions are selected. The image sequences in combination with the group of dimensions are expanding or contracted and image sequences are altered based on detected interactions with the group of dimensions. Dimensions are extracted from the group of dimensions during presentation of the digital story and a scriptwriter is enabled to modify the dimensions. The image sequences are modified and a hardware interface device is enabled to interact with various image sequences and alter the multiple contextual dimensions. The textual content of the digital story is dynamically altered.

IMPROVED MASKING OF OBJECTS IN AN IMAGE STREAM

A method (200) of masking or marking an object in an image stream is provided, including: generating one or more output image streams (114) by processing (220) an input image stream (110) capturing a scene, including discarding pixel information about the scene provided by pixels (113) of the input image stream, such that the discarded pixel information about the scene is not included in any output image stream; and detecting (230) an object in the scene using the discarded pixel information, wherein generating the one or more output image streams includes masking or marking (250) the detected object in at least one output image stream once deciding that the object is at least partially visible within this at least one output image stream. A corresponding device, computer program and computer program product are also provided.

Спортивный хронометраж на основе системы камер

Изобретение относится к области вычислительной техники. Технический результат направлен на повышение точности определения времени прохождения объекта. Способ определения времени прохождения объекта через линию хронометража, проходящую поперек спортивной дорожки, включающий: прием видеокадров, определение информации о глубине, обнаружение одного или более объектов в видеокадрах с использованием алгоритма обнаружения объектов, определение по меньшей мере одного обнаруженного объекта по меньшей мере в части видеокадров, при этом по меньшей мере один обнаруженный объект проходит через линию хронометража, проходящую поперек спортивной дорожки, причем линия хронометража определена виртуальной плоскостью, расположенной поперек дорожки на заранее заданном расстоянии от системы камеры, и определение прохождения объекта основано на координатах виртуальной плоскости и информации о глубине, и определение времени прохождения на основе одного или более моментов времени одного или более видеокадров, содержащих ...

Video and image chart fusion systems and methods

An imaging device (e.g. 360-view camera system and/or an infrared camera) provides images of an environment. An object is detected within the image and a portion of the image associated with the object is superimposed on a chart projected on a surface. A representation of the object (e.g. an icon or image element extracted from the image) is superimposed onto the projected chart at a location corresponding to a geographical position of the object. The resulting fused image corresponds to an area surrounding a mobile structure as viewed from a synthetically elevated viewpoint. A logic device determines a distance between the mobile structure and object and determines the location on the projected chart that describes that geographical position of the object based on the synthetically elevated viewpoint and the camera viewpoint. The logic device may also correct an orientation of the received image.

Packet priority for visual content

A video stream is obtained that includes at least one video stream image. The video stream is to be sent to one or more subscribers. Based on the obtaining the video stream, non-pixel data is retrieved. A first critical object in the video stream is determined. The determination is based on the obtaining the video stream and further based on the non-pixel data. The first critical object is represented by a first plurality of pixels. The first plurality of pixels is located within the at least one video stream image. A first prioritization of one or more network packets of the video stream is generated. The one or more network packets contain the first plurality of pixels. The first prioritization is generated based on determining the first critical object in the video stream.

Positional analysis using computer vision sensor synchronization

System and techniques for positional analysis using computer vision sensor synchronization are described herein. A set of sensor data may be obtained for a participant of an activity. A video stream may be captured in response to detection of a start of the activity in the set of sensor data. The video stream may include images of the participant engaging in the activity. A key stage of the activity may be identified by evaluation of the sensor data. A key frame may be selected from the video stream using a timestamp of the sensor data used to identify the key stage of the activity. A skeletal map may be generated for the participant in the key frame using key points of the participant extracted from the key frame. Instructional data may be selected using the skeletal map. The instructional data may be displayed on a display device.

Adaptive panoramic video streaming using composite pictures

Innovations in stream configuration operations and playback operations for adaptive streaming of panoramic video are described. The innovations include features of adaptive streaming of panoramic video with composite pictures. For example, a stream configuration tool splits an input picture of panoramic video into multiple sections and creates multiple composite pictures. A composite picture includes one of the sections as well as a low-resolution version of the input picture. A playback tool reconstructs one or more composite pictures. Under normal operation, the playback tool can use the reconstructed section(s) of the composite picture(s) to render high-quality views of the panoramic video. If the view window dramatically changes, however, or if encoded data for a section is lost or corrupted, the playback tool can use the low-resolution version of the input picture to render lower-quality details for views of the panoramic video, without disruption of playback.

DISPLAY ASSISTANT DEVICE HAVING A MONITORING MODE AND AN ASSISTANT MODE

A display assistant device comprises a display, a camera, a speaker, microphones, a processor and memory. The memory stores programs comprising instructions that, when executed by the processor, enable a plurality of modes of the display assistant device. The modes include a monitoring mode and an assistant mode. In the monitoring mode, the device is configured to perform a remote monitoring function in which first video captured by the camera is streamed to a remote server system for monitoring uses. The monitoring uses include transmission of the first video to remote client devices authorized to access the first video. In the assistant mode, the device is configured to perform a second plurality of functions that excludes the monitoring function and includes a video communication function in which second video captured by the camera is transmitted to second devices participating in a video communication with a first user of the device.

Video training data for machine learning detection/recognition of products

Described herein are systems, apparatus, methods and computer program products configured for image detection/recognition of products. The disclosed systems and techniques utilize video data to provide the necessary number of images and view angles needed to train a machine learning product detection/recognition system to recognize a specific product within later provided images. In various embodiments, a user may provide video data and the video data may be transformed in a manner that may aid in training of the machine learning system.

Hybrid representation of a media unit

Systems, and method and computer readable media that store instructions for generating a hybrid representation of a media unit.

Method and System for Zero-Shot Cross Domain Video Anomaly Detection

Embodiments of the present invention disclose a method and system for performing video anomaly detection by training neural networks. The method includes collecting a video of one or more digital images from a source domain. The method includes obtaining a set of images of foreground objects present in the video. In addition, the method includes training of a first neural network to predict frames for the one or more digital images in the video. The first neural network is trained using a future frame prediction module that predicts frames for the one or more digital image. The method includes training of a second neural network to classify the predicted frame as normal and to classify the synthesized pseudo anomaly frame as abnormal. The method includes performing video anomaly detection based on training of the first neural network and the second neural network.

MAINTAINING FIXED SIZES FOR TARGET OBJECTS IN FRAMES

Techniques are provided for processing one or more frames. For example, a region of interest can be determined in a first frame of a sequence of frames. The region of interest in the first frame includes an object having a size in the first frame. A portion of a second frame of the sequence of frames (occurring after the first frame in the sequence of frames) can be cropped and scaled to cause the object in the second frame to have a same size (and in some cases a same location) as the object in the first frame.

DISPLAY DEVICE, FISH COUNTING SYSTEM PROVIDED THEREWITH, AND DISPLAY CONTROL PROGRAM

A display device is used for a number-of-fish counting system for counting the number of fish. The display device is provided with a display unit that displays a plurality of selectable instruction items on a main screen. The plurality of instruction items include a recording instruction item that instructs a processing device of the number-of-fish counting system to execute or stop recording of video of fish, and an analysis instruction item that instructs the processing device to count the number of the fish by analyzing the fish on the basis of the recorded video.

3D MEDIA ELEMENTS IN 2D VIDEO

A method for processing media content includes aggregating, by at least one hardware processor, a plurality of three-dimensional (3D) images to obtain a 3D volume representation of a plurality of two-dimensional (2D) images of media content. A 3D void space associated with the plurality of 2D images is segmented based on the 3D volume representation into a plurality of 3D void segments. A media element is inserted into at least one 3D void segment of the plurality of 3D void segments. At least one 2D image of the plurality of 2D images is modified to include the at least one 3D void segment.

Information completion apparatus, method and program

A technique for interpolating positional information of a target in an image of a frame in which positional information of the target has not been acquired. An information interpolation device includes: a target information acquisition unit 4 acquiring target information that is information related to a target in an image of each frame composing an input video; an indicator determination unit 5 determining, based on the target information, an indicator indicating validity as a starting frame for each frame, the starting frame starting predetermined image processing on a target; a starting frame determination unit 6 determining a starting frame based on the determined indicator; and a target information interpolation unit 7 interpolating, when a frame in which positional information of a target is not included in target information exists among frames within a predetermined number from the determined starting frame, positional information of the target of the frame that does not include ...

MOBILE APPLICATION CAMERA ACTIVATION AND DE-ACTIVATION BASED ON PHYSICAL OBJECT LOCATION

A device determines that a physical object is to be presented, by a presenter, in a streaming video. The device identifies a set of physical objects that are confirmed as having been delivered to a physical address of the presenter, accesses an image recognition model that is trained using the set of physical objects, and applies the image recognition model to the streaming video. The device determines, based on output from the image recognition model, whether the streaming video includes the physical object. In response to determining that the physical object is part of the set of physical objects, the device permits the physical object to be presented in the streaming video, and in response to determining the physical object is not part of the set of physical objects, the device blocks the physical object from being presented in the streaming video.

METHOD AND APPARATUS FOR IDENTIFYING PRODUCT THAT HAS MISSED INSPECTION, ELECTRONIC DEVICE, AND STORAGE MEDIUM

The disclosure provides a method and an apparatus for recognizing product detection missed, an electronic device, and a storage medium, and relates to a field of computer technologies and more particularly to a field of artificial intelligence technologies such as computer vision, natural language processing, image processing, and deep learning. The detailed implementation includes: obtaining a surveillance video; generating product detection results by inputting video frames of the surveillance video into a product detection model; generating detecting action recognition results by inputting the video frames of the surveillance video into an action recognition model; and determining whether product detection is missed based on the product detection results and the detecting action recognition results. In this way, it may be quickly determined whether detection of a product in an industrial production line is missed, with a high detection accuracy.

REGISTRATION FOR AUGMENTED REALITY SYSTEM FOR VIEWING AN EVENT

FRAMES ALIGNMENT IN VIDEO PROCESSING USING SELF-ATTENTION

Validation of procedures in a decontamination process

A method for validating a decontamination procedure performed on a medical device using a decontamination system. The method comprises: capturing a video stream of a work area 34 in which the decontamination procedure is carried out by a user; analysing the video stream to identify one or more decontamination events in the video stream that correspond with the decontamination procedure being correctly performed on the medical device; determining, based on the or each identified decontamination event, if the decontamination procedure has been completed; and upon determining that the decontamination procedure has been completed, causing a corresponding indication to be provided to the user. The decontamination event can comprise the application of a decontaminating composition to the medical device. The method may include alerting the user to potential errors and/or logging data to provide an audit trail. Preferably the analysis of the video stream is with a trained neural network. There ...

Validation of procedures in a decontamination process

Video and image chart fusion systems and methods

Display assistant device having a monitoring mode and an assistant mode

A display assistant device comprises a display, a camera, a speaker, microphones, a processor and memory. The memory stores programs comprising instructions that, when executed by the processor, enable a plurality of modes of the display assistant device. The modes include a monitoring mode and an assistant mode. In the monitoring mode, the device is configured to perform a remote monitoring function in which first video captured by the camera is streamed to a remote server system for monitoring uses. The monitoring uses include transmission of the first video to remote client devices authorized to access the first video. In the assistant mode, the device is configured to perform a second plurality of functions that excludes the monitoring function and includes a video communication function in which second video captured by the camera is transmitted to second devices participating in a video communication with a first user of the device.

Preprocessing sensor data for machine learning

A method includes receiving, with a computing device, a configuration file and a client request to apply a machine learning model to a set of data from a sensor. The method includes performing, with the computing device, preprocessing on the set of data from the sensor based on the configuration file to generate preprocessed data. The method includes sending, with the computing device, a call to a model server to apply the machine learning model to the preprocessed data.

Video processing device

An image processing device includes a camera interface connectable to a camera configured to capture a video of a worker in a work area, an output interface connectable to a display device that is viewable from the work area, a memory that stores task information about a task to be performed by the worker, and a processor configured to determine a position and a posture of the worker in the work area based on the captured video, determine whether the worker has performed the task properly based on the task information stored in the memory and the determined position and posture of the worker, upon determining that the worker has not performed the task properly, extract from the video a first part showing the task that has been performed by the worker, and control the output interface to output the first part to the display device.

Detection device, detection method, and detection program

A detection device includes a processing circuit that is configured to acquire an imaging video of a user to be authenticated, specify categories of micro-expressions of the user using the acquired imaging video, and determine whether an appearance pattern of each specified category for the micro-expressions is normal.

Information processing apparatus, video synopsis method, and storage medium for video synopsis

An information processing apparatus includes a specification unit, a determination unit, and a generation unit. The specification unit specifies a relationship between a plurality of objects detected in a video. The determination unit determines arrangement of motion trajectories of the plurality of objects, the relationship between which has been specified by the specification unit, while maintaining a relative appearance order in the video and avoiding an overlap of the motion trajectories in a temporal direction. The generation unit generates a summary video of the video based on the arrangement determined by the determination unit.

TRANSPORT RELOCATION

An example operation may include one or more of detecting, by a parking processing node, a parking of a transport at an event location, accessing, by the parking processing node, a device of a transport occupant to determine a transport pickup location and a pickup time based on a conclusion of an event, detecting, by the parking processing node, from the device of the transport occupant at least one modification of the pickup location and the pickup time made based on an updated conclusion of the event, and sending a command to move the transport to a location proximate to the event based on the modified pickup location and the modified pickup time.

MULTIMEDIA INFORMATION PROCESSING METHOD, APPARATUS, ELECTRONIC DEVICE, AND MEDIUM

A method for processing media content includes: receiving a selection on a media segment in a media content, where the media content comprises at least two media segments; determining a target media segment based on the selection; and receiving a request for processing the target media segment, in response to a triggering on the target media segment; wherein in response to the request including a request for re-capturing processing, the method further includes: re-capturing a plurality of media segments; and replacing the target media segment with the at least one media segment of the plurality of media segments.

Validation of procedures in a decontamination process

A method for validating a decontamination procedure performed using a decontamination system, the system comprising a first product for use in a first step and a second product for use in a second step. The method comprises: capturing a video stream of a work area 34 in which the decontamination procedure is carried out by a user; analysing the video stream to identify when the first product is present in the work area 34 and when the second product is present in the work area 34; determining, based on said identification, that the first and second products have been presented in the correct order in the decontamination procedure; and causing a corresponding indication to be provided to the user. The method may include alerting the user to potential errors and/or logging data to provide an audit trail. Preferably the analysis of the video stream is with a trained neural network. There is also an apparatus comprising: a camera system 32; an output device for providing audio, textual and/ ...

System and method of estimating vital signs of user using artificial intelligence

Disclosed is a system and processor-implemented method of estimating one or more vital signs of a user based on a video of the user by using artificial intelligence. It comprises extracting a plurality of face frames and one or more time stamps from the video of the user, determining at least one region of interest (ROI) in the plurality of face frames using a histogram of oriented gradients (HOG) and extracting a plurality of health indicator signals by detecting volumetric changes in a peripheral blood circulation in the at least one ROI based on a remote photoplethysmography (RPPG). One or more vital signs of the user based on the plurality of health indicator signals and the one or more time stamps may then be estimated.

Activity identification method and apparatus

Message output apparatus, learning apparatus, message output method, learning method, and program

Provided are a message output apparatus, a learning apparatus, a message output method, a learning method, and a program that allow a user to feel as if communication is being performed. An input section inputs, to a learned machine learning model that has been learned using learning data that includes learning input data including a plurality of consecutive frames of learning images and teaching data including a message associated with the learning input data, target input data including at least a plurality of consecutive frames of target images. A message identification section identifies a message according to output produced when the target input data is input to the machine learning model. A message output section outputs the identified message.

Speech Activity Detection Using Dual Sensory Based Learning

A dual sensory input speech detection method includes receiving, at a first time, a first video image input of a conference participant of the video conference and a first audio input of the conference participant; communicating the first video image input to the video conference; identifying the first video image input as a first facial image of the conference participant; determining, based on the first facial image, the first video image input indicates the conference participant is in a speaking state; identifying the first audio input as a first speech sound; determining, while in the speaking state, the first speech sound originates from the conference participant; and communicating the first audio input to an audio output for the video conference.

Video quality evaluation method and apparatus, device, and storage medium

A video quality evaluation method comprises acquiring an image sequence and audio information by decoding a to-be-evaluated video, wherein the to-be-evaluated video is non-offending video; extracting an action feature vector and a face feature vector from the image sequence, and extracting an audio feature vector from the audio information; constructing a video feature vector according to at least one of the action feature vector, the face feature vector and the audio feature vector; and determining a quality score of the to-be-evaluated video according to the video feature vector.

Vision based light detection and ranging system using dynamic vision sensor

A vision based light detection and ranging (LIDAR) system detects motion of a targeted object using a dynamic vision sensor to locate and track the targeted object. The dynamic vision sensor identifies activity events associated with the motion of the targeted object based on changes in brightness detected at pixels of the dynamic vision sensor. Based on the identified events, the vision based LIDAR system predicts a location of the targeted object and directs a tracking beam onto one or more spots on the targeted object and determines distances to the one or more spots to track the motion of the targeted object in three dimensions.

SYSTEM AND METHOD FOR GENERATING VIDEO IN TARGET LANGUAGE

One or more computing devices, systems, and/or methods for generating a video in a target language are provided. In an example, a first video, in which a first speaker speaks in a first language, is identified. A translated transcript in a second language is determined. The translated transcript is indicative of a translation of speech spoken by the first speaker in the first video. Based upon the translated transcript and a speaker profile associated with a second speaker, first audio, including an auditory representation of the translated transcript being spoken in a voice of the second speaker, is generated. Based upon the first video and the first audio, a second video, in which mouth movements of the first speaker are aligned with speech of the auditory representation of the first audio, is generated.

Ecosystem for dispensing personalized lipstick

A system is provided that includes a mobile user device executes an application that receives a selection of a target color of lipstick from a user, and determines and transmit a recipe for generating the target color of the lipstick that is based on a combination of a plurality of separate lipstick ingredients. The system includes a dispensing device configured to receive the transmitted recipe from the mobile user device and dispense each of the plurality of separate lipstick ingredients onto a common dispensing surface such that when the dispensed amounts of each of the plurality of separate lipstick ingredients is blended on the dispensing surface, the target color of the lipstick is achieved. The mobile user device is configured to present at least one candidate color of lipstick to the user that is based on at least a user profile of the user of the smartphone.

CONTEXTUAL MESSAGING IN VIDEO CONFERENCE

Generally discussed herein are devices, systems, and methods for contextual messaging in a conference. A method can include receiving, by a first user interface, data indicating content of a message, a recipient of the message, and a condition that, when satisfied during the conference, causes the message to be visually displayed during the audiovisual conference, while the conference is being held via an audiovisual conference application, monitoring user contextual data for whether the condition is satisfied, responsive to the condition being satisfied, augmenting audiovisual conference data from the audiovisual conference application to include the message resulting in augmented audiovisual data, and providing, to the recipient on a second user interface of the audiovisual conference application, a view of the augmented audiovisual data.

Vehicular trailering assist system with targetless determination of misalignment of at least one trailer camera

A vehicular trailering assist system includes at least one camera disposed at a trailer hitched to a hitch of a vehicle, and an electronic control unit (ECU). The ECU determines, during a first stage of a calibration maneuver of the vehicle and trailer, image coordinates of at least one ground feature point. The ECU, responsive to determining image coordinates of the at least one ground feature point, estimates orientation parameters of the camera based at least on the determined image coordinates and intrinsic camera parameters. As the vehicle and trailer travel further along the ground surface during a second stage of the calibration maneuver of the vehicle and trailer, and based on the estimated orientation parameters of the at least one camera, the vehicular trailering assist system determines misalignment of the at least one camera at the trailer.

SYSTEM FOR AUTOMATICALLY TRIGGERING A RECORDING

System, method, and media for providing automatic recording of an event. The event may be detected from a set of data collected at a sensor. A recording device manager may send signals to other sensors and electromechanical devices to activate these sensors and electromechanical devices based on detection of the triggering event. The sensor may collect data associated with the triggering event and the electromechanical devices may perform actions based on the triggering event.

Recording and reproducing apparatus and method thereof

In a recording and reproducing apparatus and a recording and reproducing method for the recording and reproducing apparatus for recording and reproducing image information on a scene obtained through photographing, relative to a predetermined first recording medium and being capable of setting one or more chapters to each scene, a face recognizing process is executed for a photographed image based on the image information, an importance level of each chapter is set in accordance with a result of the face recognizing process for a very important person (VIP) set by a user, and each chapter having a relevant importance level among importance levels of respective chapters is selectively reproduced. A user can therefore find an object chapter and scene quickly and easily.

СПОСОБ ФОТОГРАФИРОВАНИЯ И ЭЛЕКТРОННОЕ УСТРОЙСТВО

Изобретение относится к области обработки изображений. Техническим результатом является повышение точности фокусировки, выполняемой во время фотографирования движущегося объекта. Результат достигается тем, что способ содержит этапы, на которых получают посредством электронного устройства первое съемочное изображение, где первое съемочное изображение содержит первый фотографируемый объект; при отображении первого съемочного изображения, определяют посредством электронного устройства первый фотографируемый объект в качестве цели слежения для слежения; получают посредством электронного устройства второе съемочное изображение, где второе съемочное изображение не содержит первый фотографируемый объект; отображают посредством электронного устройства второе съемочное изображение; получают посредством электронного устройства третье съемочное изображение, где третье съемочное изображение содержит первый фотографируемый объект; и при отображении третьего съемочного изображения, повторно определяют ...

Method and electronic apparatus for predicting path based on object interaction relationship

A method and an electronic apparatus 11 for predicting a path based on an object interaction relationships. Comprising a plurality of image frames received from onboard image detection device 12. Object recognition is performed on a certain image frame among the plurality of image frames to recognize at least one object. Pre-set interactive relationship information associated with the at least one object is obtained from an interactive relationship database 121 based on the at least one object. A first trajectory for navigating the first vehicle is determined based on the pre-set interactive relationship information. The apparatus may detect more than one object at once and determine if the second object is another vehicle. The system may also control dynamic features of the AV e.g., speed, direction, and brakes.

Information processing apparatus, information processing method, and endoscope system for processing images based on surgical scenes

An information processing apparatus, an information processing method, and an endoscope system capable of providing an optimal video image to an operator in accordance with surgical scenes are provided. A processing mode determination unit determines, in accordance with surgical scenes, a processing mode for an in-vivo image captured by an imaging apparatus including an imaging element arranged so as to enable pixel shift processing, and an image combining unit processes an image output from the imaging apparatus, in accordance with the processing mode. The present technology is applicable to, for example, an endoscope system for imaging a living body with an endoscope.

METHOD AND APPARATUS FOR PROVIDING VERIFICATION

An apparatus, method and computer program is disclosed. The apparatus may comprise means for receiving video data representing a video recording of at least one input made by a user at a user device; receiving audio data representing an audio recording of at least one audio input made by the user at the user device; determining whether there is a correspondence between the at least one input represented in the video data and the at least one audio input represented in the audio data; and providing verification based on the determination.

VOICE ACTIVITY DETECTION METHOD AND APPARATUS, ELECTRONIC DEVICE AND STORAGE MEDIUM

The present disclosure discloses a voice activity detection method and apparatus, an electronic device and a storage medium, and relates to the field of artificial intelligence, such as deep learning, intelligent voices, or the like. The method may include: acquiring time-aligned voice data and video data; performing a first detection of a voice start point and a voice end point of the voice data using a voice detection model obtained by a training operation; performing a second detection of a lip movement start point and a lip movement end point of the video data; and correcting a result of the first detection using a result of the second detection, and taking a corrected result as a voice activity detection result. The solution of the present disclosure may improve accuracy of the voice activity detection result, or the like.

Real time video processing for changing proportions of an object in the video

Method involving: providing an object in the video that at least partially and at least occasionally is presented in frames of a video; detecting the object in the video, wherein said detection comprises detecting feature reference points of the object; tracking the detected object in the video, wherein the tracking comprises creating a mesh that is based on the detected feature reference points of the object and aligning the mesh to the object in each frame; generating a first set of node points on the created mesh based on a request for changing proportions; generating a second set of node points based on the first set of node points; and transforming the frames of the video in such way that the object's proportions are transformed in accordance with the second set of the node points using the mesh.

Enhanced video annotation using image analysis

Devices, systems, and methods are provided for enhanced video annotations using image analysis. A method may include identifying, by a first device, first faces of first video frames, and second faces of second video frames. The method may include determining a first score for the first video frames, the first score indicative of a first number of faces to label, the first number of faces represented by the first video frames, and determining a second score for the second video frames, the second score indicative of a second number of faces to label. The method may include selecting the first video frames for face labeling, and receiving a first face label for the first face. The method may include generating a second face label for the second faces. The method may include sending the first face label and the second face label to a second device for presentation.

Large-scale automated image annotation system

Systems and methods for automating image annotations are provided, such that a large-scale annotated image collection may be efficiently generated for use in machine learning applications. In some aspects, a mobile device may capture image frames, identifying items appearing in the image frames and detect objects in three-dimensional space across those image frames. Cropped images may be created as associated with each item, which may then be correlated to the detected objects. A unique identifier may then be captured that is associated with the detected object, and labels are automatically applied to the cropped images based on data associated with that unique identifier. In some contexts, images of products carried by a retailer may be captured, and item data may be associated with such images based on that retailer's item taxonomy, for later classification of other/future products.

Behavioral data analysis and scoring system

A system and method for determining a level of empathy of an employment candidate is provided. One aspect includes receiving video input, audio input, and behavioral data input of an interview for each of a plurality of candidates. Behavioral data is extracted from the behavioral data input. An audiovisual interview file is saved in a candidate database. In response to receiving a request to view a candidate profile, the system selects one candidate from among a plurality of candidates, the selecting based at least in part on the empathy score of the selected candidate. In another aspect, a candidate can answer multiple questions during a video interview. The behavioral data extracted from a first portion of the video interview can be compared to behavioral data from a second portion of the video interview.

SYSTEMS AND METHODS FOR PROCESSING REAL-TIME VIDEO FROM A MEDICAL IMAGE DEVICE AND DETECTING OBJECTS IN THE VIDEO

DYNAMIC MEDIA CONTENT CATEGORISATION METHOD

СПОСОБ И УСТРОЙСТВО ОБРАБОТКИ ИЗОБРАЖЕНИЙ, ЭЛЕКТРОННОЕ УСТРОЙСТВО И МАШИНОЧИТАЕМЫЙ НОСИТЕЛЬ ИНФОРМАЦИИ

Изобретение относится к области обработки изображений. Техническим результатом является повышение качества обработанного изображения. Результат достигается тем, что идентифицируют первый объект в первом изображении видеокадра и второй объект, расположенный в первом объекте; в соответствии с положением первого объекта в первом изображении видеокадра накладывают третий объект в качестве изображения переднего плана на первое изображение видеокадра, чтобы получить второе изображение видеокадра; причем третий объект накладывает первый объект во втором изображении видеокадра; в соответствии с положением второго объекта в первом изображении видеокадра накладывают второй объект в качестве изображения переднего плана на третий объект второго изображения видеокадра, чтобы получить третье изображение видеокадра. 4 н. и 12 з.п. ф-лы, 6 ил.

A system for accessing a web page

System comprising a screen (5) for viewing content (6) comprising a plurality of scenes, items (30,31,32) shown in each scene, a mobile camera device (1) having a camera (7), processor, connection to internet (2) and access to computing devices (56,57,100) in the internet comprising a machine learning cloud (100) and a database (107) comprising scene identifiers (75), each scene identifier (106) associated with item data (85) describing the items shown in that scene. The system comprises the steps of a user (15) capturing an image (49) of the screen displaying the content with the mobile camera device, processing the image to obtain a prepared image (58), sending the prepared image (60) to the machine learning cloud, executing a comparison algorithm (104) to compare the prepared image with stock images (101) obtained from stock scenes of pre-recorded stock content, each stock scene assigned a scene identifier (106), the machine learning cloud identifying the scene with a degree of certainty ...

Method and apparatus for converting 3D manuals into 2D interactive videos for cloud service

Disclosed are a method and apparatus for converting 3D manuals into 2D interactive videos for a cloud service. The method includes the steps of performing labelling for annotations in a 3D manual for a cloud service and machine learning for recognizing the annotations, automatically recognizing the annotations, fine-adjusting automatically unrecognized annotations and generating a file for converting the 3D manual into a 2D interactive video. The 3D manual is then linked to a corresponding 2D manual using the file from which artificial intelligence knowledge based on work instructions in the 2D manual is extracted. Neural network tasks are performed together with linguistic inferences for processing voice requests to informing the user about the handling and completion of a requested task by sending visual and audio feedback, to execute commands based on the artificial intelligence knowledge and the annotations in the 3D manual.

IMAGING APPARATUS AND IMAGING METHOD

An imaging apparatus facilitating recording of a video within an extraction range while moving the extraction range within an angle of view are provided, which includes an image sensor that captures a reference video which is a motion picture, a housing that accommodates the image sensor, a detection portion for detecting a motion of the housing, and a processor configured to execute setting processing of setting an extraction range smaller than an angle of view within the angle of view in a case of capturing the reference video, extraction processing of extracting an extraction video within the extraction range from the reference video, movement processing of moving the extraction range within the angle of view over time in accordance with the motion detected by the detection portion, and recording processing of recording the extraction video during movement of the extraction range in the movement processing on a recording medium.

OPHTHALMOLOGIC DEVICE WITH IMAGE STORAGE

An ophthalmologic device includes a microscope, an illumination system, a camera positioned to record an image through the microscope, and a storage device. When examining an eye, the camera is operated to continuously record a series of images. The images are stored in the storage device, each one with attributed imaging parameters describing the recording conditions of the image. When the examiner wants to retrieve images taking under examining conditions similar to the one presently used, the device is able to automatically retrieve the closest matches from the storage device. This allows to record, in the background, a large number of images documenting an eye's history and to retrieve them efficiently.

Multi-cam ball location method and apparatus

A multi-camera architecture for detecting and tracking a ball in real-time. The multi-camera architecture includes network interface circuitry to receive a plurality of real-time videos taken from a plurality of high-resolution cameras. Each of the high-resolution cameras simultaneously captures a sports event, wherein each of the plurality of high-resolution cameras includes a viewpoint that covers an entire playing field where the sports event is played. The multi-camera architecture further includes one or more processors coupled to the network interface circuitry and one or more memory devices coupled to the one or more processors. The one or more memory devices includes instructions to determine the location of the ball for each frame of the plurality of real-time videos, which when executed by the one or more processors, cause the multi-camera architecture to simultaneously perform one of a detection scheme or a tracking scheme on a frame from each of the plurality of real-time videos ...

Method for triggering events in a video

A computer implemented method of triggering events in a video, the method comprising: providing a list of objects with their states and corresponding events in video such that each state from the list triggers at least one event of the corresponding events, wherein each object from the list has at least one state triggering at least one event of the corresponding events from the list in video; detecting at least one object from the list that at least partially and at least occasionally is presented in frames of the video; tracking the at least one object and its state; triggering at least one event of the corresponding events from the list in video in case the state of the at least one object matches with one of its states from the list.

REMOTE PLAYING CARD GAME

A method of playing a remote playing card game that includes a specialized physical game table communicatively coupled to a plurality of electronic communication devices remotely displaced from the game table and dealing physical playing cards on the physical game table, wherein a camera on the physical game table is operably configured to communicate the suit and rank of the dealt playing cards, the physical shuffling of the cards, and the game layout on the game table, to the electronic communication devices for the remote users for game play.

Dynamically configured processing of a region of interest dependent upon published video data selected by a runtime configuration file

A method of processing first video data of a region of interest from incoming video data includes receiving, by a computer processor, the first video data that is preprocessed according to preprocessing parameters defined within a runtime configuration file, the preprocessing includes formatting the incoming video data to create the first video data of the first region of interest and processing, by the computer processor, the first video data to determine at least one output that is indicative of a first inference dependent upon the first video data. The preprocessing parameters are dependent upon the processing to be performed on the first video data.

RECORDING CONTROL DEVICE, RECORDING DEVICE, RECORDING CONTROL METHOD, AND RECORDING CONTROL PROGRAM

SYSTEMS AND METHODS FOR STREAM RECOGNITION

VIDEO BEHAVIOR RECOGNITION METHOD AND APPARATUS, AND COMPUTER DEVICE AND STORAGE MEDIUM

A video behavior recognition method, which is executed by a computer device, and comprises: extracting video image features from at least two frames of target video images (202); performing contribution adjustment on spatial features of the video image features, so as to obtain an intermediate image feature (204); fusing, on the basis of prior information, a time feature of the intermediate image feature with a cohesion feature corresponding to the time feature, so as to obtain a fused feature, wherein the prior information is obtained according to change information of the intermediate image feature in a time dimension, and the cohesion feature is obtained by performing attention processing on the time feature (206); performing time feature contribution adjustment on the fused feature, so as to obtain a behavior recognition feature (208); and performing video behavior recognition on the basis of the behavior recognition feature (210).

OBJECT DETECTION METHOD AND ELECTRONIC DEVICE

This application relates to an object detection method and an electronic device, to reduce a probability of missing selection and incorrect selection in object detection. The method includes: An electronic device obtains an image, recognizes an object included in the image, and obtains one or more candidate boxes of the object and candidate box information corresponding to each candidate box, where the candidate box information includes a position of the object in the image, a detection probability of the object, and a first object category of the object. The electronic device further receives a first message of a mobile device, where the first message includes position information of the object and a second object category of the object; determines, from the one or more candidate boxes based on the position information of the object and the position of the object in the image, a first candidate box corresponding to the first message; adjusts a parameter corresponding to the at least one ...

VIDEO ANALYSIS APPARATUS, VIDEO ANALYSIS METHOD, AND PROGRAM

To utilize a result of analyzing an interval between persons included in a video, a video analysis apparatus 100 includes an interval acquisition unit 110 and a display control unit 113. The interval acquisition unit 110 acquires an interval between persons included in a video acquired by photographing a target region. The display control unit 113 causes a display unit to display a time-series transition of first information relating to the number of persons with the acquired interval being equal to or less than a reference value.

OOD 객체 탐지 방법 및 시스템

... 본 발명은 OOD 객체 탐지 방법에 관한 것이다. OOD 객체 탐지 방법은, 학습 이미지 세트를 이용하여 학습 이미지 세트에 포함된 각각의 이미지에 대한 분류를 수행하도록 교사 기계학습 모델을 학습시키는 단계, 교사 기계학습 모델의 학습 시 학습 이미지 세트에 포함된 이미지 외의 다른 이미지가 입력되는 경우, 다른 이미지에 대한 OOD 객체 탐지를 수행하도록 교사 기계학습 모델을 학습시키는 단계 및 지식 증류를 이용하여 학습된 교사 기계학습 모델을 기초로, 이미지에 대한 분류 및 OOD 객체 탐지를 수행하도록 학생 기계학습 모델을 학습시키는 단계를 포함한다.

OBJECT REMOVAL DURING VIDEO CONFERENCING

A video conferencing system includes an image of a participant in a video conference and a depth map of the image. The system identifies objects in the background of the image, identifies objects in the foreground of the image, and identifies objects in the middle-ground of the image. The system removes the objects from the middle-ground, and replaces the removed objects from the middle-ground with the objects from the background that are located behind the removed objects. The system then uses the image with the removed and replaced objects in a video stream of the video conference.

Method for triggering events in a video

A computer implemented method of triggering events in a video, the method comprising: providing a list of objects with their states and corresponding events in video such that each state from the list triggers at least one event of the corresponding events, wherein each object from the list has at least one state triggering at least one event of the corresponding events from the list in video; detecting at least one object from the list that at least partially and at least occasionally is presented in frames of the video; tracking the at least one object and its state; triggering at least one event of the corresponding events from the list in video in case the state of the at least one object matches with one of its states from the list.

METHOD AND ELECTRONIC APPARATUS FOR PREDICTING PATH BASED ON OBJECT INTERACTION RELATIONSHIP

A method and an electronic apparatus for predicting a path based on an object interaction relationship are provided. The method includes the following. A video including a plurality of image frames is received. Object recognition is performed on a certain image frame among the plurality of image frames to recognize at least one object in the certain image frame. Preset interactive relationship information associated with the at least one object is obtained from an interactive relationship database based on the at least one object. A first trajectory for navigating the first vehicle is determined based on the preset interactive relationship information.

Video Enhanced Time Tracking System and Method

A video enhanced time tracking system is provided. The system may include a video capturing device, software applications (such as an application running on the video capturing device), and a backend system. The application may include a time tracking application that tracks time simultaneously as the video capturing device captures video. The captured video and the tracked time information may be uploaded to the backend system where it may be stored and processed. The system may correlate the tracked time information with the captured video and provide it to a client for review. In some embodiments, the system also includes an image recognition system that recognizes the user to authenticate the user's identity, that recognizes the user's workspace to determine when the user is working, and that recognizes the work being performed to determine the client that the user may be working for.

Adaptive user interface for determining errors in performance of activities

To assist a user in the correct performance of an activity, video data is acquired. A pose of the user is determined from the video data and an avatar is generated representing the user in the pose. The pose of the user is compared to one or more other poses representing correct performance of the activity to determine one or more differences that may represent errors by the user. Depending on the activity that is being performed, some errors may be presented to the user during performance of the activity, while other errors may be presented after performance of the activity has ceased. To present an indication of an error, a specific body part or other portion of the avatar that corresponds to a difference between the user's pose and a correct pose may be presented along with an instruction regarding correct performance of the activity.

Electronic device and method for controlling the electronic device thereof

An artificial intelligence (AI) system utilizing a machine learning algorithm such as deep learning for controlling an electronic device when a video is reproduced and a user's voice instruction is received, to acquire a frame corresponding to the time point when the input of the user's voice instruction is received, and obtain a search result for information on objects in the frame using an AI model trained according to at least one of machine learning, a neural network or a deep learning algorithm.

BLADED ROTATING ASSEMBLY MITIGATION IN HIGH FRAME RATE VIDEO

METHOD AND APPARATUS FOR EXTRACTING HOTSPOT SEGMENT FROM VIDEO

Generating frames for neural simulation using one or more neural networks

Apparatuses, systems, and techniques to use one or more neural networks to generate one or more images 410, 445 based, at least in part, on one or more spatially-independent features within the one or more images 410, 445. In at least one embodiment, the one or more neural networks determine spatially-independent information and spatially-dependent information of the one or more images 410, 445 and process the spatially-independent information and the spatially-dependent information to generate the one or more spatially-independent features and one or more spatially-dependent features within the one or more images 410, 445. The images may be used in a driving simulation system.

User interface interaction method and system

The present disclosure describes techniques for implementing user interface interaction. The disclosed techniques comprise playing a video on an interface; monitoring user input performed on the interface; determining a target frame based at least in part on the user input; determining a location where the user input is performed on the interface; determining whether the location of the user input is in a predetermined area of the target frame, wherein the predetermined area is associated with at least one object in the target frame; and implementing an operation associated with the at least one object in response to determining that the location of the user input is in the predetermined area of the target frame.

Machine learning techniques for enhancing video conferencing applications

Systems, processes, and techniques to automatically detect and enlarge a speaking one of plurality of participants on one side of a video conference. In at least one embodiment, the speaking participant is identified using one or more heuristics and/or one or more neural networks.

Systems and methods for improved operations of ski lifts

Systems and methods for improved operations of ski lifts increase skier safety at on-boarding and off-boarding locations by providing an always-on, always-alert system that “watches” these locations, identifies developing problem situations, and initiates mitigation actions. One or more video cameras feed live video to a video processing module. The video processing module feeds resulting sequences of images to an artificial intelligence (AI) engine. The AI engine makes an inference regarding existence of a potential problem situation based on the sequence of images. This inference is fed to an inference processing module, which determines if the inference processing module should send an alert or interact with the lift motor controller to slow or stop the lift.

Electronic device and method for correcting image on basis of image transmission state

An electronic device comprises: a camera, at least one communication module; at least one memory; and at least one processor. The processor may be configured so as to: acquire a raw image of an external object by using the camera; generate a small raw image corresponding to the raw image; determine the possibility or not of the transmission of the small raw image from the electronic device to an external device by using at least some of the communication modules, among the at least one communication module; when the transmission of the small raw image is determined to be in a possible state, transmit the small raw image to the external device so that the external electronic device may generate first correction information by using the small raw image and on the basis of a correction processing method of the external device; receive the first correction information from the external device; when the transmission of the small raw image is determined to be in an impossible state, determine ...

Using machine learning to detect which part of the screen includes embedded frames of an uploaded video

A system and methods are disclosed for using a trained machine learning model to identify constituent images within composite images. A method may include providing pixel data of a first image as input to the trained machine learning model, obtaining one or more outputs from the trained machine learning model, and extracting, from the one or more outputs, an indication that the first image is a composite image that includes a constituent image, wherein at least a portion of the constituent image is in a spatial area of the first image.

SYSTEM AND METHOD FOR REMOTE OBSERVATION IN A NON-NETWORKED PRODUCTION FACILITY

A method includes: via a user interface of a hub device, receiving a first set of user credentials associated with a first operator, the hub device connected to a set of mobile devices; accessing a first operator schedule defining a first manufacturing operation and a first observer of the first manufacturing operation, the first observer characterized by a first set of observer credentials; detecting disconnection of a first mobile device in the set of mobile devices from the hub device, the first mobile device associated with a first device ID; in response to detecting disconnection of the first mobile device from the hub device, associating the first device ID with the first operator; and serving a first video feed from the first mobile device to the first observer based on the first device ID and the first set of observer credentials.

OVERRIDING CONTROL OF MOTORIZED TRANSPORT UNIT SYSTEMS, DEVICES AND METHODS

Some embodiments include apparatuses providing control over movement of motorized transport units at a retail facility, comprising: multiple self-propelled motorized transport units; a wireless communication network; and a central computer system, wherein the central computer system comprises: a transceiver; a control circuit; and a memory storing computer instructions that when executed cause the control circuit to: receive an override command, from a worker associated with the retail facility, to cause a first motorized transport unit of the multiple motorized transport units to implement one or more actions; confirm a valid authorization of the worker to override one or more operating limits of the first motorized transport unit; and override the one or more operating limits and communicate one or more instructions to the first motorized transport unit configured to cause the first motorized transport unit to implement the one or more actions in accordance with the override command.

STATIC PRIVACY MASKING

A method of masking in an output image stream (312) is provided, including receiving an input image stream (310) capturing a scene, processing the input image stream to generate the output image stream, including using a detector (330) to detect objects in the scene and a tracker (320) to track objects in the scene based on information (333) provided by the detector, and further including to generate a particular output image (On) of the output image stream by checking whether there exists a particular area in the scene in which an evaluation (350) of a historical performance of the detector and/or tracker fulfills at least one condition, and to, if confirming that such a particular area exists, mask (340) the particular area of the scene in the particular output image. A corresponding device, computer program, and computer program product are also provided.

Automatic endoscope video augmentation

A surgical robotic system for automatically augmenting an endoscope video for a task based on status data that describes the status of a surgical robot system that was used to at least partially perform the task. The system comprises an event detector configured to receive status data describing a status of a surgical robot system during the task and to automatically select a subset of patterns from a plurality of potential patterns in the status data based on user privileges associated with a user that initiated the augmentation, each pattern of the plurality of potential patterns indicating a different event occurred during the event and in response to the event detector identifying a pattern of the subset of patterns in the status data that indicates an event has occurred during the task, automatically augment metadata that forms part of or is associated with the endoscope video with information identifying the event and the time of the event with respect to the endoscope video.

Automatic endoscope video augmentation

A surgical robot system that automatically augments an endoscope video for a task based on status data that describes a status of a surgical robot system during a task at least partially performed by the surgical robot system. The status data comprises instrument information describing at least one instrument attached to the at least one surgical robot during the task and surgical robot position information describing a movement and/or a position of the at least one surgical robot during the task and identifies one or more patterns in the status data that indicate an event occurred during the task, wherein the one or more patterns in the status data comprises one or more patterns in the instrument information and one or more patterns in the surgical robot position information. A suturing step in the task is identified from the one or more patterns and the augmenter receives an endoscope video captured during the task, time synchronised with the status data and automatically augments metadata ...

Method and apparatus for video recognition

Surveillance camera and information processing apparatus

A surveillance camera includes an imaging unit configured to output a video frame, and a control unit configured to set a search range in the video frame and to extract a tracking-target image by using a feature quantity of an image in the search range. In a case where an object image other than the tracking target is contained in the search range, the control unit masks a feature quantity of the object image and extracts the tracking-target image.

Computer Vision Systems and Methods for Blind Localization of Image Forgery

Computer vision systems and methods for localizing image forgery are provided. The system generates a constrained convolution via a plurality of learned rich filters. The system trains a convolutional neural network with the constrained convolution and a plurality of images of a dataset to learn a low level representation of each image among the plurality of images. The low level representation is indicative of a statistical signature of at least one source camera model of each image. The system can determine a splicing manipulation localization by the trained convolutional neural network.

Battery powered artificial intelligence autonomous patrol vehicle

A battery powered artificial intelligence autonomous patrol vehicle. The vehicle is battery powered and is operated autonomously using artificial intelligence. The autonomous patrol vehicle includes a surveillance or detection system on or within an emergency light bar of the autonomous patrol vehicle. The autonomous patrol vehicle autonomously performs patrol surveillance or detection functions such as speed; red-light; and traffic enforcement; traffic enforcement with Automatic License Plate Recognition (ALPR), face recognition, animal recognition, object recognition, video surveillance and online continuous analysis and any equivalent surveillance or detection functions. The autonomous patrol vehicle stores and sends live and/or stored data to a command control center while moving or parked. The surveillance or detection system navigates with the use of any one of or a combination of a camera, radar and Light Detection and Ranging (LIDAR) sensors and can operate by viewing 360 degrees ...

Maintaining fixed sizes for target objects in frames

Techniques are provided for processing one or more frames. For example, a region of interest can be determined in a first frame of a sequence of frames. The region of interest in the first frame includes an object having a size in the first frame. A portion of a second frame of the sequence of frames (occurring after the first frame in the sequence of frames) can be cropped and scaled to cause the object in the second frame to have a same size (and in some cases a same location) as the object in the first frame.

Display Control Device, Display Control Method, and Program

The present invention relates to a display control device, a display method, and a program, whereby a new thumbnail method can be provided. A clustering unit 611 subjects each frame of a content to clustering into any cluster of a plurality of clusters, and a scene classifying unit 612 classifies, regarding each of a plurality of clusters, a frame belonging to a cluster into a scene that is a group of one or more frames that temporally continue. A thumbnail creating unit 613 creates the thumbnail of a scene, and a display control unit 614 displays the thumbnail thereof on a display device 603.

System for background subtraction with 3d camera

A system for background image subtraction includes a computing device coupled with a 3D video camera, a processor of the device programmed to receive a video feed from the camera containing images of one or more subject that include depth information. The processor, for an image: segments pixels and corresponding depth information into three different regions including foreground (FG), background (BG), and unclear (UC); categorizes UC pixels as FG or BG using a function that considers the color and background history (BGH) information associated with the UC pixels and the color and BGH information associated with pixels near the UC pixels; examines the pixels marked as FG and applies temporal and spatial filters to smooth boundaries of the FG regions; constructs a new image by overlaying the FG regions on top of a new background; displays a video feed of the new image in a display device; and continually maintains the BGH.

method for detecting and adapting video processing for far-view scenes in sports video

A method is disclosed for analyzing video to detect far-view scenes in sports video to determine when certain image processing algorithms should be applied. The method comprises analyzing and classifying the fields of view of images from a video signal, creating and classifying the fields of view of sets of sequential images, and selectively applying image processing algorithms to sets of sequential images representing a particular type of field of view.

Method of detecting logos, titles, or sub-titles in video frames

Detecting a static graphic object (such as a logo, title, or sub-title) in a sequence of video frames may be accomplished by analyzing each selected one of a plurality of pixels in a video frame of the sequence of video frames. Basic conditions for the selected pixel may be tested to determine whether the selected pixel is a static pixel. When the selected pixel is a static pixel, a static similarity measure and a forward motion similarity measure may be determined for the selected pixel. A temporal score for the selected pixel may be determined based at least in part on the similarity measures. Finally, a static graphic object decision for the selected pixel may be made based at least in part on the temporal score.

Video display device and operating method therefor

The present invention relates to a video display device and an operating method therefore. An operating method for a video display device according to one embodiment of the present invention comprises the steps of: determining whether or not a text is contained in an input video; determining whether or not a text display mode is a 2D text display mode when a text is contained in the video; separating a text region in the video when the text display mode is a 2D text display mode; performing 3D signal processing on the video region separated from the text region; performing 2D signal processing on the text region; and displaying the 2D signal-processed text region and the 3D signal-processed video region on a display. Accordingly, text can be displayed clearly when a 3D video is displayed.

Video analytics method and system

A method for performing video analytics comprises capturing video data using a video source disposed at an acquisition end. The captured video data is stored at the acquisition end, and non-adjacent single frames of the captured video data are transmitted from the acquisition end to a server via an IP network. The non-adjacent single frames of captured video data are transmitted one at a time at known time intervals, or a burst of a plurality of non-adjacent single frames is transmitted at another known time interval. At the server, video analytics is performed on a current one of the non-adjacent single frames for detecting an actionable event relative to a previous one of the non-adjacent single frames. In response to detecting an actionable event, a signal for requesting previously stored video data captured between the current one of the non-adjacent single frames and the previous one of the non-adjacent single frames is transmitted to the acquisition end via the IP network.

Method and system for segmenting and transmitting on-demand live-action video in real-time

A method and system for producing video-segments of a live-action event involving monitoring a live-action event for detection of event-segments, detecting one or more event-triggers with detectors, determining if an event-segment occurred based on the detected event-triggers, and editing one or more video feeds into a video-segment to encompass the event-segment.

Electronic device and facial image display apparatus

According to one embodiment, an electronic apparatus includes a storage device which stores face thumbnail indexing information including face images and time stamp information, extracting module configure to assign time zones to a video content data and to extract face images belonging to each time zone based on a time stamp information, classifying module configure to classify facial images of the same person from the extracted facial images, calculating module configure to calculate a frequency of appearance of each classified facial image, and facial image indication module configure to display a list of the facial images included in the facial image indexing information in a facial image indication in a two-dimensional display area, the facial image indication having time-zone-specific display areas in columns corresponding to the time zones, each facial image displayed in each time-zone-specific display area being displayed in a size based on the frequency of appearance.

Methods and apparatus to specify regions of interest in video frames

Methods and apparatus to specify regions of interest in video frames are disclosed. Example disclosed methods to mark a region in a graphical presentation include selecting a first point located at a substantially central position within the region, selecting a plurality of second points to define a boundary of the region, and comparing a plurality of stored templates with the selected first and second points to identify a first one of the stored templates to represent the region.

Automatic Photo Capture Based on Social Components and Identity Recognition

In one embodiment, a mobile device automatically captures image frames by acquiring a real-time video sequence, selecting one or more frames from the real-time video sequence based on social network information and identity recognition, and storing the selected one or more frames in a local storage of the mobile device.

Receiving device, receiving method, program, and information processing system

A receiving device includes: a receiver configured to receive AV content; a feature extractor configured to extract a feature from data of the received AV content; an identification result acquirer configured to acquire an identification result of the AV content identified from the extracted feature by using an Automatic Content Recognition technique; a command acquirer configured to acquire a command for controlling operation of an application program run in conjunction with the AV content in accordance with the acquired identification result; and a controller configured to control operation of the application program in accordance with the acquired command.

Eye Gaze Based Location Selection for Audio Visual Playback

In response to the detection of what the user is looking at on a display screen, the playback of audio or visual media associated with that region may be modified. For example, video in the region the user is looking at may be sped up or slowed down. A still image in the region of interest may be transformed into a moving picture. Audio associated with an object depicted in the region of interest on the display screen may be activated in response to user gaze detection.

Intelligent Logo and Item Detection in Video

Techniques to follow objects in a video. An object detector detects the object, and an object tracker follows that object even when the detectable part cannot be seen. The object can be tagged in its display. The object can be individual team members in a video showing sports. A color filter that is based on colors of a uniform of a team of the team member can be used to restrict an area of said automated object detection.

Techniques for video analytics of captured video content

Examples are disclosed for video analytics of captured video content. In some examples, information may be received from a host processing system for a camera to capture video content. The camera may be a surveillance camera or a camera located with a display device. Video analytics may be performed on the captured video and the captured video content may be encoded. Data associated with the video analytics may then be sent to the host processing system. In some examples, the data as well as encoded captured video content or streaming video may be sent via communication channels included in an interconnect. Other examples are described and claimed.

Identification system

An identification system for identifying, recording, and alerting to an impact between a vehicle and an impacting object, such as another vehicle that impacts the vehicle. At least one sensor positions on a front and rear bumper of the vehicle for sensing the impact and actuating the system in response. At least one camera on the vehicle periphery records the impacting object. Each camera positions on a periphery of the vehicle and tilts up to 180 degrees. An alert portion emits an alert in response to the impact. An antenna communicates with a positioning system to identify a location of the vehicle during the impact. A communication device stores and relays information, such as vehicle identification number, license plate number, and drivers license information of the impacting object to an emergency department. A processor and a SIM card store and identify information about each vehicle.

Device and method for detecting the presence of a logo in a picture

A method for detecting the presence of a logo in a current picture of a video is disclosed. The method comprises: determining a current candidate logo bounding box in the current picture and a preceding candidate logo bounding box in a picture preceding the current picture; detecting the presence of a logo in the current picture if at least one of the following conditions is fulfilled: the distance between the centers of the current and the preceding candidate logo bounding boxes is below a first threshold or an overlap between the current and the preceding candidate logo bounding boxes is above a second threshold; or an overlap between the current candidate logo bounding box and a saliency mask of the current picture is above a third, wherein the saliency mask identifies regions around saliency peaks.

Apparatus of non-touch optical detection of vital signs from multiple filters

A microprocessor is operably coupled to a camera from which patient vital signs are determined. A temporal variation of images from the camera is generated from multiple filters and then amplified from which the patient vital sign, such as heart rate or respiratory rate, can be determined and then displayed or stored.

Method and System for Generating a Smart Time-Lapse Video Clip

An electronic device with a display, processor(s), and memory displays a video monitoring user interface including a video feed from a camera located remotely from the client device in a first region and an event timeline in a second region, the event timeline including event indicators for motion events previously detected by the camera. The electronic device detects a user input selecting a portion of the event timeline, where the selected portion of the event timeline includes a subset of the event indicators. In response to the user input, the electronic device causes generation of a time-lapse video clip of the selected portion of the event timeline. The electronic device displays the time-lapse video clip, where motion events corresponding to the subset of the event indicators are played at a slower speed than the remainder of the selected portion of the event timeline.

Method and Apparatus for Multi-Dimensional Content Search and Video Identification

A multi-dimensional database and indexes and operations on the multi-dimensional database are described which include video search applications or other similar sequence or structure searches. Traversal indexes utilize highly discriminative information about images and video sequences or about object shapes. Global and local signatures around keypoints are used for compact and robust retrieval and discriminative information content of images or video sequences of interest. For other objects or structures relevant signature of pattern or structure are used for traversal indexes. Traversal indexes are stored in leaf nodes along with distance measures and occurrence of similar images in the database. During a sequence query, correlation scores are calculated for single frame, for frame sequence, and video clips, or for other objects or structures.

Using an image matching system to improve the quality of service of a video matching system

A system receives a subject video. The system identifies dynamic segments and semi-static segments within the subject video. The system determines matches between the dynamic segments of the subject video and reference dynamic segments of reference videos. Similarly, the system determines matches between the semi-static segments of the subject video and reference semi-static segments of reference videos. The system generates the match merge list including one or more entries. Each entry of the match merge list includes an indication of a grouped segment of the subject video including sequential occurrences of a dynamic segment and a semi-static segment of the subject video, and an indication of a reference grouped segment of a reference video including sequential occurrences of a reference dynamic segment and a reference semi-static segment of the reference video, where the reference dynamic segment matches the dynamic segment and the reference semi-static segment matches the semi-static segment.

Method and system for synchronizing procedure videos for comparative learning

Embodiments described herein provide various examples of synchronizing the playback of a recorded video of a surgical procedure with a live video feed of a user performing the surgical procedure. In one aspect, a system can simultaneously receive a recorded video of a surgical procedure and a live video feed of a user performing the surgical procedure in a training session. More specifically, the recorded video is shown to the user as a training reference, and the surgical procedure includes a set of surgical tasks. The system next simultaneously monitors the playback of a current surgical task in the set of surgical tasks in the recorded video and the live video feed depicting the user performing the current surgical task. Next, the system detects that the end of the current surgical task has been reached during the playback of the recorded video. In response to determining that the user has not completed the current surgical task in the live video feed, the system pauses the playback of the recorded video while awaiting the user to complete the current surgical task.

Methods and systems of a multistage object detection and tracking checkout system

A system for multistage object detection and tracking for realizing a cashierless checkout includes a mobile device. The mobile device includes a set of on-board sensors together installed to the shopping container. The on-board sensors could include multiple digital cameras viewing interior of the shopping container from different angles and positions. The on-board sensors detect and provide user activity data with respect to placement or removal of the items into or from the shopping container. The digital camera obtains a set of digital image frames associated with the unique signatures associated with various shopping items entering and leaving the interior region of the shopping container and communicates them to a mobile device comprising an on-device machine learning (ML) detection and tracking engine; and relay them to subsequent stages for improved accuracy and confidence to arrive at a go/no-go decision.

Method and apparatus for detecting region of interest, electronic device, and readable storage medium

A method and an apparatus for detecting a region of interest (ROI), an electronic device, and a readable storage medium are provided. In the method for detecting a ROI, a target video frame image is divided into a plurality of image blocks and chrominance components of pixels of each image block are acquired. A ROI of the target video frame image is detected by determining a region type of each image block according to a ratio of pixels in an image block meeting a preset chrominance condition to pixels of the image block.

Shopping Facility Assistance System and Method to Retrieve In-Store Abandoned Mobile Item Containers

A central computer system identifies a mobile item container in a retail shopping facility as being abandoned. The central computer system then directs a motorized transport unit through the retail shopping facility to the abandoned mobile item container and causes that motorized transport unit to physically attach to the abandoned mobile item container. The central computer system then directs that motorized transport unit through the retail shopping facility with the attached abandoned mobile item container to a specified destination within the retail shopping facility. Abandonment can be determined as a function, at least in part, of determining that the mobile item container is both stationary and unattended for at least a predetermined amount of time. By one approach the central computer system can use different predetermined amounts of time when assessing abandonment depending upon where in the retail shopping facility the mobile item containers are located.

Method and System for Cluster-Based Video Monitoring and Event Categorization

A computing system obtains a respective motion vector for each of a series of motion event candidates in real-time as said each motion event candidate is detected in a live video stream. In response to receiving the respective motion vector for each of the series of motion event candidates, the computing system determines a spatial relationship between the respective motion vector of said each motion event candidate to one or more existing clusters established based on a plurality of previously processed motion vectors, and in accordance with a determination that the respective motion vector of a first motion event candidate of the series of motion event candidates falls within a respective range of at least a first existing cluster of the one or more existing clusters, assigns the first motion event candidate to at least a first event category associated with the first existing cluster.

Image segmentation for object modeling

Systems, devices, and methods are presented for segmenting an image of a video stream with a client device by accessing a set of images within a video stream, identifying an object of interest within one or more images of the set of images, and detecting a region of interest within the one or more images. The systems, devices, and method identify a first set of median pixels in a first portion of the object of interest and a second set of median pixels in a second portion of the object of interest. The systems, devices, and methods determine a polyline approximating the first and second sets of median pixels and generate a model for the polyline.

Adaptive video subsampling for energy efficient object detection

Various embodiments of systems and methods for adaptive video subsampling for energy-efficient object detection are disclosed herein.

Intraoperative surgical event summary

Systems and methods for generating decision support data for surgical videos are disclosed, the system may include at least on processor configured to implement a method. The method may include receiving video footage of a surgical procedure performed by a surgeon on a patient in an operating room and implementing a model on the received video footage to determine an existence of a surgical decision-making junction. The model may be trained to detect decision-making junctions using training data based on historical video footage depicting surgical situations. The method may include accessing, in a data structure, a correlation between an outcome and a specific action taken at the decision-making junction, and, based on the existence of the decision-making junction and the correlation, outputting a recommendation to at least one of a user device or a user interface related to the specific action.

Video content analysis for automatic demographics recognition of users and videos

A video demographics analysis system selects a training set of videos to use to correlate viewer demographics and video content data. The video demographics analysis system extracts demographic data from viewer profiles related to videos in the training set and creates a set of demographic distributions, and also extracts video data from videos in the training set. The video demographics analysis system correlates the viewer demographics with the video data of videos viewed by that viewer. Using the prediction model produced by the machine learning process, a new video about which there is no a priori knowledge can be associated with a predicted demographic distribution specifying probabilities of the video appealing to different types of people within a given demographic category, such as people of different ages within an age demographic category.

Image processing method, apparatus, and non-transitory computer readable storage medium

The present disclosure relates to an image processing method and apparatus, an electronic device, and a storage medium. The method includes: obtaining video streams of a game tabletop; detecting target objects in a plurality of image frames included in the video streams; determining a current game stage based on the target objects; and determining game detecting results according to the target objects and the determined game stage.

Apparatus for video output and associated methods

An apparatus comprising a processor and memory including computer program code, the memory and computer program code configured to, with the processor, enable the apparatus at least to: use received current-field-of-view indication data together with future-event-direction data, in respect of recorded panoramic video output provided by panoramic video content data, to provide a sensory cue for a viewer of the recorded panoramic video output to indicate the direction of a future event in the recorded panoramic video output which is outside a current field of view, wherein the recorded panoramic video output is configured to provide video content to the viewer which extends outside the field of view of the viewer in at least in one direction, and the future-event-direction data is supplemental to the panoramic video content data which provides the video content itself.

Semiconductor device, method of manufacturing the same, and electronic device including the device

A semiconductor device including a first source/drain region at a lower portion thereof, a second source/drain region at an upper portion thereof, a channel region between the first source/drain region and the second source/drain region and close to peripheral surfaces thereof, and a body region inside the channel region. The semiconductor device may further include a gate stack formed around a periphery of the channel region.

Systems and methods for clipping video segments

Systems and methods for streaming video, interacting with video content, and sharing video content are disclosed herein. Other embodiments are also disclosed herein.

Protection and receovery of identities in surveillance camera environments

A mechanism is described for facilitating protection and recovery of identities in surveillance camera environments according to one embodiment. An apparatus of embodiments, as described herein, includes detection and reception logic to receive a video stream of a scene as captured by a camera, wherein the scene includes persons. The apparatus may further include recognition and application logic to recognize an abnormal activity and one or more persons associated with the abnormal activity in a video frame of the video stream. The apparatus may further include identity recovery logic to recover one or more identities of the one or more persons in response to the abnormal activity, where the one or more identities are recovered from masked data and encrypted residuals associated with the one or more persons.

Method and system of recurrent semantic segmentation for image processing

A system, article, and method of recurrent semantic segmentation for image processing by factoring historical semantic segmentation.

Food preparation assistance using image processing

A computer system monitors food preparation. Images of food preparation by a user are captured via one or more image capture devices disposed within an area containing food preparation items. A food preparation process being performed by the user is determined. Image processing is performed on the captured images to monitor the food preparation process and detect an event. The user is notified of the detected event, and provided information pertaining to the event. Embodiments of the present invention further include a method and program product for monitoring food preparation in substantially the same manner described above.

Evaluating risk factors of proposed vehicle maneuvers using external and internal data

Apparatuses and methods for evaluating the risk factors of a proposed vehicle maneuver using remote data are disclosed. In embodiments, a computer-assisted/autonomous driving vehicle communicates with one or more remote data sources to obtain remote sensor data, and process such remote sensor data to determine the risk of a proposed vehicle maneuver. A remote data source may be authenticated and validated, such as by correlation with other remote data sources and/or local sensor data. Correlation may include performing object recognition upon the remote data sources and local sensor data. Risk evaluation is performed on the validated data, and the results of the risk evaluation presented to a vehicle operator or to an autonomous vehicle navigation system.

Dynamic gesture recognition method, device and computer-readable storage medium

A dynamic gesture recognition method includes: performing detection on each frame of image of a video stream using a preset static gesture detection model to obtain a static gesture in each frame of image of the video stream; in response to detection of a change of the static gesture from a preset first gesture to a second gesture, suspending the static gesture detection model and activating a preset dynamic gesture detection model; and performing detection on multiple frames of images that are pre-stored in a storage medium using the dynamic gesture detection model to obtain a dynamic gesture recognition result.

Detection of Graphics Added to a Video Signal

The invention allows detecting which graphics, if any, have been added to the video signal at any given time by utilizing only the various signals provided by prior art hardware. A first video signal, graphics signal(s), and a second video signal are received. It is then determined which graphics, if any, are present in a given frame of the received second video signal based on comparing actual values of pixels of the received second video signal and calculated values of pixels derived from the first video signal, and the graphics signal(s), and the combination of graphics signal(s) which produces the best match is searched for.

Crop-Based Compression of Videos

A method, system and product for compressing videos. The method comprising: obtaining a video that comprises a sequence of video frames, wherein the sequence of video frames comprises at least a first frame and a second frame, wherein the first frame is ordered before the second frame in the sequence of video frames; determining to preserve the first frame in its entirety; and in response to a determination to utilize a partial frame instead of the second frame: cropping the second frame to determine a cropped frame, wherein the cropped frame is smaller in at least one dimension than the second frame, wherein said cropping is based on an anchor location; whereby an alternative video can be constructed using the first frame and the cropped frame, wherein the alternative video does not include a remainder portion of the second frame in an explicit manner.

Cloud-based communication system for monitoring and facilitating collaboration sessions

A cloud-based communication system for monitoring a collaboration session. Based on the monitoring, the system identifies a collaboration event that indicates desirability of a break or that a digression from a session topic has or is occurring. When a collaboration event is identified, a prompt is communicated to the facilitator of the collaboration session. The collaboration event may be defined in a variety of ways such as participant fatigue, participant distraction, or the like. The system provides the facilitator with actions to be initiated by the system (automatically or in response to facilitator/user input) to respond to an identified communication event. The actions include initiating a break, acting to avoid or reduce session digressions, and creating a highlight reel of the collaboration session, including a number of unique features enabling more efficient retrieval and/or review of data. A distracted or fatigued participant can be directed to access the highlight reel.

Generating highlight videos in an online game from user expressions

This disclosure relates to generating video edits. The video edits are highlight videos of gameplay of an online game. The video edits comprise of one or more video clips of the online game. A video clip includes a portion of a recording of the gameplay of the online game. From user emotional manifestations, events of interests, and/or other information of the online game, the portion of the recording of the online game to include in the video clip are determined. The user is presented with access to the video edits and/or previews to the video edits.

Video-based activity recognition

Systems and techniques are provided for performing video-based activity recognition. For example, a process can include extracting, using a first machine learning model, first one or more features from a first frame and second one or more features from a second frame. The first one or more features and the second one or more features are associated with a person driving a vehicle. The process can include processing, using a second machine learning model, the first one or more features and the second one or more features. The process can include determining, based on processing of the first one or more features and the second one or more features using the second machine learning model, at least one activity associated with the person driving the vehicle.

Determining images of article for extraction

A content application determines images of an article for extraction. The content application identifies an initial image associated with a content of the article. A caption and a credit line associated with the initial image is detected and the initial image is extracted along with the caption and the credit line. A second image of the article associated with a video is also detected and extracted along with the video. In addition, the content application extracts a slideshow detected within the article.

Video editing

A computer implemented method for editing a video file, the method comprising: loading the video file comprising a first scene followed by a second scene, the first scene having a first theme where the first scene meets the second scene and the second scene having a second theme where the second scene meets the first scene; detecting a transition point where the first scene ends and the second scene begins; selecting an intermediate scene from a library of intermediate scenes based on at least one of the first and second themes, the intermediate scene having at least one region onto which information can be overlaid; and inserting the selected intermediate scene between the first scene and second scene.

Trusted user identification and management for home automation systems

Various arrangements for determining and setting an authorization level for an unknown person are presented. Facial recognition may be performed on a received video stream. An authorized user may be recognized in the video feed. Additionally, an unknown person may be identified in the video feed. A provisional authorization level may be granted for the unknown person based on proximity between the unknown person and the authorized user in the received video stream.

Controlling bandwith utilization of video transmissions for quality and scalability

A method of managing bandwidth associated with video transmissions over a computer network is disclosed. A plurality of video transmissions is received from a plurality of video cameras connected to a computer surveillance system via the computer network. Quality levels of the plurality of video transmissions are set to a first level. A first analysis is performed on a video transmission to identify whether a region of interest exists. A quality level of the video transmission is increased to a second level with respect to the region of interest. A second analysis is performed on the region of interest to identify whether an actionable event has occurred in an area monitored by one of the plurality of video cameras. The quality level may subsequently be restored to the first level to keep usage of the bandwidth efficient and scalable for a large number of camera nodes.

Method and system for cooperatively collecting video data from driving recorders

A method for cooperatively collecting video data from driving recorders includes steps of: by a driving recorder serving as a requesting device, broadcasting a video request; by another driving recorder serving as a cooperative device, generating a video file in response to receipt of the video request, encrypting the video file to result in an encrypted file, and transmitting the encrypted file to a video file server; by the video file server, decrypting the encrypted file to result in the video file, storing the video file, and sending a success notification of video data collection to a user device based on contact information contained in pre-stored registration data.

Method and arrangement for analysing the behaviour of a moving object

The detected movements of an object are analyzed. Each location record includes coordinates of a detected or assumed location of the object and time information. For a number of location records, there is calculated a location-record-specific descriptor value that becomes the more significant the more densely there are other location records around the location record for which the descriptor value is calculated. After selecting a location record that has the most significant descriptor value, those other location records are found that according to their time information are the latest and earliest in a certain environment. The analysis result is that the object stopped at the coordinates of the selected location record for a stopping time calculated from the time information of the latest and earliest location records.

Positional analysis using computer vision sensor synchronization

System and techniques for positional analysis using computer vision sensor synchronization are described herein. A set of sensor data may be obtained for a participant of an activity. A video stream may be captured in response to detection of a start of the activity in the set of sensor data. The video stream may include images of the participant engaging in the activity. A key stage of the activity may be identified by evaluation of the sensor data. A key frame may be selected from the video stream using a timestamp of the sensor data used to identify the key stage of the activity. A skeletal map may be generated for the participant in the key frame using key points of the participant extracted from the key frame. Instructional data may be selected using the skeletal map. The instructional data may be displayed on a display device.

Method and apparatus for processing images, device and storage medium

A method for processing images, including: acquiring an original image and auxiliary information of the original image; acquiring an object feature map by inputting the original image into a main path of a first visual task processing model, and acquiring an auxiliary feature map by inputting the auxiliary information into a branch path of the first visual task processing model; and acquiring a response map of the original image by fusing the object feature map and the auxiliary feature map and inputting fused object feature map and auxiliary feature map into the main path of the first visual task processing model.

METHODS AND APPARATUSES FOR MANAGING VISITOR INFORMATION, ELECTRONIC DEVICES AND STORAGE MEDIA

Methods, devices, apparatuses, systems, and computer-readable storage media for managing visitor information are provided. In one aspect, a method includes: receiving a follow-up request for a target visitor included in unfollowed-up visitors in a visitor list, obtaining information of accompanying persons of the target visitor from a server-side computing system in response to the follow-up request, establishing a visitor group including the target visitor based on the target visitor and the accompanying persons of the target visitor to associate information of multiple visitors in the visitor group, and displaying the information of multiple visitors in the visitor group. 1. A method for managing visitor information , comprising:receiving a follow-up request for a target visitor by a client-side computing system, wherein the target visitor is included in unfollowed-up visitors in a visitor list;obtaining information of accompanying persons of the target visitor from a server-side computing system in response to the follow-up request by the client-side computing system;establishing a visitor group including the target visitor based on the target visitor and the accompanying persons of the target visitor to associate information of multiple visitors in the visitor group by the client-side computing system; anddisplaying the information of multiple visitors in the visitor group by the client-side computing system.2. The method according to claim 1 , wherein establishing the visitor group including the target visitor based on the target visitor and the accompanying persons of the target visitor comprises:displaying the information of the accompanying persons of the target visitor by the client-side computing system; andin response to a first operation of selecting a target accompanying person from the accompanying persons of the target visitor, adding the target accompanying person to the visitor group by the client-side computing system.3. The method according to ...

Sharing and Presentation of Content Within Augmented-Reality Environments

In one embodiment, a method includes rendering an augmented-reality environment on a display associated with a first computing device that is associated with a first user; determining that the first computing device is authorized to access an augmented-reality content item associated with a location within the augmented-reality environment based on social-networking information associated with the first user, wherein the augmented-reality content item is associated with a second user; receiving, by the first computing device, information configured to render the augmented-reality content item at the associated location within the augmented-reality environment; and rendering, on the display associated with the first computing device, the augmented-reality content item within the augmented-reality environment.

Area monitoring and communication

A room monitoring apparatus includes an outer shell which includes a first area transparent to at least some wavelengths of infrared radiation, a second area transparent to visible light, and a third area adapted to be positioned on a surface. A static portion is fixed to a portion of the outer shell and a rotatable portion is rotationally coupled to the static portion. The rotatable portion includes an infrared sensor positioned to receive infrared light from the room through the first area of the outer shell and an imaging sensor, separate from the infrared sensor, positioned to receive visible light from the room through the second area of the outer shell. The apparatus also includes a motor arranged to rotate the rotatable portion with respect to the static portion, a processor coupled to the infrared sensor and the imaging sensor, and a communications interface coupled to the processor.

Content Based Video Content Segmentation

A method receives video content and metadata associated with video content. The method then extracts features of the video content based on the metadata. Portions of the visual, audio, and textual features are fused into composite features that include multiple features from the visual, audio, and textual features. A set of video segments of the video content is identified based on the composite features of the video content. Also, the segments may be identified based on a user query.

Photographing method and electronic device

A photographing method and an electronic device are provided, so that a to-be-photographed target can continue to be tracked after the to-be-photographed target returns to a shooting image, to improve accuracy of focusing performed during photographing of a moving object. The method includes: displaying a first image including a first object and a tracking indicator that is associated with the first object, the tracking indicator indicating that the first object is a tracked target; displaying a second image that does not include the first object or the tracking indicator; displaying a third image including the first object; automatically setting the first object as the tracked target and displaying the tracking indicator associated with the first object; and automatically focusing on the first object when displaying the third image.

Sign Language Information Processing Method and Apparatus, Electronic Device and Readable Storage Medium

Sign language information processing method and apparatus, an electronic device and a readable storage medium provided by the present disclosure, achieve real-time collection of language data in a current communication of a user by obtaining voice information and video information collected by a user terminal in real time; and then match a speaking person with his or her speaking content by determining, in the video information, a speaking object corresponding to the voice information; and finally, make it possible for the user to clarify the corresponding speaking object when the user sees AR sign language animation in a sign language video by superimposing and displaying an augmented reality AR sign language animation corresponding to the voice information on a gesture area corresponding to the speaking object to obtain a sign language video. Therefore, it is possible to provide a higher user experience.

System and method for identifying illegal motor vehicle activity

A system for identifying illegal motor vehicle activity includes a camera configured to capture a plurality of image of a vehicle of interest within a predetermined area in proximity to the camera. A license plate recognition (LPR) device reads characters displayed on a vehicle registration plate of the vehicle of interest. The LPR identifies an owner of the vehicle of interest. A computer including a processor and a memory records at least one image of the plurality of images displaying an occurrence of an illegal act performed by the vehicle of interest and identify information of the owner of the vehicle of interest based on the characters displayed on the vehicle registration plate of the vehicle of interest.

Classification using multiframe analysis

A system for video analysis includes an interface and a processor. The interface is configured to receive a trigger indication. The processor is configured to determine a time sequence set of video frames associated with the trigger indication; determine a decision based at least in part on an analysis of the time sequence set of video frames; and indicate the decision.

Interactive augmented reality (ar) based video creation from existing video

This disclosure describes a method including determining one or more object clusters from a plurality of frames of the video content. At least one of the one or more object clusters is an object cluster with movement through the plurality of frames. The method includes extracting the determined one or more object clusters from the plurality of frames to generate a set of frames having extracted one or more object clusters and outputting the set of frames having extracted one or more object clusters. This disclosure describes a method including receiving the set of frames having the extracted one or more object clusters, rendering one or more of the set of frames in a live camera feed of a device, and generating video content based on the rendered one or more set of frames and a user interacting with the extracted one or more object clusters.

Surveillance assist device

A swing unit (411) performs swing control of causing a camera which photographs a stationary object to change a photographing range. A position calculation unit (413) calculates a last-time position representing a portion showing the stationary object in a last-time image obtained by the camera before the swing control, and a this-time position representing a portion showing the stationary object in a this-time image object obtained by the camera after the swing control. A verification unit (415) determines whether the this-time image is a false image based on a quantity of change in the photographing range resulting from the swing control and a quantity of change in the this-time position from the last-time position.

Dynamic haptic generation based on detected video events

A method or system that receives input media including at least video data in which a video event within the video data is detected. Related data that is associated with the detected video event is collected and one or more feature parameters are configured based on the collected related data. The type of video event is determining and a set of feature parameters is selected based on the type of video event. A haptic effect is then automatically generated based on the selected set of feature parameters.

Multi-sensor event detection and tagging system

A sensor event detection and tagging system that analyzes data from multiple sensors to detect an event and to automatically select or generate tags for the event. Sensors may include for example a motion capture sensor and one or more additional sensors that measure values such as temperature, humidity, wind or elevation. Tags and event detection may be performed by a microprocessor associated with or integrated with the sensors, or by a computer that receives data from the microprocessor. Tags may represent for example activity types, players, performance levels, or scoring results. The system may analyze social media postings to confirm or augment event tags. Users may filter and analyze saved events based on the assigned tags. The system may create highlight and fail reels filtered by metrics and by tags.

Management system

A management system for managing game token includes, a holder identification device for identifying the holder of the game token by referring to a memory that stores the holder of the game token when a game token s used, a player identification device for identifying the player who used the game token when the game token is used, and a controller that generates an error signal when the holder identified by the holder identification device and the player identified by the player identification device do not match for the game token that have been used.

Picture focusing method, apparatus, terminal, and corresponding storage medium

Provided by the present invention is a picture focusing method, comprising: acquiring a video picture, and, according to an instruction command, determining a target object in the video picture; determining picture depth information of a video picture region in which the target object is located; acquiring parameter information of a camera corresponding to multiple video picture frames; using the picture depth information of the video picture region and the parameter information of the camera as the input of a preset focusing neural network model; and using focus adjustment information of the camera to perform a focus adjustment operation on the camera.

Method and system for detecting flow velocity of high-temperature molten fluid

A method for detecting a flow velocity of a high-temperature molten fluid can include: collecting a video stream of a high-temperature high-velocity molten fluid, decomposing the video stream into a frame image sequence sorted by time, and extracting a molten fluid Region Of Interest (ROI) from the frame image sequence, extracting a molten fluid outline of the molten fluid ROI, and extracting a characteristic block of the molten fluid outline, and obtaining the flow velocity of the molten fluid based on the characteristic block. A flow velocity detection accuracy can be improved for a molten fluid with a high temperature, a high velocity and a high glossiness.

Live broadcast interaction method and apparatus, live broadcast system and electronic device

Provided are a live broadcast interaction method and apparatus, a live broadcast system and an electronic device. The method comprises: when it is detected from an anchor video frame collected by a video collection apparatus in real time that an anchor initiates an anchor interaction action, detecting an action posture and an action type of the anchor interaction action, wherein the anchor interaction action comprises a target prop wearing action and/or a target limb action; and then, generating, according to the action posture and the action type of the anchor interaction action, an interaction video stream of a virtual image corresponding to the anchor, and sending the interaction video stream of the virtual image to a live broadcast receiving terminal by means of a live broadcast server and playing same.

Computer-implemented Interfaces for Identifying and Revealing Selected Objects from Video

A computer-implemented visual interface for identifying and revealing objects from video-based media provides visual cues to enable users to interact with video-based media. Objects in videos are inferred and identified based upon automatic interpretations of the video and/or audio that is associated with the video. The automatic interpretations may be performed by a computer-implemented neural network. The computer-implemented visual interface is integrated with the video to enable users to interact with the identified objects. User interactions with the visual interface may be through either touch or non-touch means. Information is delivered to users that is based upon the identified objects, including in augmented or virtual reality-based form, responsive to user interactions with the computer-implemented visual interface.

Method, system and apparatus for selecting a video frame

A method of selecting at least one video frame of a video sequence comprising a plurality of video frames. The method determines a time for analysis based on length of the video sequence and processing capability of a running device. A first sampling pattern is based on the determined time for analysis. A first set of frames in the video sequence is sampled using a first sampling pattern. The first set is sampled infrequently throughout the video sequence in accordance with the first sampling pattern. A candidate frame is determined from the sampled frames based on image quality. A second set of the frames comprising one or more of the frames in a narrow range of the video sequence near the determined candidate frame, is determined in accordance with a second sampling pattern. At least one of the video frames is selected from the sampled frames based on image quality.

System for background subtraction with 3d camera

A system for background image subtraction includes a computing device coupled with a 3D video camera, a processor of the device programmed to receive a video feed from the camera containing images of one or more subject that include depth information. The processor, for an image: segments pixels and corresponding depth information to identify foreground regions associated with a target user.

ELECTRONIC DEVICE AND METHOD FOR PROCESSING DATA RECEIVED FROM IN-VEHICLE ELECTRONIC DEVICE

Video streaming from the first external electronic device, such as the vehicle image acquisition device according to various embodiments, may be processed based on a designated state (e.g., a traffic accident) identified by the first external electronic device. For example, when receiving a notification related to a designated state from the first external electronic device, the electronic device may acquire information related to the designated state and then broadcast the obtained information to one or more terminals (e.g., terminal of FIG. ), through a second external electronic device such as a navigation server. In response to the broadcasting, the terminal may provide information related to the designated state to the user of the terminal. The information may be used to change a navigation path provided by the terminal.

Video surveillance system and video surveillance method

A video surveillance system includes: a detection unit that detects a predetermined event on the basis of an image captured by a first imaging apparatus; and a control unit that controls a second imaging apparatus such that the second imaging apparatus captures an image of a predetermined position after the detection of the predetermined event.

System and method for contextually enriching a concept database

A system and method for contextually enriching a concept database. The method includes determining, based on at least one signature of a first multimedia data element (MMDE) and signatures of a plurality of third concepts stored in the concept database, at least one matching first concept among the plurality of third concepts; generating a reduced representation of the first MMDE; comparing the reduced representation of the first MMDE to signatures representing a plurality of second MMDEs to determine a plurality of matching MMDEs among the plurality of second MMDEs; generating, based on the reduced representation of the first MMDE and the signatures representing the plurality of matching MMDEs, a second concept; and generating at least one context based on the second concept and the plurality of third concepts, wherein each context includes at least one common pattern among the second concept and at least one of the plurality of third concepts.

Falling detection method and electronic system using the same

A falling detection method and an electronic system using the same are provided. The falling detection method includes: obtaining a video stream, and performing recognition on a person in an image of the video stream to obtain at least one human body feature; calculating based on the human body feature to obtain at least one falling related feature; calculating at least one movement trend in a plurality of directions of the person in the video stream by using an optical flow algorithm; inputting the falling related feature and the movement trend to a falling classifier, such that the falling classifier generates an output result indicating whether a falling event happens to the person; and sending an alarm according to the output result.

Automatic adaptation of digital content

Embodiments of the present invention provide methods, computer program products, and systems for adapting digital content. Embodiments of the present invention can be used to identify one or more entities in media content. Embodiments of the present invention can determine that an identified entity of the one more identified entities is associated with sensitive material. Embodiments of the present invention can, in response to determining that the identified entity of the one or more identified entities is sensitive, determine a contextual impact of the identified entity. Embodiments of the present invention can also be used to modify the media content based on the determined contextual impact of the identified entity.

Video retrieval in feature descriptor domain in an artificial intelligence semiconductor solution

A video retrieval system may include a feature extractor configured to extract first feature descriptors for multiple image frames in the query video. The system may also include a feature extractor to extract second feature descriptors for multiple image frames in a candidate video in a video database. The system may include a comparator to compare the first and second feature descriptors to determine a subset of image frames in the candidate video that are similar to the first video. The system may output die query output by displaying the subset of image frames in a slide show. The system may also output the query by displaying a video formed by at least the subset of image frames. The feature extractor may be implemented in a convolution neural network (CNN) in an artificial intelligence (AI) chip. The system may include key frame extractor to detect key frames in the video.

Surgical Image Processing and Reporting System (SIPORS)

Surgical Image Processing and Reporting System (SIPORS) will be able to record the procedure along with transcribing the video into text through Artificial Intelligence. Artificial Intelligence is built into the system by using cameras. Through this, the system will write operative reports for doctors by going through a Writing Module in the system. Post-surgery, the doctors will be able to review the report written by the system and make edits to it. Since this is an artificial intelligence system, it will be able to learn and save the new edits the doctor makes. It will not be necessary to make this same edit again. As of now, doctors are burdened and exhausted due to the several hours spent writing the operative report. Therefore, we invented this system that reduces the time it requires to write the report.

Low-cost video segmentation

Methods, systems, and devices for low-cost video segmentation are described. A media file may include multiple frames. Information for pixels in a first frame and pixels in a subsequent frame may be discarded based on segmentation maps computed for the first and subsequent frame. After discarding the pixel information, motion information may be determined for the remaining pixels in the first and subsequent frame. The segmentation maps generated for the first and subsequent frames and the determined motion information may be used to compute one or more additional segmentation maps for one or more additional frames that are temporally located between the first and subsequent frame. After computing segmentation maps for all or a portion of the frames in the media file, a modified version of the frames may be output based on the computed segmentation maps.

Method for detecting and classifying a motor seizure

The invention relates to a method for detecting and classifying a motor seizure. The method comprises receiving video data of a patient; detecting a first anomaly in the video data as anomaly in movement of the patient; determining a video frame stack comprising the first anomaly; classifying the video frame stack using a pre-trained neural network to obtain a first classification; and determining a motor seizure type based on the first classification.

Drone device

A fact checking system utilizes social networking information and analyzes and determines the factual accuracy of information and/or characterizes the information by comparing the information with source information. The social networking fact checking system automatically monitors information, processes the information, fact checks the information and/or provides a status of the information, including automatically modifying a web page to include the fact check results. The fact checking system is able to be implemented utilizing a drone device.

Techniques For Detecting Depleted Stock

A computer-implemented method is disclosed herein. The method includes the step of receiving, at a processing device of a commerce server, at least a video signal from a head mountable unit worn by a consumer in a retail store. The method also includes the step of identifying, with the processing device, an indication of depleted stock in the retail store in response to the video signal received from the head mountable unit. The method also includes the step of transmitting, with the processing device, a restock signal in response to the identifying step.

Methods and systems for object-recognition and link integration in a composite video stream

Disclosed herein are methods and systems for object recognition and link integration in a composite video stream. One embodiment takes the form of a process that includes detecting an object of interest in a set of video frames. The process also includes tracking the movements of the detected object of interest across a subset of the video frames in the set of video frames. The process further includes generating a composite video stream from the video frames in the subset. The composite video stream shows the tracked movements of the detected object of interest without showing background data from the video frames in the subset. The process also includes outputting the generated composite video stream.

INTELLIGENT RECOGNITION AND ALERT METHODS AND SYSTEMS

An intelligent target object detection and alerting platform may be provided. The platform may receive a content stream from a content source. A target object may be designated for detection within the content stream. A target object profile associated with the designated target object may be retrieved from a database of learned target object profiles. The learned target object profiles may be associated with target objects that have been trained for detection. At least one frame associated with the content stream may be analyzed to detect the designated target object. The analysis may comprise employing a neural net, for example, to detect each target object within each frame. A parameter for communicating target object detection data may be specified. In turn, when the parameter is met, the detection data may be communicated. 1. A method comprising: 'identifying at least one target object profile from a database of target object profiles;', 'establishing at least one target object to detect from a plurality of content streams, wherein establishing the at least one target object to detect comprisesestablishing at least one parameter for assessing the at least one target object, the at least one parameter being associated with a plurality of learned target object profiles trained by an Artificial Intelligence (AI) engine; a time of day the at least one target object is likely to be detected, and', 'a location that the at least one target object is likely to be detected;, 'calculating, with regard to the at least one target object, at least one of the following the time of day the at least one target object is likely to be detected, and', 'the location the at least one target object is likely to be detected., 'providing at least one data point to an end-user, the at least one data point comprising at least one of the following2. The method of claim 1 , wherein providing the at least one data point comprises providing the at least one data point that enables the end ...

NEURAL NETWORK-BASED IMAGE STREAM MODIFICATION

Systems, devices, media, and methods are presented for object detection and inserting graphical elements into an image stream in response to detecting the object. The systems and methods detect an object of interest in received frames of a video stream. The systems and methods identify a bounding box for the object of interest and estimate a three-dimensional position of the object of interest based on a scale of the object of interest. The systems and methods generate one or more graphical elements having a size based on the scale of the object of interest and a position based on the three-dimensional position estimated for the object of interest. The one or more graphical elements are generated within the video stream to form a modified video stream. The systems and methods cause presentation of the modified video stream including the object of interest and the one or more graphical elements. 1. A method comprising:receiving, by one or more processors, an image;detecting an object of interest within at least a region of interest in the image;identifying a bounding box for the object of interest;determining a distance between the bounding box and the region of interest;comparing the distance to a threshold;applying a non-linear function to compute a score based on a result of comparing the distance to the threshold; andgenerating, based on the score of the bounding box, one or more graphical elements within the image to form a modified image.2. The method of claim 1 , further comprising:identifying the bounding box for the object of interest using a detector.3. The method of claim 2 , wherein the detector is trained to identify the bounding box by reducing loss between a predicted box for a training image and a ground-truth box of the training image.4. The method of claim 1 , wherein the image is a frame of a video.5. The method of claim 1 , wherein the non-linear function decays scores of bounding boxes linearly based on a measure of overlap in relation to the ...

AUTOMATED EXAMINATION PROCTOR

A system is provided for performing a validation of an examination environment. The system acquires a video of the examination environment. The system applies one or more machine learning models to images (frames) of the video to indicate whether the image includes a prohibited item. A machine learning model may be trained using images of items labeled with an indication of whether an image includes a prohibited item. The system determines whether the validation has passed based on whether an image includes a prohibited item. The system notifies a proctor of when the validation has not passed and provides to the proctor an indication of an image that contains a prohibited item. The proctor then decides whether the validation should pass or fail. 1. A method performed by one or more computing systems to monitor an examination , the method comprising: acquiring a pre-examination examinee image of an examinee;', 'determining whether the pre-examination examinee image matches an authoritative image associated with an identification authority;', 'acquiring pre-examination environment images of an examination environment;', 'determining whether the pre-examination environment images include prohibited items and required items; and', 'determining whether the pre-examination validation has passed based on whether the pre-examination examinee image and the authoritative image are of the same person and whether the pre-examination environment images do not include a prohibited item and do include required items; and, 'performing a pre-examination validation prior to the examination that includes,'} acquiring examination environment images of the examination environment;', 'determining whether the examination environment images include prohibited items and required items; and', 'determining whether the examination validation has passed based on whether the whether the examination environment images do not include a prohibited item and do include required items., 'performing an ...

SYSTEM AND METHOD SOCIAL DISTANCING RECOGNITION IN CCTV SURVEILLANCE IMAGERY

A system and method for more accurate recognition of adherence to social distancing regulations in image data. A curated dataset of surveillance footage is used that shows people at a variety of angles at a wide variety of distances. The videos of this dataset are annotated and a second, numeric dataset is created as input into various classical machine learning models. The trained model is tested on more annotated data and shows a noticeable improvement over the other attempted methods. The resulting analytics allows for accurate distinction between pairs of people that are at least 6 feet apart and pairs of people that are not. This method utilizes a random forest machine learning model to improve on the Euclidean method that measures distance between human detection centroids in the 2-dimensional target image. 1. A system for recognition of adherence to social distancing regulations in image data comprising:a camera detection system to capture videos;a computer processor to process the video images;a software annotation module to analyze and annotate frames of the video images; anda distance module capable of recognizing people in frames, estimating their distance and classifying compliance/non-compliance of social distancing;wherein the distance module is programmed to detect people that are a distance apart and estimates the distance between all pairs of people and identifies those distances that are not compliant based on a threshold.2. The system of wherein the camera detection system is a CCTV system.3. The system of wherein the camera detection system captures videos at variety of angles at a wide variety of distances.4. The system of wherein the distance apart between people is tunable.5. The system of wherein the tunable distance apart can be set at 6 feet between people.6. The system of wherein the threshold is user-defined.7. The system of wherein the system utilizes various machine learning models that that measures distance between human detection ...

Geofencing with wireless beacon based consumer product marketing

Systems and methods for using wireless beacons in point of purchase (“POP”) displays to facilitate the delivery of consumer oriented content to mobile devices is disclosed. Wireless beacons may be used to broadcast wireless signals from POP displays, where the wireless signals include data packets with unique identifiers for the wireless beacons. The wireless signals may be received by mobile devices. A remote server may communicate with the mobile device and provide the mobile device with up-to-date content associated with the POP displays. A geographic location of the mobile device may be assessed and used to determine if the mobile device is at an acceptable location for displaying the up-to-date content.

Automatically computing emotions aroused from images through shape modeling

Shape features in natural images influence emotions aroused in human beings. An in-depth statistical analysis helps to understand the relationship between shapes and emotions. Through experimental results on the International Affective Picture System (IAPS) dataset, evidence is presented as to the significance of roundness-angularity and simplicity-complexity on predicting emotional content in images. Shape features are combined with other state-of-the-art features to show a gain in prediction and classification accuracy. Emotions are modeled from a dimensional perspective in order to predict valence and arousal ratings, which have advantages over modeling the traditional discrete emotional categories. Images are distinguished vis-a-vis strong emotional content from emotionally neutral images with high accuracy. All of the methods and steps disclosed herein are implemented on a programmed digital computer, which may be a stand-alone machine or integrated into another piece of equipment such as a digital still or video camera including, in all embodiments, portable devices such as smart phones.

Local data acquisition for retail displays with wireless beacons

Systems and methods for using wireless beacons in point of purchase (“POP”) displays to facilitate the delivery of consumer oriented content to mobile devices is disclosed. Wireless beacons may be used to broadcast wireless signals from POP displays, where the wireless signals include data packets with unique identifiers for the wireless beacons. The wireless signals may be received by mobile devices. A remote server may communicate with the mobile device and provide the mobile device with up-to-date content associated with the POP displays. A wireless data collection device may be used to receive and collect data from the wireless beacons. The collected data may be used to assess one or more properties of the POP displays.

Analyzing movement of data collectors/gateways associated with retail displays

Systems and methods for using wireless beacons in point of purchase (“POP”) displays to facilitate the delivery of consumer oriented content to mobile devices is disclosed. Wireless beacons may be used to broadcast wireless signals from POP displays, where the wireless signals include data packets with unique identifiers for the wireless beacons. The wireless signals may be received by mobile devices. A remote server may communicate with the mobile device and provide the mobile device with up-to-date content associated with the POP displays. Wireless data collection devices (such as network gateways) may be used to receive data packets from the wireless beacons provide the data packets to the remote server. Accelerometers may be used on the wireless data collection devices to assess movement of the devices. Movement data for the devices may be used to determine reprogramming of the devices after the devices are moved.

Search and identification of video content

Methods and systems for searching for and retrieving video content via fingerprint matching are described. In some example embodiments, the methods and systems access an index of reference fingerprints, such as quantized values associated with multiple values calculated from patches of a frame, that are associated with sequential frames of known video content. The methods and systems may receive a search query that includes a group of query fingerprints associated with sequential frames of video content presented at a client device, access the index, compare the group of query fingerprints to reference fingerprints of the index, determine that the group of query fingerprints match the reference fingerprints of the index, and identify the video content presented at the client device based on the determined match.

Systems, devices and methods for restoring shopping space conditions

Systems, apparatuses, and methods for restoring shopping space conditions are provided. A system for restoring shopping space conditions comprises a motorized transport unit comprising at least one sensor, and a central computer system comprising a wireless transceiver for communicating with the motorized transport unit. The central computer system being configured to: identify a section of a shopping space having a dropped item, instruct the motorized transport unit to travel to the section of the shopping space and collect information associated with the dropped item using the at least one sensor, determine a characteristic of the dropped item in the section of the shopping space using the at least one sensor of the motorized transport unit, and select a cleaning task from a plurality of cleaning tasks based on the characteristic of the dropped item.

PRESENTER-TRACKER MANAGEMENT IN A VIDEOCONFERENCING ENVIRONMENT

A method for tracking movement of a presenter during a videoconference comprises tracking the location of subject of interest; quickly detecting error conditions—such as can occur when a subject of interest moves too quickly or when a subject of interest walks past another person—and quickly reinitiating the tracking sequence to help ensure a positive videoconferencing experience. 2. The method of claim 1 , wherein tracking the subject of interest further comprises checking for absence of motion in the tracking region claim 1 , and wherein detecting the tracking-error condition based on data within the data stream comprises detecting absence of motion in the tracking region for a predetermined period.3. The method of claim 2 , wherein checking for absence of motion in the tracking region comprises applying a static image filter to the tracking region.4. The method of claim 1 , wherein determining claim 1 , responsive to detecting the tracker initiation data claim 1 , the subject of interest from among the one or more persons within the second frame of the data stream comprises determining personal features information corresponding to the subject of interest;wherein tracking the subject of interest further comprises determining a degree of similarity between personal features information corresponding to the tracking region and the personal features information corresponding to the subject of interest; andwherein detecting the tracking-error condition based on data within the data stream comprises determining that the degree of similarity is below a predetermined threshold value.5. The method of claim 1 , further comprising:detecting a first audio at the videoconferencing endpoint;identifying a source of sound location corresponding to the first audio;detecting facial features information within a subregion of a fourth frame of the data stream corresponding to the source of sound location;calculating an intersection of union between the tracking region and the ...

Techniques for video analytics of captured video content

Examples are disclosed for video analytics of captured video content. In some examples, information may be received from a host processing system for a camera to capture video content. The camera may be a surveillance camera or a camera located with a display device. Video analytics may be performed on the captured video and the captured video content may be encoded. Data associated with the video analytics may then be sent to the host processing system. In some examples, the data as well as encoded captured video content or streaming video may be sent via communication channels included in an interconnect. Other examples are described and claimed.

Video retrieval method, and method and apparatus for generating video retrieval mapping relationship

The present disclosure relates to a video retrieval method, system and device for generating a video retrieval mapping relationship, and a storage medium. The video retrieval method comprises: acquiring a retrieval instruction, wherein the retrieval instruction carries retrieval information for retrieving a target frame picture; and obtaining the target frame picture according to the retrieval information and a preset mapping relationship. The method for generating a video retrieval mapping relationship comprises: performing a feature extraction operation on each frame picture in a video stream by using a feature extraction model so as to obtain a key feature sequence corresponding to each frame picture; inputting the key feature sequence corresponding to each frame picture into a text sequence extraction model for processing so as to obtain a text description sequence corresponding to each frame picture; and constructing a mapping relationship according to the text description sequence corresponding to each frame picture.

Shopping facility track system and method of routing motorized transport units

Some embodiments include a track system comprising: an elevated track system comprising a series of elevated tracks that are positioned elevated above a sales floor and products distributed over at least a portion of the sales floor of a retail store, and configured such that multiple motorized transport units travel along the series of elevated tracks in traversing at least portions of the retail store.

System and method for using apparent size and orientation of an object to improve video-based tracking in regularized environments

A system and method for optimizing video-based tracking of an object of interest are provided. A video of a regularized motion environment that comprise multiple video frames is acquired and an initial instance of an object of interest in one of the frames is then detected. An expected size and orientation of the object of interest as a function of the location of the object is then determined. The location of the object of interest is then determined in a next subsequent frame using the expected size and orientation of the object of interest.

Image Cropping Using Supervised Learning

Software for supervised learning extracts a set of pixel-level features from each source image in collection of source images. Each of the source images is associated with a thumbnail created by an editor. The software also generates a collection of unique bounding boxes for each source image. And the software calculates a set of region-level features for each bounding box. Each region-level feature results from the aggregation of pixel values for one of the pixel-level features. The software learns a regression model, using the calculated region-level features and the thumbnail associated with the source image. Then the software chooses a thumbnail from a collection of unique bounding boxes in a new image, based on application of the regression model. The software uses a thumbnail received from an editor instead of the chosen thumbnail, if the chosen thumbnail is of insufficient quality as measured against a scoring threshold.

MULTIMEDIA INFORMATION PROCESSING METHOD, APPARATUS, ELECTRONIC DEVICE, AND MEDIUM

A multimedia information processing method, apparatus, electronic device, and medium are provided. The method includes: receiving a user's selection operation for any piece of multimedia information among multimedia information to be processed, the multimedia information to be processed comprising at least two pieces of multimedia information, any piece of multimedia information being any piece of multimedia information except the last piece; determining a target multimedia information piece on the basis of a selected operation; upon receiving a trigger operation for the target multimedia information piece, determining a corresponding processing method; on the basis of the determined processing method, correspondingly processing the target multimedia information piece. Thus, the complexity of processing multimedia information is reduced and efficiency is improved, thereby improving user experience. 1. A method for processing multimedia information , comprising:receiving, from a user, a selection operation on an arbitrary multimedia segment in to-be-processed multimedia information, wherein the to-be-processed multimedia information comprises at least two multimedia segments, and the arbitrary multimedia segment is not a last multimedia segment among the at least two multimedia segments:determining a target multimedia segment based on the selection operation;determining a processing mode, when a trigger operation on the target multimedia segment is received; andprocessing the target multimedia segment, based on the determined processing mode.2. The method according to claim 1 , wherein before the receiving claim 1 , from a user claim 1 , a selection operation on an arbitrary multimedia segment in to-be-processed multimedia information claim 1 , the method further comprises:displaying identification information corresponding to respective multimedia segments in the to-be-processed multimedia information, andthe receiving, from a user, a selection operation on an ...