СПОСОБ И УСТРОЙСТВО ДЛЯ ДОСТУПА К ЦИФРОВОМУ ФАЙЛУ ИЗ НАБОРА ЦИФРОВЫХ ФАЙЛОВ

... 1. Способ доступа, по меньшей мере, к одному цифровому файлу из набора, содержащего более чем один цифровой файл, в электронном устройстве, включающий в себя этапы, на которых ! формируют один индекс, содержащий информационные элементы, полученные из каждого из более чем одного цифрового файла в наборе, при этом каждый цифровой файл в информационном наборе связывается, по меньшей мере, с одним информационным элементом, по меньшей мере, один информационный элемент существует на любом языке и извлечен, по меньшей мере, из одного кодового набора символов; ! принимают независимый от говорящего голосовой ввод, по меньшей мере, на одном языке во время режима восприятия речи; ! определяют язык голосового ввода из множества языковых моделей, языковые модели выбираются на основе, по меньшей мере, одного кодового набора символов; ! устанавливают режим восприятия речи на язык голосового ввода; и ! сравнивают голосовой ввод, принятый во время режима восприятия речи, с элементами в индексе, ! при этом ...

Erweitern einer Informationsanforderung

Eine elektronische Einheit weist ein Mikrofon zum Empfangen einer mündlichen Informationsanforderung zu einem nicht näher bestimmten Objekt auf. Ein Sensor empfängt Erweiterungsinformationen zu dem nicht näher bestimmten Objekt. Kombinationslogik kombiniert Informationen aus der mündlichen Anforderung mit den Erweiterungsinformationen zu einer Informationsanforderung mit kombiniertem Format. Informationsabruflogik ruft dann eine Antwort auf die Informationsanforderung mit kombiniertem Format ab.

Processing audio-video data to produce metadata

A system for processing audio-video content to produce metadata receives the audio-video content at an extraction unit for extracting samples. The samples represent phoneme or grapheme representations of spoken speech. A processing unit is arranged to process the samples and assign an N dimensional vector to each sample. A metadata unit receives the N dimensional vector values and produces metadata by producing an average N dimensional vector for sub-parts of the whole of the audio video content.

Digitising analog audio data

A system and method for speeding up database lookups for multiple synchronized data streams

Search with joint image-audio queries

Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for processing joint image-audio queries. In one aspect, a method includes receiving, from a client device, a joint image-audio query including query image data and query audio data. Query image feature data is determined from the query image data. Query audio feature data is determined from the audio data. The query image feature data and the query audio feature data are provided to a joint image-audio relevance model trained to generate relevance scores for a plurality of resources, each resource including resource image data defining a resource image for the resource and text data defining resource text for the resource. Each relevance score is a measure of the relevance of corresponding resource to the joint image-audio query. Data defining search results indicating the order of the resources is provided to the client device.

Voice instructions during navigation

A method of providing navigation on an electronic device when the display screen is locked. The method receives a verbal request to start navigation while the display is locked. The method identifies a route from a current location to a destination based on the received verbal request. While the display screen is locked, the method provides navigational directions on the electronic device from the current location of the electronic device to the destination. Some embodiments provide a method for processing a verbal search request. The method receives a navigation-related verbal search request and prepares a sequential list of the search results based on the received request. The method then provides audible information to present a search result from the sequential list. The method presents the search results in a batch form until the user selects a search result, the user terminates the search, or the search items are exhausted.

LEXICAL DIALECT ANALYSIS SYSTEM

Techniques for using a lexical dialect analysis system to analyze words based on sound pattern constraints and non-sound specific constraints are described herein. A first set of sound pattern constraints specifying word positions of phonetic sounds is applied to a set of lexicon entries to produce a first subset of the set of lexicon entries. A second set of non-sound specific constraints specifying non-sound specific aspects of words is also applied to the set of lexicon entries to produce a second subset of the set of lexicon entries. The lexicon entries that satisfy both sets of constraints are returned.

Guiding creation for music-related content

DEVICE AND CONTROL METHOD FOR THE DEVICE

... 본 발명은 전자기기에 관한 것으로, 좀 더 구체적으로 멀티미디어를 출력하는 전자기기 및 그것의 제어 방법에 관한 것이다. 본 발명에 따른 전자기기는, 재생 중인 곡에 대한 오디오 정보를 출력하는 오디오 출력부, 상기 재생과 관련된 정보를 출력하는 디스플레이부 및 상기 디스플레이부 상에 상기 곡이 속한 플레이 리스트(play list)에 대한 정보를 출력하는 제어부를 포함하고, 상기 제어부는, 상기 디스플레이부의 일 영역에 상기 플레이 리스트(play list)에 포함된 곡들에 각각 연계된 그래픽 객체들을 나열하고, 상기 그래픽 객체들 중 상기 곡에 해당하는 그래픽 객체를 이용하여 상기 재생과 관련된 정보를 출력하는 것을 특징으로 한다.

Methods for using extracted features to perform an action

A computer system comprising one or more processors and computer-readable media operatively connected thereto, having stored thereon instructions for carrying out the steps of: maintaining one or more databases comprising first electronic data comprising digitally created reference compact electronic representations for each of a plurality of reference electronic works and second electronic data associated with the reference electronic works and related to action information corresponding thereto; obtaining a first digitally created compact electronic representation comprising one or more extracted feature vectors of a first electronic work; identifying a matching reference electronic work by comparing the first digitally created compact electronic representation of the first electronic work with the first electronic data using a sub-linear search of the first electronic data; determining the action information corresponding to the matching reference electronic work based on the second ...

VISUAL AND MULTI-DIMENSIONAL SEARCH

A system that can analyze a multi-dimensional input thereafter establishing a search query based upon extracted features from the input. In a particular example, an image can be used as an input to a search mechanism. Pattern recognition and image analysis can be applied to the image thereafter establishing a search query that corresponds to features extracted from the image input. The system can also facilitate indexing multi-dimensional searchable items thereby making them available to be retrieved as results to a search query. More particularly, the system can employ text analysis, pattern and/or speech recognition mechanisms to extract features from searchable items. These extracted features can be employed to index the searchable items.

METHOD AND APPARATUS FOR GENERATING DIGITAL SCORE FILE OF SONG, AND STORAGE MEDIUM

A method and an information processing apparatus to generate a digital score file of a song are described. The information processing apparatus includes processing circuitry. The processing circuitry is configured to obtain a candidate audio file satisfying a first condition from audio files of unaccompanied singing of the song without instrumental accompaniment. The processing circuitry is configured to divide the candidate audio file into valid audio segments based on timing information of the song, and extract pieces of music note information from the valid audio segments. Each of the pieces of music note information includes at least one data set of a music note in the song. The data set includes an onset time, a duration, and a music note value of the music note. The processing circuitry is configured to generate the digital score file based on the pieces of music note information.

QUERY-BASED GRANULARITY SELECTION FOR PARTITIONING RECORDINGS

A processor may receive a query from a user. The processor may identify one or more subjects in the query. The one or more subjects may include a particular subject. The processor may identify one or more sections of a recording. The processor may group the one or more sections into one or more subdivisions. The processor may determine that the particular subject is in at least one of the one or more sections. The processor may display the one or more subdivisions of the one or more sections that include the particular subject to the user.

Method and system for managing rights for digital music

A method is described for managing rights for digital music, including registering music players, from among a plurality of music players, with digital archives that store songs, from among a plurality of digital archives, wherein songs can be copied from digital archives to music players, and from music players to digital archives, permitting a music player to copy a song from a digital archive for which it is registered, permitting a digital archive to copy a song from a music player that is registered with the digital archive, restricting a music player from copying a song from a digital archive for which it is not registered, and restricting a digital archive from copying a song from a music player that is not registered with the digital archive. A system and a computer-readable storage medium are also described.

DISPLAY APPARATUS AND METHOD FOR QUESTION AND ANSWER

A display apparatus and a method for questions and answers includes a display unit includes an input unit configured to receive user's speech voice; a communication unit configured to perform data communication with an answer server; and a processor configured to create and display one or more question sentences using the speech voice in response to the speech voice being a word speech, create a question language corresponding to the question sentence selected from among the displayed one or more question sentences, transmit the created question language to the answer server via the communication unit, and, in response to one or more answer results related to the question language being received from the answer server, display the received one or more answer results. Accordingly, the display apparatus may provide an answer result appropriate to a user's question intention although a non-sentence speech is input.

Media fingerprinting for content determination and retrieval

Audio fingerprinting and other media matching technologies can be used to identify broadcast media, such as television shows and radio broadcasts. A user device can record image, audio, and/or video information and upload information to a matching service that is able to use matching technology to identify the media and provide supplemental content or information to the user. The user might receive information identifying a product in an advertisement, identifying an actor on screen in a movie at a particular time, or other such information. In some embodiments, the user can receive access to a digital copy of the captured media, such as the ability to download a copy of a program in which a user expressed interest. Since a user might capture media information after the point of interest, a device can buffer a window of recently captured media in order to attempt to identify the intended media.

Generating media content playlists including interstitials combined with media content items

A method includes identifying a plurality of media content items for a playlist, each of the plurality of media content items having an introductory segment, one or more main segments, and an ending segment; determining a length of an ending segment of a first media content item and a length of an introductory segment of a second media content item; selecting an interstitial to be added to the playlist between one or more main segments of the first media content item and one or more main segments of the second media content item; and responsive to determining that a length of the interstitial is less than a combined length of the ending segment and the introductory segment, adjusting an overlap on the interstitial of the ending segment of the first content media item and the introductory segment of the second media content item.

METHOD AND APPARATUS FOR RECOGNIZING OBJECTS IN MEDIA CONTENT

An approach is provided for recognizing objects in media content. The capture manager determines to detect, at a device, one or more objects in a content stream. Next, the capture manager determines to capture one or more representations of the one or more objects in the content stream. Then, the capture manager associates the one or more representations with one or more instances of the content stream.

СПОСОБ И УСТРОЙСТВО ДЛЯ ОТОБРАЖЕНИЯ ОБЛОЖКИ АУДИОМАТЕРИАЛА

Изобретение относится к способам и устройствам отображения обложки аудиоматериала. Технический результат заключается в повышении эффективности обработки данных для генерирования изображения. Способ содержит прием из терминала запроса получения, получение целевого изображения обложки и передачу указанного целевого изображения обложки в указанный терминал, определение целевой информации сцены посредством анализа информации описания целевых аудиоданных, воспроизводимого содержания целевых аудиоданных или типа целевых аудиоданных, причем целевая информация сцены служит для представления характеристики сцены, связанной с указанными целевыми аудиоданными, и включает сезон, географическое местоположение, заметный объект, погоду, настроение и время, получение дополнительного динамического изображения, связанного с указанной целевой информацией сцены, причем дополнительное динамическое изображение включает динамический визуальный образ, видеоматериал или информацию динамического отображения, и использование ...

СПОСОБ И УСТРОЙСТВО ДЛЯ ОТОБРАЖЕНИЯ ОБЛОЖКИ АУДИОМАТЕРИАЛА

СПОСОБ И СИСТЕМА ДЛЯ ОБРАБОТКИ ВХОДНЫХ КОМАНД ПОЛЬЗОВАТЕЛЯ

... 1. Способ обработки пользовательских входных команд, выполняемый на компьютерной аппаратуре, который включает:для каждой из множества машинно-исполняемых инструкций:- получение множества примерных выражений машинно-исполняемой инструкции;- генерирование соответствующего признака для каждого из множества примерных выражений; и- анализ множества признаков, связанных с множеством примерных выражений для определения множества шаблонов признаков, содержащих признак для каждого из множества примерных выражений,при том, что множество шаблонов признаков используется для преобразования входной команды пользователя в машинно-исполняемую выходную инструкцию, являющуюся одной из множества машинно-исполняемых инструкций.2. Способ по п. 1, отличающийся тем, что упомянутый анализ включает:получение числа появлений для каждого из множества признаков; ианализ множества признаков после списания из них малопоявляющихся признаков из множества признаков, чьи числа появлений являются меньшими, чем пороговое ...

СИСТЕМА И СПОСОБ ДЛЯ УСКОРЕНИЯ ПОИСКОВ В БАЗЕ ДАННЫХ ДЛЯ МНОЖЕСТВЕННЫХ СИНХРОНИЗИРОВАННЫХ ПОТОКОВ ДАННЫХ

... 1. Способ обеспечения идентификации объектов аудиовизуальной информации, включенных в потоки вещания аудиовизуальной информации, для каждого из множества компьютеров-клиентов, причем способ включает в себя использование вычислительного устройства для выполнения этапов, на которых по каждому из множества компьютеров-клиентов передают на постоянной основе сгенерированные клиентом "следы" потока аудиовизуальной информации; для каждого переданного "следа" потока аудиовизуальной информации, который был принят сервером, используют сервер для поиска в кэше "следов" совпадающего "следа" для этого "следа" потока аудиовизуальной информации; в случае если кэш "следов" содержит совпадающий "след", передают из сервера соответствующему клиенту любую идентификационную информацию об объекте аудиовизуальной информации, связанную с этим совпадающим "следом"; в случае если кэш "следов" не содержит совпадающий "след", осуществляют поиск в базе данных "характерных отпечатков" для того, чтобы определить, имеются ...

Apparatus, method and computer program product for scene synthesis

A method is disclosed for obtaining a media presentation (e.g. image, video, audio) as a seed (initial, starting) media (e.g. image); and obtaining one or more criteria for content extraction. Information relating to media presentations among a set of media presentations is examined to find out relevance information regarding the context and/or content of the media presentations using the seed / anchor media and the one or more criteria. On the basis of the examination, one or more media presentations among the set corresponding with the one or more criteria are extracted. Extraction criteria may include: visual or non-visual objects of interest in seed media / image; relevance with a social network or previous object of interest (user) preferences; position in three dimensional space of capture device 132; or object appearance frequency. Extracted media, for example captured at a same event as seed media, may be combined 148 into a synthesised (combined: Figures 12a-12f) scene 150. The ...

ASSOCIATIVE DATA BASE SCANNING AND EQUIVALENT INFORMATION RELOCATION

Finding perceptually similar music with precomputation

Method and system for managing rights for digital music

DIGITAL MUSIC LIBRARY BUILDER WHICH IDENTIFIES AND ASSOCIATES META-DATA WITH SONGS

A hand-held music player for use in conjunction with radios, including a casing, a receiver socket on the casing through which digital audio data is received, a digital-to-analog audio converter housed within the casing, a first transfer socket on the casing through which a song is transferred to a radio transmitter, a second transfer socket on the casing through which meta-data for the song is transferred to the radio transmitter, and a dial on the casing for selecting a song for playback. A method and a computer- readable storage medium are also described.

METHOD FOR RETRIEVING CONTENT HAVING VOICE IDENTICAL TO VOICE OF TARGET SPEAKER AND APPARATUS FOR PERFORMING THE SAME

디스플레이 장치, 서버 장치 및 이들을 포함하는 디스플레이 시스템과 그 컨텐츠 제공 방법들

... 디스플레이 장치가 개시된다. 본 장치는, 적어도 하나의 컨텐츠를 포함하는 화면을 디스플레이하는 디스플레이부, 음성 신호를 입력받기 위한 입력부, 음성 신호에 대응되는 결과 화면을, 화면 내의 컨텐츠의 상태에 따라 상이하게 구성하여 디스플레이부에 디스플레이하는 제어부를 포함한다. 이에 따라, 디스플레이 장치의 상태에 따라 상이한 결과 화면을 제공할 수 있다.

Synchronizing slide show events with audio

TECHNIQUES FOR CONTENT NAVIGATION USING PROXIMITY SENSING

Techniques for content navigation utilize proximity sensing so that user interaction with a graphical user interface is based at least in part on both contact with a surface and contactless interaction with the surface. A representation of an object detected as being proximate to and/or in contact with a surface appears on a display, which may be separate from the surface. The representation may appear at a location of the display that is determined according to a mapping of surface locations to display locations. The representation is updated based at least in part on movement of the object relative to the surface and one or more distances of the object from the surface.

Content access with handheld document data capture devices

Embodiments of the disclosed innovations provide systems and methods for automatically locating and retrieving digital supplemental materials and counterparts of rendered documents. These systems and methods are especially useful when the provider or copyright holder of the digital document charges a fee for access to the digital materials. Some embodiments solve the technical problem of allowing a user to access restricted digital content associated with a rendered document via a search string captured from the rendered document. Some embodiments further provide automatic intermediation to gain access to protected digital materials.

Method For Acquiring Interactive Information, Terminal, Server And System

A method for acquiring interactive information is provided, including: acquiring an interactive instruction; determining time information of the interactive instruction; acquiring multimedia data related to the time information; sending an interactive information acquisition request at least including the multimedia data and the time information; and receiving interactive information matching the multimedia data and the time information in the interactive information acquisition request. The terminal determines time information; acquires multimedia data related to the time information; sends an interactive information acquisition request at least including the multimedia data and the time information; and receives interactive information matching the multimedia data and the time information in the interactive information acquisition request.

Identifying events

Events may be identified by storing information in response to activating an event stamp function. As a result of activating the event function, the information collected may immediately be compared to event information in a database. Alternatively, the information collected may later be compared to event information in a database. One or more candidates for the event of interest may be automatically or manually retrieved, and the user may decide whether a candidate event of the one or more candidates correspond to the event of interest. Alternatively, a purchase of an item related to the event may be automatically made in response to activating the event stamp.

Methods for using extracted features to perform an action associated with selected identified image

Methods and systems to perform methods comprising receiving, at a computer system from a first electronic device a first electronic media work; extracting one or more features therefrom; determining that at least a portion of the first electronic media work corresponds to a first reference media work based on a matching of the extracted features against a database of reference features; receiving, from a second electronic device, a query related to the first electronic media work; linking the query to action information in an action database based upon determining that at least a portion of the first electronic media work corresponds to the first reference media work; generating machine-readable instructions associated with the action to be performed based at least in part on the linking of the query to the action information; transmitting, to the second electronic device, the machine-readable instructions; and logging an event associated with the machine-readable instructions.

DETECTING AND SUPPRESSING VOICE QUERIES

A computing system receives requests from client devices to process voice queries that have been detected in local environments of the client devices. The system identifies that a value that is based on a number of requests to process voice queries received by the system during a specified time interval satisfies one or more criteria. In response, the system triggers analysis of at least some of the requests received during the specified time interval to trigger analysis of at least some received requests to determine a set of requests that each identify a common voice query. The system can generate an electronic fingerprint that indicates a distinctive model of the common voice query. The fingerprint can then be used to detect an illegitimate voice query identified in a request from a client device at a later time.

Adapting search query processing according to locally detected video content consumption

A process adapts user-initiated search queries. The process executes at a client device with a microphone. The process downloads audio fingerprints from a remote server for a plurality of video programs, and downloads information that correlates the audio fingerprint to the video programs. The audio fingerprints are preselected according to relevancy criteria, including stored user preferences and prior search queries by the user. The audio fingerprints and correlating information are stored locally. The process detects ambient sound using the microphone and computes one or more sample audio fingerprints from the detected ambient sound. The process matches a sample audio fingerprint to a locally stored audio fingerprint and uses the correlating information to identify a first video program corresponding to the matched sample audio fingerprint. The process then receives user input to initiate a search query. The process provides auto-complete suggestions for the search query based on the ...

Method for Efficient Database Formation and Search on Media Devices Acting Synchronously with Television Programming

Techniques for efficient database formation and search in applications embedded in a media device are provided. The search may be performed synchronously with presentation of media programming content on a nearby media presentation device. A mobile media device captures some temporal fragments of the presented audio/video content on its microphone and camera, and then generates query fingerprints for the captured fragment. A local reference database resides on the mobile media device and a master reference database resides on a remote server with a most recent chunk of reference fingerprints transferred dynamically to the local mobile media device. A chunk of the query fingerprints generated locally on the mobile media device are searched on the local reference database for continuous content search and identification. The method presented automatically switches between the local search on the mobile media device and a remote search on an external search server.

DISCOVERING HIGHLIGHTS IN TRANSCRIBED SOURCE MATERIAL FOR RAPID MULTIMEDIA PRODUCTION

Methods, systems, apparatus, and tangible non-transitory carrier media encoded with one or more computer programs for substantially reducing the burden of identifying the best media content, discovering themes, and making connections between seemingly disparate source media. Examples provide the search and categorization tools needed to rapidly parse source media recordings using highlights, make connections between highlights, and combine highlights into a coherent and focused multimedia file.

SYSTEM AND METHOD FOR VISUAL ANALYSIS OF ON-IMAGE GESTURES

A method and system for providing at least a link to a content item related to a multimedia content element respective of an on-image gesture. The method comprises receiving, from a user device, at least on-image gesture and the multimedia content element; analyzing the at least on-image gesture determine at least one portion of the multimedia content element that a user is interested in; generating at least one signature for each of the at least a portion; determining a content item corresponding to the at least one identified portion of multimedia content, wherein the determination is based in part on a type of the at least on-image gesture; and modifying the received multimedia content element to include at least a link to an informative resource containing the content item.

ADAPTIVE DIGITAL ASSISTANT AND SPOKEN GENOME

Embodiments of the invention include a context sensitive adaptive digital assistant for personalized interaction. Embodiments of the invention also include a spoken genome for characterization and analysis of human voice. Aspects of the invention include selecting a starter vocabulary, receiving voice communications from a user, and modifying the starter vocabulary to generate a personalized lexicon. Aspects of the invention also include analyzing and categorizing human voice according to a plurality of characteristics, and creating a spoken genome database.

СИНХРОНИЗАЦИЯ СОБЫТИЙ ПОКАЗА СЛАЙДОВ С АУДИО

Изобретение относится к области синхронизации событий показа слайдов с аудио. Техническим результатом является упрощение синхронизации событий анимации в презентации в интересующие временные точки в аудиофайле. Принимаются данные, определяющие одно или более событий анимации, переходы слайдов или визуальные эффекты и аудиофайлы, воспроизводимые во время определенных событий. Аудиофайл обрабатывается для определения аудиособытий, содержащихся в нем. Если определены аудиособытия в аудиофайле, определенные события анимации синхронизируются с определенными аудиособытиями, используя схему аудиосинхронизации, которая включает в себя данные, определяющие, как аудиособытия синхронизируются с событиями анимации. Пользовательский интерфейс может обеспечиваться для предоставления пользователю возможности выбирать схему аудиосинхронизации, применяемую к презентации. Пользовательский интерфейс может также обеспечиваться для предоставления пользователю возможности визуально связывать события анимации ...

СИСТЕМА И СПОСОБ ПЕРЕДАЧИ ИНФОРМАЦИИ С ПОМОЩЬЮ ТЕГОВ ДАННЫХ НА ОСНОВЕ ЧАСТОТЫ ЗВУКОВОГО ДИАПАЗОНА

Изобретение относится к средствам для передачи информации с помощью тегов данных на основе частоты звукового диапазона. Технический результат заключается в повышении эффективности передачи информации. Составляют данные в частоте звукового диапазона в соответствии с предварительно установленным(и) правилом или правилами и увязывают части, нескольких частей или всех данных в частоте звукового диапазона с фрагментом или фрагментами предварительно составленной теговой информации через аппаратуру обработки частоты звукового диапазона для формирования связанных данных в частоте звукового диапазона. Считывают связанные данные в частоте звукового диапазона с аппаратуры обработки частоты звукового диапазона и выдают связанные данные в частоте звукового диапазона в виде звуковых волн через аппаратуру воспроизведения в частоте звукового диапазона. Получают выход звуковых волн от аппаратуры воспроизведения в частоте звукового диапазона через микрофон и преобразуют получаемые через микрофон звуковые ...

СИСТЕМА И СПОСОБ ПЕРЕДАЧИ ИНФОРМАЦИИ С ПОМОЩЬЮ ТЕГОВ ДАННЫХ НА ОСНОВЕ ЧАСТОТЫ ЗВУКОВОГО ДИАПАЗОНА

ASSOZIATIVES DATENBANKSCANNEN UND ENTSPRECHENDE INFORMATIONSWIEDERAUFFINDUNG

Digitising analog audio data

A method of identifying an album of analogue audio recordings comprising steps of: playing an analogue recording to produce an analogue audio input signal; digitally sampling the analogue audio input signal to produce a plurality of digitised segments; obtaining one or more track titles from a remote audio-fingerprinting service for each digitised segment producing a plurality of obtained track titles; requesting each album title on which any of the obtained track titles appear, to generate candidate albums; scoring each candidate album based on the number of obtained track titles that appear in the correct order; identifying the album by comparing the scores. The process of digitally sampling the analogue recording through to identifying the album may be repeated if a subsequent track does not have an expected track title. The digitised segments may be recorded as a first recording which are subsequently re-recorded as individual tracks based on the track durations collected from the identified ...

AUTOMATIC PRODUCTION OF A DIGITAL MUSIC LIBRARY

System and method of media file access and retrieval using speech recognition

PORTABLE MUSIC PLAYER AND TRANSMITTER

A hand-held music player for use in conjunction with radios, including a casing, a receiver socket on the casing through which digital audio data is received, a digital-to-analog audio converter housed within the casing, a first transfer socket on the casing through which a song is transferred to a radio transmitter, a second transfer socket on the casing through which meta-data for the song is transferred to the radio transmitter, and a dial on the casing for selecting a song for playback. A method and a computer- readable storage medium are also described.

METHOD AND SYSTEM FOR MANAGING RIGHTS FOR DIGITAL MUSIC

A method is described for managing rights for digital music, including registering music players, from among a plurality of music players, with digital archives that store songs, from among a plurality of digital archives, wherein songs can be copied from digital archives to music players, and from music players to digital archives, permitting a music player to copy a song from a digital archive for which it is registered, permitting a digital archive to copy a song from a music player that is registered with the digital archive, restricting a music player from copying a song from a digital archive for which it is not registered, and restricting a digital archive from copying a song from a music player that is not registered with the digital archive. A system and a computer-readable storage medium are also described.

RULES DRIVEN PAN ID METADATA ROUTING SYSTEM AND NETWORK

A method and system for provides routing of metadata related to media content, using content identifiers to locate the metadata content and rules to determine a subset of the metadata to deliver. This method registers globally unique identifiers for content objects. These globally unique identifiers each comprise a content identifier provided with the content object and a bounding identifier identifying a set of content identifiers of which the content identifier is a member. For each of the globally unique identifiers, information is maintained about a metadata source. The method receives a first content identifier for the content object, and uses a bounding identifier associated with the set of the first content identifier to determine the globally unique identifier for the first content identifier. The user is routed to the metadata source associated with globally unique identifier.

ASSOCIATIVE DATABASE SCANNING AND INFORMATION RETRIEVAL

A method and device are disclosed for an associative and approximate, analog or digital scanning of databases that allows for the asynchronous accessing of data from a mass storage medium. The invention includes circuitry and decision logic at the mass storage medium level for determining a key identifying the data of interest, continuously comparing the key to a signal generated from a reading of the data from the mass storage medium with an approximate or exact matching circuit to determine a pattern match, determining a correlation value between the key and the data as it is read in a continuous fashion, and determining a match based upon a preselected threshold value for the correlation value. The key and data may be either analog or digital.

Information search method and apparatus of time-series data using multi-dimensional time-series feature vector and program storage medium

It enables easy and quick searching and delivery of information desired by a user based upon a portion of time-series data which consists of clip information from music, a movie, a commercial message, or the like. The user accesses an information search server from a user terminal which is connected to a network, and, using this portion of time-series data as a search key, performs searches upon said server for information related to the time-series data. The information search server returns the name of the tune, the title of the movie, the name of goods advertised in the commercial message or the like to the user terminal via said network as search results, and the search provider levies a price for said search from the user.

SYSTEMS AND METHODS FOR MANIPULATING ELECTRONIC CONTENT BASED ON SPEECH RECOGNITION

Systems and methods are disclosed for displaying electronic multimedia content to a user. One computer-implemented method for manipulating electronic multimedia content includes generating, using a processor, a speech model and at least one speaker model of an individual speaker. The method further includes receiving electronic media content over a network; extracting an audio track from the electronic media content; and detecting speech segments within the electronic media content based on the speech model. The method further includes detecting a speaker segment within the electronic media content and calculating a probability of the detected speaker segment involving the individual speaker based on the at least one speaker model.

System for using extracted feature vectors to perform an action associated with a work identifier

A method including the steps of: receiving, by a computer system including at least one computer, a first electronic media work uploaded from a first electronic device; extracting one or more features from the first electronic media work; linking the first electronic media work with a reference electronic media work identifier associated with a reference electronic media work to generate correlation information relating the first electronic media work with at least an action associated with the reference electronic media work identifier; storing the correlation information; receiving, from a second electronic device, a query related to the first electronic media work; correlating the query with action information related to an action to be performed based at least in part on the correlation information; generating machine-readable instructions based upon the action information; and providing the machine-readable instructions to the second electronic device to be used in performing the action ...

Identifying works, using a sub linear time search or a non exhaustive search, for initiating a work-based action, such as an action on the internet

An electronic document, such as an image and a text file for example, may be associated with an action by (1) electronically extracting within a client device features from the electronic document work, (2) transmitting the extracted features from the client device to one or more servers, (3) receiving at the client device from the one or more servers an identification of the electronic document work based on the extracted features, wherein the identification is based on a sub-linear search (or wherein the identification is based on a non-exhaustive search identifying a neighbor), (4) electronically determining an action based on the identification of the electronic document work, and (5) electronically performing the action on the client device.

Triggering an automatic creation of an event stamp

A method and system is disclosed in which information related to an orientation or motion pattern of a mobile device system is detected. A determination is made whether the orientation information detected corresponds to a predetermined motion pattern or orientation for collecting event stamp information. The event stamp information may include a location and/or other event information. If the detected orientation and/or motion patterns is detected, the event stamp information is automatically collected in response to the determination, and the event stamp information is is at least temporarily stored.

DISPLAY METHOD AND DISPLAY APPARATUS

Disclosed is a display method that includes: controlling a recording device to perform a real-time recording operation on a current environment when a preset type of display data is displayed on a first display interface; and performing character recognition on audio information obtained by the recording operation to obtain text information, and displaying the obtained text information on a second display interface. Further disclosed is a display apparatus.

Rules Driven Pan ID Metadata Routing System and Network

A method of associating a content object with metadata uses a combination of a content identifier and a bounding identifier to enable handling of disparate sets of content identifiers for content objects with potentially conflicting content identifiers. The method receives a content identifier for a content object from among a set of content identifiers. It provides a unique bounding identifier for the set of content identifiers. This unique bounding identifier is used in combination with the content identifier to form a globally unique identifier for the content object. This globally unique identifier is associated with a metadata source, which enables routing of a user to the metadata source. Another novel method addresses content objects with two or more content identifiers, potentially referencing different metadata sources. This method registers different globally unique identifiers for a content object. These globally unique identifiers each comprise a content identifier provided ...

Cognitive program suite for a cognitive device and a mobile device

Systems and methods for utilizing a cognitive device are disclosed. A method includes: receiving, by a computer device, a query from a cognitive device; processing, by the computer device, the query to generate a processed query; transmitting, by the computer device, the processed query to a mobile device; receiving, by the computer device, an action query result from the mobile device based on the mobile device receiving the processed query and performing an action query; transmitting, by the computer device, the action query result to the cognitive device based on receiving the action query result.

RULES DRIVEN PAN ID METADATA ROUTING SYSTEM AND NETWORK

Content objects are associated with metadata via content identifiers that are derived from sensed signals captured by requesting mobile devices. In response to a content based query from a mobile device, content fingerprints and extracted digital codes decoded from the sensed signals are issued to a network based router system. This system determines identification priority, metadata responses associated with different forms of identification, and priority of metadata responses to the query.

Triggering actions in response to optically or acoustically capturing keywords from a rendered document

A system for processing text captured from rendered documents is described. The system receives a sequence of one or more words optically or acoustically captured from a rendered document by a user. The system identifies among words of the sequence a word with which an action has been associated. The system then performs the associated action with respect to the user.

CONTROLLING CLIENT OPERATION WITH SEGMENTATION OF CLIENTS

Data specifying a first segment of a set of clients and first configuration parameters can be received. The first configuration parameters can specify operation of a first interface. The first interface can be integrated into an application. The first segment, including a first subset of the set of clients, can be determined. A request for initiation of operation can be received from the first interface. The first segment can be determined to include a first client. The first configuration parameters can be transmitted. The first configuration parameters can cause the first client to modify operation of the first interface in response to receiving the transmitted configuration parameters. Related apparatus, systems, techniques and articles are also described.

Multimedia picture generating method, device and electronic device

The present disclosure provides a multimedia picture generating method, device and electronic device, wherein the multimedia picture generating method comprises acquiring a picture of a photographed subject of a photographing device; extracting a figure image as a foreground image from the picture after receiving an instruction for removing picture background; performing voice recognition after receiving a voice command inputted by a user; searching out multimedia content that matches a user command information recognized by voice recognition from a multimedia database as background content for the picture; and generating a multimedia picture that contains the foreground image and the background content. Thus, when a user wants to replace the picture background, a figure image can be automatically extracted from the picture as a foreground image, and the original background with poor effect can be removed, then an image and/or music that matches a user command information can be automatically ...

Graphical User Interface for Browsing, Searching and Presenting Media Items

Improved graphical user interfaces suitable for reviewing, browsing, previewing and/or purchasing media items are disclosed. The graphical user interfaces are particularly useful for a system that provides purchase and distribution of media in a client-server environment.

SYSTEM AND METHOD FOR CLUSTERING MULTIMEDIA CONTENT ELEMENTS

A system and method for clustering multimedia content. The method includes: detecting at least one clustering trigger event related to at least one multimedia content element to be clustered; generating at least one signature for the at least one multimedia content element, each signature representing at least a portion of the at least one multimedia content element; determining, based on the generated at least one signature, at least one multimedia content element cluster, wherein each multimedia content element cluster includes a plurality of clustered multimedia content elements sharing at least one common concept with the at least one multimedia content element; and adding, to each determined cluster, the at least one multimedia content element.

SYSTEM AND METHOD FOR PROVIDING SEQUENTIALLY RELEVANT CONTENT

A system and method for determining sequentially relevant content. The method includes generating at least one signature for a multimedia content item stored in a mobile device; matching the generated at least one signature to a plurality of signatures of content items; and determining, based on the matching, at least one sequentially relevant content item.

SYSTEMS AND METHODS FOR PUSHING CONTENT

Methods and systems for determining a type of push content to display to a user are described herein. The system identifies a context of a current output of an application on a device. The system extracts user profile information from a user profile of the user. The system then selects a type of push content from a database of types of push content based on the user profile information and the context of the current output. Finally, the system inserts a push content item of the selected type into the current output of the application. 1. A method of determining a type of push content to output to a user device , the method comprising:inserting a push content item into an output of an application on a device, wherein the push content item is of a first type of push content, and wherein the first type is one of: a meme, a GIF image, an audio player, an AR animation, a video, and a static graphic;monitoring a response of the user to the push content item of the first type to determine that the response of the user to the push content item of the first type indicates disinterest for the first type of push content;identifying a context of a current output of the application on a device;extracting user profile information from a user profile of the user;accessing a database comprising a plurality of types of push content items, wherein the plurality of types of push content items comprises at least two types of push content comprising the meme, the GIF image, the audio player, the AR animation, the video, and the static graphic;in response to determining that the response of the user to the push content item of the first type indicates disinterest for the first type selecting a second type of push content of the plurality of types of push content based on the user profile information and the context of the current output, wherein the second type of push content is different from the first type of push content; andinserting at least one push content item of the selected ...

Processing techniques for text capture from a rendered document

A facility for initiating a purchase is described. The facility receives a text sequence captured by a user from a rendered document using a handheld text capture device. The facility identifies in the received text sequence a reference to a distinguished product. In response to identifying the reference, the facility presents to the user an opportunity to place an order for the established product. If the user accepts the presented opportunity to order the distinct product, the facility orders the distinct product on behalf of the user.

Content metadata directory services

A method of associating a content object with metadata uses a combination of a content identifier and a bounding identifier to enable handling of disparate sets of content identifiers for content objects with potentially conflicting content identifiers. The method receives a content identifier for a content object from among a set of content identifiers. It provides a unique bounding identifier for the set of content identifiers. This unique bounding identifier is used in combination with the content identifier to form a globally unique identifier for the content object. This globally unique identifier is associated with a metadata source, which enables routing of a user to the metadata source.

A secure searchable media object

A searchable media player comprises an audio file processor operable to receive a standard audio file and convert the standard audio file into machine coding and an Automatic Speech Recognition processor, operable to receive the standard audio file, determine each spoken word and output a string of text comprising each of the determined words, wherein each word in the string is accorded a time indicative of the time of occurrence of the word in the string. An assembler then operates to receive the machine coding, the string of text and the relevant topics and therefrom to assemble a self-contained media player operable without connection to the internet. A search engine can then be operated to receive a user word search enquiry, search the media player for the string of text for the word search enquiry, determine the accorded time of the occurrence of each word enquiry in the string of text, display the occurrences of the determined word search enquiry to a user, receive a user instruction ...

Associative database scanning and information retrieval

SYSTEM AND METHOD FOR MULTIMEDIA CONTACT CENTER INTERACTIONS VIA AN AUDIOVISUAL ASYNCHRONOUS CHANNEL

A system and method for multimedia contact center interactions via an audiovisual asynchronous messaging channel is provided. In an embodiment, an organization might operate a website comprising information and for providing an entry point of communication with a contact center. A communications channel may be integrated directly with the organization's website, which includes an editable audiovisual interface. A user may interact with the editable interface through a variety of means, including sketching on a webpage and recording to create a video form of audiovisual asynchronous query over the web page. The interaction is analyzed and routed to an agent for handling. The agent may then be connected to the user through the asynchronous channel.

INCREMENTAL SPEECH INPUT INTERFACE WITH REAL TIME FEEDBACK

MEDIA FINGERPRINTING FOR SOCIAL NETWORKING

Audio fingerprinting and other media matching technologies can be used to identify media, such as movies, television shows, and radio broadcasts. A user device can record image, audio, and/or video information and upload information to a matching service that is able to use matching technology to identify the media and provide supplemental content or information to the user. The user then can share this information with other users, such as by uploading to a social networking site or passing the information to peers on a peer network as part of a container. Users can have the ability to add tagged content, provide comments and ratings, and otherwise interact based at least in part upon the tagged media content.

Copyright detection and protection system and method

A method for detecting against unauthorized transmission of digital works comprises the steps of maintaining a registry of information permitting identification of digital copyrighted works, monitoring a network for transmission of at least one packet-based digital signal, extracting at least one feature from the at least one digital signal, comparing the extracted at least one feature with registry information and applying business rules based on the comparison result.

SYSTEM AND METHOD FOR PROVIDING INTERACTIVE MULTIMEDIA SERVICES

A method for presenting interactive multimedia programs includes selecting a multimedia program for presentation, the program having one or more segments and a plurality of additional content items, where each of the items is associated with at least one of the segments and is responsive to at least one of a plurality of pre-defined queries for the program. The method also includes receiving at least one user query during presentation of the program, identifying one of the pre-defined queries corresponding to the user query, and retrieving one of the items associated with a current segment of the program and responsive to the identified one of the pre-defined queries.

CLOUD-BASED PLATFORM ENABLED WITH MEDIA CONTENT INDEXED FOR TEXT-BASED SEARCHES AND/OR METADATA EXTRACTION

Techniques are disclosed for enabling collaborative work on a media content among collaborators through a cloud-based environment. An example method comprises receiving the media content; extracting a plurality of text-based data based on the media content; and indexing the plurality of text-based data so as to enable one or more actions to be performed on the media content using the plurality of text-based data. In some embodiments, the media content comprises an audio component, and the method further comprises transcribing the audio component of the media content so that the plurality of text-based data comprises a transcript of the media content. In some embodiments, the actions include a text-based search or a semantics-based search. Among other benefits, some embodiments provided herein enable indexing media content for text-based searches and/or metadata extraction to effectively manage multimedia files in a cloud-based storage/service environment.

Mobile device application

A system and method for detecting a non-visual code using an application on a mobile device, where the application is capable of associating the non-visual code with at least one item contained in a transmitted presentation and connecting the mobile device to information about the item in a database associated with the transmitted presentation. The non-visual code may comprise a high frequency signal played alone or with another audio or video signal. A mobile device application executing on a processor of the mobile device performs signal processing on the audio signal of the presentation to extract the high frequency signal. Also contemplated is obtaining information about the visual content and presenting the information on the personal device.

Recognizer of content of digital signals

Described herein is a technology for facilitating the recognition of the content of digital signals. This abstract itself is not intended to limit the scope of this patent. The scope of the present invention is pointed out in the appending claims.

Media source identification

A server machine and a first device (e.g., a television) are configured to access a stream of media (e.g., a broadcast channel) from a media source (e.g., a broadcaster). The server machine generates a representation (e.g., a fingerprint) of the stream of media and stores the representation. The first device plays the stream of media (e.g., for a user) and generates an analog signal based on the stream of media. A second device (e.g., a mobile device of the user) is configured to receive the analog signal and generate a representation of the analog signal. The second device provides the representation of the analog signal to the server machine, which may compare the representation of the stream of media to the representation of the analog signal. Based on the comparison, the server machine may provide an identifier of the media source to the second device.

Automatic digital music library builder

A digital music library builder including a casing, a receiver socket on the casing through which analog audio is received, an analog-to-digital converter housed within the casing for converting analog audio into digital audio, a meta-data identifier housed within the casing for identifying meta-data for a song, and a database manager housed within the casing for associating the identified meta-data with the song, within a digital music library.

Receiving and sending content items associated with a multimedia file

A communications system comprising a first terminal device and one or more second terminal devices communicating with the first terminal device. The first terminal device is configured to associate at least one content item with a given multimedia file, and to send the content item associated with the multimedia file from the first terminal device to the one or more second terminal devices; and the second terminal device is configured to present the received content item in the second terminal device when a multimedia file having the same content as the multimedia file with which the at least one content item is associated is presented in the second terminal device.

Detecting and Suppressing Voice Queries

A computing system receives requests from client devices to process voice queries that have been detected in local environments of the client devices. The system identifies that a value that is based on a number of requests to process voice queries received by the system during a specified time interval satisfies one or more criteria. In response, the system triggers analysis of at least some of the requests received during the specified time interval to trigger analysis of at least some received requests to determine a set of requests that each identify a common voice query. The system can generate an electronic fingerprint that indicates a distinctive model of the common voice query. The fingerprint can then be used to detect an illegitimate voice query identified in a request from a client device at a later time.

Multimedia poster generation method and terminal

Disclosed are a multimedia poster generation method and a terminal. The method includes: receiving a poster generation instruction; acquiring a poster resource, the poster resource including a plurality of background files and a lyric file of a multimedia file, and the multimedia file being a multimedia file selected by a user; acquiring a background file to be shared that is selected by the user from the plurality of background files, and acquiring lyric information to be shared that is selected by the user from the lyric file; and generating a multimedia poster of the multimedia file according to the lyric information to be shared and the background file to be shared.

Methods and systems for providing a secure automated assistant

Implementations described herein relate to receiving user input directed to an automated assistant, processing the user input to determine whether data from a server and/or third-party application is needed to perform certain fulfillment of an assistant command included in the user input, and generating a prompt that requests a user consent to transmitting of a request to the server and/or the third-party application to obtain the data needed to perform the certain fulfillment. In implementations where the user consents, the data can be obtained and utilized to perform the certain fulfillment. In implementations where the user does not consent, client data can be generated locally at a client device and utilized to perform alternate fulfillment of the assistant command. In various implementations, the request transmitted to the server and/or third-party application can be modified based on ambient noise captured when the user input is received.

System and method for multimedia contact center interactions via an audiovisual asynchronous channel

A system and method for multimedia contact center interactions via an audiovisual asynchronous messaging channel is provided. In an embodiment, an organization might operate a website comprising information and for providing an entry point of communication with a contact center. A communications channel may be integrated directly with the organization's website, which includes an editable audiovisual interface. A user may interact with the editable interface through a variety of means, including sketching on a webpage and recording to create a video form of audiovisual asynchronous query over the web page. The interaction is analyzed and routed to an agent for handling. The agent may then be connected to the user through the asynchronous channel.

AUTOMATICALLY ENHANCING STREAMING MEDIA USING CONTENT TRANSFORMATION

СПОСОБ И СИСТЕМА ДЛЯ ОБРАБОТКИ ВХОДНЫХ КОМАНД ПОЛЬЗОВАТЕЛЯ

Изобретение относится к средствам обработки естественного языка, а именно активируемые голосом системы управления для устройств. Технический результат заключается в повышении точности обработки пользовательских команд на естественном языке и экономия вычислительных ресурсов. Указанный результат достигается за счет применения способа обработки пользовательских входных команд, выполняемый на компьютерной аппаратуре, который включает: получение пользовательских входных команд; для каждой из множества машинно-исполняемых инструкций: получение множества примерных выражений машинно-исполняемой инструкции; генерирование соответствующего признака для каждого из множества примерных выражений; и анализ множества признаков, связанных с множеством примерных выражений для определения множества шаблонов признаков, содержащих признак для каждого из множества примерных выражений, при этом множество шаблонов признаков используется для преобразования входной команды пользователя в машинно-исполняемую выходную ...

Verfahren und Vorrichtung zur Suche von Musiktiteln

Es werden ein Verfahren und eine Vorrichtung zum Suchen von Musiktiteln offenbart. Das Verfahren weist auf: Erzeugen eines Rhythmusskalensatzes aufgrund einer empfangenen Anfrage, wobei die Anfrage eine Vielzahl von Anfragewerten aufweist, die einen Rhythmus eines zu suchendenden Musiktitels definieren; Erstellen eines Rhythmuswortsatzes auf der Grundlage des erzeugten Rhythmusskalensatzes, wobei jedes Rhythmuswort im Rhythmuswortsatz mindestens eine Rhythmusskala im Rhythmusskalensatz aufweist; und Auffinden eines zu suchendenden Musiktitels unter Verwendung des erstellten Rhythmuswortsatzes. Mit dem Musiktitelsuchverfahren und der Vorrichtung der vorliegenden Erfindung können erwartete Musiktitel oder ein erwartetes musikalisches Segment lediglich auf der Grundlage eines Musikrhythmus schnell und genau gesucht oder aufgefunden werden, ohne dass eine Musikmelodie benötigt wird.

A system and method for engaging a person in the presence of ambient audio

Balance modifications of audio-based computer program output

AUTOMATIC DIGITAL MUSIC LIBRARY BUILDER

Automatic digital music library builder

Method, system, apparatus, and machine-readable medium for use in connection with a server that uses images or audio for initiating remote function calls

METHOD AND SYSTEM FOR MANAGING RIGHTS FOR DIGITAL MUSIC

A method is described for managing rights for digital music, including registering music players, from among a plurality of music players, with digital archives that store songs, from among a plurality of digital archives, wherein songs can be copied from digital archives to music players, and from music players to digital archives, permitting a music player to copy a song from a digital archive for which it is registered, permitting a digital archive to copy a song from a music player that is registered with the digital archive, restricting a music player from copying a song from a digital archive for which it is not registered, and restricting a digital archive from copying a song from a music player that is not registered with the digital archive. A system and a computer-readable storage medium are also described.

RULES DRIVEN PAN ID METADATA ROUTING SYSTEM AND NETWORK

System and method for soliciting and receiving merchandise orders

A rider signal is transmitted over programming signal. The rider signal is stored in a rider buffer and includes merchandise ordering data. When a user wishes to order the merchandise, the system establishes a channel of communication with an ordering center and places an order according to the data in the rider buffer. The system is particularly useful for implementation in car audio systems and personal computers.

Mobile system, search system and search result providing method for mobile search

Provided is a search service providing system associated with a mobile system, and a method for providing a search result for a mobile terminal. The system may include a user interface unit to provide a search interface for selecting a search mode, a search request unit to receive search request information based on the search mode selected via the search interface, and to transfer the search request information to the search server, and a search result providing unit to receive a search result corresponding to the search request information from the search server, and to provide the search result. The search mode may include an audio search mode for providing a search result corresponding to input audio data, an image search mode for providing a search result corresponding to input image data, or both the audio search mode and the image search mode.

Search with Joint Image-Audio Queries

Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for processing joint image-audio queries. In one aspect, a method includes receiving, from a client device, a joint image-audio query including query image data and query audio data. Query image feature data is determined from the query image data. Query audio feature data is determined from the audio data. The query image feature data and the query audio feature data are provided to a joint image-audio relevance model trained to generate relevance scores for a plurality of resources, each resource including resource image data defining a resource image for the resource and text data defining resource text for the resource. Each relevance score is a measure of the relevance of corresponding resource to the joint image-audio query. Data defining search results indicating the order of the resources is provided to the client device.

Method and Apparatus for Adjustable Data Matching

A method and apparatus for performing a matching operation on data are disclosed. With an exemplary embodiment, a programmable logic device can be used to search for data of interest to an application, where the programmable logic device processes streaming data against a data key to generate a signal indicative of a similarity between the streaming data and the data key and compares the generated signal with a defined threshold to thereby determine whether the streaming data is deemed a match to the data key, wherein the threshold is adjustable to control whether the programmable logic device performs an approximate match operation or an exact match operation, and further to control, for an approximate match operation, a degree of approximate matches returned by the approximate match operation.

Identifying events

Events may be identified by storing information in response to activating an event stamp function. As a result of activating the event function, the information collected may immediately be compared to event information in a database. Alternatively, the information collected may later be compared to event information in a database. One or more candidates for the event of interest may be automatically or manually retrieved, and the user may decide whether a candidate event of the one or more candidates correspond to the event of interest. Alternatively, a purchase of an item related to the event may be automatically made in response to activating the event stamp.

Method for Efficient Database Formation and Search on Media Devices Acting Synchronously with Television Programming

Techniques for efficient database formation and search in applications embedded in a media device are provided. The search may be performed synchronously with presentation of media programming content on a nearby media presentation device. A mobile media device captures some temporal fragments of the presented audio/video content on its microphone and camera, and then generates query fingerprints for the captured fragment. A local reference database resides on the mobile media device and a master reference database resides on a remote server with a most recent chunk of reference fingerprints transferred dynamically to the local mobile media device. A chunk of the query fingerprints generated locally on the mobile media device are searched on the local reference database for continuous content search and identification. The method presented automatically switches between the local search on the mobile media device and a remote search on an external search server.

Methods and systems for capturing information-enhanced images

The approaches of the present disclosure provide for the efficient technology of intelligent association of still images with contextual information relating to sounds such as a sound that may have been ambient when a still image was captured. In particular, a user may use a media device, such as a smart phone or tablet computer, to capture a still image and record first audio, for example, at the time of capturing the still image for a predetermined period of time. The first audio may be then processed and analyzed so as to recognize a particular song or melody, and then a high quality second audio related to the recognized song or melody is downloaded and associated with the still image. Accordingly, the visual nature of still images is enhanced with data relating to contextual auditory information, which boosts the sensory and memory experience for the user.

Electronic apparatus and method of controlling the same

An electronic apparatus including an audio output unit configured to output audio information on a song being reproduced; a display unit; and a controller configured to arrange graphic objects linked to songs on one region of the display unit, respectively, that are included in a playlist, and display information on the reproduced song using a corresponding graphic object of the reproduced song among the graphic objects.

Method and device for playing multimedia

Provided are a device and a method for acquiring music information about music played in an electronic device, acquiring a storyline of the music based on the music information, and acquiring and displaying one or more images based on the storyline.

Methods, systems, and media for presenting information related to an event based on metadata

Methods, systems and media for presenting information related to an event based on metadata are provided. In some implementations, the method comprises: detecting that a user-initiated event has been performed on a user device; detecting a plurality of sensors connected to the user device; causing a plurality of content items related to the user-initiated event to be obtained using the plurality of sensors connected to the user device; determining whether each of the plurality of content items is to be associated with the user-initiated event based on user device information from a plurality of data sources; associating a portion of the plurality of content items with the user-initiated event based on the determination; retrieving information related to the portion of the plurality of content items; detecting, using the plurality of sensors connected to the user device, a second plurality of content items; determining that at least one of the second plurality of content items is related to at least one of the first plurality of content items; and causing information related to the user-initiated event to be presented by the user device based at least in part on the determination.

System and method for controlling related video content based on domain specific language models

Systems and methods for controlling related video content based on domain specific language models are disclosed. Some embodiments include one or more processors configured to obtain a first audio information of first video content, identify first primary time codes based on the first audio information, obtain second audio information of second video content and identify a first secondary plurality of time codes based on the second audio information, determine an amount of differences between the first primary time codes and first secondary time codes, and generate information indicating whether the first video content and the second video content are related based on the determined amount of differences.

COMMUNICATION TERMINAL, METHOD FOR CONTROLLING COMMUNICATION TERMINAL, COMMUNICATION SYSTEM, AND STORAGE MEDIUM

A communication terminal acquires a captured image from an image capturing apparatus and transfers the captured image to a server. The communication terminal includes: a first communication unit configured to communicate with the image capturing apparatus; a second communication unit configured to communicate with the server; a display unit configured to communicate with the image capturing apparatus, acquire, from the image capturing apparatus, a captured image managed by the image capturing apparatus, and display the captured image; a sound input unit configured to accept sound input for generating a terminal sound memo related to the displayed captured image; a storage unit configured to store the generated terminal sound memo in association with the captured image; and a control unit configured to perform control so that the second communication unit transfers, to the server, the acquired captured image and the generated terminal sound memo associated with the captured image. 1. A communication terminal that acquires a captured image from an image capturing apparatus and transfers the captured image to a server , the communication terminal comprising:a first communication unit configured to communicate with the image capturing apparatus;a second communication unit configured to communicate with the server;a display unit configured to communicate with the image capturing apparatus by using the first communication unit, acquire, from the image capturing apparatus, a captured image managed by the image capturing apparatus, and display the captured image;a sound input unit configured to accept sound input for generating a terminal sound memo related to the captured image displayed by the display unit;a storage unit configured to store the generated terminal sound memo in association with the captured image; anda control unit configured to perform control so that the second communication unit transfers, to the server, the captured image acquired from the image ...

ACCESSIBLE MULTIMEDIA CONTENT

A method of generating accessible content is described. Embodiments of the method identifies a plurality of channels for a multimedia communication session, generate a master timeline for the communication session, wherein the master timeline comprises a chronological ordering of events from each of the channels, and wherein each of the events is associated with event-specific audio data, and present the multimedia communication session to a user to enable the user to transition among the channels based on the master timeline. 1. A method for generating accessible content , comprising:identifying a plurality of channels for a multimedia communication session;generating a master timeline for the communication session, wherein the master timeline comprises a chronological ordering of events from each of the channels, and wherein each of the events is associated with event-specific audio data; andpresenting the multimedia communication session to a user to enable the user to transition among the channels based on the master timeline.2. The method of claim 1 , further comprising:identifying the events from each of the plurality of channels;generating event data for each of the events, wherein the event data includes the event-specific audio data and a start time of the event; andgenerating channel metadata for each of the channels based on the event data, wherein the master timeline is generated based on the channel metadata.3. The method of claim 2 , wherein:the event data further includes at least one of an event ID, an event name, and an event duration.4. The method of claim 1 , further comprising:converting visual data from one or more of the channels to the event-specific audio data.5. The method of claim 4 , wherein:the conversion of the visual data comprises a text-to-speech conversion.6. The method of claim 1 , further comprising:playing a first audio file associated with a default channel of the plurality of channels;identifying an event from a secondary ...

Displaying a Summary of Media Content Items

The various implementations described herein include methods and systems for displaying a summary of media content items. In one aspect, a method is performed at a server system that includes processors and memory storing programs for execution by the processors. The server system: (1) detects presentation of a media content item at a first device in proximity to a second device, including receiving from the second device content identification information; (2) identifies the media content item; (3) identifies entities related to the identified media content item; (4) determines a level of interest with respect to a user of the second device, for each of the identified entities; (5) selects a subset of the identified plurality of entities based on the determined level of interest; and (6) sends to the second device, a summary of the media content item, for presenting at the second device.

Stereo Playback Configuration and Control

An example method includes, based on an adjustment to a first displayed volume control, instructing the first playback device to adjust playback volume level; based on an adjustment to a second displayed volume control, instructing the second playback device to adjust playback volume level; after sending the commands, instructing the first and/or second playback device to process an audio stream into a first and/or second channel and to reproduce a respective one of the first and second channel, wherein the grouped first and second playback devices provide multi-channel sound; and based on an adjustment to a third displayed volume control, instructing the first and/or second playback device to adjust a group volume level for both the first and second playback devices. 1. A computing device comprising:one or more processors;a tangible, non-transitory computer-readable medium; andprogram instructions stored on the tangible, non-transitory computer-readable medium that are executable by the one or more processors such that the computing device is configured to:at a first time when the computing device is configured to control a first group of two or more devices:(i) obtain first audio information;(ii) transmit the first audio information from the computing device to one or more devices in the first group; and(iii) cause the first group to play the first audio information in a groupwise manner with a stereo effect; andat a second time when the computing device is configured to control a second group of two or more devices:{'claim-text': ['(a) obtain the second audio information from the first source;', '(b) transmit at least a portion of the second audio information to one or more devices in the second group; and', '(c) cause the second group to play the second audio information in a groupwise manner with a stereo effect; and'], '#text': '(i) when second audio information is to be played from a first source:'}{'claim-text': ['(a) obtain the second audio information from ...

SYSTEMS AND METHODS FOR LEVERAGING ACOUSTIC INFORMATION OF VOICE QUERIES

The methods and systems described herein leveraging acoustic features of a user to generate and present a personalized content to a user. In one example, the method receives a voice query and determines that the query refers to either a first content item or a second content item. The first content item is associated with a first type assigned with a first score and the second content method also determines whether the query is from the second entity type. The method ranks the first and the second content items based on this determination and generates for presentation of the first and the second content items based on the ranking. The method also changes the first or the second scores based on this determination and selects one of the first or the second content item for presentation. 1. A method comprising:receiving, by a control circuitry, a voice query;{'claim-text': ['a first content item having an associated first type and a first score, wherein the first type indicates the first content item is labeled for a first group, and the first score indicates a level of affinity of the first content item for members of the first group; and', 'a second content item having an associated second type and a second score, wherein the second type indicates the second content item is labeled for a second group different from the first group, and the second score indicates a level of affinity of the second content item for members of the second group;'], '#text': 'identifying, by the control circuitry, a plurality of content items stored in a database that match the voice query, wherein the plurality of content items comprises:'}receiving, by the control circuitry, a selection of one of the first content item or the second content item;determining whether the voice query is from a member of the second group;in response to determining the voice query is not from a member of the second group and the selection is of the second content item, ranking, by the control circuitry, the ...

SYSTEMS AND METHODS FOR LEVERAGING ACOUSTIC INFORMATION OF VOICE QUERIES

The methods and systems described herein leveraging acoustic features of a user to generate and present a personalized content to a user. In one example, the method receives a voice query and determines that the query refers to either a first content item or a second content item. The first content item is associated with a first type assigned with a first score and the second content item is associated with a second entity type assigned with a second score. The method also determines whether the query is from the second entity type. The method ranks the first and the second content items based on this determination and generates for presentation of the first and the second content items based on the ranking. The method also changes the first or the second scores based on this determination and selects one of the first or the second content item for presentation. 1. A method comprising:receiving, by a control circuitry, a voice query; a first content item having an associated first type and a first score, wherein the first type indicates the first content item is labeled for a first group, and the first score indicates a level of affinity of the first content item for members of the first group; and', 'a second content item having an associated second type and a second score, wherein the second type indicates the second content item is labeled for a second group different from the first group, and the second score indicates a level of affinity of the second content item for members of the second group;, 'identifying, by the control circuitry, a plurality of content items stored in a database that match the voice query, wherein the plurality of content items comprisesdetermining whether the voice query is from a member of the second group;in response to determining that the voice query is from a member of the second group, decreasing, by the control circuitry, the first score of the first content item by a first value;in response to determining that the voice query ...

GENERATING MEDIA CONTENT PLAYLISTS INCLUDING INTERSTITIALS COMBINED WITH MEDIA CONTENT ITEMS

A method includes identifying a plurality of media content items for a playlist, each of the plurality of media content items having an introductory segment, one or more main segments, and an ending segment; determining a length of an ending segment of a first media content item and a length of an introductory segment of a second media content item; selecting an interstitial to be added to the playlist between one or more main segments of the first media content item and one or more main segments of the second media content item; and responsive to determining that a length of the interstitial is less than a combined length of the ending segment and the introductory segment, adjusting an overlap on the interstitial of the ending segment of the first content media item and the introductory segment of the second media content item. 1. A method comprising:identifying a plurality of media content items for a playlist, each of the plurality of media content items having an introductory segment, one or more main segments, and an ending segment;determining a length of an ending segment of a first media content item of the plurality of media content items and a length of an introductory segment of a second media content item of the plurality of media content items;selecting an interstitial to be added to the playlist between one or more main segments of the first media content item and one or more main segments of the second media content item; andresponsive to determining that a length of the interstitial is less than a combined length of the ending segment of the first media content item and the introductory segment of the second media content item, adjusting an overlap on the interstitial of the ending segment of the first content media item and the introductory segment of the second media content item.2. The method of claim 1 , further comprising:responsive to determining that half of the length of the interstitial exceeds the length of the introductory segment of the ...

System and method for speech-enabled access to media content by a ranked normalized weighted graph using speech recognition

Disclosed herein are systems, methods, and computer-readable storage media for generating a speech recognition model for a media content retrieval system. The method causes a computing device to retrieve information describing media available in a media content retrieval system, construct a graph that models how the media are interconnected based on the retrieved information, rank the information describing the media based on the graph, and generate a speech recognition model based on the ranked information. The information can be a list of actors, directors, composers, titles, and/or locations. The graph that models how the media are interconnected can further model pieces of common information between two or more media. The method can further cause the computing device to weight the graph based on the retrieved information, wherein the weighted graph is further normalized weighted graph to help with speech query searching of media content using speech recognition. The graph can further model relative popularity information in the list. The method can rank information based on a PageRank algorithm.

Methods and devices for generating media items

The various implementations described herein include methods, devices, and systems for generating media items. In one aspect, a method is performed at a server system. The method includes: (1) receiving one or more audio files; (2) obtaining one or more audio characteristics for the audio files; (3) receiving a request to generate a media item using the audio files, the request including one or more criteria; and (4) in response to receiving the request, generating the media item, including: (a) identifying one or more visual media files based on the criteria and the audio characteristics; and (b) generating synchronization information; (5) storing the media item in the server system; and (6) enabling playback of the media item by sending a link for the stored media item to the client device.

Methods for arbitrating online disputes and anticipating outcomes using machine intelligence

Methods for conflict arbitration and resolution anticipation through machine intelligence learning are provided herein. Methods for hypothesizing by a machine intelligence such that predictions of user text strings put forth from one demographic may be proposed. Methods for pattern recognition between demographical user groups and similar user solutions are provided herein. Methods for lexical matrix construction by a machine intelligence in which root meanings of user text strings are used to associate groups of similar user text strings. Methods for semantic and polarity analysis as well as natural language processing are also employed. Methods for allowing Internet users to air their grievances and put forth solutions to said grievances in an online and/or mobile setting are provided. Methods for summarizing and categorizing cases of user disputes for hypothesizing and determining patterns between demographical groups and similar solutions are provided herein.

Query response using media consumption history

Methods, systems, and apparatus for receiving a natural language query of a user, and environmental data, identifying a media item based on the environmental data, determining an entity type based on the natural language query, selecting an entity associated with the media item that matches the entity type, selecting, from a media consumption database that identifies media items that have been indicated as consumed by the user, one or more media items that have been indicated as consumed by the user and that are associated with the selected entity, and providing a response to the query based on selecting the one or more media items that have been indicated as consumed by the user and that are associated with the selected entity.

Method and system for providing audio content

Methods and systems are disclosed in which audio broadcasts are converted into audio segments, for example, based on segment content. These audio segments are indexed, so as to be searchable, as computer searchable segments, for example, by network search engines and other computerized search tools.

Adapting search query processing according to locally detected video content consumption

A process adapts user-initiated search queries. The process executes at a client device with a microphone. The process downloads audio fingerprints from a remote server for a plurality of video programs, and downloads information that correlates the audio fingerprint to the video programs. The audio fingerprints are preselected according to relevancy criteria, including stored user preferences and prior search queries by the user. The audio fingerprints and correlating information are stored locally. The process detects ambient sound using the microphone and computes one or more sample audio fingerprints from the detected ambient sound. The process matches a sample audio fingerprint to a locally stored audio fingerprint and uses the correlating information to identify a first video program corresponding to the matched sample audio fingerprint. The process then receives user input to initiate a search query. The process provides auto-complete suggestions for the search query based on the first video program.

VOICE SEARCHING METADATA THROUGH MEDIA CONTENT

Techniques for searching metadata through media content. User input identifying a search criteria is received from a user device. Metadata associated with media content files is searched to identify a subset of the media content files. Search results identifying the subset of the media content files are provided to the user device. The metadata is generated by an originator of each media content file and describes each scene. 1. A computer-implemented method , comprising:receiving, from a user device, user input identifying a search criteria;searching, by operation of one or more computer processors, metadata associated with a plurality of media content files to identify a subset of the plurality of media content files, the subset of the plurality of media content files comprising one or more media content files of the plurality of media content files that includes one or more scenes that match the search criteria; andproviding, to the user device, search results identifying the subset of the plurality of media content files,wherein the metadata is generated by a respective originator of each media content file of the plurality of media content files and describes each scene of the plurality of media content files.2. The computer-implemented method of claim 1 , wherein the metadata comprises visual metadata describing an actor claim 1 , an actress claim 1 , a character claim 1 , an object claim 1 , a location claim 1 , an emotion claim 1 , an action claim 1 , a theme claim 1 , or a plot point associated with each scene of the plurality of media content files.3. The computer-implemented method of claim 1 , wherein the metadata comprises audio metadata describing a dialog or a song associated with each scene of the plurality of media content files.4. The computer-implemented method of claim 1 , wherein the metadata comprises subtitle metadata describing a subtitle associated with each scene of the plurality of media content files.5. The computer-implemented method of ...

COORDINATION OF PARALLEL PROCESSING OF AUDIO QUERIES ACROSS MULTIPLE DEVICES

The present disclosure is generally related to a data processing system to coordinate parallel processing of audio queries across multiple devices. A data processing system can receive an audio input signal detected the display device and parse the audio input signal to identify an entity. The data processing system can transmit a query command to the display device to cause a multimedia content application to perform a search for the entity. The data processing system can access at least one of an address database and a multimedia content provider to identify a reference address for the entity. The data processing system can provide the reference address for the entity to cause the display device to present a content selection interface. The content selection interface can include an element for the reference address, prior to completion of the search for the entity performed by the multimedia content application. 1. A system to coordinate parallel processing of an audio query-based search across multiple devices , comprising: receive, via an interface, a data packet including an audio input signal detected by a sensor of a display device; and', 'parse the audio input signal of the data packet to identify a request and an entity from the request; and, 'a natural language processor component executed by a data processing system to generate a query command including the entity and instructions for the display device to process the query command; and', 'transmit, via the interface, the query command to the display device to cause a multimedia content application executing on the display device to perform a search for the entity based on the instructions;, 'a search coordinator component executed by the data processing system toa content indexer component executed by the data processing system to access at least one of an address database and a multimedia content provider to identify a reference address corresponding to the entity; anda response handler component ...

METHODS AND APPARATUS FOR SECONDARY CONTENT ANALYSIS AND PROVISION WITHIN A NETWORK

Methods and apparatus for providing attribute-based search of media assets such as video and audio assets, and associated augmented reality functions including dynamic provision of relevant secondary content relating to the identified attribute(s). In one embodiment, media or content assets are ingested into a processing system and processed according to one or more attribute detection, identification, and characterization algorithms. Attributes detected may include for example the presence of tangible items such as clothing or chattels, particular persons such as celebrities, and/or certain contexts such as sporting activities and musical performances, as rendered within the media asset. In one implementation, the characterized assets are provided a unique ID, and stored so as to permit cross-correlation based on, e.g., the identified and characterized attributes. Secondary content (e.g., advertising or promotional content) is correlated to each identified asset, and dynamically served upon a user providing some threshold level of interaction with the attribute. 115.-. (canceled)16. A non-transitory computer-readable storage apparatus comprising a storage medium having one or more computer programs stored thereon , the one or more computer programs operative to be executed by a digital processor apparatus of a computerized device , the one or more computer programs comprising a plurality of instructions which are configured to , when executed on the digital processor apparatus , cause the computerized device to:obtain media data via a network data interface;communicate via the network data interface with at least one network entity to receive first data relating to (i) secondary content to be rendered in association with the media data by the computerized device, and (ii) one or more instructions regarding the rendering of the secondary content in association with the media data; andbased at least on the received first data, cause rendering the secondary content in ...

Method and system for content retrieval based on rate-coverage optimization

A content retrieval method including: extracting a plurality of fingerprints including a plurality of video fingerprints and audio fingerprints from contents stored in a content database; determining representative video fingerprints of the video frames and representative audio fingerprints of the audio sequences; determining a data rate indicating a storage limitation and a coverage indicating a number of searching results to be returned; storing selected representative video fingerprints and representative audio fingerprints based on the storage limitation indicated by the data rate in a fingerprint database; receiving a query containing at least one of video data and audio data submitted by a user; extracting at least one query fingerprint representing the query; determining a number of fingerprints most matching the query fingerprint based on the coverage to generate search results indicating matching contents represented by the number of most matching fingerprints; and returning the search results to the user.

SYSTEM AND METHOD TO INDEX TRAINING CONTENT OF A TRAINING SYSTEM

A non-transitory computer-readable medium includes computer-executable instructions that, when executed by at least one processor, may cause the at least one processor to retrieve a first training profile of a plurality of training profiles from a database, identify a plurality of index keywords in a respective training content of the first training profile, in which the respective training content includes audio data, video data, or both, and divide the first training profile into a plurality of sections based on the plurality of index keywords. Each of the plurality of sections is selectable for playback. 1. A non-transitory computer-readable medium comprising computer-executable instructions that , when executed by at least one processor , are configured to cause the at least one processor to:retrieve a first training profile of a plurality of training profiles from a database;identify a plurality of index keywords in a respective training content of the first training profile, wherein the respective training content comprises audio data, video data, or both; anddivide the first training profile into a plurality of sections based on the plurality of index keywords, wherein each of the plurality of sections is selectable for playback.2. The non-transitory computer-readable medium of claim 1 , wherein the computer-executable instructions claim 1 , when executed by the at least one processor claim 1 , are configured to:identify a plurality of timestamps of the respective training content, wherein each timestamp of the plurality of timestamps is associated with an index keyword of the plurality of index keywords; anddivide the first training profile into the plurality of sections based on the plurality of timestamps.3. The non-transitory computer-readable medium of claim 1 , wherein the respective training content is associated with a plurality of keywords claim 1 , and wherein the computer-executable instructions claim 1 , when executed by the at least one processor ...

DISPLAY APPARATUS AND METHOD FOR QUESTION AND ANSWER

A display apparatus and a method for questions and answers includes a display unit includes an input unit configured to receive user's speech voice; a communication unit configured to perform data communication with an answer server; and a processor configured to create and display one or more question sentences using the speech voice in response to the speech voice being a word speech, create a question language corresponding to the question sentence selected from among the displayed one or more question sentences, transmit the created question language to the answer server via the communication unit, and, in response to one or more answer results related to the question language being received from the answer server, display the received one or more answer results. Accordingly, the display apparatus may provide an answer result appropriate to a user's question intention although a non-sentence speech is input. 1. A display apparatus comprising:an input receiver;a voice receiver;a display;a communicator; and receive a user voice through the voice receiver,', 'based on a voice text corresponding to the user voice including a plurality of words, receive a related word corresponding to the voice text through the communicator from an external server and generate a plurality of texts including the related word,', 'control the display to display the plurality of texts,', 'based on a user input for selecting a text from among the plurality of texts being received through the input receiver, receive information corresponding to the selected text through the communicator from the external server, and', 'control the display to display the received information corresponding to the selected text., 'a processor configured to2. The display apparatus as claimed in claim 1 , wherein the processor is configured to control the display to display the plurality of texts in order of a number of times in which each of the plurality of texts has been previously selected based on ...

SYSTEM AND METHOD FOR PROVIDING CONTEXTUAL FEEDBACK IN RESPONSE TO A COMMAND

A voice recognition system in an aircraft is provided. The voice recognition system includes: a voice recognition controller configured to receive a voice command from a flight crew member voice interface, convert the voice command to an avionics system command, and forward the avionics system command to an avionics system for execution. The voice recognition system further includes an application controller configured to: receive the avionics system command that has been converted from the voice command; determine whether the avionics system command can be performed; cause the avionics system command to be performed when it is determined that the avionics system command can be performed; and when it is determined that the avionics system command cannot be performed, generate a message that provides a reason why the avionics system command cannot be performed and cause the message to be displayed on a display device and/or annunciated on an aural device. 1. A voice recognition system in an aircraft , comprising:a voice recognition controller configured to receive a voice command from a flight crew member voice interface, convert the voice command to an avionics system command, and forward the avionics system command to an appropriate application controller; and receive the avionics system command that has been converted from the voice command;', 'determine whether the avionics system command can be performed;', 'cause the avionics system command to be performed when it is determined that the avionics system command can be performed; and', 'when it is determined that the avionics system command cannot be performed, generate a message that provides a reason why the avionics system command cannot be performed, and cause the message to be displayed on a display device and/or annunciated on an aural device., 'an application controller configured to2. The voice recognition system of claim 1 , wherein to convert the voice command to the avionics system command claim 1 , ...

Generation of refinement terms for search queries

A computer-implemented method is provided, which includes receiving from a user a first search query consisting of one or more first query terms, and receiving from the user an indication of a desired level of personalization of refinement options for the search query. Responsively to the search query, a set of one or more refinement terms is generated at least in part responsively to the indication. The set of refinement terms is presented to the user. Responsively to a selection of at least one of the refinement terms by the user, the selected at least one refinement term is added to the first search query to generate a second search query. Search results are presented to the user responsively to the second search query. Other embodiments are also described.

Display method and display apparatus

Disclosed is a display method that includes: controlling a recording device to perform a real-time recording operation on a current environment when a preset type of display data is displayed on a first display interface; and performing character recognition on audio information obtained by the recording operation to obtain text information, and displaying the obtained text information on a second display interface. Further disclosed is a display apparatus.

SYSTEMS AND METHODS FOR DISPLAYING A CONTEXT IMAGE FOR A MULTIMEDIA ASSET

Systems and methods for displaying a context image for a multimedia asset are disclosed. In one embodiment, a system includes a programmable processor, and a display device. In some embodiments, the programmable processor is configured to identify a first multimedia asset being broadcast in a region, determine and retrieve a first context image associated with the first multimedia asset, and direct the display device to display the first context image during the broadcast of the first multimedia asset. 1. A system comprising:a programmable processor; anda display device,wherein the programmable processor is configured to (a) identify a first multimedia asset being broadcast in a region, (b) determine and retrieve a first context image associated with the first multimedia asset, and (c) direct the display device to display the first context image during the broadcast of the first multimedia asset.2. The system of further comprising an enclosure and matting to surround the display device.3. The system of wherein the enclosure and matting cause a visible portion of the display device to be a traditional size of a vinyl LP record jacket.4. The system of wherein the first multimedia asset is a music track from a larger musical album release claim 1 , and the context image is album cover art associated with the larger musical album release.5. The system of further comprising a gesture sensor claim 1 , wherein the gesture sensor is configured to detect body gestures of a person claim 1 , identify a command associated with a first body gesture claim 1 , and transmit the command associated with the first body gesture to a device controlling playback of the first multimedia asset.6. The system of wherein the command associated with the first body gesture is a pause command claim 5 , a play command claim 5 , a next track command claim 5 , a previous track command claim 5 , or a power down command.7. The system of further comprising a light meter that transmits a level of light ...

Pseudo real time communication system

Aspects of the invention include determining artifact data associated with an artifact, segmenting the artifact data into a plurality of portions, associating each portion in the plurality of portions with one or more resources, receiving a query associated with the artifact, determining a candidate resource from the one or more resources based on the query, and initializing a communication session with the candidate resource and a requesting application associated with the query.

APPARATUS, SYSTEM, AND METHOD OF ASSISTING INFORMATION SHARING, AND RECORDING MEDIUM

A system for assisting sharing of information includes circuitry to: input a plurality of sentences each representing a statement made by one of a plurality of users, the sentence being generated by speaking or writing during a meeting or by extracting from at least one of meeting data, email data, electronic file data, and chat data at any time; determine a statement type of the statement represented by each one of the plurality of sentences, the statement type being one of a plurality of statement types previously determined; select, from among the plurality of sentences being input, one or more sentences each representing a statement of a specific statement type of the plurality of types; and output a list of the selected one or more sentences as key statements of the plurality of sentences. 1 receive communication data of a plurality of users;', 'calculate, using the received communication data, a relationship strength between at least a first user and a second user of the plurality of users; and, 'circuitry configured to'}cause a display to display a communication diagram, the communication diagram illustrating the calculated relationship strength between the first user and the second user, the calculated relationship strength between the first user and the second user being expressed as a thickness of a line displayed between a displayed representation of the first user and a displayed representation of the second user.. A system, comprising: This application is a continuation Application of U.S. application Ser. No. 16/796,313, filed Feb. 20, 2020, which is a continuation application Ser. No. 15/606,691, filed May 26, 2017 (now U.S. Pat. No. 10,614,162), which is based on and claims priority pursuant to 35 U.S.C. § 119(a) to Japanese Patent Application No. 2016-106604, filed on May 27, 2016 and 2017-074344, filed on Apr. 4, 2017, in the Japan Patent Office. The entire contents of the above-identified applications are incorporated herein by reference.The ...

Search and Access System for Media Content Files

Method and apparatus for managing media content files. In some embodiments, a processing circuit is used to identify a reference audio sequence (e.g., spoken words) in an audio portion of a media content file. A data structure stored in a memory links each portion of the reference audio sequence with an associated time stamp that identifies a time location of the associated portion of the reference audio sequence within the media content file with respect to a reference point of the media content file. The data structure is searched using an input search string to identify a selected portion of the reference audio sequence in the media content file. Playback of the media content file is initiated on a display device beginning at an intermediate point of the media content file corresponding to the time stamp associated with the selected portion of the reference audio sequence.

System and method for contextually enriching a concept database

A system and method for contextually enriching a concept database. The method includes determining, based on at least one signature of a first multimedia data element (MMDE) and signatures of a plurality of third concepts stored in the concept database, at least one matching first concept among the plurality of third concepts; generating a reduced representation of the first MMDE; comparing the reduced representation of the first MMDE to signatures representing a plurality of second MMDEs to determine a plurality of matching MMDEs among the plurality of second MMDEs; generating, based on the reduced representation of the first MMDE and the signatures representing the plurality of matching MMDEs, a second concept; and generating at least one context based on the second concept and the plurality of third concepts, wherein each context includes at least one common pattern among the second concept and at least one of the plurality of third concepts.

COGNITIVE PROGRAM SUITE FOR A COGNITIVE DEVICE AND A MOBILE DEVICE

Systems and methods for utilizing a cognitive device are disclosed. A method includes: receiving, by a computer device, a query from a cognitive device; processing, by the computer device, the query to generate a processed query; transmitting, by the computer device, the processed query to a mobile device; receiving, by the computer device, an action query result from the mobile device based on the mobile device receiving the processed query and performing an action query; transmitting, by the computer device, the action query result to the cognitive device based on receiving the action query result. 1. A computer-implemented method , comprising:receiving, by a computer device, a query from a cognitive device;determining, by the computer device, whether a user of a mobile device has a required access level for the query, the required access level being based on the user being listed in settings of the mobile device; andrestricting, by the computer device and based on a result of the determining being that the user is not listed in the settings of the mobile device, access to the mobile device by the cognitive device.2. The method of claim 1 , further comprising determining claim 1 , by the computer device claim 1 , an action in the query.3. The method of claim 2 , wherein the query includes one of: send or read a SMS message claim 2 , send or read an email claim 2 , activate a navigation system claim 2 , retrieve a phone notification claim 2 , and play a voicemail.4. The method of claim 1 , further comprising processing claim 1 , by the computer device and based on the result of the determining being that the user is listed in the settings of the mobile device claim 1 , the query to generate a processed query.5. The method of claim 4 , further comprising transmitting claim 4 , by the computer device and based on the result of the determining being that the user is listed in the settings of the mobile device claim 4 , the processed query to the mobile device.6. The ...

Multi-Media Forms System

An inventory management or equipment inspection system that allows an audio or audio-video session to be recorded and converted to text, where the text is entered into semi-structured fields of a data form, while the audio track is being recorded. In other words, the system records an audio or audio-video session providing for concurrent collection of unstructured data stream, such as the audio track, and structured or semi-structured data, such as completion of text fields in the form. The system provides the ability to record the session, automatically convert the recorded voice to text, enter the text into data fields, and edit the text in the fields, while the audio or audio-video session is ongoing.

METHOD FOR PROVIDING KEY MOMENTS IN MULTIMEDIA CONTENT AND ELECTRONIC DEVICE THEREOF

A method for automatically providing key moments in a multimedia content on an electronic device and an electronic device therefor are provided. The method includes determining a navigation behavior of each user of the multimedia content during playback, determining a plurality of key moments in the multimedia content based on the navigational behavior, the plurality of key moments including a positive key moment, a negative key moment, and a neutral key moment, storing the plurality of key moments, detecting a playback event of the multimedia content by a candidate user, retrieving at least one key moment from the plurality of key moments in the multimedia content based on the candidate user, and displaying an actionable user interface including the at least one key moment. 1. A method for operating an electronic device , the method comprising:determining a navigation behavior of each user of the multimedia content during playback;determining a plurality of key moments in the multimedia content based on the navigational behavior, the plurality of key moments including a positive key moment, a negative key moment, and a neutral key moment;storing the plurality of key moments;detecting a playback event of the multimedia content by a candidate user;retrieving at least one key moment from the plurality of key moments in the multimedia content based on the candidate user; anddisplaying an actionable user interface including the at least one key moment.2. The method of claim 1 , wherein the determining of the plurality of key moments in the multimedia content based on the navigational behavior comprises:determining a navigation score for each of the timestamp from a plurality of timestamps of the multimedia content;determining, for each of the timestamp of the multimedia content, whether the navigation score is above a navigation threshold, below a navigation threshold or equal to the navigation threshold; and the positive key moment based on the navigation score of at ...

Method and apparatus for pairing music and food selections

A system and method enable the selection of musical recordings for pairing with a food serving, possibly an appetizer, a main course, a dessert or a beverage, for the purpose of increasing the enjoyment of a given meal. A plurality of factors for specific meal components such as entree, including protein type, method of cooking, amount of spice, side dish component and type of sauce are used to determine a specific numerical value for a meal; appetizer including protein type, bread and dough content, method of cooking and spice level; dessert, including content of cacao, sweetener and content of sweetener, ambient temperature at service and dairy content; and beverage, including but not limited to alcohol content, acidity, body, dryness, lingering quality, and IBU. A specific numerical value for a musical recording is also determined based on a plurality of factors, including genre, tempo, dynamics, and primary instrument. The numerical value assigned to the meal and the numerical value assigned to the musical recording are preferably as nearly identical as possible. The musical recording enhances the perception of the flavor, texture, and overall experience of the food. The process may be facilitated through use of a dedicated mobile application, or may be performed manually by a user.

MULTIDIMENSIONAL SCENE DATA GENERATING DEVICE AND METHOD BASED ON DIGITIZED WORK

The present disclosure discloses a multidimensional scene data generating device and method based on a digitized work, which can acquire a digitized work; match, according to the acquired digitized work, corresponding multidimensional information data from a prestored multidimensional information database; and generate, according to the determined multidimensional information data, multidimensional scene data corresponding to a multidimensional scene to be presented. 1. A multidimensional scene data generating device based on a digitized work , comprising:an acquiring module configured to acquire a digitized work;a matching module configured to match, according to acquired digitized work, corresponding multidimensional information data from a prestored multidimensional information database; anda generating module configured to generate, according to determined multidimensional information data, multidimensional scene data corresponding to a multidimensional scene to be presented.2. The multidimensional scene data generating device based on a digitized work of claim 1 , wherein the matching module is configured to acquire a selection instruction determined by a user according to the digitized work claim 1 , and match multidimensional information data corresponding to the digitized work according to the selection instruction.3. The multidimensional scene data generating device based on a digitized work of claim 1 , wherein the generating module is configured to perform analysis processing on the determined multidimensional information data claim 1 , and determine a display time of the multidimensional information data in a multidimensional scene to be presented; and generate claim 1 , according to the determined multidimensional information data and the display time corresponding thereto claim 1 , multidimensional scene data corresponding to the multidimensional scene to be presented.4. The multidimensional scene data generating device based on a digitized work of ...

MULTIMEDIA POSTER GENERATION METHOD AND TERMINAL

Disclosed are a multimedia poster generation method and a terminal. The method includes: receiving a poster generation instruction; acquiring a poster resource, the poster resource including a plurality of background files and a lyric file of a multimedia file, and the multimedia file being a multimedia file selected by a user; acquiring a background file to be shared that is selected by the user from the plurality of background files, and acquiring lyric information to be shared that is selected by the user from the lyric file; and generating a multimedia poster of the multimedia file according to the lyric information to be shared and the background file to be shared. 116-. (canceled)17. A multimedia poster generation method , comprising:receiving a poster generation instruction;acquiring a poster resource, wherein the poster resource comprises a plurality of background files and a lyric file of a multimedia file and the multimedia file is a multimedia file selected by a user;acquiring a background file to be shared that is selected by the user from the plurality of background files, and acquiring lyric information to be shared that is selected by the user from the lyric file; andgenerating a multimedia poster of the multimedia file according to the lyric information to be shared and the background file to be shared.18. The method according to claim 17 , wherein after generating the multimedia poster of the multimedia file claim 17 , the method further comprises:displaying at least one social entry, determining a selected entry, and sharing the multimedia poster through a social network corresponding to the selected entry when a sharing operation for the multimedia poster is detected.19. The method according to claim 17 , wherein after acquiring the poster resource claim 17 , the method further comprises:displaying a lyric content of the multimedia file; andtaking the selected lyric content as lyric information to be shared, and displaying the lyric information to ...

METHOD FOR USING PAUSES DETECTED IN SPEECH INPUT TO ASSIST IN INTERPRETING THE INPUT DURING CONVERSATIONAL INTERACTION FOR INFORMATION RETRIEVAL

A method for using speech disfluencies detected in speech input to assist in interpreting the input is provided. The method includes providing access to a set of content items with metadata describing the content items, and receiving a speech input intended to identify a desired content item. The method further includes detecting a speech disfluency in the speech input and determining a measure of confidence of a user in a portion of the speech input following the speech disfluency. If the confidence measure is lower than a threshold value, the method includes determining an alternative query input based on replacing the portion of the speech input following the speech disfluency with another word or phrase. The method further includes selecting content items based on comparing the speech input, the alternative query input (when the confidence measure is low), and the metadata associated with the content items. 128.-. (canceled)29. A method for using speech disfluencies detected in speech input to assist in interpreting the input , the method comprising:providing access to a set of content items, each of the content items being associated with metadata that describes the corresponding content item;receiving a speech input from a user;detecting an absence of a period of silence in a beginning of the speech input;in response to detecting the absence of the period of silence in the beginning of the speech input, determining that the speech input excludes a first portion of a first word of the speech input;in response to determining that the speech input excludes the first portion of the first word of the speech input, identifying a second portion of the first word included in the speech input;identifying a plurality of words having a suffix matching the second portion of the first word;selecting a subset of content items, from the set of content items, wherein each content item of the subset of content items matches a word of the plurality of words; andgenerating for ...

SYSTEMS AND METHODS TO HANDLE QUERIES COMPRISING A MEDIA QUOTE

Systems and methods for handling a query comprising a media quote are provided. One example method includes receiving, at a computing device, an input comprising a query. A media quote is identified based on the query. A media asset is identified based on the identified media quote. An action is performed at the computing device, the action based on the identified media asset. 1. A method for handling a query comprising a media quote , the method comprising:receiving, at a computing device, an input comprising a query, wherein the query comprises a media quote;identifying, from the query, a media quote;identifying, based on the identified media quote, a media asset; andperforming, based on the identified media asset, an action at the computing device.230-. (canceled)31. The method of claim 1 , wherein the identifying the media quote and the media asset further comprises:chunking the query to produce one or more chunks;generating a hash for each chunk of the one or more chunks, thereby producing one or more hashes;identifying whether the one or more hashes are present in an index of media assets; andwhere the one or more hashes are present in the index of media assets, returning an indication of the media asset associated with the one or more hashes.32. The method of claim 1 , wherein the identifying the media quote and the media asset further comprises:identifying, based on the identified media quote, one or more phrases;determining whether the one or more phrases have one or more phonetic and/or lexical variants; and, if a phrase has a phonetic and/or lexical variant:chunking the query and the one or more phonetic and/or lexical variants, thereby producing a plurality of hashes;identifying whether identifying whether the one or more hashes are present in an index of media assets; andwhere the one or more hashes are present in the index of media assets, returning an indication of the media asset associated with the one or more hashes.332. The method of claim claim 1 ...

Voice instructions during navigation

A method of providing navigation on an electronic device when the display screen is locked. The method receives a verbal request to start navigation while the display is locked. The method identifies a route from a current location to a destination based on the received verbal request. While the display screen is locked, the method provides navigational directions on the electronic device from the current location of the electronic device to the destination. Some embodiments provide a method for processing a verbal search request. The method receives a navigation-related verbal search request and prepares a sequential list of the search results based on the received request. The method then provides audible information to present a search result from the sequential list. The method presents the search results in a batch form until the user selects a search result, the user terminates the search, or the search items are exhausted.

GENERATING MEDIA CONTENT PLAYLISTS INCLUDING RELEVANT INTERSTITIALS

A method includes identifying media content items for a playlist, identifying interstitials for the playlist, and pairing the media content items based on the interstitials. Each resulting pair of media content items is related to one of the interstitials. The method also includes arranging the resulting pairs of media content items in the playlist together with the interstitials that are each related to both media content items in a respective pair of the resulting pairs. Each interstitial is inserted between a first media content item and a second media content item in a respective pair of the resulting pairs in the playlist. 1. A method , comprising:identifying a plurality of media content items for a playlist;identifying a plurality of interstitials for the playlist;pairing the plurality of media content items based on the plurality of interstitials, wherein each resulting pair of media content items is related to one of the plurality of interstitials; andarranging the resulting pairs of media content items in the playlist together with the interstitials that are each related to both media content items in a respective pair of the resulting pairs, wherein each interstitial is inserted between a first media content item and a second media content item in a respective pair of the resulting pairs in the playlist.2. The method of claim 1 , wherein content of each interstitial provides a transition from the first media content item in the respective pair of the resulting pairs to the second media content item in the respective pair of the resulting pairs claim 1 , to facilitate cohesiveness of content across the playlist.3. The method of claim 1 , wherein the resulting pairs of media content items and the interstitials are arranged in the playlist based on a score of a frequency of occurrence of pairs of media content items having one or more identifiers that match one or more identifiers of one of the plurality of interstitials.4. The method of claim 3 , wherein ...

Autonomously providing search results post-facto, including in assistant context

Methods, apparatus, and computer readable media related to determining that no resources responsive to a query of a user at a first time satisfy one or more criteria (e.g., one or more quality criteria) and, in response to such a determination: providing for presentation to the user at a later time, content that is based on a given resource that is responsive to the query at the later time and that satisfies the criteria. The given resource that is responsive to the query at the later time may be a resource that is in addition to any resources responsive to the query at the first time or may be a refined version of a resource that was responsive to the query at the first time.

SYSTEMS AND METHODS FOR RECORDING RELEVANT PORTIONS OF A MEDIA ASSET

Systems and methods are presented herein for recording portions of a media asset relevant to recording criteria. A media application receives input indicating the recording criteria and identifying a first keyword. The media application accesses a data structure to identify a first node associated with the first keyword. The data structure includes the first node and a plurality of nodes connected to the first node via a plurality of paths. The media application receiving audio component data for a portion of the media asset extracts a term from the audio component data, and identifies a second node in the data structure that is associated with the extracted term. The media application calculates a path score for the portion of the media asset based on a path size in the data structure between the first node and the second node. When the score is high enough, the portion of the media asset is recorded. 130-. (canceled)31. A method for recording portions of a media asset relevant to recording criteria , the method comprising:receiving input indicating the recording criteria for identifying one or more portions of the media asset to be recorded;identifying a keyword based on the recording criteria;determining a relatedness between the keyword and a term associated with a portion of the media asset; andin response to determining that the determined relatedness exceeds a relatedness threshold, recording the portion of the media asset.32. The method of claim 31 , further comprising:retrieving data associated with the portion of the media asset; andextracting the term associated with the portion of the media asset from the retrieved data.33. The method of claim 32 , wherein the retrieved data corresponds to audio associated with the portion of the media asset.34. The method of claim 31 , wherein the determining the relatedness between the keyword and the term associated with the portion of the media asset comprises:accessing a data structure to identify a first node ...

VOICE INSTRUCTIONS DURING NAVIGATION

A method of providing navigation on an electronic device when the display screen is locked. The method receives a verbal request to start navigation while the display is locked. The method identifies a route from a current location to a destination based on the received verbal request. While the display screen is locked, the method provides navigational directions on the electronic device from the current location of the electronic device to the destination. Some embodiments provide a method for processing a verbal search request. The method receives a navigation-related verbal search request and prepares a sequential list of the search results based on the received request. The method then provides audible information to present a search result from the sequential list. The method presents the search results in a batch form until the user selects a search result, the user terminates the search, or the search items are exhausted. 1. A method of providing navigational audio announcements on an electronic device traveling a route , comprising:receiving, by a voice-activated service, a navigation audio file from a navigation application for a navigational audio announcement corresponding to the route;detecting that a user verbal request is currently being provided to the voice-activated service, the user verbal request representing a query;determining that the electronic device has reached within a threshold distance of an upcoming maneuver that corresponds to the navigational audio announcement;generating, by the voice-activated service, a preliminary voice response to the user verbal request;generating, by the voice-activated service, a composite output that incorporates the navigational audio file into the preliminary voice response to the verbal input; andoutputting, by the voice-activated service, the composite output.2. The method of claim 1 , further comprising:receiving, by a voice-activated service, a navigation text file from the navigation application for ...

Methods and systems for providing a secure automated assistant

Implementations described herein relate to receiving user input directed to an automated assistant, processing the user input to determine whether data from a server and/or third-party application is needed to perform certain fulfillment of an assistant command included in the user input, and generating a prompt that requests a user consent to transmitting of a request to the server and/or the third-party application to obtain the data needed to perform the certain fulfillment. In implementations where the user consents, the data can be obtained and utilized to perform the certain fulfillment. In implementations where the user does not consent, client data can be generated locally at a client device and utilized to perform alternate fulfillment of the assistant command. In various implementations, the request transmitted to the server and/or third-party application can be modified based on ambient noise captured when the user input is received.

Displaying information related to spoken dialogue in content playing on a device

A server system detects presentation of a media content item being played at a first device in proximity to a second device associated with a first user. It also receives from the second device content information derived from sound output from the presentation of the media content item at the first device captured at the second device. Based on the received content information, it identifies the media content item being played at the first device and a plurality of first quotations associated with the media content item. The server system sends to the second device the first quotations and a plurality of quotation operation affordances. It receives selection by the first user of a first affordance of the quotation operation affordances for a first one of the first quotations. In accordance with the selection, it performs an operation with respect to the first one of the first quotations.

Method and apparatus for processing information

Embodiments of the present disclosure disclose a method and apparatus for processing information. A specific implementation of the method includes: parsing a received voice query request sent by a user to obtain text query information corresponding to the voice query request; obtaining text push information obtained by searching using the text query information; processing the text push information to obtain to-be-pushed information corresponding to the text push information; and playing the to-be-pushed information. The implementation can play information when the user is not convenient to browse the information, so that the user can obtain the information in time.

METHODS FOR ARBITRATING ONLINE DISPUTES AND ANTICIPATING OUTCOMES USING MACHINE INTELLIGENCE

Methods for conflict arbitration and resolution anticipation through machine intelligence learning are provided herein. Methods for hypothesizing by a machine intelligence such that predictions of user text strings put forth from one demographic may be proposed. Methods for pattern recognition between demographical user groups and similar user solutions are provided herein. Methods for lexical matrix construction by a machine intelligence in which root meanings of user text strings are used to associate groups of similar user text strings. Methods for semantic and polarity analysis as well as natural language processing are also employed. Methods for allowing Internet users to air their grievances and put forth solutions to said grievances in an online and/or mobile setting are provided. Methods for summarizing and categorizing cases of user disputes for hypothesizing and determining patterns between demographical groups and similar solutions are provided herein. 1. A processor-based method for refining a machine intelligence comprising the steps of:parsing to a first unresolved case in a set of unresolved cases;parsing to a first resolved case in a set of resolved cases;performing a case similarity determination as to whether the first resolved case is similar to the first unresolved case; loading a resolved case solution associated with the first resolved case;', 'converting the resolved case solution into a hypothesis associated with the first unresolved case; and,', [ 'increasing a hypothesis accuracy rate; or,', 'if the solution similarity determination results in similarity,'}, 'decreasing the hypothesis accuracy rate.', 'if the solution similarity determination results in dissimilarity,'}], 'performing a solution similarity determination as to whether the hypothesis is similar to an unresolved case solution;'}], 'if the case similarity determination results in similarity;'}2. The method of claim 1 , further including the steps of:if the case similarity ...

VOICE ASSISTANTS WITH GRAPHICAL IMAGE RESPONSES

In an example, an apparatus having a voice assistant application that generates a graphical image response is provided. The apparatus includes a microphone and a processor in communication with the microphone. The microphone receives a secure voice assistant mode activation command and a voice command. The processor is to execute a voice assistant application, wherein the voice assistant application is to generate a graphical image response in response to the secure voice assistant mode activation command and the voice command, to change a privacy setting in the apparatus in response to the secure voice assistant mode activation command, to transmit the voice command from the microphone to the voice assistant application, and to transmit the graphical image response to a display. 1. An apparatus , comprising:a microphone to receive a secure voice assistant mode activation command and a voice command; and execute a voice assistant application, wherein the voice assistant application is to generate a graphical image response in response to the secure voice assistant mode activation command and the voice command,', 'change a privacy setting in the apparatus in response to the secure voice assistant mode activation command,', 'transmit the voice command from the microphone to the voice assistant application, and', 'transmit the graphical image response to a display., 'a processor in communication with the microphone, wherein the processor is to2. The apparatus of claim 1 , wherein the display is part of the apparatus.3. The apparatus of claim 1 , further comprising:a communication interface to establish a communication path with a personal device, wherein the display is associated with the personal device and the graphical image response is transmitted over the communication path to the personal device to be shown on the display of the personal device.4. The apparatus of claim 3 , wherein the personal device comprises a mobile endpoint device or a wearable device.5. The ...

REFINEMENT OF VOICE QUERY INTERPRETATION

A system for refinement of a voice query interpretation interprets a voice query received at a voice-enabled device to identify commands responsive to the voice query for execution at the voice-enabled device, and enables refinement of the interpretation of the voice query through a graphical user interface generated and displayed at a GUI-capable device. The graphical user interface includes a set of selectable options relating to the voice query and identifying a refinement of the interpretation of the voice query to enable control and/or adjustment of commands to be executed by the voice-enabled device. For example, if one of the selectable options is selected, then a command associated with the selected option is identified and executed by the voice-enabled device. 120-. (canceled)21. A method for refining an interpretation of a voice query , the method comprising:receiving, at a server from a voice-enabled device, a voice query requesting execution of a command by the voice-enabled device;providing, by the server, instructions for generating and displaying a graphical user interface (GUI) that includes a set of selectable options related to the voice query, the graphical user interface being displayed on a GUI-capable device that is separate from the voice-enabled device;receiving, at the graphical user interface, a selection of one of the selectable options; andcausing, by the server, a command associated with the selected option to be executed.22. The method of claim 21 , wherein the command is to be executed by the voice-enabled device.23. The method of claim 21 , wherein providing the instructions comprises determining claim 21 , by the server claim 21 , an interpretation of the voice query.24. The method of claim 23 , wherein each of the selectable options identifies a refinement of the interpretation of the voice query.25. The method of claim 23 , further comprising:upon receipt of the voice query, causing an initial command responsive to the voice query ...

Search for content data in content

Video and audio content is searchable using a text search. A search component can analyze respective items of content to identify words spoken in the items of content, and generate respective transcripts of the respective words of the items of content based on the analysis. The search component receives a text search comprising a keyword and analyzes the respective transcripts to determine whether a transcript(s) contains a word that matches or substantially matches the keyword. The search component generates a search result(s) associated with the transcript(s) that at least is a substantial match to the keyword. The search component can present a time indicator indicating a time position in proximity to where the word is located in the content of the search result(s), and presentation of the content can start from that time position. The search component can be executed in a set-top box associated with a presentation device.

INFORMATION COMMUNICATION TERMINAL, INFORMATION DISTRIBUTION APPARATUS, INFORMATION DISTRIBUTION SYSTEM, CONTENT MANAGEMENT METHOD, BROADCAST RECEPTION METHOD, INFORMATION DISTRIBUTION METHOD, PROGRAMS AND STORAGE MEDIUM

A method for providing purchased content is provided. Management data including the identification data of the purchased content data stored in the information processing apparatus is received. Backup data of a user identification associated with the information processing apparatus is updated based on the management data. A request with the user identification associated with the information processing apparatus is received. A determination is made as to whether the request is authorized based on an authentication process. A list of identification data of content data identified in the backup data is provided to the information processing apparatus in response to a determination that the request is authorized. Further, the purchased content data without the fee is provided to the information processing apparatus based on a user selection of the identification data of the purchased content data from the list of the identification data of the content data. 1. An information processing apparatus , comprising:communication circuitry configured to communicate with a server;a touch panel to detect a user input; receive, from the server, identification data of content data available for purchase,', 'when the content data is purchased based on a user input for a fee, receive the purchased content data from the server,', 'provide, to the server, management data including the identification data of the purchased content data, wherein the management data is stored in the information processing apparatus, and wherein the server updates backup data of a user identification associated with the information processing apparatus based on the management data,', 'provide, to the server, a request with the user identification associated with the information processing apparatus, wherein the server determines whether the request is authorized based on an authentication process,', 'receive, from the server, the purchased content data without the fee based on a user selection of the ...

METHOD OF AND SYSTEM FOR REAL TIME FEEDBACK IN AN INCREMENTAL SPEECH INPUT INTERFACE

The present disclosure provides systems and methods for selecting and presenting content items based on user input. The method includes receiving first input intended to identify a desired content item among content items associated with metadata, determining that an input portion has an importance measure exceeding a threshold, and providing feedback identifying the input portion. The method further includes receiving second input, and inferring user intent to alter or supplement the first input with the second input. The method further includes, upon inferring intent to alter the first input, determining an alternative query by modifying the first input based on the second input, and, upon inferring intent to supplement the first input, determining an alternative query by combining the first input and the second input. The method further includes selecting and presenting a subset of content items based on comparing the alternative query and metadata associated with the subset. 120-. (canceled)21. A computer-implemented method for selecting and presenting content items based on user input , the method comprising:providing access to a plurality of content items;beginning to receive of a voice input intended by the user to identify at least one desired content item;determining, prior to receiving the completed voice input, that a portion of the voice input has a measure of importance that exceeds a threshold value;selecting a content item from the plurality of content items;interrupting receipt of the voice input; andpresenting the selected content item to the user.22. The method of wherein each of the plurality of content items is associated with metadata that describes a corresponding content item23. The method of wherein selecting a content item from the plurality of content items further comprises comparing the portion of the voice input with the metadata of each of the plurality of the content item.24. The method of further comprising presenting the selected ...

Information communication terminal, information distribution apparatus, information distribution system, content management method, broadcast reception method, information distribution method, programs and storage medium

It is an object of the present invention to enhance convenience and service qualities in an information distribution system. In a server serving as an information distribution apparatus and an information communication terminal, contents are managed by using content identifiers (content IDs) managed as IDs conforming to a rule of uniformity. Particularly, in the information communication terminal, a content ripped from a recording medium such as a CD and stored in storage means such as an HDD is also managed by using a content identifier acquired from the information distribution apparatus. In this way, contents stored in the storage means can be managed by using content IDs each managed as an ID common to the information communication terminal and the information distribution apparatus. In communication between the information communication terminal and the information distribution apparatus, a content identifier conforming to a rule of uniformity is used for identifying a content to which the content identifier is assigned so that the terminal is capable of downloading the content as well as acquiring additional information relevant to the content from the apparatus, and the apparatus is capable of rendering a plurality of other services.

Using cross-matching between users and matching against reference data to facilitate content identification

Techniques for identifying video and/or audio content are presented. An identification management component (IMC) groups users determined to be at least potentially be watching the same content based on first content fingerprints associated with respective content viewed by the users on communication devices, and a defined matching criterion. IMC facilitates identifying the content associated with the group of users based on first content fingerprints associated with the group of users and first reference content fingerprints. IMC receives a second content fingerprint associated with a communication device of a user in the group, sends the second content fingerprint to a third-party identification component for comparison with second reference content fingerprints, and receives content identification information in response. IMC identifies the content for the group of users based on the content identification information and/or the content identification made based on the first content fingerprints associated with the group.

PRECISION RECALL IN VOICE COMPUTING

A voice computing environment includes a library of items, each item having one or more excerpts. Users are enabled to assign a unique voice tag to each item in the library. Each voice tag comprises three words or less. The system monitors for potential duplicate voice tags in the library. When such duplicates are detected, one or more alternative voice tags are recommended to the user. 1. A method comprising:creating a library of items, each item having one or more excerpts;enabling a user to add new items to the library and to assign a unique voice tag to each new item as it is added to the library;adding metadata about each new item to an index as the new item is added to the library, together with the unique voice tag assigned to the new item by the user; andmonitoring for potential duplicate voice tags in the index, and when such duplicates are detected, recommending one or more alternative voice tags to the user.2. The method of claim 1 , wherein each voice tag comprising three words or less.3. The method of claim 1 , wherein the library comprises a personal library unique to the user.4. The method of claim 1 , wherein the library comprises a universal library comprising items added by more than one user or accessible to more than one user.5. The method of claim 1 , wherein the items comprise audio claim 1 , video claim 1 , text claim 1 , images claim 1 , webpages claim 1 , or presentations.6. The method of claim 1 , wherein enabling a user to assign a unique voice tag to each new item comprises presenting the user with a voice tag assignment module accessible via a website or mobile application.7. The method of claim 1 , wherein recommending alternative voice tags to a user comprises recommending avoiding problematic words for voice computing systems.8. A system comprising:a library of items, each item having one or more excerpts;an index comprising metadata about each item in the library and a plurality of unique voice tags, each voice tag corresponding to ...

SYSTEMS AND METHODS FOR HANDLING CONTEXTUAL QUERIES

Systems and methods for facilitating contextual queries based on media samples automatically captured by a computing device are disclosed herein. A server receives from a computing device over a communication network, a media sample of a media asset automatically captured by the computing device. The server obtains contextual information corresponding to the captured media sample. The server stores the media sample in a memory indexed by the contextual information. The server receives, from the computing device over the communication network, a query that includes a criterion but lacks an identifier of the media asset. The server identifies the media sample in the memory by matching the query criterion to the contextual information. The server generates a reply to the query based on the identifying of the media sample and communicates the reply to the computing device over the communication network. 1. A method for facilitating contextual queries based on media samples automatically captured by a computing device , the method comprising:receiving, at a server from a computing device by way of a communication network, a media sample of a media asset automatically captured by the computing device;obtaining contextual information corresponding to the captured media sample;storing the contextual information in a memory;storing the media sample in a memory indexed by the contextual information;receiving, at the server from the computing device by way of the communication network, a query including a criterion, wherein the query lacks an identifier of the media asset;identifying the media sample in the memory by matching the criterion to the contextual information;generating a reply to the query based on a result of the identifying; andcommunicating the reply to the computing device by way of the communication network.2. The method of claim 1 , further comprising: generating a media fingerprint based on the media sample; and', 'identifying the media asset based on the ...

SYSTEMS AND METHODS FOR USING CONJUNCTIONS IN A VOICE INPUT TO CAUSE A SEARCH APPLICATION TO WAIT FOR ADDITIONAL INPUTS

A search is performed based on a voice input combined with user selection of entities displayed on a display screen as well as real-world entities. A voice input is received from the user by a media device, as well as a selection of a first entity being displayed on the media device. A conjunction spoken in the voice input triggers the media device to wait for selection of a second entity before performing the search. After receiving selection of the second entity, a search query is constructed based on the voice input, the first entity, and the second entity. The search query is transmitted to a database and, in response, the media device receives at least one identifier of a least one content item. The at least one identifier is then generated for display to the user. 1. A method for searching for media content , the method comprising:receiving, at a media device, a selection of a first entity currently being displayed on a display of the media device;receiving, at the media device, a voice input from a user;detecting, by processing the voice input, a conjunction;in response to detecting the conjunction, waiting for a selection of at least one additional entity;receiving the selection of at least one additional entity;constructing a search query based on the conjunction, the first entity, and the at least one additional entity;transmitting the search query to a database;receiving, in response to transmitting the search query, at least one identifier of at least one content item; andgenerating for display, on the media device, the at least one identifier.2. The method of claim 1 , wherein the conjunction is a coordinating conjunction and wherein constructing the search query further comprises:determining a type of the coordinating conjunction;identifying a logical operator corresponding to the type of coordinating conjunction; andgenerating a search string comprising the first entity and each additional entity separated by the logical operator.3. The method of ...

METHODS, SYSTEMS, AND MEDIA FOR PROCESSING QUERIES RELATING TO PRESENTED MEDIA CONTENT

Methods, systems, and media for processing queries relating to presented media content are provided. In some implementations, a method comprises: receiving a request to associate with a media playback device that is presenting media content to a user of the mobile device, wherein a mobile application executing on the mobile device and a media application executing on the media playback device exchange media playback information; activating a microphone associated with the mobile device to receive ambient sounds in response to associating with the media playback device; converting the received ambient sounds to one or more text inputs; determining whether the text inputs include a trigger term that corresponds to a request to initiate a query relating to the presented media content and the query; in response to determining that the trigger term has been included in the text inputs, determining the media playback information from the media application that includes timing information corresponding to when during the presentation of the media content the query was received and media content identification information; causing a search to be performed that includes the query, the timing information, and the media content identification information; obtaining a search result that is responsive to the query; and presenting at least a portion of the search result to the query on a mobile display associated with the mobile device. 1. A method for providing media guidance , the method comprising:receiving, using a computing device, one or more inputs;determining whether the one or more inputs include a query and a trigger term that corresponds to a request to initiate the query relating to media content being presented;in response to determining that the trigger term has been included in the one or more inputs, determining media playback information that includes timing information corresponding to a time at which the query was received during the presentation of the media ...

Playlist trailers for media content playback during travel

Systems, devices, apparatuses, components, methods, and techniques for media content playback during travel are provided. An example method a method of generating a playlist trailer for a media playback device, the method comprising: identifying a plurality of media content items from a playlist for inclusion in a playlist trailer identifying snippets from the identified plurality of media content items; and combining the identified snippets to generate a playlist trailer.

Feedback controller for data transmissions

A feedback control system for data transmissions in voice activated data packet based computer network environment is provided. A system can receive audio signals detected by a microphone of a device. The system can parse the audio signal to identify trigger keyword and request. The system can select a content item using the trigger keyword or request. The content item can be configured to establish a communication session between the device and a third party device. The system can monitor the communication session to measure a characteristic of the communication session. The system can generate a quality signal based on the measured characteristic.

USING CROSS-MATCHING BETWEEN USERS AND MATCHING AGAINST REFERENCE DATA TO FACILITATE CONTENT IDENTIFICATION

Techniques for identifying video and/or audio content are presented. An identification management component (IMC) groups users determined to be at least potentially be watching the same content based on first content fingerprints associated with respective content viewed by the users on communication devices, and a defined matching criterion. IMC facilitates identifying the content associated with the group of users based on first content fingerprints associated with the group of users and first reference content fingerprints. IMC receives a second content fingerprint associated with a communication device of a user in the group, sends the second content fingerprint to a third-party identification component for comparison with second reference content fingerprints, and receives content identification information in response. IMC identifies the content for the group of users based on the content identification information and/or the content identification made based on the first content fingerprints associated with the group. 1. (canceled)2. A method for identifying content , the method comprising:receiving, using a hardware processor, a first fingerprint associated with a first media content item and a second fingerprint associated with a second media content item;determining, using the hardware processor, that the first media content item is related to the second media content item by comparing a first group of characteristic components associated with the first fingerprint with a second group of characteristic components associated with the second fingerprint;identifying, using the hardware processor, the first media content based on the first content fingerprint, wherein a confidence value is associated with the identification; andin response to determining that the confidence value exceeds a predetermined threshold, identifying, using the hardware processor, the second media content based on the identification of the first media content.3. The method of claim 2 ...

METHOD FOR SEARCHING AND DEVICE THEREOF

Provided are a method and an apparatus for searching for and acquiring information under a computing environment. The apparatus includes: at least one input device configured to receive a first query input of a first query type and a second query input of a second query type; and a controller configured to output a query input window including a first display item corresponding to the first query input and a second display item corresponding to the second query input, to automatically switch, in response to receiving the first query input, the apparatus from a first state to receive the first query input of the first query type to a second state to receive the second query input of the second query type, and to obtain a search result according to a query based on the first query input and the second query input. 1. A method , comprising:displaying, on a display of an electronic device, at least one search object for visual search;obtaining, based on a selection of a search object among the at least one search object for the visual search, an input image for a first search request;sending, toward an external search server, the first search request based at least on the input image;receiving, from the external search server, a first search result based at least on the first search request, the first search result comprising a plurality of search result images;displaying, on the display, a search result image from among the plurality of search result images;receiving, on the displayed search result image, a user input for selecting a partial region of the displayed search result image;sending, toward the external search server, a second search request based at least on the selected partial region of the displayed search result image;receiving, from the external search server, a second search result based at least on the second search request; anddisplaying, together with the selected partial region displayed on the display the second search result received from the ...

Information processor and information processing program

An information processor includes a generation section that generates a specified character string on the basis of at least one of voice information corresponding to a content of speech detected by a voice detection section and vehicle information acquired from a vehicle. With this configuration, a user can input the specified character string, which is a hashtag, without an operation. Thus, compared to the related art in which the hashtag is generated on the basis of the operation (manual input) by the user, a burden on the user can significantly be reduced, and an input error can be prevented.

Discussion model generation system and method

A method, computer program product, and computing system for receiving an input text. The one or more portions of the input text may be tagged. A discussion model between a plurality of virtual speakers may be generated based upon, at least in part, the tagging of the one or more portions of the input text. The discussion model may be presented.

Context-aware voice guidance

A context-aware voice guidance method is provided that interacts with other voice services of a user device. The voice guidance does not provide audible guidance while the user is making a verbal request to any of the voice-activated services. Instead, the voice guidance transcribes its output on the screen while the verbal requests from the user are received. In some embodiments, the voice guidance only provides a short warning sound to get the user's attention while the user is speaking on a phone call or another voice-activated service is providing audible response to the user's inquires. The voice guidance in some embodiments distinguishes between music that can be ducked and spoken words, for example from an audiobook, that the user wants to pause instead of being skipped. The voice guidance ducks music but pauses spoken words of an audio book in order to provide voice guidance to the user.

INTELLIGENT AUTOMATED ASSISTANT FOR MEDIA EXPLORATION

Systems and processes for operating an intelligent automated assistant are provided. In accordance with one example, a method includes, at an electronic device with one or more processors and memory, receiving a first natural-language speech input indicative of a request for media, where the first natural-language speech input comprises a first search parameter; providing, by a digital assistant, a first media item identified based on the first search parameter. The method further includes, while providing the first media item, receiving a second natural-language speech input and determining whether the second input corresponds to a user intent of refining the request for media. The method further includes, in accordance with a determination that the second speech input corresponds to a user intent of refining the request for media: identifying, based on the first parameter and the second speech input, a second media item and providing the second media item. 1. A non-transitory computer-readable storage medium storing one or more programs , the one or more programs comprising instructions , which when executed by one or more processors of an electronic device , cause the electronic device to:receive a speech input indicative of a request for media;detect, by a digital assistant, physical presence of a plurality of users to the electronic device;in response to detecting the physical presence of the plurality of users, obtain a plurality of preference profiles corresponding to the plurality of users;provide, by the digital assistant, a merged preference profile based on the plurality of preference profiles;identify, by the digital assistant, a media item based on the merged preference profile; andprovide, by the digital assistant, an audio output including the identified media item.2. The non-transitory computer-readable storage medium of claim 1 ,wherein the electronic device is a first electronic device associated with a first user of the plurality of users, and ' ...

APPARATUS, SYSTEM, AND METHOD OF ASSISTING INFORMATION SHARING, AND RECORDING MEDIUM

A system for assisting sharing of information includes circuitry to: input a plurality of sentences each representing a statement made by one of a plurality of users, the sentence being generated by speaking or writing during a meeting or by extracting from at least one of meeting data, email data, electronic file data, and chat data at any time; determine a statement type of the statement represented by each one of the plurality of sentences, the statement type being one of a plurality of statement types previously determined; select, from among the plurality of sentences being input, one or more sentences each representing a statement of a specific statement type of the plurality of types; and output a list of the selected one or more sentences as key statements of the plurality of sentences. 1. A system , comprising: receive communication data of a plurality of users;', 'calculate, using the received communication data, a relationship strength between at least a first user and a second user of the plurality of users; and', 'cause a display to display a communication diagram, the communication diagram illustrating the calculated relationship strength between the first user and the second user, the calculated relationship strength between the first user and the second user being expressed as a thickness of a line displayed between a displayed representation of the first user and a displayed representation of the second user., 'circuitry configured to'}2. The system of claim 1 , wherein the circuitry is further configured to calculate the relationship strength between the first user and the second user based on a number of communications that have been made between the first user and the second user within a predetermined time period.3. The system of claim 1 , wherein the circuitry is further configured to calculate the relationship strength using the communication data claim 1 , which includes chat data.4. The system of claim 1 , wherein the circuitry is further ...

REFINEMENT OF VOICE QUERY INTERPRETATION

A system for refinement of a voice query interpretation interprets a voice query received at a voice-enabled device to identify commands responsive to the voice query for execution at the voice-enabled device, and enables refinement of the interpretation of the voice query through a graphical user interface generated and displayed at a GUI-capable device. The graphical user interface includes a set of selectable options relating to the voice query and identifying a refinement of the interpretation of the voice query to enable control and/or adjustment of commands to be executed by the voice-enabled device. For example, if one of the selectable options is selected, then a command associated with the selected option is identified and executed by the voice-enabled device. 1. A server for refining an interpretation of a voice query , the server comprising:at least one processing device; and receive, from a first device, a voice query requesting execution of a command by the first device;', 'determine an interpretation of the voice query;', 'provide instructions to a second device for generating and displaying a graphical user interface at the second device, the graphical user interface including a set of one or more selectable options, each of the one or more selectable options relating to the voice query and identifying a refinement of the interpretation of the voice query;', 'receive, from the second device, an indication of a selection of one of the one or more selectable options from the set in the graphical user interface displayed at the second device; and', 'cause a command associated with the selected option to be executed by the first device., 'memory coupled to the at least one processing device and storing instructions, which when executed by the at least one processing device, cause the at least one processing device to2. The server of claim 1 , wherein the at least one processing device is further caused to:generate the set of one or more selectable options ...

METHODS, SYSTEMS, AND MEDIA FOR PROCESSING QUERIES RELATING TO PRESENTED MEDIA CONTENT

Methods, systems, and media for processing queries relating to presented media content are provided. In some implementations, a method comprises: receiving a request to associate with a media playback device that is presenting media content to a user of the mobile device, wherein a mobile application executing on the mobile device and a media application executing on the media playback device exchange media playback information; activating a microphone associated with the mobile device to receive ambient sounds in response to associating with the media playback device; converting the received ambient sounds to one or more text inputs; determining whether the text inputs include a trigger term that corresponds to a request to initiate a query relating to the presented media content and the query; in response to determining that the trigger term has been included in the text inputs, determining the media playback information from the media application that includes timing information corresponding to when during the presentation of the media content the query was received and media content identification information; causing a search to be performed that includes the query, the timing information, and the media content identification information; obtaining a search result that is responsive to the query; and presenting at least a portion of the search result to the query on a mobile display associated with the mobile device. 1. A method for providing media guidance , the method comprising:receiving, using a computing device, a plurality of input terms;determining whether the plurality of input terms include a query and a trigger term that corresponds to a request to initiate the query relating to media content being presented;in response to determining that the trigger term has been included in the plurality of input terms, determining media playback information that includes timing information corresponding to a time at which the query was received during the ...

INFORMATION SEARCH METHOD AND APPARATUS

This application discloses an information search method and apparatus. The method includes the steps of receiving a voice message from a first terminal, the voice message including a first request, and the first request requesting a search operation; parsing out a search keyword of the first request from the voice message; and performing the search operation by using the search keyword to obtain a search result. The method further includes sending the search result to a second terminal, the first terminal being associated with the second terminal, and the second terminal being configured to present the search result. 1. An information search method , implemented by a server , and comprising:receiving a voice message from a first terminal, the voice message including a first request, and the first request requesting a search operation;parsing out a search keyword of the first request from the voice message;performing the search operation by using the search keyword to obtain a search result; andsending the search result to a second terminal, the first terminal being associated with the second terminal, and the second terminal being configured to present the search result.2. The method according to claim 1 , further comprising:receiving a second request from the second terminal, the second request including a request to initiate the first request; andsending a prompt message to the first terminal corresponding to the second request, the prompt message prompting an input of the voice message by using the first terminal.3. The method according to claim 2 , further comprising:obtaining an application account associated with the second terminal, the application account being logged into on the first terminal; andsending the prompt message to the application account through a network platform of the application account.4. The method according to claim 2 , further comprising:detecting whether there is an application account associated with the second terminal; andsending an ...

USING CROSS-MATCHING BETWEEN USERS AND MATCHING AGAINST REFERENCE DATA TO FACILITATE CONTENT IDENTIFICATION

Techniques for identifying video and/or audio content are presented. An identification management component (IMC) groups users determined to be at least potentially be watching the same content based on first content fingerprints associated with respective content viewed by the users on communication devices, and a defined matching criterion. IMC facilitates identifying the content associated with the group of users based on first content fingerprints associated with the group of users and first reference content fingerprints. IMC receives a second content fingerprint associated with a communication device of a user in the group, sends the second content fingerprint to a third-party identification component for comparison with second reference content fingerprints, and receives content identification information in response. IMC identifies the content for the group of users based on the content identification information and/or the content identification made based on the first content fingerprints associated with the group. 1. A method for identifying content , the method comprising:receiving, using a hardware processor, a first fingerprint associated with a first media content item and a second fingerprint associated with a second media content item;determining, using the hardware processor, that the first media content item is related to the second media content item by determining that characteristic components of a characteristic type match between a first group of characteristic components associated with the first fingerprint and a second group of characteristic components associated with the second fingerprint; andidentifying, using the hardware processor, the second media content item based on an identification of the first media content item.2. The method of claim 1 , further comprising identifying the first media content item based on the first content fingerprint claim 1 , wherein a confidence value is associated with the identification and wherein the ...

Audio and Visual Asset Matching Platform

Provided are computer-implemented methods and systems for implementing and utilizing an audio and visual asset matching platform. The audio and visual asset matching platform may include a first interface, a digital asset creation platform, an asset matching engine, and a user feedback engine. The first interface may be configured to select at least one master digital asset. The digital asset creation platform may be configured to create digital assets, the digital assets comprising at least one of text, audio, image, video, 3D/4D virtual environments, and animation files and metadata. The asset matching engine may be configured to match digital assets and generate at least one output digital asset. The user feedback engine may be configured to monitor and analyze behavior in response to receipt of at least one output digital asset and generate feedback metrics to improve the matching of the asset matching engine. 1. A system for creating and using an audio and visual asset matching platform , the system comprising:a first interface configured to select at least one master digital asset;a digital asset creation platform configured to create digital assets, the digital assets comprising at least one of text, audio, image, video, 3D/4D virtual environments, and animation files and metadata associated with the digital assets; apply a dynamic set of matching rules to the digital assets;', 'assign at least one value associated with each of the matching rules to the digital assets; and', "aggregate the at least one values to determine the digital assets' positions within the ordered array;", 'deliver the digital assets according to their position in the ordered array;', 'and, 'an asset matching engine configured to match digital assets and generate at least one output digital asset in an ordered array, wherein the asset matching engine is configured toa user feedback engine configured to monitor and analyze behavior in response to receipt of at least one output digital ...

Method of and system for processing a user-generated input command

A method of processing a user-generated input command executable at a computing apparatus includes, for each one of the plurality of machine-executable instructions, receiving a plurality of example expressions of the machine-executable instruction, generating a plurality of features for the plurality of example expressions, and analyzing the plurality of features associated with the plurality of example expressions to determine a plurality of feature patterns. The plurality of feature patterns is used to convert the user-generated input command into a machine executable output instruction, the machine executable output instruction being one of the plurality of machine-executable instructions. Systems for processing a user-generated command are also disclosed.

SYSTEM AND METHOD FOR AUTOMATIC SYNCHRONIZATION OF VIDEO WITH MUSIC, AND GAMING APPLICATIONS RELATED THERETO

A computer system including a server having a processor and a memory, the memory having a video database and a music database, the video database storing at least one video file having a plurality of video file markers, and the music database storing at least one music file having a plurality of music file markers, wherein the server receives and decodes encoded data from computer readable code, identifies and retrieves from the music database a music file based on the decoded data, synchronizes the retrieved music file with one of the video files by aligning the video file markers of the video file with the music file markers for the retrieved music file to produce a synchronized video-music file, and transmits the synchronized video-music file to a display, wherein the video file markers are generated for each video file and the music file markers are generated for each music file. 1. A computer system comprising:a server comprising a processor and a memory, the memory comprising a video database and a music database, the video database configured to store a plurality of video files, each of the video files comprising a plurality of video file markers, and the music database configured to store a plurality of music files, the plurality of music files each comprising a plurality of music file markers,wherein the server is configured to:synchronize a music file from the plurality of music files with one of the plurality of video files by aligning the video file markers of the video file with the music file markers for the music file to produce a synchronized video-music file; andtransmit the synchronized video-music file to a display to be displayed,wherein the video file markers are generated by the processor for each of the video files stored in the video database and the music file markers are generated by the processor for each of the music files stored in the music database,wherein the video file comprises at least a portion of a movie, a video, or a graphical ...

SYSTEM AND METHOD FOR USING MULTIMEDIA CONTENT AS SEARCH QUERIES

There is provided a method for searching a plurality of information sources using a multimedia element, the method may include receiving at least one multimedia element; generating, by a signature generator, for the at least one multimedia element at least one signature that is unidirectional, and yields compression; generating at least one textual search query using the at least one signature; wherein the generating of the textual search query comprises: (a) searching for at least one matching stored signature that matches one or more of the at least one signature; and (b) using a mapping between stored signatures and textual search queries, selecting at least one textual search query mapped to at least one matching stored signature; searching the plurality of information sources using the at least one textual search query; and causing a display of search results retrieved from the plurality of information sources. 1. (canceled)2. (canceled)3. (canceled)4. (canceled)5. (canceled)6. (canceled)7. (canceled)8. (canceled)9. (canceled)10. (canceled)11. (canceled)12. (canceled)13. (canceled)14. (canceled)15. (canceled)16. (canceled)17. (canceled)18. (canceled)19. (canceled)20. (canceled)21. (canceled)22. (canceled)23. A method for searching a plurality of information sources using a multimedia element , comprising:receiving at least one multimedia element; generating , by a signature generator , for the at least one multimedia element at least one signature that is unidirectional , and yields compression; generating at least one textual search query using the at least one signature; wherein the generating of the textual search query comprises: (a) searching for at least one matching stored signature that matches one or more of the at least one signature; and (b) using a mapping between stored signatures and textual search queries , selecting at least one textual search query mapped to at least one matching stored signature; searching the plurality of information sources ...

Search with joint image-audio queries

Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for processing joint image-audio queries. In one aspect, a method includes receiving, from a client device, a joint image-audio query including query image data and query audio data. Query image feature data is determined from the query image data. Query audio feature data is determined from the audio data. The query image feature data and the query audio feature data are provided to a joint image-audio relevance model trained to generate relevance scores for a plurality of resources, each resource including resource image data defining a resource image for the resource and text data defining resource text for the resource. Each relevance score is a measure of the relevance of corresponding resource to the joint image-audio query. Data defining search results indicating the order of the resources is provided to the client device.

Media Consumption History

Methods, systems, and apparatus for receiving, from a user, a request that includes an entity identifier associated with an entity that is referenced by one or more query terms of a search query, determining that the entity is identified in a media consumption database as a media item that has been indicated as consumed by the user or that the entity is associated with a media item that is identified in the media consumption database as a media item that has been indicated as consumed by the user, and based on the determination, providing a response to the request, the response including data indicating that the entity is a media item that has been indicated as consumed by the user or that the entity is associated with a media item that has been indicated as consumed by the user. 120-. (canceled)21. A computer-implemented method comprising:receiving a search query from a user, wherein the search query references a particular entity as a subject of the search query; (i) querying a first database to identify a media item that features the particular entity and that is determined to have previously been consumed by the user, and', '(ii) querying a second database to obtain a set of search results, the set of search results being separate from the media item; and, 'in response to receiving the search queryproviding, for display on a screen of a computing device, an interface that includes information about the media item that was identified in response to the search query and information about the set of search results that were identified in response to the search query,wherein the information about the media item includes an indication that the media item features the particular entity that was referenced in the search query, and the information about the media item is provided for display in the interface distinctively from the information about the set of search results.22. The computer-implemented method of claim 21 , further comprising identifying a particular ...

METHOD AND SYSTEM FOR PROVIDING AUDIO CONTENT

Methods and systems are disclosed in which audio broadcasts are converted into audio segments, for example, based on segment content. These audio segments are indexed, so as to be searchable, as computer searchable segments, for example, by network search engines and other computerized search tools. 1. A computer-implemented method for providing audio content in segments comprising:obtaining an audio stream;converting the audio stream to text;separating the text into text segments based on at least one indicator; and, correlating each text segment with a corresponding portion of the audio from the audio stream, the corresponding portion of the audio defining an audio segment.2. The computer-implemented method of claim 1 , additionally comprising:enriching each audio segment such that each audio segment is a computer searchable audio segment.3. The computer-implemented method of claim 2 , performed automatically by at least one processor.4. The computer-implemented method of claim 1 , wherein the at least one indicator is selected from at least one of: rules and policies claim 1 , changes in the relatedness of words based on their meaning in a portion of the text claim 1 , keywords claim 1 , word markers claim 1 , audio cues claim 1 , and scores for relatedness between words in a portion of the text.5. The computer-implemented method of claim 4 , wherein the at least one indicator includes a plurality of indicators.6. The computer-implemented method of claim 1 , wherein the audio segments include segments of audio content based on at least one of topics claim 1 , advertisements claim 1 , and public service announcements.7. The computer-implemented method of claim 1 , wherein the audio stream is from a broadcast.8. The computer-implemented method of claim 4 , wherein the broadcast is selected from the group consisting of a radio broadcast claim 4 , a television broadcast claim 4 , a cable broadcast claim 4 , a webcast claim 4 , a podcast claim 4 , and a network ...

METHODS AND APPARATUS FOR MEDIA SEARCH, CHARACTERIZATION, AND AUGMENTED REALITY PROVISION

Methods and apparatus for providing attribute-based search of media assets such as video and audio assets, and associated augmented reality functions including dynamic provision of relevant secondary content relating to the identified attribute(s). In one embodiment, media or content assets are ingested into a processing system and processed according to one or more attribute detection, identification, and characterization algorithms. Attributes detected may include for example the presence of tangible items such as clothing or chattels, particular persons such as celebrities, and/or certain contexts such as sporting activities and musical performances, as rendered within the media asset. In one implementation, the characterized assets are provided a unique ID, and stored so as to permit cross-correlation based on, e.g., the identified and characterized attributes. Secondary content (e.g., advertising or promotional content) is correlated to each identified asset, and dynamically served upon a user providing some threshold level of interaction with the attribute. 1. A computerized method for automatically providing secondary digital content relating to a user-cognizable digital element present in a digital content asset , the method comprising:identifying a plurality of digital content assets; identifying at least one user-cognizable digital element within each of the plurality of identified digital content assets;', 'characterizing the identified at least one user-cognizable digital element in each of the plurality of identified digital content assets to generate characterizing data;', 'assigning data indicative of a unique identifier to each of the plurality of identified digital content assets;', 'storing the generated characterizing data along with at least a portion of the data indicative of the unique identifier in a database; and', 'forming an association between (i) at least a portion of the stored generated characterizing data of the identified at least one ...

Methods, systems, and apparatuses to respond to voice requests to play desired video clips in streamed media based on matched close caption and sub-title text

Methods, Systems, and Apparatuses are described to implement voice search in media content for requesting media content of a video clip of a scene contained in the media content streamed to the client device; for capturing the voice request for the media content of the video clip to display at the client device wherein the streamed media content is a selected video streamed from a video source; for applying a NLP solution to convert the voice request to text for matching to a set of one or more words contained in at least close caption text of the selected video; for associating matched words to close caption text with a start index and an end index of the video clip contained in the selected video; and for streaming the video clip to the client device based on the start index and the end index associated with matched closed caption text.

METHODS AND APPARATUS FOR MEDIA SEARCH, CHARACTERIZATION, AND AUGMENTED REALITY PROVISION

Methods and apparatus for providing attribute-based search of media assets such as video and audio assets, and associated augmented reality functions including dynamic provision of relevant secondary content relating to the identified attribute(s). In one embodiment, media or content assets are ingested into a processing system and processed according to one or more attribute detection, identification, and characterization algorithms. Attributes detected may include for example the presence of tangible items such as clothing or chattels, particular persons such as celebrities, and/or certain contexts such as sporting activities and musical performances, as rendered within the media asset. In one implementation, the characterized assets are provided a unique ID, and stored so as to permit cross-correlation based on, e.g., the identified and characterized attributes. Secondary content (e.g., advertising or promotional content) is correlated to each identified asset, and dynamically served upon a user providing some threshold level of interaction with the attribute. 115.-. (canceled)16. A non-transitory computer-readable storage medium having one or more computer programs stored thereon , the one or more computer programs operative to be executed by a digital processor apparatus of a computerized user device , the computerized user device configured for data communication with a digital content delivery network , the one or more computer programs comprising a plurality of instructions which are configured to , when executed on the digital processor apparatus , cause the computerized user device to:receive, at the computerized user device via the digital content delivery network, at least one first digital content asset;identify whether the at least one first digital content asset has been previously processed;based at least in part on an identification that the at least one first digital content asset has been previously processed, cause access of previously generated ...

Device, System, and Method for Automatic Generation of Presentations

Devices, systems, and methods for automatically generating presentations, and for automatically generating a visual presentation that corresponds to a verbal meeting in which one or more topics were discussed. A method includes: obtaining an audio recording of a meeting; generating a transcript of the meeting from the audio recording; and automatically generating a visual presentation that corresponds to particular key elements of the meeting. The generated visual presentation includes automatically-generated slides or portions or chapters, which correspond to the agenda of the meeting, topics discussed and their summary, conclusions, decisions, action items, and other key elements of the meeting. 1. A method comprising:obtaining an audio recording of a meeting;obtaining a transcript of said meeting from said audio recording;automatically generating a visual presentation that corresponds to particular key elements in said meeting.2. The method of claim 1 , comprising:based on textual analysis of said transcript, determining a main topic of said meeting; andgenerating a slide in said visual presentation that comprises said main topic.3. The method of claim 1 , comprising:based on analysis of meeting scheduling data, determining a main topic of said meeting; and generating a slide in said visual presentation that comprises said main topic.4. The method of claim 1 , comprising:determining at least one topic that was discussed in said meeting, based on textual analysis of said transcript;generating a slide in said visual presentation that comprises said topic, and further comprises a textual summary of utterances about said topic in said meeting.5. The method of claim 1 , comprising:determining at least one topic that was discussed in said meeting, based on analysis of scheduling data of said meeting;generating a slide in said visual presentation that comprises said topic, and further comprises a textual summary of utterances about said topic in said meeting.6. The ...

MEDIA CONSUMPTION HISTORY

Methods, systems, and apparatus for receiving a request that includes a user identifier of a user that submitted a search query and an entity identifier of an entity that is referenced by the search query, identifying a plurality of knowledge elements that are related to the entity, identifying, in a consumption database, one or more items that have been indicated as consumed by the user and that are associated with the entity that is referenced by the search query, assigning rank scores to the plurality of knowledge elements, based at least on identifying the one or more items, selecting one or more of the knowledge elements from among the knowledge elements based at least on the rank scores assigned to the knowledge elements, and providing, in response to the request, information associated with the entity and the one or more selected knowledge elements. 1. A computer-implemented method comprising:receiving, by one or more computers, a request at a request time that indicates (i) a user that submitted a search query, and (ii) an entity that is referenced by the search query;identifying, by the one or more computers, (i) one or more items that have been indicated as consumed by the user and that are associated with the entity that is referenced by the search query, and (ii) for each item, a time of when the user consumed the item;determining, based at least on (i) identifying the one or more items that have been indicated as consumed by the user and that are associated with the entity that is referenced by the search query, and (ii) for each item, the time the user consumed the item, a level of familiarity of the user with the entity, wherein a level of familiarity of a first entity is higher than a level of familiarity of a second entity when a first time that an item associated with the first entity was consumed by the user is closer in time to the request time then a second time that an item associated with the second entity was consumed by the user;determining, ...

Method and apparatus for automatically sending multimedia file, mobile terminal, and storage medium

A method for automatically sending a multimedia file comprises: obtaining a voice feature of each object in a multimedia file ( 101 ); matching the obtained voice feature of each object with a voice feature of each contact in a voice parameter database ( 102 ); and when matching succeeds, automatically sending the multimedia file to a contact obtained by successful matching ( 103 ). Further disclosed are an apparatus for automatically sending a multimedia file, a mobile terminal, and a storage medium.

Methods, systems, and media for presenting information related to an event based on metadata

Methods, systems and media for presenting information related to an event based on metadata are provided. In some implementations, the method comprises: detecting that a user-initiated event has been performed on a user device; detecting a plurality of sensors connected to the user device; causing a plurality of content items related to the user-initiated event to be obtained using the plurality of sensors connected to the user device; determining whether each of the plurality of content items is to be associated with the user-initiated event based on user device information from a plurality of data sources; associating a portion of the plurality of content items with the user-initiated event based on the determination; retrieving information related to the portion of the plurality of content items; detecting, using the plurality of sensors connected to the user device, a second plurality of content items; determining that at least one of the second plurality of content items is related to at least one of the first plurality of content items; and causing information related to the user-initiated event to be presented by the user device based at least in part on the determination.

SYSTEMS AND METHODS FOR RECORDING RELEVANT PORTIONS OF A MEDIA ASSET

Systems and methods are presented herein for recording portions of a media asset relevant to recording criteria. A media application receives input indicating the recording criteria and identifying a first keyword. The media application accesses a data structure to identify a first node associated with the first keyword. The data structure includes the first node and a plurality of nodes connected to the first node via a plurality of paths. The media application receiving audio component data for a portion of the media asset extracts a term from the audio component data, and identifies a second node in the data structure that is associated with the extracted term. The media application calculates a path score for the portion of the media asset based on a path size in the data structure between the first node and the second node. When the score is high enough, the portion of the media asset is recorded. 130-. (canceled)31. A method for recording portions of a media asset relevant to recording criteria , the method comprising:receiving input indicating the recording criteria for identifying one or more portions of the media asset to be recorded;identifying a first keyword based on the recording criteria;accessing a data structure to identify a first node associated with the first keyword, wherein the data structure comprises the first node and a plurality of nodes connected to the first node via a plurality of paths;identifying a second node in the data structure that is associated with a term associated with a portion of the media asset;calculating a path score for the portion of the media asset based on a path size in the data structure between the first node and the second node; andin response to determining that the path score exceeds a path threshold, recording the portion of the media asset.32. The method of claim 31 , further comprising:retrieving data associated with the portion of the media asset; andextracting the term associated with the portion of the ...

System, Method And Apparatus And Computer Program Product To Use Imperceptible SONAD Sound Codes And SONAD Visual Code Technology For Distributing Multimedia Content To Mobile Devices

A system, method, and apparatus, to distribute and deliver to mobile computing device any multimedia content including non-interrupting, actionable advertisements, promotions and information by using imperceptible to humans sound codes embedded in audio and, alternatively or in tandem, by using visual codes printed on paper or displayed on any electronic screen is provided. The invention enriches the format of traditional broadcasting and digital content delivery through any existing digital and print media channel by augmenting the programming and printed text with unlimited information residing on the Internet. All this added information, including text, video, graphics, and sound is made available to listeners or viewers seamlessly, in real time and contextualized with the programs—radio, TV, arena broadcasting, public address system broadcasting, and Internet, either live or pre-recorded. 1. A sound code comprising ,(a) a series of human inaudible sound elements which encode at least one alphanumeric string of data,wherein the sound code is receivable by a microphone in wireless or wired connection with a mobile computing device,wherein the mobile computing device has application software that identifies the sound code,wherein the application software interprets the sound code to determine the at least one alphanumeric string of datawherein the application software queries a database with the at least one alphanumeric string of data andwherein the database returns one or more multimedia content or links to multimedia content to the mobile computing device in response to the query.2. The sound code of wherein the one or more multimedia content or links to multimedia content are associated with the at least one alphanumeric string of data.3. The sound code of wherein the one or more multimedia content or links to multimedia content are saved as a single file in a cloud computing environment.4. The sound code of wherein the one or more multimedia content or links ...

VOICE COMMAND SYSTEM AND VOICE COMMAND METHOD

A voice command system according to a first disclosure comprises a gateway apparatus having an interface configured to receive a voice command, and a controller configured to perform a registration process of registering a speaker permitted to receive the voice command. The controller is configured to perform an authentication process of rejecting a reception of the voice command when a speaker of the voice command is not registered, and permitting a reception of the voice command when a speaker of the voice command is registered. The controller is configured to perform the authentication process for each voice command. 1. A voice command system comprising:a gateway apparatus including an interface configured to receive a voice command; anda controller configured to perform a registration process of registering a speaker whose voice command is permitted to be received, wherein the controller is configured to perform an authentication process of rejecting a reception of the voice command when a speaker of the voice command is not registered, and permitting a reception of the voice command when a speaker of the voice command is registered, andthe controller is configured to perform the authentication process for each the voice command.2. The voice command system according to claim 1 , wherein the gateway apparatus has the controller.3. The voice command system according to claim 1 , wherein the controller is configured to access an external database based on the voice command when the reception of the voice command is permitted claim 1 , and acquire claim 1 , from the external database claim 1 , information corresponding to the voice command.4. The voice command system according to claim 1 , wherein the controller is configured to perform the registration process and the authentication process during an installation operation period of an equipment.5. The voice command system according to claim 4 , wherein the controller is configured to cancel claim 4 , with an ...

Presentation Assistance Device for Calling Attention to Words that are Forbidden to Speak

To provide a presentation assistance device that can display keywords related to presentation materials and call attention by displaying an alert when words that are forbidden to speak are spoken, A presentation assistance device comprises: a presentation material storage means ; a keyword storage means which stores a plurality of keywords related to presentation materials; a related word storage means which stores one or a plurality of related words for each of the plurality of keywords; an NG word storage means which stores one or a plurality of NG words for each of the plurality of keywords; a voice recognition means ; a term determination means which determines whether a voice recognition term corresponds to a related word or an NG word; and a keyword output means which when the voice recognition is a related word, outputs a keyword related to the related word, and when the voice recognition term is an NG word, outputs an alert and a keyword related to the NG word. 2. The presentation assistance device according to claim 1 , further comprising{'b': 19', '5, 'a keyword creation/update means () that creates or updates, using the speech recognition term, a plurality of keywords related to the presentation material which are stored by the keyword storage means ().'}3. The presentation assistance device according to claim 1 , further comprising:{'b': '21', 'an evaluation point storage means () that stores an evaluation point related to one or two or more of the keywords, the related words, and the NG words; and'}{'b': 23', '21', '15, 'a conversation evaluation means () that reads the evaluation points stored by the evaluation point storage means () for the keywords, the related words, and the NG words determined by the term determination means (), and adds up the evaluation points that were read to obtain a sum of the evaluation points.'}4. A program that causes a computer to function as:{'b': '3', 'a presentation material storage means () that stores a presentation ...

Media popularity tracker

One embodiment provides a method, including: receiving, at an information handling device, an indication to play a media file, wherein the media file begins playing at a first volume; receiving, at an input device of the information handling device, volume adjustment input from a user during a duration of the media file; adjusting, based on the volume adjustment input, a volume setting of the information handling device from the first volume to a second volume; determining, using a processor, that the volume adjustment input is associated with a user's disposition towards the media file; and recording, based on the determining, the user's disposition towards the media file in a database. Other aspects are described and claimed.