METHODS AND SYSTEMS FOR AUGMENTATIVE AND ALTERNATIVE COMMUNICATION

Methods and systems for augmentative and alternative communication are disclosed. An example method can comprise receiving a candidate input, classifying the candidate input as an intentional input, and generating a signal in response to the intentional input.

Methods and systems for augmentative and alternative communication

Methods and systems for augmentative and alternative communication are disclosed. An example method can comprise receiving a candidate input, classifying the candidate input as an intentional input, and generating a signal in response to the intentional input.

SMART GRIP

The present invention relates to a smart grip inputting a motion by being linked to a virtual reality device. The smart grip includes: an inner space; and an outer surface comprising an upper surface, a bottom surface, and a side which a user grips by hand. The smart grip includes: multiple grooves (10) formed in a part of the side of the outer surface and accommodating four of the user′s fingers; multiple protrusion units (20) protruding between the multiple grooves (10) to the upper side; a power switch (150) installed on the upper surface of the outer surface; a power LED (151) installed in the power switch (150); a tact switch (40-1, 40-2) individually installed in the groove accommodating a forefinger and a middle finger in a part of the side; a USB charge terminal (60) formed to charge a battery on the opposite side on which the tact switch (40-1, 40-2) is located; a USB B-type terminal (70) for serial communications; and a PCB including an MCU (90), a sensor device, a communication ...

스마트 그립

... 본 발명은 사용자가 손으로 파지하는 측면, 상면, 및 하면으로 구성되는 외면과 내부의 공간을 포함하고, 가상현실 기기와 연동하여 모션을 입력하는 스마트 그립에 있어서, 상기 외면의 상기 측면 중 일부에서 형성되어 사용자의 네 손가락을 수용하는 복수의 요홈(10) 및 상기 복수의 요홈(10)들 사이에서 위로 융기한 복수의 융기부(20); 상기 외면의 상단면에 설치된 전원 스위치(150)와 상기 전원 스위치(150) 내부의 전원 LED(151); 상기 측면 중 일부에서 검지 손가락과 중지 손가락이 수용되는 요홈 부위에 각각 설치된 택트 스위치(40-1; 40-2); 상기 택트 스위치(40-1; 40-2) 형성면의 반대편 면에서 형성된 배터리 충전을 위해 형성된 USB 충전 단자(60)와 시리얼 통신을 위한 USB B-type 단자(70); 및 상기 내부에서 MCU(90), 감지장치, 통신장치, 및 배터리를 내장한 PCB를 포함하고, 상기 MCU(90)는 상기 배터리로부터 전력을 공급받고 상기 감지장치로부터 감지신호를 수신받으며 상기 통신장치를 통해 상기 감지신호를 상기 가상현실 기기로 송신하는 것을 특징으로 하는 스마트 그립에 관한 것이다.

Methods and systems for augmentative and alternative communication

Methods and systems for augmentative and alternative communication are disclosed. An example method can comprise receiving a candidate input, classifying the candidate input as an intentional input, and generating a signal in response to the intentional input.

System and method for promoting connectivity between a mobile communication device and a vehicle touch screen

Systems and methods for promoting connectivity between a mobile communication device having a touch screen and a vehicle touch screen installed in a vehicle are disclosed. According to an embodiments, a system may include a controller configured to: connect to the mobile communication device and to the vehicle touch screen. The controller may also be configured to receive video signal of a current screen video image shown on the touch screen of the mobile communication device and transmit the current video image to the vehicle touch screen, causing a corresponding video image of the current screen video image to be displayed on the vehicle touch screen. The controller may further be configured to receive a signal indicative of a touch action that was performed on the vehicle touch screen, and cause the mobile communication device to respond as if a touch action corresponding to the touch action that was performed on the vehicle touch screen was performed on the touch screen of the mobile ...

Methods and systems for augmentative and alternative communication

Methods and systems for augmentative and alternative communication are disclosed. An example method can comprise receiving a candidate input, classifying the candidate input as an intentional input, and generating a signal in response to the intentional input.

System and method for promoting connectivity between a mobile communication device and a vehicle touch screen

Methods And Systems For Augmentative And Alternative Communication

Methods and systems for augmentative and alternative communication are disclosed. An example method can comprise receiving a candidate input, classifying the candidate input as an intentional input, and generating a signal in response to the intentional input.

SYSTEM AND METHOD FOR PROMOTING CONNECTIVITY BETWEEN A MOBILE COMMUNICATION DEVICE AND A VEHICLE TOUCH SCREEN

Systems and methods for promoting connectivity between a mobile communication device having a touch screen and a vehicle touch screen installed in a vehicle are disclosed. According to an embodiments, a system may include a controller configured to: connect to the mobile communication device and to the vehicle touch screen. The controller may also be configured to receive video signal of a current screen video image shown on the touch screen of the mobile communication device and transmit the current video image to the vehicle touch screen, causing a corresponding video image of the current screen video image to be displayed on the vehicle touch screen. The controller may further be configured to receive a signal indicative of a touch action that was performed on the vehicle touch screen, and cause the mobile communication device to respond as if a touch action corresponding to the touch action that was performed on the vehicle touch screen was performed on the touch screen of the mobile ...

INTERFACING DEVICE AND METHOD FOR PROVIDING USER INTERFACE EXPLOITING MULTI-MODALITY

An interfacing device for providing a user interface (UI) exploiting a multi-modality may recognize at least two modality inputs for controlling a scene, and generate scene control information based on the at least two modality inputs.

Interfacing device and method for providing user interface exploiting multi-modality

An interfacing device for providing a user interface (UI) exploiting a multi-modality may recognize at least two modality inputs for controlling a scene, and generate scene control information based on the at least two modality inputs.

Multi-functional mouse

A multi-functional mouse transmits to an electronic device through radio signals. The multi-functional mouse comprises a power source supplies power for the multi-functional mouse, a navigation module controlling the coordinates of a cursor on a screen of the electronic device, an audio output module converting electronic audio signals into sounds, an audio input module receiving and converting sounds into audio signals and transmits the audio signals to electronic device, and a wireless transceiver module. The mouse electronically communicates with the electronic device.

Three Dimensional User Interface Effects on a Display by Using Properties of Motion

The techniques disclosed herein use a compass, MEMS accelerometer, GPS module, and MEMS gyrometer to infer a frame of reference for a hand-held device. This can provide a true Frenet frame, i.e., X- and Y-vectors for the display, and also a Z-vector that points perpendicularly to the display. In fact, with various inertial clues from accelerometer, gyrometer, and other instruments that report their states in real time, it is possible to track the Frenet frame of the device in real time to provide a continuous 3D frame-of-reference. Once this continuous frame of reference is known, the position of a user's eyes may either be inferred or calculated directly by using a device's front-facing camera. With the position of the user's eyes and a continuous 3D frame-of-reference for the display, more realistic virtual 3D depictions of the objects on the device's display may be created and interacted with by the user.

Virtual touch control apparatus and method thereof

The present invention discloses a virtual touch control apparatus and a method thereof. The virtual touch control apparatus includes a virtual touch interface for generating a graphic display; a remote controller device controllable by a user to interact with the virtual touch control interface, wherein the interaction between the remote controller device and the virtual touch control interface generates a coordinate or an action command; a data format converter device converting the coordinate or action command into data with a format compatible to a physical touch control apparatus; and a processor for processing the converted data.

Techniques using captured information

Techniques are provided utilizing captured information. The captured information includes at least one of audio and image information. In response to connecting a capture device including the captured information to another device, the captured information is downloaded to the other device, a text portion is formed corresponding to the captured information, and at least a portion of the captured information and text portion is stored. A selected action is automatically performed using at least one of the text portion and the captured information.

Input device, input control system, method of processing information, and program

An input device includes a housing having a two dimensional detection surface, a first detection unit detecting a position coordinate of a detection object that travels on the detection surface and outputting a first signal to calculate a travel direction and an amount of travel of the detection object, a second detection unit detecting gradient of the detection surface relative to one reference plane in a spatial coordinate system to which a screen belongs and outputting a second signal to calculate a tilt angle of the detection surface relative to the reference plane, and a control unit generating a control signal to three dimensionally control a display of an image displayed on the screen based on the first signal and the second signal.

Interface device for electronic equipment and electronic equipment including the same

An interface device for electronic equipment including at least one port electronically connected to an external device; a housing disposed in the electronic equipment and includes an opening through which the port is drawn in and out; a door which accommodates the port and performs a first motion and a second motion, the first motion being rotation between an open position, in which the opening of the housing is open, and a close position, in which the opening is closed, the second motion being sliding between the open position and a projecting position, in which the door projects from the open position in a transverse direction to a rotation axis of the first motion parallel with an installation surface of the electronic equipment; and a driving unit which provides driving force to the door in the close position of the first motion of the door and in the second motion.

Operation and control methods for host apparatus

An operation method for a first host apparatus is provided by the present invention. First, the operation method captures an event of the first host apparatus, so as to generate an event information. Then, the event information is transmitted to a second host apparatus, so as to control the second host apparatus.

Multi-Touch Integrated Desktop Environment

A technique for integrating a multi-touch surface into a desktop environment is disclosed. One or more multi-touch display devices are placed on the horizontal surface surrounding or beneath a keyboard or mouse. At least one region on the multi-touch surface is defined to display one or more user interface tools on the multi-touch surface. The one or more user interface tools displayed via the multi-touch surface may control or display information associated with desktop applications displayed via a primary display device.

Wireless mouse

A wireless mouse includes a case, a mouse circuit received in the case, and a battery control circuit to power the mouse circuit. The battery control circuit includes a battery, a touch switch positioned on the case, and a switch circuit connected to the battery, the touch switch, and the mouse circuit. When the touch switch is touched, the touch switch is turned on, the switch circuit outputs a high level signal to the mouse circuit. When the touch switch is not touched, the touch switch is turned off, the switch circuit outputs a low level signal to the mouse circuit.

Method and apparatus for editing touch display

A method and an apparatus are provided for editing a display of a touch display apparatus. A first screen including at least one object is displayed. An object on the first screen is designated. The touch display apparatus is converted to an edit mode for editing the display, when the object is designated. When a movement of the touch display apparatus is detected, the first screen is converted into a second screen according to at least one of a degree and a direction of the movement. The designated object is displayed on the second screen.

Network apparatus and methods for user information delivery

A network apparatus useful for providing directions and other information to a user of a client device in wireless communication therewith. In one embodiment, the apparatus includes one or more wireless interfaces and a network interface for communication with a server. User speech inputs in the form of digitized representations are received by the apparatus and used by the server as the basis for retrieving information including graphical representations of location or entities that the user wishes to find.

Portable electronic device having gesture recognition and a method for controlling the same

The present disclosure provides a portable electronic device having gesture recognition and a method for controlling the same. In accordance with one example embodiment, the method comprises: sensing distortion of the portable electronic device from a neutral state; determining an action associated with a sensed distortion; and causing the determined action to be performed.

Computer and recording medium

A computer to which multiple operation units can be connected is caused to function as a reception unit that receives identification information and operation information from each operation unit that is connected, an association setting unit that sets an association between connected operation units based on the identification information received from the connected operation units and an association condition that is set in advance, and an execution unit that executes processing on the same processing target based on the operation information received from the associated operation units.

Method for controlling electronic devices and a hand-held device using the same

A hand-held device can communicate with at least one electronic device via a communicating platform. The hand-held device includes a location database, at least one orientation device, a computing module, a comparing module, a control unit, and a transmitting module. The at least one orientation device detects a direction information related to the pointed-to electronic device relative to the hand-held device. The location database stores a location information related to the position of each electronic device relative to the hand-held device. The computing module can calculate a pointed-to location information related to the position of the pointed-to electronic device relative to the hand-held device based on the direction information. The comparing module can distinguish the pointed-to electronic device by comparing the pointed-to location information with the location information in the location database.

Apparatus and method of multi-input and multi-output using a mobile communication terminal

A multi input control window in one-to-one correspondence with an external information device can be programmed and activated in the mobile communication terminal in diverse ways through a multi input mode application unit, depending on the type of a multi-input operation. Also, a first input signal with respect to a touch screen, a second input signal with respect to an acceleration sensor, and a third input signal based on the location of a mobile communication terminal that moves in the X, Y and Z axes measured by a gyroscope sensor are wirelessly transmitted from the mobile communication terminal to the external information device. A fourth input signal for the voice-to-text conversion can be transmitted wirelessly. During a multi-input operation in the external information device, an event signal for outputting a vibration or speaker sound is sent as an output signal to the mobile communication terminal.

Unintentional Touch Rejection

A method for rejecting an unintentional palm touch is disclosed. In at least some embodiments, a touch is detected by a touch-sensitive surface associated with a display. Characteristics of the touch may be used to generate a set of parameters related to the touch. In an embodiment, firmware is used to determine a reliability value for the touch. The reliability value and the location of the touch is provided to a software module. The software module uses the reliability value and an activity context to determine a confidence level of the touch. In an embodiment, the confidence level may include an evaluation of changes in the reliability value over time. If the confidence level for the touch is too low, it may be rejected.

Device, method, and storage medium storing program

According to an aspect, a device includes a touch screen display and a controller. The touch screen display displays a screen. The controller controls an orientation of the screen based on a gesture detected through the touch screen display and a state of the device.

Techniques to Facilitate Asynchronous Communication

Users may communicate an idea asynchronously by including contextual information. The contextual information may be presented in multimodal annotations, suggestions of logical idea progression, and a chronological history of the project creation. The contextual information may include content captured from the real-world including from the user's immediate environment or elsewhere.

System and method for continuous multimodal speech and gesture interaction

Disclosed herein are systems, methods, and non-transitory computer-readable storage media for processing multimodal input. A system configured to practice the method continuously monitors an audio stream associated with a gesture input stream, and detects a speech event in the audio stream. Then the system identifies a temporal window associated with a time of the speech event, and analyzes data from the gesture input stream within the temporal window to identify a gesture event. The system processes the speech event and the gesture event to produce a multimodal command. The gesture in the gesture input stream can be directed to a display, but is remote from the display. The system can analyze the data from the gesture input stream by calculating an average of gesture coordinates within the temporal window.

Mobile terminal, output control system, and data outputting method for the mobile terminal

According to an embodiment, provided is a mobile terminal, that includes: an operation display unit that displays information and receives operation input; an operation detection unit that detects operation of the operation display unit; a motion detection unit that detects a motion of the mobile terminal; a data selection unit that selects data to be output; an output destination determining unit that determines an external apparatus serving as an output destination of the selected data; and an output instruction unit that gives an instruction of outputting the data to the external apparatus when the motion is detected by the motion detection unit.

Input information processing system, input information processing method, program and computer-readable recording medium

An input information processing system, which is configured so as to enable an operator to efficiently conduct work without interruption, and processes input information that has been inputted using an input device, is configured so as to comprise: a display means for displaying data to be processed on a display screen; a first input device for inputting first input information; a second input device for inputting second input information; an acquisition means for acquiring a predetermined position in the data to be processed, which is displayed on the display screen of the display means, on the basis of the first input information inputted using the first input device; and control means for clearly showing the predetermined position in the data to be processed which was acquired by the acquisition means on the data to be processed displayed on the display screen of the display means, and for controlling the data to be processed which is displayed on the display screen of the display means on the basis of the second input information inputted using the second input device.

Computerized information and display apparatus

Apparatus useful for obtaining and displaying information. In one embodiment, the apparatus includes a network interface, display device, and speech recognition apparatus configured to receive user speech input and enable performance of various tasks via a remote entity, such as obtaining desired information relating to directions, sports, finance, weather, or any number of other topics. The downloaded may also, in one variant, be transmitted to a personal user device, such as via a data interface.

Backscatter stylus for use with touchscreen

A stylus touch sensor and an inexpensive, battery free, wireless backscatter stylus, the stylus touch sensor including a host radio frequency (RF) antenna for generating a magnetic field, an electrode grid for detecting finger touches, and a stylus reader circuit for detecting a signal from a backscatter stylus, and the backscatter stylus having a first circuit for using the magnetic field to generate an electrical current for powering the backscatter stylus, and a second circuit for generating a backscatter signal that is detectable by the stylus reader circuit.

Display apparatus and method for controlling display apparatus thereof

An display apparatus and a method of setting a view angle thereof are provided. The method includes in response to an occurrence of a predetermined event, displaying, on an area of a display screen, a view angle guiding user interface which guides setting a view angle of a camera connected to the display apparatus; and setting the view angle of the camera using the view angle guiding UI.

Image sharing system and user terminal for the system

An image sharing system and a user terminal for the system are disclosed. The user terminal can include: a display unit configured to display an image; a sensing unit configured to sense a position of a touch means near the display unit; and an image information transmitting unit configured to transmit image information, which relates to an image displayed on the display unit, and position information, which relates to a position of the touch means near the display unit, to a receiving terminal, where an image corresponding to the image information and an image indicating a position of the nearby touch means are displayed on the receiving terminal. Certain embodiments of the invention provide the advantages of enabling image sharing between a user terminal and a different type of terminal and enabling a user to manipulate the user terminal while viewing another terminal.

User terminal capable of sharing image and method for controlling the same

A user terminal capable of sharing images and a method for controlling the user terminal are disclosed. The user terminal can include: a position image generation unit configured to generate a position image corresponding to a position of a touch means when the touch means is touching a display unit or is near the display unit; and a sensing unit configured to sense at least one of a touch pressure and a touch area of the touch means, where the position image is changed according to at least one of the touch pressure and the touch area of the touch means sensed by the sensing unit. Certain embodiments of the invention provide the advantages of enabling a user terminal and a different type of terminal to share images and minimizing touch errors on a touch interface.

Method and system for annotating image regions through gestures and natural speech interaction

The invention relates to a method and system for annotating image regions with specific concepts based on multimodal user input. The system ( 10 ) comprises an identification unit ( 11 ) for the identification of a region of interest on a multidimensional image; an automatic speech recognition unit ( 12 ) for recognizing speech input in a natural language; a natural language understanding unit ( 13 ) which interprets the speech input in the context of a specific application domain; a fusion unit ( 14 ) which combines the multimodal user input from the identification unit ( 11 ) and the natural language understanding unit ( 13 ); and an annotation unit ( 15 ) which annotates the result of the natural language understanding unit ( 13 ) on the image regions and optionally provides user feedback about the annotation process. Thus, the system advantageously facilitates a user's task to annotate specific image regions with standardized key concepts based on multimodal speech-based user input.

Information processing device, information processing method and computer program

Provided is an information processing device capable of executing a larger variety of processes on screen data on the basis of motion of the device body. An information processing device 1 has: a display unit 11 provided with a display screen; a contact detection unit 12 which detects contacting operation to the display screen and a position of the contact; a motion detection unit 13 which detects information representing a motion of the own device; an operation mode selection unit 14 which, while the contact position detected by the contact detection unit 12 is kept included in any one of one or more operation areas defined in the display screen, selects a predetermined operation mode related to the operation area; a display process discrimination unit 15 which discriminates the content of a display process designated with respect to screen data displayed on the display screen, on the basis of a combination of the operation mode and information representing a motion of the own device; and a display process control unit 16 which, if information representing a motion of the own device is detected by the motion detection unit 13 while the operation mode is kept selected, executes a display process discriminated by the display process discrimination unit 15 on screen data.

Shake unlock mobile touch device and method for unlocking the same

A shake unlock method for unlocking a shake unlock mobile touch device has steps of displaying an initial unlock image, receiving a touch signal that occurs when the initial unlock image is touched, displaying a shaking control image and an unlock endpoint on the touch panel, receiving a series of continuous location coordinates after the mobile touch device is shaken and varying coordinates of the shaking control image according to the received series of continuous location coordinates, and unlocking a lock mode of the mobile touch device when detecting the coordinates of the shaking control image coincide with coordinates of the unlock endpoint. Accordingly, the drawback of unlocking a conventional mobile touch device arising from the difficulty of dragging an image with single-handed operation can be eliminated without requiring additional hardware equipment.

Information equipment

An information equipment for displaying shortcut keys for operating the information equipment on a screen and rearranging the displayed shortcut keys on the screen based on a recognition result of an input voice, the information equipment including: a voice recognition processor referring to a recognition dictionary database memory to output text as a recognition result of an input voice; and a shortcut key rearranging mechanism referring to a conversion database memory, where an association relation between a function of the information equipment and text is written, mapping the recognition result text onto a function of the information equipment, and displaying a shortcut key to the function on the display screen.

Multi-Media Systems, Controllers and Methods for Controlling Display Devices

A multi-media system includes a display device and a controller. The display device receives a video signal indicating image content and displays the image content according to the video signal. The controller captures a user's information, identifies a user's sensory state according to captured user information, and generates a control signal according to the sensory state for controlling the display device. The user information includes image information. The sensory state includes eyeball movement.

Method and system for multimodal and gestural control

Embodiments of the present invention disclose a multimodal and gestural control system. According to one embodiment, the multimodal and gestural control system is configured to detect a gesture command from a user via at least one device of a plurality of devices. A control operation and a destination device are both determined based on the gesture command such that the determined control operation is executed on the determined destination device.

Speech recognition support for remote applications and desktops

An application may be hosted for utilization by a remote computing platform. User interface (UI) elements of a UI generated by the hosted application may be identified. Proxy UI elements may be generated. Each of the proxy UI elements may correspond to one or more of the identified UI elements. A transcript of an audio sample may be processed. The audio sample may comprise an utterance of a user of the remote computing platform. The transcript of the audio sample may comprise at least one word corresponding to one or more of the proxy UI elements. A functionality of the hosted application may be invoked. The invoked functionality may correspond to one or more of the UI elements corresponding to the one or more of the proxy UI elements.

Display with Wireless Transmission Functions

A display with wireless transmission functions for transmitting wireless signals to a first wireless transmission module of an electronic device; said display comprising: a screen, touch module and second wireless transmission module; of which, the touch module is configured on the screen; and the second wireless transmission module is mounted onto the screen and connected with the touch module, and used to receive touch signals from the touch module and transmit wireless signals to the electronic device.

Device and method for eye tracking data trigger arrangement

A system and method tracks a user's eye for a data trigger arrangement. The method includes obtaining first image data within a first vision field of a first data capturing sensor. The method includes determining a first area viewed by a user's eye as a function of the first image data. The method includes obtaining second image data within a second vision field of a second sensor. The method includes determining a second area captured within the second field of vision as a function of the second image data. The method includes determining disposition data of the first area within the second area. When a trigger command is captured, the method includes data capturing a machine readable representation of data (MRRoD) using the second sensor as a function of the disposition data.

Display apparatus control system and method and apparatus for controlling a plurality of displays

A display apparatus control system and a method and apparatus for controlling a plurality of display apparatuses are provided. The method of controlling a plurality of display apparatuses includes capturing a region at which a user is located, generating a user-captured image, determining which display apparatus the user is looking at from among the plurality of display apparatuses, based on the user-captured image, and determining the determined display apparatus to be a control target display apparatus, and transmitting a control signal which corresponds to a user's command to be the control target display apparatus when the user's command is input.

Speech and gesture recognition enhancement

The recognition of user input to a computing device is enhanced. The user input is either speech, or handwriting data input by the user making screen-contacting gestures, or a combination of one or more prescribed words that are spoken by the user and one or more prescribed screen-contacting gestures that are made by the user, or a combination of one or more prescribed words that are spoken by the user and one or more prescribed non-screen-contacting gestures that are made by the user.

System and method for reducing the effects of inadvertent touch on a touch screen controller

A method and system are provided for determining if a control button on a touch screen controller (TSC) was inadvertently touched. A user gaze point is determined using gaze detection apparatus, and the level of functional significance of the control button is identified. User gaze boundary values for the control button are then determined, and the gaze boundary values are altered to reflect the level of functional significance.

Interactive drawing recognition

Interactive drawing recognition is described. In one example, a command is received indicating a type of drawing and a user drawing is observed. A library of drawing templates associated with the drawing type is accessed based on the command. The observed drawing is compared to the drawing templates to identify the observed drawing, and attributes are assigned to the identified drawing.

System and control method for character make-up

The present invention relates, in general, to a method of conveniently making up a character string in smart phone-based messengers or Internet-based Social Network Services (SNSs) by utilizing technology for implementing a user-friendly interface using multi-touch, a gyro sensor, etc.

Information transmission method and system, device, and computer readable recording medium thereof

An information transmission method performed by a device is provided. The method includes receiving a selection, performed by an external input device, of target information displayed on the device, extracting the target information corresponding to the selection of the external input device, and transmitting information corresponding to the target information to the external input device.

PORTABLE MULTI-TOUCH INPUT DEVICE

A portable input device is described. The portable input device can wirelessly send control signals to an external circuit. The control signals can derive from touch or gestures applied to a touch sensitive surface. The control signals can also include a mouse click equivalent control signal generated by mechanical manipulation of the portable input device. 1. A wireless input device , comprising:a housing body, the housing body enclosing a rigid frame structure arranged to support operational components of the portable input device;a touch pad assembly, the touch pad assembly mounted to and supported by the rigid frame structure, the touch pad assembly comprising: detect a touch event at the touch sensitive layer, and', 'generate a first signal in accordance with the detected touch event;, 'a touch sensitive layer, the touch sensitive layer arranged to'}a protective covering overlaying the touch sensitive layer, wherein the touch sensitive layer detects a touch event applied on or near the protective covering and generates a first signal based upon the detected touch event; andan RF transmitter comprising:a portion of the rigid frame structure shaped in such a way to form a current path, wherein a voltage applied to the portion of the rigid frame structure causes current to flow along the current path resulting in generation of RF energy emitted by the RF transmitter.2. The portable input device as recited in claim 1 , further comprising:a signal generating circuit, the signal generating circuit responsive to a force applied to the housing body by generating a second signal, the second signal being independent of the first signal.3. The portable input device as recited in claim 2 , wherein when the applied force is a discrete force claim 2 , the second signal is a discrete signal claim 2 , otherwise claim 2 , the second signal is continuous signal.4. The portable input device as recited in claim 3 , wherein the first signal is based upon positional and movement ...

Mobile terminal and method for controlling the same

A mobile terminal may activate a specific mode on the basis of an external input received through a microphone activated on the basis of a specific condition. The mobile terminal includes a terminal body, a microphone disposed on the terminal body and configured to receive an input outside of the terminal body, a sensor configured to sense a movement of the terminal body, and a controller configured to activate the microphone on the basis of a specific movement of the terminal body sensed by the sensor, and activate a specific mode when the input outside of the terminal body received through the activate microphone corresponds to a change in vibration of air having a preset pattern.

Apparatus and Method for Improving, Augmenting or Enhancing Vision

The present invention provides various apparatus and methods for improving, augmenting or enhancing a vision of a person that include a first camera, one or more sensors, a microdisplay, and one or more processors communicably coupled to the first camera, the one or more sensors and the microdisplay. The first camera is configured to acquire a first image of a scene facing away from an eye of the person. The microdisplay is configured to display a modified first image to the eye. In one operational mode, the one or more processors are configured to acquire the first image of the scene using the first camera, modify the first image based on one or more vision improvement parameters, and display the modified first image on the microdisplay to improve, augment or enhance the vision of the person.

Camera-Based Input Device

In embodiments of a camera-based input device, the input device includes an inertial measurement unit that collects motion data associated with velocity and acceleration of the input device in an environment, such as in three-dimensional (3D) space. The input device also includes at least two visual light cameras that capture images of the environment. A positioning application is implemented to receive the motion data from the inertial measurement unit, and receive the images of the environment from the at least two visual light cameras. The positioning application can then determine positions of the input device based on the motion data and the images correlated with a map of the environment, and track a motion of the input device in the environment based on the determined positions of the input device.

DEVICES AND METHODS FOR GENERATING INPUT

Devices and methods are disclosed for generating input. In one implementation, a stylus is provided for generating writing input. The stylus includes an elongated body having a distal end, and a light source configured to project coherent light on an opposing surface adjacent the distal end. The stylus further includes at least one sensor configured to measure first reflections of the coherent light from the opposing surface while the distal end moves in contact with the opposing surface, and to measure second reflections of the coherent light from the opposing surface while the distal end moves above the opposing surface and out of contact with the opposing surface. The stylus also includes at least one processor configured to receive input from the at least one sensor and to enable determining three dimensional positions of the distal end based on the first reflections and the second reflections. 1135-. (canceled)136. A stylus for generating writing input , the stylus comprising:an elongated body having a distal end;a light source configured to project coherent light on an opposing surface adjacent the distal end;at least one sensor including at least three pairs of light detectors and configured to coherently detect first reflections of the coherent light from the opposing surface while the distal end moves in contact with the opposing surface, and to coherently detect second reflections of the coherent light from the opposing surface while the distal end moves above the opposing surface and out of contact with the opposing surface, wherein the at least one sensor is further configured to generate at least one data stream indicative of changes in the first reflections and changes in the second reflections as detected by the at least three pairs of light detectors; andat least one processor configured to receive the at least one data stream from the at least one sensor and to enable determination of three dimensional movement of the distal end from the changes in ...

WEARABLE ELECTRONIC DEVICES HAVING USER INTERFACE MIRRORING BASED ON DEVICE POSITION

Wearable electronic systems having user interface mirroring based on device position are described herein. The wearable electronic systems include a first wearable electronic device having a display and a second wearable electronic device having a device orientation sensor. The device orientation sensor detects a device orientation of the second wearable electronic device and generates a device orientation signal in response to detecting the device orientation. The first wearable electronic device generates and displays an orientable user interface on its display in response to the first wearable electronic device receiving a first device orientation signal from the second wearable electronic device and dynamically reorients the orientable user interface in response to receiving a second device orientation signal from the first wearable electronic device. Methods of controlling an orientation of an orientable user interface presented on the display of a first wearable electronic device are also described herein. 1. A wearable electronic system comprising:a first wearable electronic device having a first processor, a first non-transitory processor-readable storage medium communicatively coupled to the first processor, a display communicatively coupled to the first processor, and a first communication interface communicatively coupled to the first processor; anda second wearable electronic device having a device orientation sensor and a second communication interface communicatively coupled to the device orientation sensor, the device orientation sensor to detect a device orientation of the second wearable electronic device and generate a device orientation signal in response to detecting the device orientation of the second wearable electronic device, and the second communication interface to transmit the device orientation signal;wherein:the first communication interface is communicatively coupleable with the second communication interface to provide communications ...

Method and system for ink data generation, ink data rendering, ink data manipulation and ink data communication

A method implemented by a transmission device to communicate with multiple reception devices that respectively share a drawing area with the transmission device is provided. The transmission device transmits to the multiple reception devices vector-data ink data representative of traces of input operation detected by an input sensor of the transmission device. The method includes: (a) an ink data generation step of generating fragmented data of a stroke object, wherein the stroke object contains multiple point objects to represent a trace formed by a pointer, the fragmented data being generated per defined unit T, and generating a drawing style object; (b) a message formation step of generating messages including the drawing style object and the fragmented data; and (c) a transmission step of transmitting the messages.

SYSTEM AND METHOD FOR CONTINUOUS MULTIMODAL SPEECH AND GESTURE INTERACTION

Disclosed herein are systems, methods, and non-transitory computer-readable storage media for processing multimodal input. A system configured to practice the method continuously monitors an audio stream associated with a gesture input stream, and detects a speech event in the audio stream. Then the system identifies a temporal window associated with a time of the speech event, and analyzes data from the gesture input stream within the temporal window to identify a gesture event. The system processes the speech event and the gesture event to produce a multimodal command. The gesture in the gesture input stream can be directed to a display, but is remote from the display. The system can analyze the data from the gesture input stream by calculating an average of gesture coordinates within the temporal window. 1monitoring an audio stream associated with a non-tactile gesture input stream;identifying a speech event in an audio stream;determining a temporal window associated with a time of the speech event, wherein the temporal window extends forward and backward from the time of the speech event;analyzing, via a processor, data from the non-tactile gesture input stream within the temporal window to identify, based on the speech event, a non-tactile gesture event; andprocessing the speech event and the non-tactile gesture event to produce a multimodal command.. A method comprising: The present application is a continuation of U.S. patent application Ser. No. 14/875,105, filed Oct. 5, 2015, which is a continuation of U.S. patent application Ser. No. 13/308,846, filed Dec. 1, 2011, now U.S. Pat. No. 9,152,376, issued Oct. 6, 2015, which was also filed as PCT Application No. PCT/US12/67309, filed Nov. 30, 2012, the contents of which is incorporated herein by reference in its entirety.The present disclosure relates to human-computer interaction and more specifically to incorporating a continuous speech input stream and a continuous gesture input stream.Currently deployed ...

SMALL AND PORTABLE INPUT DEVICE WITH FUNCTIONS FOR STARTING AND CONTROLLING DOCUMENT DISPLAY

A portable and simple input device for document display purposes which can operate with the powers and functions of a full computer includes a cover, keys for user input, a circuit board, a storage unit, a first communication unit, and a processor. The keys are outside the cover, the circuit board, the processor, and the storage unit are within the cover. The storage unit stores a computer operating system and a preset document. The first communication unit enables communication between the input device and an external display device. The processor can generate a starting signal when a first preset condition is met, execute the computer operating system and the preset document in the computer operating system according to the starting signal, transmit the executed preset document to the external display device for display, and control the display characteristics of the preset document. 1. An input device being selected from a group consisting of a mouse and a keyboard , the input device comprising:a cover;a plurality of keys arranged on an external surface of the cover;a circuit board arranged in the cover;a storage unit coupled to the circuit board, the storage unit storing a computer operating system of a computer and a preset document, the computer operating system having a micro-computer architecture and executing a part of function of the standard computer operating system when executed;a first communication unit coupled to the circuit board, the first communication unit configured to enable the input device to communicate with an external display device; anda processor coupled to the circuit board, the processor configured to generate a starting signal when a first preset condition is met, execute the computer operating system of the computer and the preset document in the computer operating system according to the starting signal, and display the executed preset document on the external display device via the first communication unit.2. The input device ...

Electronic device for executing operation based on user input via electronic pen, and operating method thereof

Provided are an electronic device for executing an operation based on a user input via an electronic pen and an operating method of the electronic device, the operating method including: connecting to the electronic pen; receiving, from the electronic pen, a first input via a touch input to a touch pad at least one operation of rotation of at least a part of the electronic pen or the entire electronic pen; and executing a preset operation based on the first input.

EXECUTING MULTIPLE PEN INPUTS

In example implementations, a method executed by a processor is provided. The method receives a first pen input from first pen and a second pen input from a second pen. The first pen and the second pen interact with a single display. The first pen input and the second pen input are translated into a first output and a second output, respectively, that are executed by an application. The first output and the second output are sent to the application. The application executes the first output and the second output simultaneously. 1. A method , comprising:receiving, by a processor, a first pen input from a first pen and a second pen input from a second pen, wherein the first pen and the second pen are interacting with a single display;translating, by the processor, the first pen input into a first output and the second pen input into a second output that are executed by an application; andsending, by the processor, the first output and the second output to the application, wherein the application executes the first output and the second output simultaneously.2. The method of claim 1 , wherein the first pen and the second pen each comprises an electro-mechanical pen device that transmits the first pen input and the second pen input via a respective short range wireless connection or the first pen and the second pen each comprises a mechanical input device that transmits the first pen input and the second pen input via a touch screen interface.3. The method of claim 1 , wherein the first pen input and the second pen input are received at different locations on the single display.4. The method of claim 1 , comprising:buffering, by the processor, the first pen input and the second pen input to translate the first pen input and the second pen input.5. The method of claim 1 , wherein the translating comprises:sending, by the processor, an application programming interface (API) call for the first pen input and the second pen input.6. The method of claim 1 , wherein the ...

Electronic apparatus and method for controlling the electronic apparatus

An electronic apparatus is disclosed. The electronic apparatus includes an input unit configured to receive a user input, a storage configured to store a recognition model for recognizing the user input, a sensor configured to sense a surrounding circumstance of the electronic apparatus, and a processor configured to control to recognize the received user input based on the stored recognition model and to perform an operation corresponding to the recognized user input, and update the stored recognition model in response to determining that the performed operation is caused by a misrecognition based on a user input recognized after performing the operation and the sensed surrounding circumstance.

Electronic device and communication method using the same

An electronic device includes a first electronic element and a second electronic element. The first electronic element stores a pairing information. The second electronic element is detachably disposed on the first electronic element. When the second electronic element is electrically connected with the first electronic element, the first electronic element is wirelessly communicated with a third electronic element. When the second electronic element is detached from the first electronic element, the second electronic element is wirelessly communicated with the third electronic element through the pairing information.

Intellectual host switching system and method

An intellectual host switching system is disclosed, which is installed in multi host devices, and comprises a host switching setting unit and a host switching executing unit. The host switching setting unit provides a plurality of color regions on a display screen of the host device, and the color regions are corresponding to multi host devices by a setting operation of host switching. In case of a pointer being moved to be in a color region as well as a motion distance of the pointer being smaller than a reference motion distance, the host switching executing unit executes a host switching operation after receiving a host switching command that is transmitted from a wireless inputting device, thereby making the wireless inputting device wirelessly connected with one host device be switched to be wirelessly connected with another one host device, without completing any Bluetooth pairing procedure.

Gesture Recognition Using Multiple Antenna

Various embodiments wirelessly detect micro gestures using multiple antenna of a gesture sensor device. At times, the gesture sensor device transmits multiple outgoing radio frequency (RF) signals, each outgoing RF signal transmitted via a respective antenna of the gesture sensor device. The outgoing RF signals are configured to help capture information that can be used to identify micro-gestures performed by a hand. The gesture sensor device captures incoming RF signals generated by the outgoing RF signals reflecting off of the hand, and then analyzes the incoming RF signals to identify the micro-gesture.

Remote Pointing Device

A method, system, and apparatus, including a program encoded on computer-readable medium, for providing remote control of a light beam pointing device. The system includes a camera that captures at least one image at a first location and a light source that generates a light beam in a direction within a viewable area of the camera. At a second location, remote from the first location, a display screen displays images captured by the camera and a controller that controls pointing of the light source toward a desired target object at the first location. 1. A system comprising:a camera adapted to capture at least one image at a first location;a light source adapted to generate a light beam in a direction within a viewable area of the camera;a display screen at a second location, remote from the first location, adapted to display images captured by the camera; anda controller, associated with the display screen, adapted to facilitate pointing of the light source toward a desired target object at the first location.2. The system of further comprising:a first communication module at the first location; and transmitting the images captured at the first location from the first communication module to the second communication module for display on the display screen; or', 'transmitting control data received from the controller from the second communication module to the first communication module., 'a second communication module at the second location, wherein the first communication module and the second communication module are adapted to enable at least one of3. The system of wherein the first communication module and the second communication module are adapted to enable:transmitting the images captured at the first location from the first communication module to the second communication module for display on the display screen; andtransmitting control data received from the controller from the second communication module to the first communication module.4. The system of ...

LIGHT-EMITTING USER INPUT DEVICE FOR CALIBRATION OR PAIRING

A light emitting user input device can include a touch sensitive portion configured to accept user input (e.g., from a user's thumb) and a light emitting portion configured to output a light pattern. The light pattern can be used to assist the user in interacting with the user input device. Examples include emulating a multi-degree-of-freedom controller, indicating scrolling or swiping actions, indicating presence of objects nearby the device, indicating receipt of notifications, assisting pairing the user input device with another device, or assisting calibrating the user input device. The light emitting user input device can be used to provide user input to a wearable device, such as, e.g., a head mounted display device. 1. (canceled)2. A wearable device for pairing a light-emitting user input device , the wearable device comprising:an outward-facing imaging system configured to image an environment; and receive an image acquired by the outward-facing imaging system wherein the image comprises a light pattern illuminated by a light-emitting user input device to be paired with the wearable device;', 'analyze the image to identify the light pattern which encodes information associated with pairing the light-emitting user input device with a wearable device;', 'extract the information encoded in the light pattern for pairing the light-emitting user input device with the wearable device; and', 'pair the light-emitting user input device with wearable device based at least in part on the extracted information., 'a hardware processor in communication with the outward-facing imaging system, and programmed to3. The wearable device of claim 2 , wherein the hardware processor is further programmed to:determine whether the pairing between the light-emitting user input device and the wearable device is successful; andin response to a determination that the pairing is successful, instruct the light-emitting user input device to illuminate another light pattern indicative of a ...

Three Dimensional User Interface Effects On A Display

The techniques disclosed herein may use various sensors to infer a frame of reference for a hand-held device. In fact, with various inertial clues from accelerometer, gyrometer, and other instruments that report their states in real time, it is possible to track a Frenet frame of the device in real time to provide an instantaneous (or continuous) 3D frame-of-reference. In addition to—or in place of—calculating this instantaneous (or continuous) frame of reference, the position of a user's head may either be inferred or calculated directly by using one or more of a device's optical sensors, e.g., an optical camera, infrared camera, laser, etc. With knowledge of the 3D frame-of-reference for the display and/or knowledge of the position of the user's head, more realistic virtual 3D depictions of the graphical objects on the device's display may be created—and interacted with—by the user.

Apparatus and method for manipulating objects with gesture controls

An apparatus for manipulating an object includes first and second gesture controllers, each operatively connected to the object and structured and programmed such that, in a first-action active state, each can causes a first action to be carried out on the object by an appropriate first-action gesture made in the gesture controller. Only one of the first and second gesture controllers at any given time is capable of being in the first-action active state, and the first-action active state is transferable between the first and second gesture controllers upon the detecting of a first-action transfer gesture by one of said first gesture controller and said second gesture controller. Specific gesture control apparatus and methods for manipulating an object are also disclosed.

Action design apparatus and computer readable medium

An action design apparatus ( 100 ) includes a design tool group ( 120 ) that is a plurality of design tools ( 121 ) to generate design information in which a coordinated action among a plurality of devices is specified according to a user operation, each of the plurality of design tools ( 121 ) generating the design information in a different format. Each design tool ( 121 ) is provided with a corresponding design information abstraction unit ( 122 ). The design information abstraction unit ( 122 ) converts the design information generated by the corresponding design tool ( 121 ) into common design information described by using vocabulary stored in a dictionary unit ( 110 ) as well as converts common design information generated from the design information that is generated by another design tool ( 121 ) into design information in a format generated by the corresponding design tool ( 121 ).

External display system for displaying data and visuals of an input operating interface

An external display system for displaying data of an input operating interface comprises: a computer module comprising a host, a display and a keyboard; a mouse module comprising a sensor unit, a first USB transmission interface unit, a control unit and a switch unit; an external display module comprising a second USB transmission interface unit, a microprocessor, a storage unit and a display unit. Upon receiving the triggering signal, the mouse module sends a signal to the microprocessor via the host. The microprocessor retrieves the status non-video data or the setting non-video data, generates and displays a status video data and/or a setting video data on the display unit. Or the microprocessor retrieves and transfers the setting non-video data to the host, and the host generates and transfers the setting video data to the display.

INTERFACING APPARATUS AND USER INPUT PROCESSING METHOD

An interfacing apparatus and a user input processing method are provided. The interfacing apparatus may group event generation elements and output an address of a group in which an event occurs based on a generated group event signal. The interfacing apparatus may include a grouper configured to generate a group event signal in which a plurality of event generation elements corresponding to a plurality of pixels in at least one event sensor are grouped based on one or more events occurring with respect to the plurality of pixels, and an interface configured to output an address of the group of the plurality of event generation elements in which the one or more event occurs based on the generated group event signal 1. An interfacing apparatus comprising:a grouper configured to generate a group event signal in which a plurality of event generation elements corresponding to a plurality of pixels in at least one event sensor are grouped, based on one or more events occurring with respect to the plurality of pixels; andan interface configured to output an address of a group of the plurality of event generation elements in which the one or more event occurs, based on the generated group event signal.2. The interfacing apparatus of claim 1 , wherein the event generation elements are respectively configured to generate an event signal asynchronously in response to an occurrence of an event corresponding to a respective event generation element.3. The interfacing apparatus of claim 1 , wherein the address of the group is an address representing the plurality of event generation elements belonging to the group.4. The interfacing apparatus of claim 1 , wherein the grouped plurality of event generation elements are disposed consecutively in a predetermined pattern.5. The interfacing apparatus of claim 4 , wherein the predetermined pattern comprises at least one of:a pattern in which event generation elements are disposed consecutively in a row direction in a group;a pattern in ...

CONTEXT-AWARE AUGMENTED REALITY OBJECT COMMANDS

Embodiments are disclosed that relate to operating a user interface on an augmented reality computing device comprising a see-through display system. For example, one disclosed embodiment includes receiving a user input selecting an object in a field of view of the see-through display system, determining a first group of commands currently operable based on one or more of an identification of the selected object and a state of the object, and presenting the first group of commands to a user. The method may further include receiving a command from the first group of commands, changing the state of the selected object from a first state to a second state in response to the command, determining a second group of commands based on the second state, where the second group of commands is different than the first group of commands, and presenting the second group of commands to the user. 1. On an augmented reality computing device comprising a see-through display system , a method for operating a user interface , the method comprising:identifying one or more objects in a field of view of the see-through display system;identifying an object type and a current state for each identified object in the field of view of the see-through display system; determining a first group of commands operable on the object selected based on a first state of the object selected and on the object type,', 'presenting the first group of commands to a user,', 'receiving a user input of a command from the first group of commands, and', 'performing the command on the object selected and not performing the command on unselected objects, thereby changing the current state of the object selected from the first state of the object selected to a second state of the object selected in response to the command; and, 'when an object has been selected via a user input,'} receiving a user input of the command, and', 'based on the current state of each identified object in the field of view, performing the ...

Wireless positioning pen with pressure-sensitive tip

The present invention relates to a wireless positioning pen with a pressure-sensitive tip comprising an electric power source, optical system ( 1 ), inertial sensors and Bluetooth wireless technology, in which a casing ( 6 ) is provided with the second casing ( 7 ) in the rear, and the top part is provided with holes ( 61 ) with fingerboards ( 8 ) with buttons; said casing ( 6 ) provides a sliding housed body ( 4 ) with a battery ( 10 ) therein, a head ( 3 ) is attached to the front part thereof, and the first cover is ( 5 ) provided with a fastening mechanism ( 51 ) attached to lower part of the body ( 4 ), wherein the said body ( 4 ) houses a printed circuit board ( 2 ) consisting of the first fixed part ( 21 ), the second fixed part ( 22 ), the third fixed part ( 23 ), and the fourth fixed part ( 24 ) mutually interconnected with flexible parts ( 20 ), wherein the front body ( 4 ) part is provided with the optical system ( 1 ) configured for sliding thereof on the PCB fixed part ( 14 ) bearing the optical sensor ( 13 ) connected through the PCB flexible part ( 15 ) to the fourth fixed part ( 24 ), wherein the head ( 3 ) is provided with a tip button ( 92 ) with a light source ( 16 ), and in addition, a capacitive sensor ( 91 ).

Information processing device, information processing system, and non-transitory computer-readable storage medium

An information processing device includes: a memory; and a processor coupled to the memory and configured to execute reception processing that includes receiving event information from a plurality of terminal devices, execute conversion processing that includes converting the event information received in a predetermined time period to a multitouch event in a format describing a plurality of touch events that occur at the same time; and execute notification processing that includes notifying a target application of the multitouch event via an operating system.

Voice command-driven database

A voice command-driven system and computer-implemented method are disclosed for selecting a data item in a list of text-based data items stored in a database using a simple affirmative voice command input without utilizing a connection to a network. The text-based data items in the list are converted to speech using an embedded text-to-speech engine and an audio output of a first converted data item is provided. A listening state is entered into for a predefined pause time to await receipt of the simple affirmative voice command input. If the simple affirmative voice command input is received during the predefined pause time, the first converted data item is selected for processing. If the simple affirmative voice command input is not received during the predefined pause time, an audio output of a next converted data item in the list is provided.

Gesture Component with Gesture Library

A gesture component with a gesture library is described. The gesture component is configured to expose operations for execution by application of a computing device based on detected gestures. In one example, an input is detected using a three dimensional object detection system of a gesture component of the computing device. A gesture is recognized by the gesture component based on the detected input through comparison with a library of gestures maintained by the gesture component. An operation is then recognized that corresponds to the gesture by the gesture component using the library of gestures. The operation is exposed by the gesture component via an application programming interface to at least one application executed by the computing device to control performance of the operation by the at least one application. 1. A method of controlling operation of a computing device based on gesture detection , the method comprising:detecting an input using a three dimensional object detection module of a gesture component of the computing device;transforming raw data of the detected input into one or more different representations that represent information about an object used to provide the input;extracting three dimensional feature information about the object from the transformed raw data;recognizing a gesture performed by the object by the gesture component based on the detected input through comparison of the extracted feature information about the object with a library of gestures maintained by the gesture component;recognizing an operation that corresponds to the gesture by the gesture component using the library of gestures; andexposing an indication of the operation by the gesture component via an application programming interface for receipt by at least one application executed by the computing device to cause the at least one application to control performance of the operation.2. The method of claim 1 , wherein the three dimensional object detection system ...

SYSTEMS AND METHODS FOR PROVIDING AUDIO TO A USER BASED ON GAZE INPUT

According to the invention, a method for providing audio to a user is disclosed. The method may include determining, with an eye tracking device, a gaze point of a user on a display. The method may also include causing, with a computer system, an audio device to produce audio to the user, where content of the audio may be based at least in part on the gaze point of the user on the display. 1. A system for modifying a volume of audio provided to a user gazing at a display , the system comprising:an eye tracking device for at least determining a gaze point of a user on a display; determining audio content associated with a virtual sound source in a virtual environment, wherein the audio content has a first volume and includes one or more virtual sounds in the virtual environment;', 'determining a virtual distance and a virtual direction from the virtual sound source to the gaze point of the user on the display;', 'determining a sound channel produced by an audio device, wherein the sound channel is associated with the virtual distance and the virtual;', 'causing the audio content to be produced to the user, wherein the audio content is produced at the first volume via the sound channel, and the first volume is based at least in part on (i) the gaze point of the user on the display, and (ii) at least one of the virtual distance or the virtual direction;', 'determining a change in the gaze point of the user;', 'determining, based on the changed gaze point, a modified virtual distance and a modified virtual direction from the virtual sound source to the changed gaze point; and', 'causing a change in the first volume of the audio content, wherein the change is based at least in part on the modified virtual distance and the modified virtual direction., 'a processor configured for at least2. The system for modifying the volume of audio provided to the user gazing at the display of claim 1 , the system further comprising:a wearable device, wherein the wearable device is ...

DEVICE AND METHOD FOR PERFORMING FUNCTIONS

Provided is a device including a display, an audio inputter, and a controller. The display displays at least one screen page of an application that is being executed. The audio inputter receives a voice command of a user. The controller performs an operation corresponding to the voice command by using screen page transition information for transition between application screen pages corresponding to the voice command, which is obtained from information about user interface (UI) elements included in the application screen pages of the application. Each of the UI elements performs a predetermined function when selected by the user. 1. A device comprising:a communicator configured to receive service information from at least one Internet of Things (IoT) device;a memory configured to store the service information received from the at least one IoT device; andan inputter configured to receive a user input requesting performance of a predetermined function from a user; anda controller configured to analyze the service information of the at least one IoT device stored in the memory to select at least one IoT device for performing the predetermined function corresponding to the user input and transmit an execution command of the predetermined function to the selected at least one IoT device.2. The device of claim 1 , wherein the service information comprises at least one of service information provided by the at least one IoT device claim 1 , device identification information claim 1 , sensor data collected by a sensor and operation information of the at least one IoT device.3. The device of claim 1 , wherein the communicator is further configured to receive an execution result of the predetermined function from the at least one IoT device.4. The device of claim 1 , wherein the communicator is further configured to provide the user input to a server and receive text data generated by analyzing the user input from the server.5. The device of claim 1 , wherein the user input ...

MULTI-MODAL USER INTERFACE

A device for multi-modal user input includes a processor configured to process first data received from a first input device. The first data indicates a first input from a user based on a first input mode. The first input corresponds to a command. The processor is configured to send a feedback message to an output device based on processing the first data. The feedback message instructs the user to provide, based on a second input mode that is different from the first input mode, a second input that identifies a command associated with the first input. The processor is configured to receive second data from a second input device, the second data indicating the second input, and to update a mapping to associate the first input to the command identified by the second input. 1. A device for multi-modal user input , the device comprising: process first data received from a first input device, the first data indicating a first input from a user based on a first input mode, the first input corresponding to a command;', 'send a feedback message to an output device based on processing the first data, wherein the feedback message instructs the user to provide, based on a second input mode that is different from the first input mode, a second input that identifies a command associated with the first input;', 'receive second data from a second input device, the second data indicating the second input; and', 'update a mapping to associate the first input to the command identified by the second input., 'one or more processors configured to2. The device of claim 1 , wherein the first input mode is one of a speech mode claim 1 , a gesture mode claim 1 , or a video mode claim 1 , and wherein the second input mode is a different one of the speech mode claim 1 , the gesture mode claim 1 , or the video mode.3. The device of claim 1 , wherein the feedback message instructs the user to provide the second input to disambiguate the first input.4. The device of claim 3 , wherein the one or ...

Operating a device using touchless and touchscreen gestures

A device operable using touch-less and touchscreen gestures and a method and system to operate the device are described. The device includes two or more ambient light sensors arranged at respective surface locations of the device and sensing light intensity at the respective surface locations. The device also includes a processor coupled to the two or more ambient light sensors to identify a touch-less gesture based on the light intensity sensed by the two or more ambient light sensors, receive a touchscreen gesture, and operate the device based on the touch-less gesture and the touchscreen gesture.

METHOD AND DEVICE FOR PROVIDING A TRUSTED ENVIRONMENT FOR EXECUTING AN ANALOGUE-DIGITAL SIGNATURE

The invention relates to the field of providing a trusted environment for executing an analogue-digital signature. The claimed document-signing device in the form of a stylus includes a protective compartment, in which the following are disposed: a microcontroller with a programme code; a memory with a secret digital signature key; and additionally inertial sensors, which are connected to the microcontroller; a lens; and a camera, which is also connected to the microcontroller. A wireless interface is used in order to communicate with a computer. The inertial sensors serve to verify the handwritten signature of the user, while the lens and camera serve to carry out a comparison with the text of an electronic document uploaded via the wireless interface. In this way it is ensured that verified information enters the trusted environment of the stylus. 114.-. (canceled)16. The method of claim 15 , wherein the second comparing is made by comparing of the stylus movement data with the digitized handwritten signature video on a common timeline.17. The method of claim 15 , wherein the second comparing renders the positive outcome if the stylus movement data and the digitized handwritten signature video match with an error being within a predetermined error margin.18. The method according to claim 15 , wherein the first comparing is performed by overlaying the digitized text of the electronic document over image frame data claim 15 , taking into account respective locations in the document image window of the digitized text of the electronic document and of a text in the image frame data.19. The method according to claim 15 , wherein requesting to display the image of the electronic document on the computer screen and controlling of the camera and the lens for capturing the image at the computer screen is made by the same computer-executable program code.20. The method according to claim 19 , further comprising claim 19 , at the microcontroller claim 19 , identifying ...

Information processing device, information processing method, and program

An information processing device according to an aspect of the present technology includes a user information acquiring unit, an object information acquiring unit, and an output control unit. The user information acquiring unit acquires information related to a gaze position of a user while a substance of content is being automatically reproduced, in accordance with a first control amount, from an audio source located in a space in which the user is located. The object information acquiring unit acquires position information related to the audio source and position information related to a first object gazed at by the user. The output control unit performs first output control of providing the user with the substance of the content in accordance with a second control amount different from the first control amount in a case where the gaze position within the first object moves toward the audio source.

MULTIPLE USER WIRELESS DOCKING

A host device () for wireless communication with multiple dockee devices () is coupled to peripherals () for rendering audio or video (AV) data. The host has a docking processor for docking dockee devices for providing access to the peripherals. The dockee device has a dockee processor arranged for docking, as a dockee device, with the host device for getting access to the peripherals. The docking processor is arranged for docking at least one primary dockee device () and at least one secondary dockee device (). Thereby, to the primary dockee device, control is provided over the peripherals for determining the AV data to be rendered. To the secondary dockee device is transferred the AV data to be rendered via the peripherals. For example a primary dockee device, presenter P, is enabled to control and determine the AV contents that are rendered, whereas secondary devices, attendees A, are enabled to monitor the AV data. 1. A host device for wireless communication with multiple dockee devices , the host device being arranged for coupling to at least one peripheral for rendering audio or video data , the host device comprising:a host communication unit configured for accommodating said wireless communication;a docking processor configured for docking at least one dockee device for providing access to the at the least one peripheral for the dockee device, the dockee device comprisinga dockee communication unit configured for accommodating said wireless communication;a dockee processor configured for docking, as the dockee device, with the host device for getting access to the at least one peripheral, the docking processor being configured fordocking at least one primary dockee device and at least one secondary dockee device,providing, to the primary dockee device, control over the at least one peripheral for determining the AV data to be rendered, andtransferring, to the secondary dockee device, at least part of the AV data to be rendered, and the docking processor ...

Image Data Display System and Image Data Display Program

An image data display system classifies image data into a cluster based on a predetermined condition regardless of whether or not the image data conforms to DCF standard and displays information specific to the image data when displayed as a slide show. A CPU creates a cluster, including a plurality of the image data, and a slide show table having first and second cluster name candidates based on a FAT data or an Exif data and a third cluster name candidate input by a user. The image display screen combines any two of the above first, second, and third cluster name candidates and displays a list of the combined candidates as cluster names indicating contents of the image data. The user can select the cluster name in high visibility and can easily display the desired image data as the slide show. 1. An image data display system , comprising:an image data input unit to which image data and attribute information of the image data are inputted;an image display screen which displays the image data or the attribute information;an input unit to which character information or an operation command is inputted by a user;a control unit which controls the image data display system; anda memory unit which stores a control computer readable medium to control the image data display system, whereinthe control unit executes processings of:creating a cluster which includes a plurality of the image data based on a directory which stores the image data;designating a directory name of the directory as a first cluster name candidate;calculating a period when the image data included in the cluster is created as an image creation period based on a creation date and time of the image data and designating the image creation period as a second cluster name candidate;designating an arbitrary character string as a third cluster name candidate in response to a provision of the character string to the cluster via the input unit; andcreating a slide show table which associatedly stores the first ...

AUTOMATIC MULTI-HOST DISCOVERY IN A FLOW-ENABLED SYSTEM

A computer-implemented method includes sending a broadcast over a network requesting a response from other host computers on the network that are also communicatively paired with the input device, receiving a broadcasted response from a second host computer on the network indicating that it is communicatively paired with the input device, establishing a communicative connection with the second host computer via the network and automatically reestablishing the connection with the second host computer when the second host computer disconnects and reconnects to the network. In response to an edge-detect event, sending a control signal to switch the communicative pairing of the input device from the first host computer to the second host computer. 120-. (canceled)21. A computer-implemented method comprising:receiving, by a first host computer, an input signal from an input device communicatively paired with the first host computer, the input signal corresponding to a movement of a cursor on a display of the first host computer, wherein the first host computer is communicatively coupled to a second host computer;detecting, by the first host computer, when the cursor moves to an edge of the display of the first host computer and when the input signal corresponds to a continued movement of the cursor beyond the edge of the display of the first host computer; andin response to detecting that the cursor has moved to the edge of the display of the first host computer and that the input signal corresponds to continued movement of the cursor beyond the edge of the display of the first host computer:sending, by the first host computer to the input device, a first control signal configured to cause the input device to switch the communicative pairing of the input device from the first host computer to the second host computer; andsending, by the first host computer to the second host computer, a second control signal configured to cause a processor in the second host computer to ...

Method and device providing multimodal input mechanism

Conventional input mechanisms available are built considering majority users but face usability and security challenge when used by special users or when used in challenging environments. Embodiments herein provide a method and device for multimodal input mechanism. The device is preconfigured for a plurality of modalities and provides an option to a user to select an input modality pair for entering a sequence of characters into the device. A first modality among the pair enables selection of a character set among a plurality of character sets and the second modality enables selecting a character from the selected character set. The plurality of modalities comprise a touch mode defined by a set of touch based gestures, a motion keyboard mode defined by a set of device tilt based gestures, an air gesture mode defined by a set of virtual gestures and a voice mode defined by a set of voice commands. The input modality pair from among the plurality of input modalities is selected by the user based on physical constraints of the user and environmental constraints posed by an environment around the device.

System, device and method for processing interlaced multimodal user input

A device, method and system are provided for interpreting and executing operations based on multimodal input received at a computing device. The multimodal input can include one or more verbal and non-verbal inputs, such as a combination of speech and gesture inputs received substantially concurrently via suitable user interface means provided on the computing device. One or more target objects is identified from the non-verbal input, and text is recognized from the verbal input. An interaction object is generated using the recognized text and identified target objects, and thus comprises a natural language expression with embedded target objects. The interaction object is then processed to identify one or more operations to be executed.

Display Device

A display device configured to be connected to an information terminal, includes: a video reception unit that receives video information about a screen including a cursor from the information terminal; a touch panel that brings up the screen on display based on the video information received by the video reception unit and detects a touch position specified by a touch operation; and a transmission unit that transmits operation information in correspondence to the touch operation to the information terminal. The transmission unit transmits the operation information in a delay when the touch operation is performed continuously.

CONTROLLING A COMPUTER SYSTEM USING EPIDERMAL ELECTRONIC DEVICES

Control of a computer system using epidermal electronic devices. Movement of a first epidermal electronic device (EED) relative to a second EED is detected based on electronic signals of the first and second EEDs, the first EED being associated with a first portion of a user's body and the second EED being associated with a second portion of the user's body. Movement of the first portion of the user's body relative to the second portion of the user's body is determine based on the detected movement of the first EED relative to the second EED. A computer-recognizable input event correlated to the determined movement is identified, and a computer function associated with the computer-recognizable input event is performed. 1. A computer-implemented method comprising:detecting movement of a first epidermal electronic device relative to a second epidermal electronic device based on electronic signals of the first and second epidermal electronic devices, the first epidermal electronic device being associated with a first portion of a body of a user and the second epidermal electronic device being associated with a second portion of the body of the user;determining movement of the first portion of the body of the user relative to the second portion of the body of the user based on the detected movement of the first epidermal electronic device relative to the second epidermal electronic device;identifying a computer-recognizable input event correlated to the determined movement; andperforming a computer function associated with the computer-recognizable input event.2. The method of claim 1 , wherein the electronic signals of the first and second epidermal electronic devices comprise near-field communication signals of near-field communication circuits of the first and second epidermal electronic devices claim 1 , and wherein the detecting movement of the first epidermal electronic device relative to the second epidermal electronic device comprises tracking signal strength ...

Operating device

Disclosed herein is an operating device including: a circuit board; a frame arranged on top of the circuit board; a plate-shaped operating member located on top of the frame, the plate-shaped operating member including a surface touched by a user's finger and a touch sensor adapted to detect the position of the user's finger that has touched the surface, the plate-shaped operating member being arranged to be able to move up and down so that the operating member can be pressed by the user; and an elastic member arranged between the frame and operating member to bias the operating member upward.

COMPUTER SYSTEM ALLOWING MULTIPLE USERS TO CONCURRENTLY USE WITH SINGLE MAIN COMPUTER AND OPERATION METHOD THEREOF

The present invention relates to a computer system allowing multiple users to use with a single main computer and an operation method thereof. The computer system includes: a main computer for generating a signal so that multiple users can use concurrently; a plurality of first communication devices for receiving the signal from the main computer; a plurality of second communication devices for receiving the signal produced by the main computer through the first communication devices, wherein each of the second communication devices transfers the signal to a monitor and receives signals from a keyboard and a mouse and sends and receives signals with the first communication device; a communication port identifying unit for identifying that any one among the plurality of second communication devices is connected with which one among the plurality of communication ports, which are formed as software of the main computer, and for transferring the signal to a control unit; and the control unit for controlling communication connection between the communication port of the main computer and the software running in the second communication device depending on the signal received from the communication port identifying unit. The control unit outputs the information corresponding to the signals transmitted from the communication port identifying unit to a monitor connected to the second communication device. When a communication port corresponding to the information is selected through the communication port selection unit, a communication connection is established between the selected communication port and the operating software of the second communication device. 1. A computer system allowing multiple users to use with a single main computer comprising:a main computer for generating a signal such that multiple users can use concurrently;a plurality of first communication devices for receiving the signal from the main computer;a plurality of second communication devices for ...

Hand-held wireless electronic device with accelerometer for interacting with a display

A device and method for interacting with a display using an accelerometer sensitive to tilt about two perpendicular axes and a third signal having a magnitude responsive to user input. The device and method allow a user to change a characteristic of an object on the display by converting pitch information, roll information, and a linear dimension into Cartesian coordinates for use by the display.

Systems and methods to enable and disable scrolling using camera input

In one aspect, a device includes at least one processor, a camera, at least one sensor, a display, and storage. The storage bears instructions executable by the at least one processor to receive input from the at least one sensor and determine, based on the input, whether a user is making physical contact with the device. Based on a determination that the user is not making physical contact with the device, the instructions are executable by the at least one processor to execute scrolling of content based on input from the camera, with the content presented on the display. Based on a determination that the user is making physical contact with the device, the instructions are executable by the at least one processor to decline to execute scrolling of content based on input from the camera.

Method and finger-worn device for controlling an external computer

The invention relates to a method and a computer program for wireless interactions with an external computer with a finger-worn device configured to acquire and transmit position data of at least one finger relative to an object surface to an external computer, wherein the method comprises the steps of: —acquiring ( 300, 301 ) sensor data ( 201, 202 ) from a first sensor system ( 9 ) and a second sensor system ( 10 ) comprised in the device ( 1 ); —estimating ( 302 ) a position and/or an orientation of at least one finger ( 2 ) with respect to an object surface ( 7 ) from the sensor data ( 201, 202 ), wherein the estimation ( 302 ) of the position and/or the orientation of the at least one finger ( 2 ) with respect to the object surface ( 7 ) is performed by a machine learning method ( 100 ) executed on a processor ( 4 ) comprised by the device ( 1 ); —wirelessly transmitting ( 304 ) position data ( 203 ) comprising the estimated position and/or orientation of the at least one finger ( 2 ) with respect to the subject surface ( 7 ) to an external computer ( 15 ); —relating ( 305 ) the estimated position and/or orientation of the at least one finger ( 2 ) with respect to the object surface ( 7 ) comprised in the position data ( 203 ) to a display position and/or a display orientation ( 204 ) in a coordinate system of a display ( 18 ); —indicating the display position and/or the display orientation ( 204 ) on the display ( 18 ). The invention furthermore relates to a device ( 1 ) for executing the method according to the invention.

System and Method of Utilizing a Stylus with an Information Handling System

In one or more embodiments, one or more systems, methods, and/or processes may receive, via a touch screen, first user input from a stylus that selects an element of a graphical user interface (GUI); may receive, via a rotary encoder of the stylus, second user input that is associated with a first possible selection associated with the element of the GUI; may provide first light emissions of a first color; may receive, via the rotary encoder of the stylus, third user input that is associated with a second possible selection associated with the element of the GUI; may provide second light emissions of a second color, different from the first color; may receive fourth user input via an electromechanical switch of the stylus; and may select the second possible selection associated with the element of the GUI. 1. A stylus communicatively coupled to an information handling system (IHS) having a display for presenting a graphical user interface (GUI) , the stylus comprising:a processor;a rotary encoder coupled to the processor;an electromechanical switch coupled to the processor, the electromechanical switch comprising a slider configurable in one position of a plurality of positions;a set of light emitting diodes (LEDs) configurable to emit light having a color in a visible spectrum; and receive, via the electromechanical switch, a first user input comprising an indication of the slider in a position of the plurality of positions;', 'receive, via the rotary encoder, a second user input associated with an element of the GUI;', 'in response to receiving the second user input, emit, via the set of LEDs, first light emissions of a first color in the visible spectrum;', 'receive, via the rotary encoder, a third user input associated with a selection associated with the element of the GUI;', 'in response to receiving, the third user input, emit, via the set of LEDs, second light emissions of a second color in the visible spectrum, different from the first color;', 'and', ' ...

TOUCH-SENSITIVE SYSTEM WITH MOTION FILTERING

In one embodiment, computer-readable non-transitory storage media receive one or more signals based on motion of an object, a device, or both. The received signals are compared to a motion profile which defines unintended motion of the object, the device, or both, and this comparison determines whether any of the signals represent unintended motion of the stylus or device. The received signals are then processed to correct for the unintended motion defined by the motion profile. 1. A stylus , comprising:a pen-tip;at least one sensor selected from an accelerometer, a gyroscope, a global positioning system, a magnetometer, and a touch-sensitive element; and operate in one of a lower-power mode and a higher-power mode;', 'detect, with the at least one sensor, defined one or more frequencies or defined one or more ranges of frequencies indicating shaking of the stylus; and', 'transition between the lower-power mode and the higher-power mode in response to detection of the defined one or more frequencies or the defined one or more ranges of frequencies., 'one or more computer-readable non-transitory storage media embodying logic operable when executed to2. The stylus according to the claim 1 , whereinthe higher-power mode is a mode in which the logic is operable when executed to activate a component for transmitting a high-voltage signal from an electrode in the stylus, andthe lower power mode is a mode in which the logic is operable when executed to deactivate the component.3. The stylus according to the claim 1 , whereinthe logic is operable when executed to transition from the lower-power mode to the higher-power mode in response to detection of the defined one or more frequencies or the defined one or more ranges of frequencies.4. The stylus according to claim 1 , whereinthe defined one or more frequencies or the defined one or more ranges of frequencies indicate unintentional shaking of the stylus as opposed to intentional shaking of the stylus.5. A stylus claim 1 , ...

COUPLING A PEN DEVICE TO A COMPANION DEVICE BASED ON PEN PROXIMITY

The disclosure herein describes coupling a stylus and a computing device. Based on a tip of a stylus being brought proximate to a display of a computing device configured to communicate in accordance with a wireless protocol, the computing device is configured to receive a stylus wireless protocol identifier and transmit a wireless protocol identifier of the computing device and one or more security keys to the stylus via a communication channel in response, whereby the stylus and computing device are coupled. Based on receiving a signal associated with user input from the coupled stylus using the wireless protocol, the computing device performs an operation based on the signal. The described “loose coupling” enables streamlined use of styluses with compatible computing devices without requiring full pairing. 1. A system for coupling a stylus to a computing device , the system comprising: receive a stylus wireless protocol identifier in a first signal from the stylus via the at least one communication channel;', 'based on receiving the stylus wireless protocol identifier, transmit a second signal including a wireless protocol identifier of the computing device and a signing key to the stylus via the at least one communication channel associated with the second wireless protocol, whereby the computing device is coupled to the stylus to listen for signals from the stylus; and', 'based on receiving a third signal from the coupled stylus to the computing device via the first wireless protocol, perform an operation on the computing device based on the received third signal, the third signal indicating user input to the stylus;', 'wherein performing, by the computing device, the operation based on the third signal includes pairing the coupled stylus to the computing device based on the stylus wireless protocol identifier and the wireless protocol identifier of the computing device., 'a computing device having a display and configured to communicate with the stylus in ...

Modality Learning on Mobile Devices

Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for cross input modality learning in a mobile device are disclosed. In one aspect, a method includes activating a first modality user input mode in which user inputs by way of a first modality are recognized using a first modality recognizer; and receiving a user input by way of the first modality. The method includes, obtaining, as a result of the first modality recognizer recognizing the user input, a transcription that includes a particular term; and generating an input context data structure that references at least the particular term. The method further includes, transmitting, by the first modality recognizer, the input context data structure to a second modality recognizer for use in updating a second modality recognition model associated with the second modality recognizer. 1. A computer-implemented method , comprising:receiving, by a computing device, user input of a particular term via a first user input mode associated with the computing device;generating, by the computing device, annotated data associated with the particular term, wherein the annotated data is based on a first modality recognition model corresponding to the first user input mode;generating, based on the annotated data, an input context data structure that references at least the particular term; andsending, by the computing device and to a second modality recognition model corresponding to a second user input mode associated with the computing device, the input context data structure for use in training the second modality recognition model.2. The method of claim 1 , further comprising:determining, by the computing device and based on a user-indication, whether a transcribed version of the particular term is correct, wherein the transcribed version is based on the first modality recognition model, and wherein the annotated data is based on the user-indication.3. The method of claim 1 , ...

METHOD AND SYSTEM FOR INK DATA GENERATION, INK DATA RENDERING, INK DATA MANIPULATION AND INK DATA COMMUNICATION

Methods and systems are provided for generating, rendering, manipulating (e.g., slicing), and communicating stroke objects that form ink data. In a method of generating a stroke object, pen event data indicative of pen down, pen movement, and pen up events are sequentially received to generate point objects that collectively form a stroke object. The point objects serve as control points for interpolating curve segments. Further, a start parameter indicative of a start point within a starting curve segment of the curve segments at which display of the stroke object starts, and an end parameter indicative of an end point within an ending curve segment of at which display of the stroke object ends, are generated for the stroke object. When rendering the stroke object, a system limits display of the stroke object to a range bound by the start and end parameters, as opposed to displaying the entire stroke object. 1. A method implemented by computer-executable instructions loaded to one or more processors , which are coupled to one or more memory devices and used to manipulate ink data including a plurality of stroke objects , the method comprising:deriving an intersection between a target stroke object and a slicing stroke object;slicing the target stroke object at the derived intersection to generate two slice objects from the target stroke object; andassociating metadata information with the two slice objects, respectively.2. The method of claim 1 , wherein the slicing stroke object is based on coordinates data inputted by a user operating an electronic pen on a sensor surface claim 1 , on which the target stroke object is displayed and which is coupled to the one or more processors.3. The method of claim 1 , wherein the metadata information includes at least one piece of information selected from pen ID information claim 1 , author information claim 1 , date and time information claim 1 , and GPS location information.4. The method of claim 1 , wherein the same ...

CROSS DEVICE INTERACTIONS

The present disclosure generally relates to engaging in cross device interactions. The method includes at a first device with a first display, while a second device having a second display is placed over a first region of the first display, detecting, via input devices of the first device, a first input. In response to detecting the first input and in accordance with a determination that the first input occurred while focus was directed to the second device, the method includes causing a response to the first input to be displayed on the second display. In response to detecting the first input and in accordance with a determination that the first input occurred while focus was directed to the first device, the method includes displaying, on the first display, a response to the first input without causing a response to the first input to be displayed on the second display. 1. A method , comprising: detecting, via the one or more input devices of the first electronic device, a first user input;', in accordance with a determination that the first user input occurred while focus was directed to the second electronic device, causing a response to the first user input to be displayed on the second display; and', 'in accordance with a determination that the first user input occurred while focus was directed to the first electronic device, displaying, on the first display, a response to the first user input without causing a response to the first user input to be displayed on the second display., 'in response to detecting the first user input], 'while a second electronic device having a second display is placed over a first region of the first display, 'at a first electronic device with a first display and one or more input devices2. The method of claim 1 , further comprising determining if a gaze of the first user is directed at the first electronic device claim 1 , wherein focus is directed to the first electronic device if the gaze of the first user is directed at the ...

Multi-device personal assistants

Systems and methods are disclosed for multi-device personal assistants. In one implementation, input(s) are received in relation to a first device. The input(s) are processed in relation to one or more inputs received in relation to a second device to determine a proximity of the first device to the second device. Operation(s) of the first device are adjusted based on the determined proximity of the first device to the second device. In another implementation, one or more first outputs are provided with respect to a first user via one or more interfaces of a first device. One or more inputs are received in relation to the first user. The one or more inputs are processed to identify a second device in relation to the first user. One or more second outputs are provided, with respect to the first user, via one or more interfaces of the second device.

KEYBOARD AND TOUCH SCREEN GESTURE SYSTEM

A method at an electronic device including a touch-sensitive display for receiving touch input and a keyboard comprising a plurality of buttons, the method comprising: detecting actuation of a button on at least one of the plurality of buttons; detecting a touch input at the touch-sensitive display while the button is actuated; responding to the touch input, wherein response to the touch input while the button is actuated is different to response to touch input detected while the button is not actuated. 1. A method comprising:at an electronic device including a touch-sensitive display for receiving touch input and a keyboard comprising a plurality of keyboard buttons, wherein the keyboard is a hardware_keyboard separate from the touch-sensitive display, performingdetecting the touch input comprising a touch gesture on the touch-sensitive display;before release of the touch gesture, detecting actuation comprising pressing of a keyboard button on at least one of the plurality of keyboard buttons;modifying a response to the touch gesture based on detecting the actuation of the keyboard button before the release of the touch gesture; andresponding to the touch gesture, wherein an action performed in response to the touch gesture occurring while the keyboard button is actuated is different from an action performed in response to a same touch gesture detected while the keyboard button is not actuated.2. The method of claim 1 , wherein the touch gesture is a press and hold gesture.3. The method of claim 1 , wherein the action performed in response to the touch gesture while the keyboard button is actuated is dependent on which of the plurality of keyboard buttons is actuated.4. The method of claim 1 , wherein the action performed in response to the touch gesture while the keyboard button is not actuated is a first action on a content item claim 1 , and the action performed in response to the touch gesture while the keyboard button is actuated comprises a second action on ...

SYSTEMS AND METHODS FOR THREE DIMENSIONAL CONTROL OF MOBILE APPLICATIONS

The embodiments described herein relate to systems, methods, and devices for capturing arm motion. The arm motion can be transformed into a rendered object that can interact with a three dimensional scene that allows a user to intuitively grab, move, manipulate and hit objects within the scene. 1. An inertial measurement unit (IMU) device , comprising:an IMU sensor that detects orientation information, and transmits the orientation information, and retrieve the orientation information from the IMU sensor;', 'periodically update an offset correction for the IMU sensor, wherein the offset correction is updated while the IMU sensor is stationary;', 'calibrate the orientation information using the offset correction; and', 'transform the calibrated orientation information into an orientation signal indicative of orientation of the IMU device using a fusion algorithm, wherein the fusion algorithm comprises a gradient descent method., 'an IMU processor communicatively coupled to the IMU sensor, wherein the IMU processor executes machine readable instructions to2. The IMU device of claim 1 , comprising low power communication hardware communicatively coupled to the IMU processor claim 1 , wherein the low power communication hardware wirelessly transmits the orientation signal.3. The IMU device of claim 1 , wherein the IMU processor executes the machine readable instruction to operate in a low power mode after the fusion algorithm is executed.4. The IMU device of claim 1 , wherein the fusion algorithm is executed in parallel to retrieval of the orientation information.5. The IMU device of claim 1 , wherein the IMU sensor comprises an accelerometer claim 1 , a gyroscope claim 1 , and a magnetometer.6. The IMU device of claim 5 , wherein the fusion algorithm is synchronized to an interrupt provided by one of the accelerometer claim 5 , the gyroscope claim 5 , and the magnetometer.7. The IMU device of claim 6 , wherein the fusion algorithm takes less time to execute than a ...

DEVICE FOR INTERACTION WITH TOUCH SCREEN

According to an example aspect of the present invention, there is provided an apparatus comprising at least one receiver configured to receive an identifier and an indication of at least one new touch point detected on a touch sensitive screen, and at least one processing core configured to cause transmission of a disable touch point instruction, to determine whether the at least one new touch point disappears from the touch sensitive screen, and responsive to a determination that the at least one new touch point disappears from the touch sensitive screen, to associate a location on the touch sensitive screen with the identifier. 1. An apparatus comprising:at least one receiver configured to receive an identifier and an indication of at least one new touch point detected on a touch sensitive screen; andat least one processing core configured to cause transmission of a disable touch point instruction, to determine whether the at least one new touch point disappears from the touch sensitive screen, and responsive to a determination that the at least one new touch point disappears from the touch sensitive screen, to associate a location on the touch sensitive screen with the identifier.2. The apparatus according to claim 1 , wherein the location on the touch sensitive screen is a location where the at least one new touch point was detected.3. The apparatus according to claim 1 , wherein the identifier comprises an identifier of an accessory or device external to the apparatus.4. The apparatus according to claim 1 , wherein the apparatus is configured to receive the identifier via a wireless link and to transmit the disable touch point instruction via the wireless link.5. The apparatus according to claim 1 , wherein determining whether the at least one new touch point disappears from the touch sensitive comprises determining whether the at least one new touch point disappears from the touch sensitive screen within a predefined length of time from transmission of the ...

Sensitivity adjustment for a pointing device

A computer program product includes a non-transitory computer readable storage medium having program instructions embodied therewith, wherein the program instructions are executable by a processor to cause the processor to perform a method. The method includes monitoring use of a user input device of a computer system relative to a graphical user interface (GUI) of an active application, wherein the user input device includes a pointing device, wherein user input to the pointing device controls movement of a pointer within the GUI, and wherein a software interface establishes a level of sensitivity between the user input to the pointing device and the resulting movement of the pointer. The method further includes determining a value of one or more parameters characterizing the use of the at least one user input device, and automatically adjusting the level of sensitivity in response to the value of the one or more parameters.

OPERATING TOOL, INPUT DEVICE, AND ELECTRONIC DEVICE

In a rotary switch (), a rotation unit () is rotatably supported by a holder unit (). The holder unit () is fixed onto a detection surface of a touch panel (). Contact points () make contact with the detection surface of the touch panel () with their positional relationship corresponding to a function of the rotary switch (). A contact point () rotates while making contact with the detection surface of the touch panel (), as the rotation unit () rotates. 1. An operating tool comprising:a holder unit to be fixed onto a detection surface of a touch panel;a movable unit movably supported by the holder unit;a movable-unit-side contact point that is provided on the movable unit, and that moves, while making contact with the detection surface of the touch panel, as the movable unit moves; andmultiple holder-unit-side contact points that are provided on the holder unit, and that are to be in contact with the detection surface of the touch panel in a positional relationship of the holder-unit side contact points, the positional relationship corresponding to a function of the operating tool.2. The operating tool of claim 1 , whereinthe touch panel is a capacitance-type touch panel,the movable unit, the movable-unit-side contact point and the holder-unit-side contact points are formed of electrically-conductive members, andthe holder-unit-side contact points are electrically connected to the movable unit.3. The operating tool of claim 1 , comprising an operation unit that claim 1 , upon receiving operation claim 1 , causes a contact point for switching the function of the operating tool claim 1 , to make contact with the detection surface of the touch panel.4. An input device comprising:a display;a touch panel provided on a screen of the display in an overlapping manner;{'claim-ref': {'@idref': 'CLM-00001', 'claim 1'}, 'the operating tool of fixed onto a detection surface of the touch panel;'}a function determination unit to determine a function of the operating tool, on a ...

Virtual packaging and electronic gifting system and methodology

A method for electronic gifting while simulating the wrapping and unwrapping experience in the real world is provided. The method comprises creation of a virtual package, by a giver, for temporarily concealing a virtual gift icon from a recipient using a concealing overlay. The concealing overlay may comprise one or more components, at least one of which forms a temporary barrier layer over the gift icon for temporarily concealing it. The gift icon is representative of any gifitable asset. The method also enables the recipient to interact with the virtual package for removing at least a portion of the concealing overlay from the virtual package for revealing the gift icon. A system implementing the method is also provided. The system comprises modules which enables the giver to create the virtual package and the recipient to interact with the virtual package.

PAIR OF KEYBOARD/MOUSE GLOVES AND CONTROL METHOD THEREOF

The present disclosure relates to a pair of keyboard/mouse gloves and a control method thereof, where the pair of keyboard/mouse gloves include a left-handed keyboard/mouse glove and a right-handed keyboard/mouse glove that are matched for use and have a same structure, a glove body, a control chip, a plurality of sensor groups, and a display. The sensor group is disposed inside the glove body and respectively sleeved on each finger, and the sensor groups are connected to the control chip after being connected to each other through a data communication line. The control chip receives a single signal or a signal combo from each sensor group for key position analysis, and transmits a key position analysis result to the display for display. 1. A pair of keyboard/mouse gloves , comprising a left-handed keyboard/mouse glove and a right-handed keyboard/mouse glove that are matched for use and have a same structure , wherein the pair of keyboard/mouse gloves comprise a glove body , a control chip , a plurality of sensor groups , and a display;the sensor group comprises a pressure sensor and at least two displacement sensor groups, wherein the sensor group is disposed inside the glove body and located at each finger, the pressure sensor is disposed at a fingertip of each finger, the displacement sensor group is disposed at a joint of each finger, the pressure sensor and the displacement sensor group, two displacement sensor groups, and two adjacent sensor groups are respectively connected to each other through a data communication line, and the plurality of sensor groups are connected to the control chip after being connected to each other;the displacement sensor group comprises an arch-shaped elastic ring, a silicone ring, and four displacement sensors, wherein the four displacement sensors are equidistantly, circumferentially and evenly distributed on an outer wall of the arch-shaped elastic ring, two adjacent displacement sensors are connected to each other through the ...