INTERACTIVE PROJECTION EFFECT AND ENTERTAINMENT SYSTEM

Various embodiments herein include systems, methods, and software for an entertainment projection device. In addition to projecting entertainment content, the projection device includes a camera for capturing user motion and a graphical display that is arranged to be altered in response to detection of user motion as captured by the camera. Two or more systems may also be used to display a continuous image, such as in projecting streaming video. The entertainment projection device may be a standalone device, or may be in a self-contained light fixture replacement that provides ambient room light or an interactive RGB projection.

Image display that moves physical objects and causes tactile sensation

An image display including a touch-sensitive display, that creates tactile sensation and movement of an object (3-2) along its surface is provided. Actuators including conductive rods (4-111, 4-112) attached together may be used, such that each rod of the actuator (4-11) may increase or decrease in size when current is applied to that rod to cause the actuator to bend toward a specified direction. Also, an image display that includes ball bearings (1-10) whose rotation is controlled by driving magnets (1-21, 1-22) to cause an object to move is provided. Further, air holes (3-11) tilted in various directions to control object movement by air pressure may be provided. Moreover, rods (3-10) may be moved up or down as activated by driving magnets (2-20). The actuators, rods, ball bearing assemblies, or holes may provide touch sensitivity for the image display.

SYSTEM WITH WEARABLE SENSOR FOR DETECTING EEG RESPONSE

A system in which a head-mountable wearable device detects a real-time electroencephalographic (EEG) response from a user while the user is performing an activity or exposed to an external stimulus in a real-world (non-clinical) setting. The wearable device performs on-board processing of a detected EEG signal to enable efficient data wireless transfer to a processing unit (e.g. on a smartphone or the like). The processing unit transforms the EEG signal in real time into a meaningful indicator of current mental state, and presents indicator to the user, e.g. in a form able to improve their performance of the activity, promote complementary activities or to enhance or alter their mental state.

System and method for detecting three dimensional gestures to initiate and complete the transfer of application data between networked devices

An apparatus and method for detecting a three-dimensional gesture are provided. The method includes detecting, by at least one three dimensional motion sensing input device embedded in a network having a plurality of interconnected hardware, a three dimensional gesture of a user, selecting, based on the detected gesture, application data corresponding to an application being executed, stored or displayed on a first device in the network to be transmitted to a second device in the network, transmitting the selected application data to hardware and software associated with the second device, and performing at least one of executing, storing or displaying the selected application data on the second device, wherein the at least one three dimensional motion sensing input device comprises gesture detection hardware and software. 4889732_1 (GHMatters) P95514.AU 211 1/13 rH rH ...

IMAGE DISPLAY THAT MOVES PHYSICAL OBJECTS AND CAUSES TACTILE SENSATION

An image display including a touch-sensitive display, that creates tactile sensation and movement of an object (3-2) along its surface is provided. Actuators including conductive rods (4-111, 4-112) attached together may be used, such that each rod of the actuator (4-11) may increase or decrease in size when current is applied to that rod to cause the actuator to bend toward a specified direction. Also, an image display that includes ball bearings (1-10) whose rotation is controlled by driving magnets (1-21, 1-22) to cause an object to move is provided. Further, air holes (3-11) tilted in various directions to control object movement by air pressure may be provided. Moreover, rods (3-10) may be moved up or down as activated by driving magnets (2-20). The actuators, rods, ball bearing assemblies, or holes may provide touch sensitivity for the image display.

SYSTEM AND METHOD FOR DETECTING THREE DIMENSIONAL GESTURES TO INITIATE AND COMPLETE THE TRANSFER OF APPLICATION DATA BETWEEN NETWORKED DEVICES

An apparatus and method for detecting a three-dimensional gesture are provided. The method includes detecting, by at least one three dimensional motion sensing input device embedded in a network having a plurality of interconnected hardware, a three-dimensional gesture of a user, selecting, based on the detected gesture, application data corresponding to an application being executed, stored or displayed on a first device in the network to be transmitted to a second device in the network, transmitting the selected application data to hardware and software associated with the second device, and performing at least one of executing, storing or displaying the selected application data on the second device, wherein the at least one three dimensional motion sensing input device comprises gesture detection hardware and software.

CONTENT GENERATION FOR INTERACTIVE VIDEO PROJECTION SYSTEMS

Various embodiments herein include systems, methods, and software for interactive video projection system content generation. Such content is content consumed by a system that projects a scene view on a surface, such as a wall, screen, or floor, and is interactive with user motion. User motion is captured as input via a camera or other imaging device and processed on a computing device to determine where in a projected scene a user is moving. The scene is then modified based on the detected motion. A user generates content for consumption in such embodiments by providing image and variable input to populate a graphical rendering template when rendered for presentation to a user.

METHOD, APPARARUS AND WEARABLE APPARATUS FOR AUTOMATICALLY REMINDING USER TO SLEEP

In the present invention, information about daily activities is acquired, cumulative intensity of present-day activities is calculated, the required sleeping duration is calculated based on the cumulative intensity of the present-day activities and the functional relationship between the cumulative intensity of the daily activities and the sleeping duration, a set waking alarm clock time is acquired, the user's starting bedtime is calculated by using the waking alarm clock time and the required sleeping duration of the user, and the user is reminded to sleep when the starting bedtime is reached. The user is reminded in advance by analyzing the daily activities and records to determine the optimal sleeping duration.

CONTENT GENERATION FOR INTERACTIVE VIDEO PROJECTION SYSTEMS

Various embodiments herein include systems, methods, and software for interactive video projection system content generation. Such content is content consumed by a system that projects a scene view on a surface, such as a wall, screen, or floor, and is interactive with user motion. User motion is captured as input via a camera or other imaging device and processed on a computing device to determine where in a projected scene a user is moving. The scene is then modified based on the detected motion. A user generates content for consumption in such embodiments by providing image and variable input to populate a graphical rendering template when rendered for presentation to a user.

CONTENT GENERATION FOR INTERACTIVE VIDEO PROJECTION SYSTEMS

Various embodiments herein include systems, methods, and software for interactive video projection system content generation. Such content is content consumed by a system that projects a scene view on a surface, such as a wall, screen, or floor, and is interactive with user motion. User motion is captured as input via a camera or other imaging device and processed on a computing device to determine where in a projected scene a user is moving. The scene is then modified based on the detected motion. A user generates content for consumption in such embodiments by providing image and variable input to populate a graphical rendering template when rendered for presentation to a user.

DISPLAY APPARATUS WITH MOTION SENSING SWITCH

MOTION RECOGNITION BASED AUTOMOBILE TRIAL DRIVING CONTROL DEVICE AND METHOD THEREOF

The present invention relates to an automobile trial driving training system, and more specifically, to a device and method for controlling attachments included in the automobile trial driving training system by recognizing finger motions of a driver. An automobile trial driving control device of the present invention, comprises: a motion recognition part which recognizes the number of fingers and finger motions from finger images of a driver; a storage part in which attachment control instructions are mapped by the number of recognized fingers and the finger motions of the recognized numbers; and a control part which controls the attachments included in the automobile trial driving training system or requires control thereof by reading the attachment control instructions mapped for the number of recognized fingers and the finger motions. COPYRIGHT KIPO 2016 (100) Motion recognition sensor (Three-dimensional photographing part) (210) First filtering part (220) Finger number recognition ...

DISPLAY DEVICE EQUIPPED WITH MOTION DETECTION SENSOR

The present invention relates to a display device which is driven by a motion detection sensor, and more specifically, to a display device in which power, volume, channels, and the like are adjusted by a motion detection sensor. The display device according to the present invention comprises: a display unit which displays an image; a support stand which supports the display unit; a power supply unit which supplies power to the display unit; a motion detection sensor which is provided on the edge of the display unit, and senses a motion signal of an object in a non-contact state; and a main control unit which controls the display unit based on the sensed signal from the motion detection sensor. In this situation, the motion detection sensor is provided towards the outer surface of the display unit so as to sense a signal operating on the outer surface of the display unit. According to the present invention, since an edge frame portion including the bezel of a display unit and the like is ...

System and method for detecting three dimensional gestures to initiate and complete the transfer of application data between networked devices

An apparatus and method for detecting a three-dimensional gesture are provided. The method includes detecting, by at least one three dimensional motion sensing input device embedded in a network having a plurality of interconnected hardware, a three-dimensional gesture of a user, selecting, based on the detected gesture, application data corresponding to an application being executed, stored or displayed on a first device in the network to be transmitted to a second device in the network, transmitting the selected application data to hardware and software associated with the second device, and performing at least one of executing, storing or displaying the selected application data on the second device, wherein the at least one three dimensional motion sensing input device comprises gesture detection hardware and software.

Electronic device, keyboard, and electronic device assembly

An electronic device includes a keyboard. The keyboard includes a base plate and keys disposed on a base plate. The base plate includes a back support plate, a membrane, and a backlight plate. The membrane and the backlight plate are disposed on two sides of the back support plate. The back support plate supports the membrane, the backlight plate, and the keys. In addition, a buffer structure is disposed on a surface of a side that is of the backlight plate and that faces the key. The back support plate is provided with a first through hole. The key is disposed on a side that is of the membrane and that is away from the back support plate. A protrusion is disposed on a side that is of the key and that faces the base plate. The key moves toward the base plate. The protrusion can press the buffer structure.

LIGHT EMITTING DEVICE AND KEYBOARD STRUCTURE

A light emitting device and a keyboard structure are provided. The light emitting device includes a circuit board and multiple light emitting units. The circuit board includes a substrate, a first conductive pad, multiple second conductive pads, and multiple third conductive pads. The first conductive pad and the second conductive pads are disposed on a first board surface of the substrate. The first conductive pad has a symmetrical shape and a symmetrical axis. The symmetrical axis passes through the second conductive pads. The third conductive pads are disposed on a second board surface of the substrate. Each of the third conductive pads is electrically coupled to the first conductive pad and the second conductive pads by multiple conductive columns. Each of the light emitting units is connected to the first conductive pad and one of the second conductive pads.

Content generation for interactive video projection systems

Various embodiments herein include systems, methods, and software for interactive video projection system content generation. Such content is content consumed by a system that projects a scene view on a surface, such as a wall, screen, or floor, and is interactive with user motion. User motion is captured as input via a camera or other imaging device and processed on a computing device to determine where in a projected scene a user is moving. The scene is then modified based on the detected motion. A user generates content for consumption in such embodiments by providing image and variable input to populate a graphical rendering template when rendered for presentation to a user.

IMAGE DISPLAY THAT MOVES PHYSICAL OBJECTS AND CAUSES TACTILE SENSATION

An image display including a touch-sensitive display, that creates tactile sensation and movement of an object (3-2) along its surface is provided. Actuators including conductive rods (4-111, 4-112) attached together may be used, such that each rod of the actuator (4-11) may increase or decrease in size when current is applied to that rod to cause the actuator to bend toward a specified direction. Also, an image display that includes ball bearings (1-10) whose rotation is controlled by driving magnets (1-21, 1-22) to cause an object to move is provided. Further, air holes (3-11) tilted in various directions to control object movement by air pressure may be provided. Moreover, rods (3-10) may be moved up or down as activated by driving magnets (2-20). The actuators, rods, ball bearing assemblies, or holes may provide touch sensitivity for the image display.

For interactive video projection system for content of the

Synchronized dual eye variable refresh rate update for VR display

This disclosure provides systems, devices, apparatus, and methods, including computer programs encoded on storage media, for synchronized dual eye variable refresh rate update for a VR display. A display processor obtains an indication of a synchronous flush or an asynchronous flush with respect to a first DPU and/or a second DPU. The display processor determines whether a first flush operation and/or a second flush operation is available at a time instance, where the first flush operation and the second flush operation are associated with the first DPU and/or the second DPU. The display processor performs, based on a VSync instance, the first flush operation and/or the second flush operation based on whether the first flush operation and/or the second flush operation are available at the time instance and based on the indication of the synchronous flush or the asynchronous flush.

CONTENT GENERATION FOR INTERACTIVE VIDEO PROJECTION SYSTEMS

Various embodiments herein include systems, methods, and software for interactive video projection system content generation. Such content is content consumed by a system that projects a scene view on a surface, such as a wall, screen, or floor, and is interactive with user motion. User motion is captured as input via a camera or other imaging device and processed on a computing device to determine where in a projected scene a user is moving. The scene is then modified based on the detected motion. A user generates content for consumption in such embodiments by providing image and variable input to populate a graphical rendering template when rendered for presentation to a user.

Content generation for interactive video projection systems

IMAGE DISPLAY THAT MOVES PHYSICAL OBJECTS AND CAUSES TACTILE SENSATION

An image display including a touch-sensitive display, that creates tactile sensation and movement of an object (3-2) along its surface is provided. Actuators including conductive rods (4-111, 4-112) attached together may be used, such that each rod of the actuator (4-11) may increase or decrease in size when current is applied to that rod to cause the actuator to bend toward a specified direction. Also, an image display that includes ball bearings (1-10) whose rotation is controlled by driving magnets (1-21, 1-22) to cause an object to move is provided. Further, air holes (3-11) tilted in various directions to control object movement by air pressure may be provided. Moreover, rods (3-10) may be moved up or down as activated by driving magnets (2-20). The actuators, rods, ball bearing assemblies, or holes may provide touch sensitivity for the image display.

Image display that moves physical objects and causes tactile sensation

An image display including a touch-sensitive display, that creates tactile sensation and movement of an object (3-2) along its surface is provided. Actuators including conductive rods (4-111, 4-112) attached together may be used, such that each rod of the actuator (4-11) may increase or decrease in size when current is applied to that rod to cause the actuator to bend toward a specified direction. Also, an image display that includes ball bearings (1-10) whose rotation is controlled by driving magnets (1-21, 1-22) to cause an object to move is provided. Further, air holes (3-11) tilted in various directions to control object movement by air pressure may be provided. Moreover, rods (3-10) may be moved up or down as activated by driving magnets (2-20). The actuators, rods, ball bearing assemblies, or holes may provide touch sensitivity for the image display.

DISPLAY APPARATUS EQUIPPED WITH MOTION DETECTION SENSOR

Disclosed is a display apparatus which is driven by a motion detection sensor, and more particularly, to a display apparatus in which power, volume, channel or the like are controlled by a motion detection sensor. The display apparatus of the present invention includes a display part which displays an image; a support stand which supports the display part; a power source which supplies power to the display part; a motion detection sensor which is installed at an edge surface of the display part so as to detect an operation signal of an object in a contactless manner; and a main control part which controls the display part based on a detection signal from the motion detection sensor, wherein the motion detection sensor is installed so as to be oriented toward an outer surface of the display part, thereby detecting a motion signal at the outer surface of the display part. According to the present invention, since the frame part such as a bezel of the display part is not needed, the display ...

Image display that moves physical objects and causes tactile sensation

An image display including a touch-sensitive display, that creates tactile sensation and movement of an object (3-2) along its surface is provided. Actuators including conductive rods (4-111, 4-112) attached together may be used, such that each rod of the actuator (4-11) may increase or decrease in size when current is applied to that rod to cause the actuator to bend toward a specified direction. Also, an image display that includes ball bearings (1-10) whose rotation is controlled by driving magnets (1-21, 1-22) to cause an object to move is provided. Further, air holes (3-11) tilted in various directions to control object movement by air pressure may be provided. Moreover, rods (3-10) may be moved up or down as activated by driving magnets (2-20). The actuators, rods, ball bearing assemblies, or holes may provide touch sensitivity for the image display.

Automatically remind the user to sleep method, system and can be worn equipment

Multidirectional controller with shear feedback

A multidirectional control system with shear feedback, comprising at least one stationary body, a plurality of tactors disposed within the at least one movable body or the at least one stationary body. In some embodiments, a moveable body is included, such that the tactors have at least one degree of freedom of motion with respect to the stationary body or the moveable body within which they are disposed and are operable to engage target areas of a user's skin; and a plurality of actuators capable of moving the tactors.

Contextual help based on facial recognition

A computer program product includes a computer readable storage medium to store a computer readable program, wherein the computer readable program, when executed on a computer, causes the computer to perform operations for providing contextual help based on a user facial expression. The operations include: capturing a user facial expression using a camera device connected to a computing device; categorizing the user facial expression into a facial expression category; collecting an application context from the computing device in conjunction with an application, wherein the application context includes a recently performed task and a current application state, wherein the current application state comprises information on a current performance of an application in which the user is operating; determining a set of available tasks relating to the application context; and automatically executing one of the set of available tasks based on the facial expression category and the application context.

Multiple Actuation Handheld Device

A device includes a housing, a processor that is coupled to the housing, the processor is configured to process a software program stored in a memory. A touch screen is coupled to the housing and configured to display graphical objects, wherein a sensor signal associated with a user's interaction with the touch screen is provided to the processor. A first actuator is coupled to the touch screen and positioned within the housing. The first actuator is configured to output a first haptic effect to the touch screen upon receiving a first activating signal from the processor. A second actuator is coupled to the housing and configured to output a second haptic effect to the housing upon receiving a second activating signal from the processor. The first activating signal is associated with a foreground event and the second activating signal is associated with a background event occurring in the software program.

System, method, and recording medium for controlling an object in virtual world

A system and method of controlling characteristics of an avatar in a virtual world may generate avatar control information based on avatar information of the virtual world and a sensor control command expressing a user intent using a sensor-based input device.

Apparatus and method for generating sensory vibration

In an image display apparatus for outputting a vibration with a sense of realism and an realistic sense and a method for adjusting an intensity of vibration for implementing a vibration with sense of realism and an realistic sense, a user of the image display apparatus can directly recognize (experience) a situation happened on a space formed by a screen by virtue of the vibration with the sense or presence and the realistic sense, output in association with an effect of a displayed image, and also can feel more the sense of realism and the realistic sense from the situation in the game or a virtual reality.

Audio/Visual Device User Interface with Tactile Feedback

A user interface for an audio/visual device includes a touch sensor in which the touch sensor is vibrated by an actuator coupled thereto to provide a user with a virtual texture for a corresponding menu on which the user is provided with the impression that menu item have textures, where the menu may extend about the periphery of a display element so as to at least partially surround a display area in which a visual portion of an audio/visual program may be played and possibly in a manner corresponding to how a surface defined on the touch sensor at least partially surrounds another manually-operable control.

System and Method for Augmented and Virtual Reality

One embodiment is directed to a system for enabling two or more users to interact within a virtual world comprising virtual world data, comprising a computer network comprising one or more computing devices, the one or more computing devices comprising memory, processing circuitry, and software stored at least in part in the memory and executable by the processing circuitry to process at least a portion of the virtual world data; wherein at least a first portion of the virtual world data originates from a first user virtual world local to a first user, and wherein the computer network is operable to transmit the first portion to a user device for presentation to a second user, such that the second user may experience the first portion from the location of the second user, such that aspects of the first user virtual world are effectively passed to the second user.

System and method for providing haptic feedback from haptic textile

A system includes a haptic textile comprising a plurality of haptic threads configured to provide haptic feedback, and an ancillary electronic device configured to transfer data to or from the haptic textile.

Electroactive polymer transducers for tactile feedback devices

Electroactive transducers as well as methods of producing a haptic effect in a user interface device simultaneously with a sound generated by a separately generated audio signal and electroactive polymer transducers for sensory feedback applications in user interface devices are disclosed.

Electronic device, image display system, and image selection method

The electronic device includes an image-capturing unit that captures an image of a subject, and generates image data, a sensor unit that detects a physical quantity given by a user, a calculation unit that calculates a score representing an emotional state of the user based on the physical quantity detected by the sensor unit, a storage unit that stores in association with the image data generated by the image-capturing unit and the score calculated by the calculation unit, and a selection unit that selects the image data based on the score stored in the storage unit.

Force feedback system including multi-tasking graphical host environment and interface device

A force feedback system provides components for use in a force feedback system including a host computer and a force feedback interface device. An architecture for a host computer allows multi-tasking application programs to interface with the force feedback device without conflicts, where a single active application may output forces. A background application also provides force effects to be output and allows a user to assign force effects to graphical objects in a graphical user interface. Force feedback effects and structures are further described, such as events and enclosures.

Context-dependent haptic confirmation system

A haptic confirmation system is provided that produces a confirmation haptic effect in response to a user interaction with a user interface element, where the confirmation haptic effect is based on context metadata. The context metadata is mapped to one or more haptic parameters. A haptic signal is generated based on the one or more haptic parameters. The haptic signal is sent to an actuator configured to receive the haptic signal. The actuator utilized the haptic signal to generate the confirmation haptic effect.

Quantifying frustration via a user interface

Implementations and techniques for quantifying frustration via a user interface are generally disclosed.

Wearable communication platform

An wearable communications garment that includes one or more user-selectable inputs integrated into the garment. A sartorial communications apparatus may include a flexible material that is worn (e.g., as an undergarment) by the user and includes one or more interactive sensors that may be manually activated by a user, even through one or more intervening layers of clothing. The apparatus may also include one or more additional body sensors configured to sense a user's position, movement, and/or physiological status. The sensor(s) may be connected via a conductive trace on the garment to a sensor module for analysis and/or transmission. Methods of manufacturing the garments as well as methods of using the garments are also described.

VEHICULAR NOTIFICATION APPARATUS

A vehicular notification apparatus detects an emotion of a driver based on a line-of-sight detection result and a brain activity detection result, and performs control to suppress notification in response to that the detected emotion of the driver is uncomfortable. 1. A vehicular notification apparatus , comprising:a line-of-sight detector configured to detect a line of sight of a driver of a vehicle to provide a line-of-sight detection result;a brain activity detector configured to detect a brain activity of the driver to provide a brain activity detection result; and (i) to determine whether a notification-required condition occurs;', '(ii) to detect an emotion of the driver based on the line-of-sight detection result and the brain activity detection result, and', '(iii) to perform control so as to suppress notification in response to that the detected emotion of the driver is uncomfortable,, 'the controller configured'}, 'at least one controller connected with the line-of-sight detector and the brain activity detector via a communication line,'}wherein the controller is configured to detect the emotion of the driver in response to that a notification is performed,wherein in response to that the detected emotion is uncomfortable and a cause of being uncomfortable is undetermined, the controller is configured to issue an inquiry about the cause of being uncomfortable to the driver,wherein in response to issuing the inquiry and then receiving an answer indicating that the cause of being uncomfortable is an intention of the driver , the controller is configured to reduce a frequency of inquiries if the frequency of inquiries is determined to be higher than a threshold value.2. A vehicular notification apparatus , comprising:a line-of-sight detector configured to detect a line of sight of a driver of a vehicle to provide a line-of-sight detection result;a brain activity detector configured to detect a brain activity of the driver to provide a brain activity detection ...

DETECTION OF HUMAN-MACHINE INTERACTION ERRORS

Disclosed are a system and method of detection of an interaction-error. The interaction-error is derived from an incorrect decision and is directed to interacting with a machine. During human-machine interaction, command related data values are obtained. Command related data values characterize any one of an interacting-command and an interacting-action. The command related data values are compared with command related reference data values, and an interaction-error is identified if a difference between the command related data values and the command related reference data values complies with a predefined criterion. 140-. (canceled)41. A human-machine interface system configured and operable to control the machine operation via monitoring cognitive brain commands of a user while operating the machine , wherein the human-machine interface system comprises:at least one sensor configured and operable to generate sensing data indicative of user's cognitive brain commands, anda computer processor configured for data communication with said at least one sensor, the computer processor being adapted to process said sensing data to identify, in said data indicative of user's cognitive brain commands, motor-command related data indicative of motor commands controlling the user interaction with the machine to perform one or more actions, wherein the computer processor comprises an error detector configured and operable to analyze the data indicative of motor-command related data and determine a relation of said motor command related data to command related reference data indicative of a condition of user's predicted error in his cognitive brain command, and upon identifying, based on the determined relation, that the motor command related data corresponds to said condition of user's predicted error in his cognitive brain command, generate and store data indicative of said predicted error condition, thereby enabling to carry out at least one of the following: (i) selectively ...

System and method for evaluation, detection, conditioning, and treatment of neurological functioning and conditions

A system and method for evaluation, detection, conditioning, and treatment of neurological functioning and conditions which uses data obtained while a person is engaged in simultaneously in a range of primary physical tasks combined with defined types of associative activity, such as listening, reading, speaking, mathematics, logic puzzles, navigation of a virtual environment, recall of past stimuli, etc. The data from the physical and associative activities are combined to generate a composite functioning score visualization indicating the relative functioning of areas aspects of neurological functioning; including those in which deficiencies may be present, which are early indicators of possible neurological conditions. Through algorithmic recommendations combined with expert and user input, a conditioning regimen targeting neurological aspects of interest paired with periodic testing allows the user to track their progress in these areas over time.

PROCESSING SYSTEM AND METHOD

A system and method of processing information relating to a user state, the method comprising determining a state of a user and affecting one or more elements external to the user in dependence on the user state, wherein the user state is determined from user biometric data in combination with user online activity. 1. A method of processing information relating to a user state , the method comprising:determining a state of a user; andaffecting one or more elements external to the user according to the determined user state,wherein the user state is determined from user biometric data in combination with user online activity.2. The method of Claim 1 , wherein the user state is further determined from telemetry data.3. The method of or S Claim 1 , wherein user state comprises a mood.4. The method of claim 1 , wherein biometric data comprises one or more of: a galvanic skin response claim 1 , a blood pressure claim 1 , a heart rate (pulse) claim 1 , a pedometer count claim 1 , an optical skin and blood vessel dilation measurement claim 1 , a skin hydration measurement claim 1 , a blood glucose level claim 1 , a blood oxygen level claim 1 , a blood alcohol level claim 1 , an electrocardiogram claim 1 , an electroencephalogram claim 1 , an electromyogram claim 1 , a respiration rate claim 1 , a skin temperature claim 1 , a measure of stress claim 1 , a number of steps taken claim 1 , a measure of calories used claim 1 , a measure of activity claim 1 , a movement from an accelerometer claim 1 , a movement from a gyroscope claim 1 , a response to mechanical or electrical stimuli claim 1 , an environment temperature claim 1 , an ambient ultraviolet light level claim 1 , touch claim 1 , taste claim 1 , smell claim 1 , age claim 1 , weight claim 1 , height claim 1 , fitness level claim 1 , body-mass index claim 1 , appearance rating claim 1 , demographic data and an ambient COlevel.5. The method of claim 1 , wherein user online activity comprises one or more of: user calendar ...

Systems and Methods for Surface Elements that Provide Electrostatic Haptic Effects

One illustrative system disclosed herein includes a processor configured to determine an electrostatic force (ESF)-based haptic effect and transmit a haptic signal associated with the ESF-based haptic effect. The illustrative system also includes an ESF controller in communication with the processor, the ESF controller configured to receive the haptic signal, determine an ESF signal based at least in part on the haptic signal, and transmit the ESF signal. The illustrative system further includes a surface configured to contact a user, and an ESF device coupled to the surface and in communication with the ESF controller, the ESF device configured to receive the ESF signal and output the ESF-based haptic effect on the surface. 1. A system comprising: determine an electrostatic force (ESF)-based haptic effect; and', 'transmit a haptic signal associated with the ESF-based haptic effect;, 'a processor configured to receive the haptic signal,', 'determine an ESF signal based at least in part on the haptic signal, and', 'transmit the ESF signal;, 'an ESF controller in communication with the processor, the ESF controller configured toa surface configured to contact a user; andan ESF device coupled to the surface and in communication with the ESF controller, the ESF device configured to receive the ESF signal and output the ESF-based haptic effect on the surface.2. The system of claim 1 , wherein the surface is associated with an article configured to be worn by the user.3. The system of claim 2 , wherein the article comprises one of: a sleeve claim 2 , a watch claim 2 , an article of clothing claim 2 , a hat claim 2 , a jacket claim 2 , gloves claim 2 , a ring claim 2 , jewelry claim 2 , a collar claim 2 , or glasses.4. The system of claim 1 , wherein the surface is associated with a manipulable device.5. The system of claim 4 , wherein the manipulable device is configured to be held claim 4 , grasped claim 4 , a standalone device claim 4 , or a component of a device.6. The ...

Systems and Methods for Multi-Output Electrostatic Haptic Effects

One illustrative system disclosed herein includes a processor configured to determine a haptic effect, wherein the haptic effect includes a static ESF effect or a confirmation ESF effect; and transmit a haptic signal associated with the haptic effect. The illustrative system also includes an ESF controller in communication with the processor, the ESF controller configured to receive the haptic signal, determine an ESF signal based at least in part on the haptic signal, and transmit the ESF signal. The illustrative system further includes an ESF device in communication with the ESF controller, the ESF device including an ESF cell and configured to receive the ESF signal and output the haptic effect. 1. A system comprising: determine a haptic effect, wherein the haptic effect comprises a static ESF effect or a confirmation ESF effect; and', 'transmit a haptic signal associated with the haptic effect;, 'a processor configured to receive the haptic signal,', 'determine an ESF signal based at least in part on the haptic signal, and', 'transmit the ESF signal; and, 'an ESF controller in communication with the processor, the ESF controller configured toan ESF device in communication with the ESF controller, the ESF device comprising an ESF cell and configured to receive the ESF signal and output the haptic effect.2. The system of claim 1 , wherein the ESF device comprises a plurality of ESF cells.3. The system of claim 2 , wherein the plurality of ESF cells comprise nine ESF cells configured in a three-by-three matrix.4. The system of claim 2 , wherein the plurality of ESF cells comprise interlocking ESF cells.5. The system of claim 1 , wherein the ESF signal comprises a plurality of sinusoids with varying frequencies.6. The system of claim 1 , further comprising a second ESF device claim 1 , and wherein determining the haptic effect comprises determining a different ESF signal for each ESF device.7. The system of claim 1 , wherein the ESF device is coupled to a ...

Systems and Methods for Transmitting Haptic Messages

Systems and methods for transmitting haptic messages are disclosed. For example, one disclosed method includes the steps of: receiving at least one sensor signal from at least one sensor of a mobile device, the at least one sensor signal associated with a movement of the mobile device, determining a message to be displayed in a user interface based at least in part on the at least one sensor signal, and causing the message to be displayed.

System and method for continual decoding of brain states to multi-degree-of-freedom control signals in hands free devices

A brain-machine interface system configured to decode neural signals to control a target device includes a sensor to sample the neural signals, and a computer-readable storage medium having software instructions, which, when executed by a processor, cause the processor to transform the neural signals into a common representational space stored in the system, provide the common representational space as a state representation to inform an Actor recurrent neural network policy of the system, generate and evaluate, utilizing a deep recurrent neural network of the system having a generative sequence decoder, predictive sequences of control signals, supply a control signal to the target device to achieve an output of the target device, determine an intrinsic biometric-based reward signal, from the common representational space, based on an expectation of the output of the target device, and supply the intrinsic biometric-based reward signal to a Critic model of the system.

SYSTEMS AND METHODS OF GENERATING CONSCIOUSNESS AFFECTS USING ONE OR MORE NON-BIOLOGICAL INPUTS

A method of generating a consciousness affect is described. The method includes: (i) receiving a consciousness input originating from one or more users associated with a client device; (ii) receiving a non-biological input not originating from one or more of the users and the non-biological input originating from a device or a module; (iii) calculating, using a server and/or the client device and based on the consciousness input and the non-biological input, a consciousness affect for one or more of the users; (iv) storing, in memory of the server and/or the client device, the consciousness affect; and wherein said consciousness input includes at least one input chosen from a group comprising emotional state input, reasoned input, location information input, physical awareness input and spiritual insight input, and said non-biological input is at least one input chosen from a group comprising emotional state input, reasoned input, location information input, physical awareness input and synchronicity input. 1. A method of generating a consciousness affect , said method comprising:receiving a consciousness input originating from one or more users associated with a client device;receiving a non-biological input not originating from one or more of said users and said non-biological input originating from a device or a module;calculating, using a server and/or said client device and based on said consciousness input and said non-biological input, a consciousness affect for one or more of said users;storing, in memory of said server and/or said client device, said consciousness affect; andwherein said consciousness input includes at least one input chosen from a group comprising emotional state input, reasoned input, location information input, physical awareness input and spiritual insight input, and said non-biological input is at least one input chosen from a group comprising emotional state input, reasoned input, location information input, physical awareness input ...

SYSTEMS AND METHODS FOR PRESENTING INTERMEDIARIES

A system that incorporates teachings of the present disclosure may include, for example, an intermediary engine having a controller, and a storage medium for storing instructions to be executed by the controller. The instructions, when executed by the controller, can cause the controller to receive a measure of a mood of an individual, invoke an intermediary according to the measure of the mood of the individual, and present the intermediary to an entity requesting to interact with the individual. The measure of the mood can be synthesized from collected information associated with a behavior of the individual, and can have a plurality of dimensions. The mood can also indicate an availability of the individual and a receptiveness of the individual to accept a request to interact with an entity. Other embodiments are disclosed. 1. A device , comprising:an intermediary engine;a processing system including a processor; anda memory that stores executable instructions that, when executed by the processing system, facilitate performance of operations, comprising:receiving a measure of a mood of an individual, wherein the measure of the mood is synthesized from changes that are identified in collected information associated with a behavior of the individual, wherein the collected information includes one of media content consumed by the individual, images of the individual captured by a group of cameras at a plurality of locations, audio recordings of the individual captured by a plurality of end user devices or a combination thereof, wherein the mood indicates an availability of the individual and a receptiveness of the individual to accept a request to interact with an entity, wherein the measure of the mood includes a group of dimensions comprising a first dimension identifying a plurality of metaphor expressions to express the mood of the individual to interact with the entity, a second dimension identifying a plurality of techniques to disclose activities of the ...

SYSTEMS AND METHODS FOR A LOW PROFILE HAPTIC ACTUATOR

Systems and methods or a low profile haptic actuator are disclosed. In one embodiment, a system for a low profile haptic actuator includes: a moveable surface comprising a first coil, the moveable surface configured to move in a degree of freedom; a fixed surface beneath the moveable surface, the fixed surface comprising a second coil coupled underneath the first coil; a suspension coupled to the fixed surface and the moveable surface and configured to suspend the moveable surface; and a controller coupled to the first coil and the second coil. 1. A system for a low profile haptic actuator comprising:a flexible surface comprising two or more first coils, the flexible surface configured to move in at least one degree of freedom;a fixed surface associated with the flexible surface, the fixed surface comprising two or more second coils coupled adjacent to the two or more first coils; anda controller electrically coupled to the two or more first coils and the two or more second coils, the controller configured to apply current to one of the two or more first coils and one of the two or more second coils without applying current to others of the two or more first coils and two or more second coils.2. The system of claim 1 , wherein the flexible surface comprises a touch sensitive interface configured to detect user interaction.3. The system of claim 1 , wherein the flexible surface further comprises a ferrite material.4. The system of claim 3 , wherein the controller is configured to detect a change in inductance in one or more of the second coils claim 3 , wherein the change in inductance is associated with one or more of movement of the flexible surface or pressure applied to the flexible surface.5. The system of claim 1 , wherein the controller is configured to apply current to one or both of the two or more first coils and the two or more second coils.6. The system of claim 5 , wherein the controller is configured to determine a haptic effect and wherein the current ...

Systems and Methods for Providing Haptic Feedback Via a Case

One illustrative system disclosed herein includes a case configured to mechanically couple with a mobile device and position the mobile device such that the mobile device serves as a display for the case. The system also includes a processor coupled to the case and configured to generate a haptic signal based at least in part on a characteristic of the case. The system also includes a haptic output device in communication with the processor and configured to receive the haptic signal and output a haptic effect in response to the haptic signal.

Apparatus and method for motor imagery classification using eeg

The present disclosure relates to an apparatus and method for motor imagery classification using electroencephalography (EEG), and more particularly, to an apparatus and method for motor imagery classification that extracts features in different domains included in EEG signals generated during motor imagery in real time and classifies a user's intentions using the features.

METHODS AND APPARATUS FOR MULTI-TASK RECOGNITION USING NEURAL NETWORKS

Methods and apparatus for multi-task recognition using neural networks are disclosed. An example apparatus includes a filter engine to generate a facial identifier feature map based on image data, the facial identifier feature map to identify a face within the image data. The example apparatus also includes a sibling semantic engine to process the facial identifier feature map to generate an attribute feature map associated with a facial attribute. The example apparatus also includes a task loss engine to calculate a probability factor for the attribute, the probability factor identifying the facial attribute. The example apparatus also includes a report generator to generate a report indicative of a classification of the facial attribute. 1. An apparatus to perform multi-task recognition comprising:a filter engine to generate a facial identifier feature map based on image data, the facial identifier feature map to identify a face within the image data;a sibling semantic engine to process the facial identifier feature map to generate an attribute feature map associated with a facial attribute;a task loss engine to calculate a probability factor for the attribute, the probability factor identifying the facial attribute; anda report generator to generate a report indicative of a classification of the facial attribute.2. The apparatus of claim 1 , wherein the filter engine to generate the facial identifier map using a phase-convolution engine claim 1 , a phase-residual engine and an inception-residual engine.3. The apparatus of claim 1 , wherein the sibling semantic engine to generate the attribute feature map using at least one of a face semantic engine claim 1 , a local-part semantic engine or a hybrid coupled semantic engine.4. The apparatus of claim 3 , wherein the face semantic engine to convolve the facial identifier feature map to identify at least gender or age.5. The apparatus of claim 4 , wherein the face semantic engine to convolve the facial identifier map ...

Subconscious estimation system, subconscious estimation method, and subconscious estimation program

The subconscious mind estimation system includes: an image display control unit 111 which causes an image display unit 13 to display first classification destination images 1211, 1212, 1213 , and 1214 , representing each of first type concepts and representing each of second type concepts, and first target images 1241 and 1251 , corresponding to one of the first type concept and the second type concept; an operation trajectory recognition unit 112 which recognizes a first operation trajectory via an operation detection unit 14 ; and a subconscious mind estimation unit 113 which estimates the subconscious mind of the subject S about a tie between the first type concept and the second type concept based on the first operation trajectory.

Electronic apparatus and method for controlling the electronic apparatus

An electronic apparatus is disclosed. The electronic apparatus includes an input unit configured to receive a user input, a storage configured to store a recognition model for recognizing the user input, a sensor configured to sense a surrounding circumstance of the electronic apparatus, and a processor configured to control to recognize the received user input based on the stored recognition model and to perform an operation corresponding to the recognized user input, and update the stored recognition model in response to determining that the performed operation is caused by a misrecognition based on a user input recognized after performing the operation and the sensed surrounding circumstance.

INTERACTION PERIPHERAL DEVICE CAPABLE OF CONTROLLING AN ELEMENT FOR TOUCHING AND GRASPING MULTIDIMENSIONAL VIRTUAL OBJECTS

An interaction peripheral device () capable of controlling an element for touching and grasping multidimensional virtual objects, including at least two interaction modules (), each interaction module () being intended to be actuated by a finger of an operator and including a control sensor allowing control of displacement, according to a predetermined number of degrees of freedom, of a portion of the element for touching and grasping virtual objects by bending/extending and/or adduction/abduction displacement of the finger of the operator, and a vibrator able to emit a vibration upon touching and/or letting go of a virtual object by a portion of said element for touching and grasping virtual objects, characterized in that each interaction module () is attached to said peripheral device through a connection () in a damping material. 1. An interaction peripheral device capable of controlling an element for touching and grasping multidimensional virtual objects , including at least two interaction modules , each interaction module being intended to be actuated by a finger of an operator and including a control sensor with which a displacement may be controlled according to a predetermined number of degrees of freedom , of a portion of the element for touching and grasping of virtual objects , by bending/extending and/or adduction/abduction displacement of the finger of the operator and a vibrator able to emit a vibration upon touching and/or letting go of a virtual object by a portion of said element for touching and grasping virtual objects , wherein each interaction module is attached to said peripheral device through a connection in a damping material.2. The interaction peripheral device according to claim 1 , wherein said interaction modules are mounted with a spacing between them of at least one predetermined distance d.3. The interaction peripheral device according to claim 1 , comprising a structure in at least two portions claim 1 , capable of being attached ...

Method and system for virtual hiking

A virtual biking system and a virtual hiking method by which a user can bike indoors while simulating actually being outdoors are provided. The virtual hiking system includes a Personal Computer (PC) configured to display a simulation screen, a motion platform configured to move corresponding to a state of a road of the simulation screen displayed on the PC, and a bicycle fixed onto the motion platform such that the simulation screen is changed corresponding to a movement and a speed of a handle.

Reducing power consumed by a head-mounted system that measures affective response to content

Some aspects of this disclosure include systems, methods, and/or computer programs that may be used to reduce power consumed to measure affective response of a user to content presented via a display of a head-mounted system such as an augmented reality system or a virtual reality system. In one embodiment, a controller selects a mode of operation for a sensor coupled to the head-mounted system based on a received indication. The mode of operation is selected from a set comprising first and second modes of operation, and the sensor is configured to consume significantly less power while operating at the first mode of operation compared to the power it is configured to consume while operating at the second mode of operation. 1. A head-mounted system , comprising:a display configured to present segments of content to a user;a sensor configured to measure affective response of the user to the segments of content; anda controller configured to receive an indication indicating a mode of operation for the sensor from among a set comprising first and second modes of operation, and to configure the sensor to operate in the indicated mode of operation; wherein the sensor consumes at least 50% less power while operating at the first mode of operation compared to the power it consumes while operating at the second mode of operation.2. The head-mounted system of claim 1 , further comprising a processor configured to generate the segments of content as part of an interactive computer game claim 1 , and to generate the indication; wherein the indication is provided in a form of a tag that describes a mode of operation in which to operate the sensor while the user consumes a certain segment of content.3. The head-mounted system of claim 1 , wherein the indication is received from a content emotional response analyzer (content ERA) configured to: receive a segment of content claim 1 , analyze the segment claim 1 , and output an indication indicating whether a value related to an ...

METHOD AND SYSTEM FOR CUSTOMIZABLE FEEDBACK BASED ON DOMINANT MOVEMENT

In a method for customizable feedback based on dominant movement of a device, an application receives user action data from the device, determines a dominant movement based on the user action data and the plurality of movement thresholds, and determines a feedback associated with the dominant movement. The associated feedback is then performed. When the application determines that the user action data indicates one or more button presses, the feedback associated with the one or more buttons is determined, and the feedback associated with the one or more button presses is performed. When the user action data does not indicate any button presses, the application determines the dominant movement based on movement data in the user action data, the movement data indicating movement through space in one or more directions by the device. 1. A method for customizable feedback based on dominant movement of a device , implemented by a computer system , comprising:(a) synchronizing a device and an application implemented by the computer system, wherein a plurality of movement thresholds is associated with the application;(b) receiving user action data from the device, wherein the user action data indicates one or more user actions performed with or on the device;(c) determining a dominant movement based on the user action data and the plurality of movement thresholds;(d) determining a feedback associated with the dominant movement, wherein the feedback comprises one or more sensory activities to be performed by the device in response to a given user action; and(e) performing the associated feedback by the device or the computer system.2. The method of claim 1 , wherein the performing (e) comprises:(e1) when the associated feedback is to be performed by the device, sending, by the computer system, an interaction to the device to perform the associated feedback; and(e2) when the associated feedback is to be performed by the computer system, executing the associated feedback.3. ...

PREDICTIVE NAVIGATION SYSTEM

A method, computer system, and a computer program product for providing a personalized anxiety-reducing navigation system for a user utilizing augmented reality (AR) and virtual reality (VR) is provided. The present invention may include detecting a current location of the user. The present invention may then include, in response to detecting the current location of the user is beyond a comfort boundary threshold, determining a stress state of the user. The present invention may also activate an AR system. The present invention may further, in response to determining the determined stress state of the user is high, activate a VR system. 1. A method for providing a personalized anxiety-reducing navigation system for a user utilizing augmented reality (AR) and virtual reality (VR) , the method comprising:detecting a current location of the user;in response to detecting the current location of the user is beyond a comfort boundary threshold, determining a stress state of the user;activating an AR system; andin response to determining that the stress state of the user is high, obtaining a three-dimensional historical representation of the detected current location of the user and superimposing the obtained three-dimensional historical representation of the detected current location onto a visual field associated with the user by utilizing VR.2. The method of claim 1 , wherein detecting the current location of the user claim 1 , further comprises:obtaining a piece of feedback data from at least one biometric device and at least one Internet of Things (IoT) sensor.3. The method of claim 1 , further comprising:determining the comfort boundary threshold based on a history of interactions and a plurality of workflow experiments between the user and a caregiver associated with user.4. The method of claim 1 , wherein activating the AR system claim 1 , further comprises:alerting a caregiver associated with the user;superimposing a plurality of historical images on a visual ...

DISPLAY CASE

A display case includes a transparent LCD panel for viewing display case contents therethrough. 1. (canceled)2. A display case system for viewing a product through a transparent liquid crystal display (LCD) screen , the display case comprising:a housing arranged around a product display space;the screen outside a housing opening to provide a view into the product display space;a plurality of light emitting diode (LED) arrays within the product display space for backlighting the screen;a power supply responsive to control signals for selectively distributing electric power to one or more of the arrays;a local controller for electrically exchanging signals with the power supply and a sensor;the sensor for triggering operation of the screen when a patron whose direction of motion brings them closer to the display case is recognized by the sensor;a multimedia patron immersion function;tasks implementing the function include patron assessment, scene creation, scene delivery, and a response to patron feedback;patron assessment via voice recognition;scene creation that results in video and audio content that is personalized based on patron assessment;delivery of the personalized scene directed to a space occupied by the patron; and,patron reaction to the personalized scene followed by a display case system multimedia message responding to the patron and directed to a space occupied by the patron.3. The display case system of wherein:patron assessment includes an assessment of patron gender, age, and ethnicity assessments;scene creation utilizes content derived from video camera images of the patron;scene delivery includes video presented in a first plane via the LCD screen and video presented in a second plane different from the first that intersects the first plane;scene delivery includes audio presented via a sound field focused on the patron;patron feedback is via patron hand gestures received by the video camera and interpreted by the local controller; and,delivery of ...

DISPLAY CASE

A display case includes a transparent LCD panel for viewing display case contents therethrough. 1. A display case for viewing a product through a transparent liquid crystal display (LCD) screen , the display case comprising:a housing arranged around a product display space;a display case front including the screen that provides a view into the product display space;a plurality of light emitting diode (LED) arrays for backlighting the screen, the LED arrays located away from the display case front;a power supply responsive to control signals for selectively distributing electric power to one or more of the arrays;a local controller for electrically exchanging signals with the power supply and a sensor; and,the sensor for triggering operation of the screen when a patron is recognized by the sensor.2. The display case of further comprising:scene creation that results in video and audio content that is personalized based on patron assessment; and,patron reaction to the personalized scene followed by a display case system multimedia message responding to the patron.3. The display case of further comprising delivery of the personalized scene directed to a space occupied by the patron.4. The display case of further comprising:a display case front-most glass through which the product display space is viewed;the LCD screen having pixels and opposite the front-most glass with no structure therebetween; and,the product display space opposite the LCD screen with no structure therebetween;wherein the LCD screen consists of an LCD cell covered by and mounted to a carrier glass.5. The display case of wherein during operation of the LCD screen a regular pattern of LCD screen pixels covering all of the screen is operated for continuous transparency while the remaining pixels are operated to reproduce a desired image.6. The display case of wherein the regular pattern is a checkerboard pattern of pixels.7. A display case system including a housing and a transparent window immovable ...

SYSTEMS AND METHODS FOR BIOMECHANICALLY-BASED EYE SIGNALS FOR INTERACTING WITH REAL AND VIRTUAL OBJECTS

Systems and methods are provided for discerning the intent of a device wearer primarily based on movements of the eyes. The system may be included within unobtrusive headwear that performs eye tracking and controls screen display. The system may also utilize remote eye tracking camera(s), remote displays and/or other ancillary inputs. Screen layout is optimized to facilitate the formation and reliable detection of rapid eye signals. The detection of eye signals is based on tracking physiological movements of the eye that are under voluntary control by the device wearer. The detection of eye signals results in actions that are compatible with wearable computing and a wide range of display devices. 19.-. (canceled)10. A method for providing a graphical user interface to convey intent of a user based at least in part on movement of the user's one or both eyes using a detector , the method comprising:identifying, with the detector, when the user's one or both eyes are directed at a first key of a first object;identifying, with the detector, a first one or more saccades of the user's one or both eyes from the first key towards a second key of a second object;confirming, with the detector, that the first one or more saccades are completed to within a pre-determined distance from a location of the second key; andperforming an action associated with one or both of the first key and the second key, without waiting for perception of the second key by the user.11. The method of claim 10 , wherein the first object is one of a virtual object projected onto a display and a physical object.12. The method of claim 10 , wherein the second object is one of a virtual keyboard projected onto a display and a physical object.13. The method of claim 10 , wherein the action comprises concatenating a character associated with the first key to a series of characters.14. The method of claim 13 , wherein the concatenating a character associated with the first key forms one of a group ...

Systems and Methods for a Texture Engine

Systems and methods for a texture engine are disclosed. For example, one disclosed system includes: a processor configured to receive a display signal including a plurality of pixels, determine a haptic effect comprising a texture, and transmit a haptic signal associated with the haptic effect to an actuator in communication with the processor, the actuator configured to receive the haptic signal and output the haptic effect. 1. A system comprising: receive a display signal comprising a color and an intensity of the color;', 'assign a haptic value to each color;', 'determine a haptic effect comprising a texture, wherein determining the haptic effect comprises determining the haptic value associated with one or more of the colors; and', 'transmit a haptic signal associated with the haptic effect, wherein the haptic signal comprises a direction of operation and an intensity of operation, wherein the direction of operation is based in part on the color and the intensity of operation is based in part on an intensity of the color; and, 'a processor configured toan actuator in communication with the processor, the actuator configured to receive the haptic signal and output the haptic effect.2. The system of claim 1 , further comprising a display in communication with the processor claim 1 , the display configured to receive the display signal and output an image claim 1 , and wherein the texture is output onto a surface of the display.3. The system of claim 1 , further comprising a touch-sensitive interface configured to detect user interaction and wherein the processor is further configured to determine the haptic effect based at least in part on the user interaction.4. The system of claim 3 , wherein the touch-sensitive interface is configured to detect a speed of the user interaction and wherein determining the haptic effect comprises adjusting the haptic effect to correspond with the speed of the user interaction.5. The system of claim 3 , wherein the touch-sensitive ...

METHOD AND APPARATUS FOR MOOD BASED COMPUTING EXPERIENCE

The system provides a method and apparatus for dynamically modifying a computing experience based on an existing or desired state or mood of the user. The system detects the state or mood of the user in one or more ways. In one embodiment the system uses detected biometrics and desires of the user and/or manual input by the user to determine state, mood, and the like. The biometrics and other data can be used to identify a present and/or desired change in mood or moods of the user and to modify parameters of a computing experience in response to the mood. 1. A method for modifying a computing experience comprising:identifying a mood of a user of the computing experience;identifying one or more modifications of the computing experience based on the identified mood to achieve a target computing experience;making the one or more modifications of the computing experience to achieve the target computing experience.2. The method of wherein the mood of the user is identified by collection and analyzing biometric data of the user.3. The method of wherein the mood of the user is identified by having the user select a setting on an on-screen display.4. The method of wherein the target computing experience represents a goal mood of the user.5. The method of wherein the computing experience is modified to change the identified mood of the user to the goal mood.6. The method of wherein the modification to the computing experience comprises changing the GUI of the computing experience.7. The method of wherein the modification to the computing experience comprises modifying the audio of the computing experience.8. The method of wherein the modification to the computing experience comprises modifying the speed of performance of the computing experience.9. The method of wherein the computing experience comprises a search.10. The method of wherein the modification to the computing experience comprises modifying search results of the search based on the mood of the user.11. A method ...

HAPTIC INFORMATION PRESENTATION SYSTEM AND METHOD

A haptic information presentation system uses a human sensory characteristic or illusion to suitably control a physical quantity, and causes a person to feel a force which cannot exist physically, or a haptic sensory physical characteristic. 1. A man machine interface with a haptic information presenting system comprising:an object, the object being an actual object or a virtual object;a sensor that detects a stimulus by the object and/or to the object including at least one of a position, a velocity, an acceleration, a shape, a displacement, a deformation, an oscillation, a rotation, a vibration, a force, a torque, a pressure, a humidity, a temperature, a viscosity, and an elasticity;a haptic presenting device that applies a sensory characteristic and/or a sensory illusion of a member to the object, so as to present tactile force and/or a haptic information to the member as if the member actually operates the object; anda haptic presentation controller that controls the haptic presenting device on the basis of the stimulus from the sensor, whereinthe haptic presentation controller uses that the sensory characteristic which indicates a relationship between a quantity of stimulus applied to the member and a sensory quantity comprises nonlinear and/or the sensory illusion to control the stimulus and present the tactile force and/or the haptic information,the sensory characteristic includes at least one of the quantity of stimulus that is provided to the member and the quantity of stimulus that is generated through an operation by the member and the sensory quantity that is presented to the member, and the sensory quantity may not exist physically by utilizing the illusion and/or the sensory characteristic, andthe haptic presenting device presents the stimulus by the object and/or to the object, controls the stimulus that is applied to the object in accordance with the operation by the member, and thereby generates the haptic information.2. The man machine interface ...

Method, apparatus and system for rendering haptic effects

The present disclosure relates to methods, apparatus or systems for managing a map of haptic atmospheres over a topographical zone. The zone may contain relief or noticeable objects. A set of devices equipped with haptic sensors and haptic actuators is wore by a set of users spread over the topographical zone. Each device is contributing to the management of the map by sending its localized haptic measurements to a server. The server calculates and maintain the map according to these spread measurements. Client devices also send request to get a haptic effect representative of the haptic atmosphere around a second location in the topographical zone. The server calculates the response according to this second location and to the characteristics of the client.

MESSAGING SYSTEM HAVING SEND-RECOMMENDATION FUNCTIONALITY

A method is provided for determining when to send an electronic message. The method may include receiving the electronic message for a recipient, and making a prediction associated with the electronic message being positively received by the recipient based on an attribute of the electronic message and an additional attribute of the recipient. The method may also include selectively sending or deferring sending of the electronic message based on the prediction. 1. A method for determining when to send an electronic message , the method comprising:receiving, by a server, the electronic message from a sender and for a recipient;predicting, by the server, a likelihood that the electronic message will be positively received by the recipient based on an attribute of the electronic message and an additional attribute of the recipient; andselectively sending or deferring sending of the electronic message from the server to the recipient, based on preference information of the sender and the predicted likelihood that the electronic message will be positively received by the recipient.2. The method of claim 1 , further including:determining a receptiveness indicator based on the attribute of the electronic message and the additional attribute of the recipient; anddisplaying the receptiveness indicator to a sender of the electronic message.3. The method of claim 2 , further including receiving a control instruction from the sender to send or defer sending of the electronic message claim 2 , wherein selectively sending or deferring sending of the electronic message includes selectively sending or deferring sending of the electronic message based on the control instruction.4. The method of claim 3 , wherein claim 3 , when the control instruction is an instruction to defer sending of the electronic message claim 3 , the method further includes selectively saving the electronic message claim 3 , auto-sending the electronic message when the receptiveness indicator is higher claim ...

Information processing device, information processing method, and program

An information processing device according to an aspect of the present technology includes a user information acquiring unit, an object information acquiring unit, and an output control unit. The user information acquiring unit acquires information related to a gaze position of a user while a substance of content is being automatically reproduced, in accordance with a first control amount, from an audio source located in a space in which the user is located. The object information acquiring unit acquires position information related to the audio source and position information related to a first object gazed at by the user. The output control unit performs first output control of providing the user with the substance of the content in accordance with a second control amount different from the first control amount in a case where the gaze position within the first object moves toward the audio source.

Systems and Methods for Optical Transmission of Haptic Display Parameters

Systems and methods for optical transmission of haptic display parameters are disclosed. One disclosed method includes receiving an image signal from an image sensor, the image signal associated with an image, determining a haptic signal based at least in part on the image signal, generating a haptic effect signal based at least in part on the haptic signal, and transmitting the haptic effect signal to a haptic output device.

HAPTIC FEEDBACK SCREEN USING PIEZOELECTRIC POLYMER

The present invention relates to a haptic feedback screen using a piezoelectric polymer. The present invention provides a haptic feedback screen using a piezoelectric polymer, which comprises: a piezoelectric polymer layer made of a transparent piezoelectric polymer material; an upper electrode and a lower electrode disposed on an upper surface of and under a lower surface of the piezoelectric polymer layer, respectively, the upper electrode and the lower electrode being made of a transparent material; a transparent cover disposed on the upper electrode; and a transparent substrate disposed under the lower electrode, wherein the piezoelectric polymer layer generates vibration in a touch area by a power applied between the upper electrode and the lower electrode when a touch occurs on the transparent cover. The present invention can implement an overall or partial haptic feedback function by applying a transparent piezoelectric polymer material to a touch screen.

A Touch Display Device with Tactile Feedback

An apparatus comprising: an image processor configured to determine at least one image parameter with respect to at least one image displayed on at least one display; a touch controller configured to determine at least one touch parameter with respect to the at least one display configured to display the at least one image; and a tactile effect generator configured to generate at least one tactile signal based on the at least one touch parameter and the at least one image parameter.

LOCOMOTION SYSTEM AND APPARATUS

A locomotion system for use with a virtual environment technology includes a platform configured to support a user, a harness support assembly coupled to the platform and extending upwardly from the platform, and a safety harness configured to be worn by the user. The harness support assembly includes a support halo positioned above the platform and extending about a vertical central axis. The safety harness includes an interface structure moveably coupled to the support halo. 120. -. (canceled)21. A 360 degree locomotion system for use in a virtual environment , the system comprising:a platform;at least one harness support assembly coupled to the platform and extending upward from the platform, wherein the at least one harness support assembly is configured to enable vertical adjustment;a safety harness configured to provide vertical support, horizontal support and radial support to a user via the harness support assembly.22. The system of claim 21 , wherein the platform is octagonal shaped.23. The system of claim 21 , wherein the platform is concave.24. The system of claim 21 , further comprising at least one foot covering configured to engage the platform claim 21 , wherein at least part of the foot covering is a low friction material.25. The system of claim 24 , wherein the at least one foot covering includes one or more sensing devices.26. The system of claim 21 , further comprising one or more motion sensing devices.27. The system of claim 26 , wherein one of the one or more sensing devices is located on the at least one harness support assembly.28. The system of claim 26 , wherein the one or more sensing devices are located on the user.29. The system of claim 26 , wherein the one or more sensing devices are inertial sensors.30. The system of claim 21 , further comprising a controller.31. The system of claim 30 , wherein the controller includes one or more sensing devices.32. The system of claim 21 , further comprising a support halo coupled to the harness ...

Systems and Methods for Pressure-Based Haptic Effects

One illustrative system disclosed herein includes a sensor configured to detect a user interaction with a touch surface and transmit a sensor signal including data associated with a pressure of the user interaction. The illustrative system also includes a processor in communication with the sensor, the processor configured to: receive the sensor signal; determine, based on the sensor signal, a pressure level; determine a user interface level based at least in part on the pressure level; perform a function associated with the user interface level and the user interaction; determine a haptic effect based at least in part on the user interface level and the user interaction; generate a haptic signal based at least in part on the haptic effect; and transmit the haptic signal. The illustrative system further includes a haptic output device in configured to receive the haptic signal and output the haptic effect. 1. A system comprising:an automotive device that includes a capacitive sensor configured to detect a capacitance between a vehicle occupant and the automotive device and generate a sensor signal based on the capacitance, wherein the automotive device does not include a touch-screen display;a haptic output device coupled to the automotive device, wherein the haptic output device is configured to receive a haptic signal and output a haptic effect to the automotive device;a processor communicatively coupled to the automotive device; and receive the sensor signal;', 'determine the haptic effect based on the sensor signal; and', 'transmit the haptic signal to the haptic output device based on the sensor signal to cause the haptic output device to output the haptic effect., 'a memory comprising program code that is executable by the processor to cause the processor to2. The system of claim 1 , wherein the automotive device is a push button.3. The system of claim 1 , wherein the automotive device is a joystick.4. The system of claim 1 , wherein the automotive device is a ...

Cognitive replication through augmented reality

In one embodiment of the present invention, environment information corresponding to a user is received. A target environment is simulated in augmented reality based on the environment information. Physiological information corresponding to the user is received. A cognitive state of the user is determined based on the physiological information. In response to determining that the cognitive state of the user is not a target cognitive state, the target environment is modified in augmented reality to achieve the target cognitive state.

SYSTEMS AND METHODS FOR DELIVERING SENSORY INPUT DURING A DREAM STATE

Embodiments of the invention provide apparatus, systems and methods for detecting neurological activity indicative of a dream state of a human. Many embodiments of the invention provide apparatus, systems and methods for detecting neurological activity of a human indicative of a dream state or the onset thereof and delivering an input to the user (such as an audio or other sensory input) during the dream state. Particular embodiments of the invention provide systems and methods for detecting neurological activity indicative of the onset or occurrence of a dream state of a human and delivering an audio or other sensory input during the user's dream state. The audio input may be used for learning, delivering messages to the user's subconscious, and/or promoting a state of relaxation. 1. (canceled)2. A system for delivering audio content to a user during a dream state , the system comprising:a headband configured to be worn on the head of the user and extend over at least the user's forehead,a plurality of electrodes positioned on an inside surface of the headband to make electrical contact with user's skin in a pattern configured to detect electrical signals of the user's brain or head indicative of the dream state, the headband being configured to bend and flex with movement of the user's head to maintain electrical contact between the electrodes and the user's skin during head movement;logic resources operably coupled to the plurality of electrodes, the logic resources being configured to analyze the electrical signals to determine when the dream state occurs;an audio storage device operably coupled to the logic resources; the audio storage device configured to store audio content to be delivered to the user; andan audio output device operably coupled to at least one of the logic resources or the audio storage device, the audio output device configured to output an audio signal to the user containing the audio content.3. The system of claim 2 , further comprising ...

DIGITAL PERSONAL EXPRESSION VIA WEARABLE DEVICE

Examples are disclosed that relate to evoking an emotion and/or other an expression of an avatar via a gesture and/or posture sensed by a wearable device. One example provides a computing device including a logic subsystem and memory storing instructions executable by the logic subsystem to receive, from a wearable device configured to be worn on a hand of a user, an input of data indicative of one or more of a gesture and a posture. The instructions are further executable to, based on the input of data received, determine a digital personal expression corresponding to the one or more of the gesture and the posture, and output the digital personal expression. 1. A computing device , comprising:a logic subsystem; and receive an input;', 'receive, from a wearable device configured to be worn on a hand of a user, an input of data indicative of one or more of a gesture and a posture of the hand of the user;', 'based on the input of data received, determine a digital personal expression corresponding to the one or more of the gesture and the posture;', 'store the digital personal expression determined as associated with the input; and', 'output the digital personal expression., 'memory comprising instructions executable by the logic subsystem to'}2. The computing device of claim 1 , wherein the instructions are executable to output claim 1 , via a display claim 1 , an avatar of the user claim 1 , the avatar of the user comprising a feature representing the digital personal expression.3. The computing device of claim 1 , wherein the input comprises an input of one or more of a video claim 1 , a speech claim 1 , an image claim 1 , and/or a text.4. The computing device of claim 1 , wherein the instructions are executable to output the digital personal expression by sending the digital personal expression to another computing device.5. The computing device of claim 1 , wherein the wearable device comprises one or more of a ring and a glove.6. The computing device of claim 1 ...

Realtime evaluation method and system for virtual reality immersion effect

A realtime evaluation method and system for a virtual reality (VR) immersion effect are provided. An electroencephalogram signal is collected while a VR video is played, a degree of emotional arousal and a degree of cognitive absorption are calculated in real time based on energy of frequency bands α, β, and θ that is obtained after wavelet transform, and finally, an immersion effect index is dynamically monitored for objective evaluation on an immersion effect. The method and the system realize realtime measurement and analysis, dynamically monitors a VR video immersion effect, adopts a multi-dimensional comprehensive calculation strategy and takes individual differences into account when calculating an index, effectively resolves problems such as after-fact reporting, social desirability biases, and strong subjectivity in questionnaire measurement and other measurement means, and has a broad market application prospect.

METHODS AND SYSTEMS FOR VOICE PROFILING AS A SERVICE

Methods, systems and computer products as described herein are directed to a Voice Profiler. According to various embodiments, the Voice Profiler receives audio data that includes a representation of a human voice. The Voice Profiler extracts voiced segments, non-voiced segments and respiratory event segments from the input audio data. The Voice Profiler predicts a physical state of the speaker of the human voice based on respective attributes of the extracted segments. According to various embodiments, the Voice Profiler predicts the lung function of the speaker based on input audio data. 1. A computer-implemented method , comprising:receiving input audio data that includes a representation of a human voice;extracting one or more voiced segments, one or more non-voiced segments and one or more respiratory event segments from the input audio data; andpredicting a physical state of the speaker of the human voice based on respective attributes of the extracted segments.2. The computer-implemented method of claim 1 , wherein extracting the respective segments comprises:identifying respective audio portions in the input audio data that correspond to vocal actions performed by the speaker in response to instructions provided by one or more prompts;wherein each prompt is one of: a prompt to remain silent, one or more types of speech prompts and one or more types of non-speech prompts; andwherein respective types of respiratory events include respective inhale occurrences and respective exhale occurrences during the vocal actions performed by the speaker.3. The computer-implemented method of claim 1 , wherein extracting the respective segments comprises:determining a background noise calibration in the input audio data, the input audio data representing a recording of a session during which the speaker responded to one or more prompts;applying one or more machine learning segmentation models to the input audio data with respect to the background noise calibration; ...

Control device for a motor vehicle and control method

The present invention relates to a new process for the synthesis of Colesevelam, which is used in therapy in cases of hypercholesterolemia due to low density lipoproteins. Said process comprises the reaction, in a basic environment, of polyallylamine with: i) at least one alkylating agent of formula X—(CH 2 ) 9 —CH 3 and at least one alkylating agent of formula Y—(CH 2 ) 6 —N + (CH 3 ) 3 Z − , wherein X and Y are each independently a leaving group, and Z is a halogen; and ii) at least one crosslinking agent. The present invention also relates to the Colesevelam obtainable by the above process.

SCREEN CHANGING DEVICE, SCREEN CHANGING METHOD, AND SCREEN CHANGING PROGRAM

A screen changing device includes: an operation log organization unit for organizing operation logs containing operation contents on operation screens by type; an emotion storage unit for storing user's emotions and emotion quotients indicating magnitudes of the emotions corresponding to the operation logs; an emotion allocation unit for allocating the user's emotions and the emotion quotients stored in the emotion storage unit to the organized operation logs; a display unit for displaying the information on the user's emotions and the emotion quotients allocated to the operation logs; an improvement idea storage unit for storing improvement ideas of the operation screens corresponding to user's emotions; a screen improvement unit for acquiring the improvement ideas of the operation screens corresponding to the user's emotions allocated to the operation logs from the improvement idea storage unit and presenting the same on the display unit; and a screen changing unit for changing the operation screen based on an improvement idea selected by a designer from among the presented improvement ideas. 1. A screen changing device comprising:an operation log organization unit for organizing operation logs containing operation contents on operation screens by type;an emotion storage unit for storing user's emotions and emotion quotients indicating magnitudes of the emotions corresponding to the operation logs;an emotion allocation unit for allocating the user's emotions and the emotion quotients stored in the emotion storage unit to the organized operation logs;a display unit for displaying the information on the user's emotions and the emotion quotients allocated to the operation logs;an improvement idea storage unit for storing improvement ideas of the operation screens corresponding to user's emotions;a screen improvement unit for acquiring the improvement ideas of the operation screens corresponding to the user's emotions allocated to the operation logs from the ...

DETERMINING A MATCHING SCORE BETWEEN USERS OF WEARABLE CAMERA SYSTEMS

A server and method are provided for determining a matching score related to users of wearable camera systems. In one implementation, a server determines a matching score related to users of wearable camera systems. Each wearable camera system is configured to capture images from an environment of a corresponding user and produce image data from the captured images. At least one processing device associated with the server may be programmed to receive image data from the wearable camera systems. The processing device may further determine a value of a matching score related to at least two users of the wearable camera systems. The value of the matching score may be based on the image data received from the wearable camera systems. The value of the matching score may indicate a level of exposure of the two users to similar visual details in their environments. 1. A server for determining a matching score related to users of wearable camera systems , the server comprising:a memory for storing image data received from the wearable camera systems, wherein each wearable camera system is configured to capture images from an environment of a corresponding user and produce image data from the captured images; and receive the image data from the wearable camera systems; and', 'determine a value of the matching score related to at least two users of the wearable camera systems, wherein the value of the matching score is based on the image data received from the wearable camera systems of the at least two users and indicates a level of exposure of the two users to similar visual details in their environments., 'at least one processing device associated with the server and programmed to2. The server of claim 1 , wherein the image data includes images or video streams captured by the wearable camera systems.3. The server of claim 1 , wherein the image data includes information derived from at least one of images and video streams captured by the wearable camera systems.4. The ...

TECHNIQUE FOR CONTROLLING VIRTUAL IMAGE GENERATION SYSTEM USING EMOTIONAL STATES OF USER

A method of operating a virtual image generation system comprises allowing an end user to interact with a three-dimensional environment comprising at least one virtual object, presenting a stimulus to the end user in the context of the three-dimensional environment, sensing at least one biometric parameter of the end user in response to the presentation of the stimulus to the end user, generating biometric data for each of the sensed biometric parameter(s), determining if the end user is in at least one specific emotional state based on the biometric data for the each of the sensed biometric parameter(s), and performing an action discernible to the end user to facilitate a current objective at least partially based on if it is determined that the end user is in the specific emotional state(s). 1. A method of operating a virtual image generation system , comprising:allowing an end user to interact with a three-dimensional environment comprising at least one virtual object;presenting a stimulus to the end user in the context of the three-dimensional environment;sensing at least one biometric parameter of the end user in response to the presentation of the stimulus to the end user;generating biometric data for each of the at least one sensed biometric parameter;determining if the end user is in at least one specific emotional state based on the biometric data for the each of the at least one sensed biometric parameter; andperforming an action discernible to the end user to facilitate a current objective at least partially based on if it is determined that the end user is in the at least one specific emotional state.2. The method of claim 1 , wherein the current objective is to evoke a desired emotional state in the end user for a desired duration claim 1 , or to not evoke an undesired emotional state in the end user for a desired duration claim 1 , or to evoke a plurality of different desired emotional states in the end user for a desired duration.3. The method of ...

Drive controlling apparatus, electronic device, computer-readable recording medium, and drive controlling method

A drive controlling apparatus, which drives a vibrating element of an electronic device including a display part, a top panel having a manipulation surface, a coordinate detector, and the vibrating element, includes a storage part configured to store image data for a scrollable image in association with data representing a position of an edge, or with data representing a scrollable direction; and a drive controlling part configured to drive the vibrating element according to a first pattern when the edge is not being displayed, and to drive the vibrating element according to a second pattern when the edge is being displayed, or configured to drive the vibrating element according to a third pattern when the direction of the scrolling operation is the scrollable direction and to drive the vibrating element according to a fourth pattern when the direction of the scrolling operation is not the scrollable direction.

Information processing apparatus and non-transitory computer readable medium storing information processing program

An information processing apparatus includes a processor configured to detect a free area of an object in a real space, acquire an arrangement of plural virtual objects, and cause the plural virtual objects to be displayed in the free area, in the acquired arrangement.

MULTI-MODAL TOUCHPAD

A multi-modal touchpad can include: a touchscreen; at least one type of input sensor; a motion sensor; a haptic feedback device; and a multi-modal controller operably coupled with: the at least one type of input sensor so as to receive sensor data therefrom; the motion sensor so as to receive motion sensor data therefrom; the haptic feedback device so as to provide instructional haptic data to the haptic feedback device; a data interface that operably couples the multi-modal controller with an operating system of a device having the multi-modal touchpad; and a graphics user interface provided from the multi-modal controller to the display so as to display data from the multi-modal controller to the display. The at least one type of sensor can include a force sensor or a proximity sensor operably coupled with the physical sensing surface. 1. A multi-modal touchpad comprising:a display having a physical sensing surface and configured as a touchscreen;at least one type of input sensor operably coupled with the physical sensing surface;a motion sensor;a haptic feedback device operably coupled with the physical sensing surface; and the at least one type of input sensor so as to receive sensor data therefrom;', 'the motion sensor so as to receive motion sensor data therefrom;', 'the haptic feedback device so as to provide instructional haptic data to the haptic feedback device;', 'a data interface that operably couples the multi-modal controller with an operating system of a device having the multi-modal touchpad; and', 'a graphics user interface provided from the multi-modal controller to the display so as to display data from the multi-modal controller to the display., 'a multi-modal controller operably coupled with2. The multi-modal touchpad of claim 1 , the at least one type of input sensor comprising:a force sensor operably coupled with the physical sensing surface, wherein the multi-modal controller is operably coupled with the force sensor so as to receive force ...

DETERMINATION DEVICE, DETERMINATION METHOD, PROGRAM, AND INFORMATION STORAGE MEDIUM

In each trial, brain electrical activity at multiple points of a target person is measured. An acquirer of a determination device acquires response matrices for n trials under a first condition and response matrices form trials under a second condition. An analyzer performs canonical correlation analysis on the acquired response matrices to obtain first canonical variable time series. A distance calculator calculates a distance between the trials from the obtained first canonical variable time series to obtain a distance matrix. A determiner obtains a possibility that the n trials and the m trials are classified into two different clusters from the distance matrix and determines whether the first condition and the second condition are substantially different. It is possible to provide to a single target person a first content in n trials and a second content in m trials so as to determine a difference in interest of the single target person. It is possible to provide the same content to a first subject who is the target person in n trials and to a second subject who is the target person in m trials so as to determine whether the two are different or the same. 1. A determination device , comprising:an acquirer that acquires (n+m) response matrices by measuring brain electrical activity of a target person in n trials under a first condition and m trials under a second condition;an analyzer that performs canonical correlation analysis on response matrices included in the acquired (n+m) response matrices to obtain first canonical variable time series for the response matrices;a distance calculator that calculates a distance between the trials for the response matrices from the obtained first canonical variable time series; anda determiner that obtains a possibility that the n trials and the m trials are classified into two different clusters from the calculated distance and determines whether the first condition and the second condition are substantially different based ...

System, terminal apparatus, method, and recording medium

There is provided a system that enables rich communication using tactile simulation, the system including: a first terminal apparatus; and a plurality of second terminal apparatuses. The first terminal apparatus transmits first tactile information that has been generated by combining first sensor information related to a first user detected by sensors and indicates a state of the first user. The plurality of second terminal apparatuses receive and output the first tactile information.

FLICKER MITIGATION WHEN TOGGLING EYEPIECE DISPLAY ILLUMINATION IN AUGMENTED REALITY SYSTEMS

An augmented reality display system is disclosed. The system can include a partially transparent eyepiece, an ambient light sensor, and an image input device. The image input device can include a light source and a spatial light modulator. The system can also include a controller that determines that no virtual content is being displayed to the user and compares the ambient light to display light to determine if a light source shutoff criterion is satisfied. If the light source shutoff criterion is satisfied, the controller can turn off the light source. 1. An augmented reality display system comprising:an eyepiece display configured to be worn by a user, the eyepiece display being at least partially transparent so as to transmit ambient light toward the eye of the user;an ambient light sensor configured to detect the ambient light;an image input device capable of inputting virtual content into the eyepiece display, the image input device comprising a light source and a spatial light modulator illuminated by the light source; anda controller,wherein the eyepiece display is configured to emit display light, and determine that no virtual content is being displayed to the user;', 'compare the ambient light to the display light to determine if a light source shutoff criterion is satisfied, and', 'turn off the light source if the light source shutoff criterion is satisfied., 'wherein the controller is configured to2. The augmented reality display system of claim 1 , wherein the controller is configured to compare the ambient light to the display light using on one or more ambient light values measured by the ambient light sensor and one or more display light values.3. The augmented reality display system of claim 2 , wherein the controller is configured to determine the one or more display light values based on the state of the light source.4. The augmented reality display system of claim 2 , further comprising a display light sensor claim 2 , wherein the controller is ...

MULTIDEVICE MULTIMODAL EMOTION SERVICES MONITORING

Techniques for multidevice, multimodal emotion services monitoring are disclosed. An expression to be detected is determined. The expression relates to a cognitive state of an individual. Input on the cognitive state of the individual is obtained using a device local to the individual. Monitoring for the expression is performed. The monitoring uses a background process on a device remote from the individual. An occurrence of the expression is identified. The identification is performed by the background process. Notification that the expression was identified is provided. The notification is provided from the background process to a device distinct from the device running the background process. The expression is defined as a multimodal expression. The multimodal expression includes image data and audio data from the individual. The notification enables emotion services to be provided. The emotion services augment messaging, social media, and automated help applications. 1. A computer-implemented method for multi-device analysis comprising:determining an expression to be detected, wherein the expression relates to a cognitive state of an individual;obtaining input on the cognitive state of the individual using a first device local to the individual;monitoring for the expression, using a background process on a second device remote from the individual;identifying an occurrence of the expression, by the background process; andproviding notification that the expression was identified, wherein the notification is provided from the background process to a third device, wherein the third device is distinct from the second device.2. The method of wherein the expression is defined as a multimodal expression.3. The method of wherein the multimodal expression includes image data and audio data from the individual.4. The method of wherein the providing notification enables emotion services.5. The method of wherein the emotion services are requested by the individual.6. The ...

INTENTION EMERGENCE DEVICE, INTENTION EMERGENCE METHOD, AND INTENTION EMERGENCE PROGRAM

An acquisition unit acquiring data including sound information uttered by a subject; a detection unit detecting feelings of the subject using the acquired data; a decision unit deciding weighting coefficients for data in accordance with the feelings of the subject; a calculation unit calculating energy which involves in human emotions and organ activities; a plurality of elements outputting signals each of which indicates the change in a state of the element as homeostasis in each of the human emotions and the organ activities; an emergence unit deciding feelings and intentions in accordance with the signals output from the elements; and a control unit performing phase transition of the state of the elements when an amount of change in the state of at least one element is equal to or less than a predetermined amount or when the state of at least one element is in a predetermined state. 1. An intention emergence device comprising:an acquisition unit acquiring data including at least sound information uttered by a subject;a detection unit detecting feelings of the subject using the data being acquired;a decision unit deciding weighting coefficients for the data acquired in accordance with the feelings of the subject being detected;a calculation unit calculating energy which involves in human emotions and organ activities with the data and the coefficients;a plurality of elements, each of which has a material changing a state in accordance with input of the energy calculated by the calculation unit, outputting signals each of which indicates the change in the state of the material as homeostasis in each of the human emotions and the organ activities;an emergence unit deciding feelings and intentions in accordance with the change in the state of the material included in the signals output from each of the plurality of elements; anda control unit performing phase transition of the state of the material in each of the plurality of elements when an amount of change in the ...

Computer Systems and Computer-Implemented Methods of Use Thereof Configured to Recognize User Activity During User Interaction with Electronic Computing Devices

A computer-implemented method and system that entails a continuous tracking of a plurality of representations over a predetermined time duration. The method and system also entails a continuous application of at least one eye-gaze movement tracking (EGMT) algorithm to the visual input to form a time series of eye-gaze vectors and a continuous continuously input of the time series of eye-gaze vectors into an Activity Tracking Neural Network (ATNN). The ATNN classifies at least one activity of the at least one user over the predetermined time duration and outputs a measure of the at least one user's engagement with the classified activity. 1. A computer-implemented method , comprising: 'wherein the visual input comprises a series of video frames, a series of images, or both;', 'continuously obtaining, by at least one processor, a visual input comprising a plurality of representations of at least one eye of at least one user to continuously track the plurality of representations over a predetermined time duration;'}continuously applying, by the at least one processor, at least one eye-gaze movement tracking (EGMT) algorithm to the visual input to form a time series of eye-gaze vectors; classify at least one activity of the at least one user over the predetermined time duration; and', "output a measure of the at least one user's engagement with the classified activity."], 'continuously inputting, by the at least one processor, the time series of eye-gaze vectors into an Activity Tracking Neural Network (ATNN) to2. The method of claim 1 , wherein the visual input further comprises a plurality of representations of at least one additional facial feature of the at least one user claim 1 , wherein the at least one additional facial feature is chosen from at least one of: eye gaze claim 1 , head pose claim 1 , a distance between a user's face and at least one screen claim 1 , head posture claim 1 , at least one detected emotion claim 1 , or combinations thereof.3. The method ...

Tactile Feedback in an Electronic Device

An electronic device for providing tactile feedback is provided. The electronic device may provide tactile feedback using any suitable approach, including for example vibration, heat, electrical, visual, or any other type of feedback. The electronic device may provide tactile feedback in response to detecting any particular status of the electronic device, receiving any particular input, or detecting any suitable communication received by the electronic device. For example, the electronic device may provide tactile feedback in response to identifying the current network of the device, the status of a particular electronic device component, or any other electronic device status. As another example, the electronic device may provide tactile feedback in response to receiving a particular type of communication, or in response to receiving a communication from a particular contact. As still another example, the electronic device may provide tactile feedback in response to receiving a particular user input, or to detecting a user's finger on a particular portion of the electronic device.

HAPTIC INFORMATION PRESENTATION SYSTEM AND METHOD

A system and method are disclosed in which in a conventional non-grounding man-machine interface having no reaction base on the human body and for giving the existence of a virtual object and the impact force of a collision to a person, a haptic sensation of a torque, a force and the like can be continuously presented in the same direction, which cannot be presented by only the physical characteristic of a haptic sensation presentation device. In a haptic presentation device, the rotation velocity of at least one rotator in the haptic presentation device is controlled by a control device, and a vibration, a force or a torque as the physical characteristic is controlled, so that the user is made to conceive various haptic information of the vibration, force, torque or the like. 1. A method for presenting haptic information comprising at least one of a haptic sensory characteristic and force that does not exist physically to at least one of a medium and a user by controlling at least one of a physical quantity and a sensory quantity utilizing at least one of the haptic sensory characteristic and illusion of at least one of the medium and the user , the method comprising:presenting at least one motion of a nonlinear characteristic, a hysteresis characteristic, a masking characteristic, a threshold characteristic, and muscle reflection to at least one of the medium and the user.2. The method according to claim 1 , wherein the haptic sensory characteristic comprises (i) a physical quantity provided to at least one of the medium and the user by at least one of being given to at least one of the medium and the user and being bought by motion of at least one of the medium and the user; and (ii) a sensory quantity to be presented to at least one of the medium and the user claim 1 , andwherein the haptic sensory characteristic represents a relationship between the physical quantity to be applied to at least one of the medium and the user, and the sensory quantity to be ...

SYSTEMS AND METHODS FOR MAPPING MESSAGE CONTENTS TO VIRTUAL PHYSICAL PROPERTIES FOR VIBROTACTILE MESSAGING

Systems and methods for mapping message contents to virtual physical properties for vibrotactile messaging are disclosed. For example, one disclosed method includes the steps of receiving a sensor signal from a sensor, the sensor configured to detect an interaction with a messaging device, determining a virtual physical property of a virtual message object based at least in part on the sensor signal, determining a haptic effect based at least in part on the virtual physical parameter; and generating a haptic signal configured to cause an actuator to output the haptic effect. 1. A method of transmitting haptic effects from a first device to a second device , the method comprising:displaying a first visual representation of a virtual message object having an associated virtual physical parameter at the first device;generating a haptic effect based on the virtual physical parameter at the first device;receiving a command at the first device to send the virtual message object to the second device;in response to the command, sending a message to the second device, wherein the message is configured to display a second visual representation of the virtual message object at the second device and generate the haptic effect based on the virtual physical parameter at the second device; andin response to the command, causing the first visual representation to disappear from the first device.2. The method of claim 1 , wherein the virtual physical parameter is based on a sensor signal received at the first device.3. The method of claim 2 , wherein the sensor signal is generated by an accelerometer and is in response to a movement of the first device claim 2 , and the haptic effect is a vibratory haptic effect based on the movement.4. The method of claim 2 , wherein the sensor signal is in response to a user input selecting a texture claim 2 , and the haptic effect simulates the texture.5. The method of claim 1 , wherein the command is received in response to a user gesture on a ...

Method and system for measuring emotional state

Techniques for measuring the emotional state of minds in a person based upon a set of biological data captured from a person in a natural environment, where the person is not restricted at all in his movement. Various sensing data from sensors are captured with or without the intervention of the person. In addition, expression data is also captured before, during or after the sensing signals are captured. The data sets are processed to filter out those uncorrelated. A dedicated computing device is provided to collect the data along with other necessary data available on the Internet, where the measurement of the emotion is measured, derived or calculated based on the collected data, and/or any historical measurements of the person. The result may be shared with a list of contacts selected by the person who may also views theirs as well.

ADJUSTING GRAPHICS RENDERING BASED ON FACIAL EXPRESSION

An embodiment of a graphics apparatus may include a facial expression detector to detect a facial expression of a user, and a parameter adjuster communicatively coupled to the facial expression detector to adjust a graphics parameter based on the detected facial expression of the user. The detected facial expression may include one or more of a squinting, blinking, winking, and facial muscle tension of the user. The graphics parameter may include one or more of a frame resolution, a screen contrast, a screen brightness, and a shading rate. Other embodiments are disclosed and claimed. 1. (canceled)2. A computing system comprising:a graphics processor;a central processing unit; anda memory including a set of instructions, which when executed by one or more of the graphics processor or the central processing unit, cause the computing system to:detect a first facial expression of a user;detect a secondary input from the user that is associated with the first facial expression; andtrigger an associated action based on the first facial expression and the secondary input.3. The system of claim 2 , wherein the associated action is one or more of a zoom or a pan.4. The system of claim 2 , wherein the secondary input from the user is one or more of a pulse of the user claim 2 , a heart rate of the user or a gesture of the user.5. The system of claim 2 , wherein the secondary input is a second facial expression of the user that is different from the first facial expression.6. The system of claim 2 , wherein the instructions claim 2 , when executed claim 2 , cause the computing system to:detect a focal point associated with the user;detect a focus area based on the focal point; andadjust the associated action based on the focus area.7. The system of claim 6 , wherein the instructions claim 6 , when executed claim 6 , cause the computing system to:determine a depth of focus of the user during a calibration process;determine a focus distance of the user that is associated with ...

SYSTEM AND METHOD FOR ENHANCED TRAINING USING A VIRTUAL REALITY ENVIRONMENT AND BIO-SIGNAL DATA

A training apparatus has an input device and a wearable computing device with a bio-signal sensor and a display to provide an interactive virtual reality (“VR”) environment for a user. The bio-signal sensor receives bio-signal data from the user. The user interacts with content that is presented in the VR environment. The user interactions and bio-signal data are scored with a user state score and a performance scored. Feedback is given to the user based on the scores in furtherance of training. The feedback may update the VR environment and may trigger additional VR events to continue training. 1. A training apparatus comprising:an input device and a wearable computing device with a bio-signal sensor and a display to provide an interactive continuous virtual reality (“VR”) environment for a user, the VR environment containing virtual elements, the bio-signal sensor receives bio-signal data from the user, the bio-signal sensor comprising a brainwave sensor;the computing device having or in communication with a processor configured to:as part of the interactive continuous VR environment, present content on the display where the content includes the virtual elements and has a VR event occurring within the interactive continuous VR environment, the VR event having one or more changes on the virtual elements in the VR environment, the VR event having desired user states, and desired effects;continuously receive user manual inputs from the input device for user interaction with the virtual elements in the interactive continuous VR environment including during the VR event;continuously receive the bio-signal data of the user from the bio-signal sensor including during the VR event;process the bio-signal data to determine user states of the user, including brain states, during the VR event;determine a user state score by comparing the user states of the user to the desired user states during the course of the VR event;determine a performance score by comparing the effects ...

INFORMATION PROCESSING SYSTEM, CLIENT TERMINAL, INFORMATION PROCESSING METHOD, AND RECORDING MEDIUM

[Object] To provide an information processing system, a client terminal, an information processing method, and a recording medium capable of selecting an appropriate agent from among multiple agents according to a user emotion, and providing more comfortable dialogue. 1. An information processing system comprising:a storage section that holds a plurality of agent programs with different attributes;a communication section that provides an agent service by the agent programs to a client terminal of a user; anda control section that selects, from among the plurality of agent programs, one agent program suited to an emotion of a user who can use the agent service.2. The information processing system according to claim 1 , whereinwhen providing an agent service by a first agent program to a client terminal of the user, if an emotion change of the user is detected, the control section controls a switching to an agent service by a second agent program appropriate to the emotion change.3. The information processing system according to claim 1 , whereinwhen the user owns a usage right to the agent service by the selected agent program, the control section starts providing the agent service by the selected agent program to the user.4. The information processing system according to claim 3 , whereinthe control section stores, in the storage section, preference information of the user according to feedback received from the user enjoying the agent service.5. The information processing system according to claim 4 , whereinthe control section selects, from among the plurality of agent programs, one agent program suited to an emotion of the user who can use the agent service, on a basis of the preference information.6. The information processing system according to claim 4 , whereinthe feedback is input through text or speech by the user on the client terminal.7. The information processing system according to claim 4 , whereinthe feedback is at least one of biological information, ...

SYSTEMS AND METHODS FOR USING IMAGINED DIRECTIONS TO DEFINE AN ACTION, FUNCTION OR EXECUTION FOR NON-TACTILE DEVICES

A system and method for controlling a non-tactile device including a receiving device configured to receive signals corresponding to a user's brain waves or movements, the brain waves or movements corresponding to a series of directional intentions, the intentions defining at least one line pattern, a processor configured to process the at least one line pattern, each of said at least one line patterns associated with an action of the device, and output a control signal to the non-tactile device related to the action. 1. A system for controlling a device , the system comprising:a receiving device configured to receive signals corresponding to a series of directional thoughts generated in a brain of a user, the directional thoughts comprising rhythms of mu and beta rhythms, each series of directional thoughts corresponding to a series of imagined directions, the directions defining a line pattern, wherein the line pattern comprises one or more parts, each part comprising a plurality of steps, each step corresponding to an imagined direction, the length of each step corresponding to the duration of a corresponding thought; and process the line pattern to match a pre-defined line pattern with a pre-defined action of the device; and', 'output a control signal to the device related to the pre-defined action., 'a processor configured to2. The system of wherein the steps comprise at least one up claim 1 , down claim 1 , left or right step.3. The system of claim 1 , wherein the receiving device is a brain-scanning device.4. The system of claim 1 , wherein the receiving device is selected from the group consisting of electroencephalography (EEG) devices claim 1 , movement receivers claim 1 , micro gyroscopes claim 1 , accelerometers claim 1 , microelectromechanical systems (MEMS) claim 1 , motion-detecting infrared sensors claim 1 , magnetic resonance imaging (MRI) devices claim 1 , nuclear magnetic resonance imaging (NMRI) devices claim 1 , magnetic resonance tomography ( ...

INFORMATION PROCESSING DEVICE, INFORMATION PROCESSING SYSTEM, AND RECORDING MEDIUM

An example system includes: a display processing unit performing processing of displaying on a display unit a home screen containing a selection image and a background image, the selection image being constructed from one or a plurality of images used for receiving selection operation, the background image serving as a background of the selection image; and a scroll operation reception unit receiving operation of scrolling the selection image displayed on the display unit. In accordance with the operation of scrolling received by the scroll operation reception unit, the display processing unit scrolls the selection image while animating the background image of the home screen. 1. An information processing device comprising:a display processing unit performing processing of displaying on a display unit a selection image constructed from one or a plurality of images used for receiving selection operation;an operation reception unit receiving operation performed to the selection image displayed on the display unit;a sound output unit outputting sound in accordance with the operation received by the operation reception unit; anda sound setting unit setting sound to be outputted in accordance with operation received by the operation reception unit.2. The information processing device according to claim 1 , wherein the operation reception unit receives operation of scrolling the selection image.3. The information processing device according to claim 1 , wherein the sound output unit changes an output mode of the sound in accordance with a mode of the operation received by the operation reception unit.4. The information processing device according to claim 1 , wherein the sound output unit changes the sound in accordance with a speed of the operation received by the operation reception unit.5. The information processing device according to claim 1 , comprising a selection reception unit receiving selection of sound to be outputted by the sound output unit.6. The ...

FACIAL TRACKING WITH CLASSIFIERS FOR QUERY EVALUATION

Concepts for facial tracking with classifiers are disclosed. A plurality of images is captured, received, and partitioned into a series of image frames. The plurality of images is captured on an individual viewing a display. One or more faces is identified and tracked in the image frames using a plurality of classifiers. The plurality of classifiers is used to perform head pose estimation. The plurality of images is analyzed to evaluate a query of determining whether the electronic display was attended by the individual with the face. The analyzing includes determining whether the individual is in front of the screen, facing the screen, and gazing at the screen. An engagement score and emotional responses are determined for media and images provided on the display. A result is rendered for the query, based on the analysis. 1. A computer-implemented method for facial detection comprising:receiving a plurality of images of an individual viewing an electronic display; the identifying is based on a plurality of image classifiers;', 'the identifying occurs for at least one of the plurality of images; and', 'the plurality of image classifiers is used to perform head pose estimation;, 'identifying, using one or more processors, a face of the individual whereinanalyzing the plurality of images to evaluate a query of determining whether the electronic display was attended by the individual with the face; andrendering a result for the query, based on the analyzing.2. The method of wherein the receiving is in response to tagging of media rendered on the electronic display.3. The method of wherein being attended by the individual includes viewing of the electronic display.4. The method of wherein determination that the electronic display was attended is used in determining viewership.5. The method of wherein the electronic display renders an object and the viewing includes viewing the object.6. The method of wherein being attended by the individual includes determining ...

APPARATUS FOR CAPTURING MOVEMENTS OF A PERSON USING THE APPARATUS FOR THE PURPOSES OF TRANSFORMING THE MOVEMENTS INTO A VIRTUAL SPACE

Apparatus for detecting movements of a person using the apparatus for the purpose of transforming the movements into a virtual space, comprising a seat (), sensors which detect the movements of the feet of the person using the apparatus, and cyber foot covers () for receiving at least one of the sensors. The seat () comprises a support member () adapted in that a seat element (), on which the person using the apparatus can sit, is attachable to an upper portion of the support member () and in that the load of the seat element () is received substantially along a vertically arranged longitudinal axis of the support member () and transferred downwards to a ground. The seat () is rotatably arranged relative to the ground and is shaped such that at least a movement of the legs from the knee to the distal end of the legs of the person using the apparatus is allowed. The cyber foot covers () each have a sole () and fastening means () with which the cyber foot covers () can be fastened to the legs of the person using the apparatus. The sole () of the cyber foot covers () is curved so as to allow a continuous sliding rolling movement of the feet of the person using the apparatus during movement of the legs of the person using the apparatus. 1. A cyber foot cover for use in an apparatus for detecting movements of a person using the apparatus , the cyber foot cover comprising: fastening means with which the foot cover is attachable to the leg of the person using the apparatus, and', 'a sole which is curved so as to allow a continuously sliding rolling movement of the foot of the person using the apparatus during movement of the legs of the person using the apparatus,, 'a foot cover for receiving at least one sensor, or at least one marker to track the movement of the foot,'} wherein the sole has a front region and a rear region in the longitudinal direction, and', 'wherein a radius of the convex curvature of the sole in the front region of the sole is larger than in the rear ...

Method and system for consumer purchase using physiological change monitoring

A method for product identification based on physiological response includes: displaying a plurality of display screens over a period of time, wherein at least one display screen includes one or more displayed products; storing a display time for each displayed product corresponding to a time of the period of time at which the displayed product and the respective display screen is displayed on the display device; receiving a plurality of physiological measurements over the period of time for a first physiological function of a user of the computing device; detecting a change in the first physiological function based on the plurality of physiological measurements and a change time for the detected change; identifying a specific displayed product based on a correspondence between the respective display time and the detected change time; and transmitting product data associated with the specific displayed product.

Apparatus and method for providing boost protection logic

An apparatus, such as a haptic-enabled device, and a method for providing boost protection logic are presented. The method comprises receiving, by a control circuit of the apparatus, a nonzero drive signal to be used by the haptic actuator to generate a haptic effect. The control circuit causes a first portion of the nonzero drive signal to be applied to the haptic actuator in a boost mode. The control circuit detects a boost duration exceeding a first defined time threshold, such as a boost timeout threshold, or detects an accumulated boost time exceeding the first defined time threshold. In response, the control circuit causes a second portion of the nonzero drive signal to be applied to the haptic actuator in an amplitude-limited mode.

Control Method, Terminal, and System

A control method includes obtaining feature data using at least one sensor, the feature data being acquired by the terminal using the at least one sensor, generating an action instruction based on the feature data and a decision-making mechanism of the terminal, and executing the action instruction. In this application, various aspects of feature data are acquired using a plurality of sensors, data analysis is performed on the feature data, and a corresponding action instruction is then generated based on a corresponding decision-making mechanism to implement interactive control. 145.-. (canceled)46. A control method , applied to a terminal , comprising:obtaining feature data using a sensor, wherein the feature data comprises biological feature data of a user and environmental feature data;authenticating the user based on the biological feature data;generating a first action instruction based on the biological feature data, the environmental feature data and a first decision-making mechanism of the terminal; andexecuting the first action instruction in response to the authenticating.47. The method of claim 46 , wherein generating the first action instruction comprises controlling claim 46 , based on a part of the environmental feature data and a part of the biological feature data claim 46 , the terminal to display a current movement picture.48. The method of claim 46 , wherein generating the first action instruction comprises controlling claim 46 , based on a part of the environmental feature data and a part of the biological feature data claim 46 , the terminal to prompt road driving information.49. The method of claim 46 , wherein generating the first action instruction comprises:obtaining environmental status information based on at least one of temperature data, humidity data, image data, image depth data, direction data, or position data in the feature data, wherein the environmental status information comprises object element information and comfort level ...

MOTION DEVICE FOR VIRTUAL REALITY INTERACTION AND VIRTUAL REALITY SYSTEM

A motion device for a virtual reality interaction includes a core, a running belt carried by the core and a frame. The running belt is configured to wrap the core and capable of sliding on the outer surface of the core. The running belt includes a number of running belt units. A surface of each running belt unit facing the core is provided with a number of grooves, and each groove of each running belt unit is connected with a corresponding groove of an adjacent running belt unit through an elastic strap. The frame is located at a periphery of the running belt and is configured to carry the running belt and the core. A number of first balls are arranged between the frame and the running belt. 1. A motion device for a virtual reality interaction , comprising:a core;a running belt carried by the core, wherein the running belt is configured to wrap the core and capable of sliding on an outer surface of the core, the running belt comprises a plurality of running belt units, a surface of each running belt unit facing the core is provided with a plurality of grooves, and each groove of each running belt unit is connected with a corresponding groove of an adjacent running belt unit through an elastic strap; anda frame located at a periphery of the running belt and configured to carry the running belt and the core, wherein a plurality of first balls are arranged between the frame and the running belt.2. The motion device for the virtual reality interaction according to claim 1 , wherein the outer surface of the core is provided with a plurality of sockets claim 1 , and a second ball is arranged in each socket.3. The motion device for the virtual reality interaction according to claim 1 , wherein a cross section of each running belt unit is hexagonal claim 1 , and a corresponding groove is provided along a perpendicular bisector of each side of the hexagon.4. The motion device for the virtual reality interaction according to claim 1 , wherein the running belt is an omni- ...

Systems and methods for using imagined directions to define an action, function or execution for non-tactile devices

A system and method for controlling a non-tactile device including a receiving device configured to receive signals corresponding to a user's brain waves or movements, the brain waves or movements corresponding to a series of directional intentions, the intentions defining at least one line pattern, a processor configured to process the at least one line pattern, each of said at least one line patterns associated with an action of the device, and output a control signal to the non-tactile device related to the action.

FLICKERING MITIGATION WHEN TOGGLING EYEPIECE DISPLAY ILLUMINATION IN AUGMENTED REALITY SYSTEMS

An augmented reality display system is disclosed. The system can include a partially transparent eyepiece, an ambient light sensor, and an image input device. The image input device can include a light source and a spatial light modulator. The system can also include a controller that determines that no virtual content is being displayed to the user and compares the ambient light to display light to determine if a light source shutoff criterion is satisfied. The light source shutoff criterion can be indicative of whether shutting off the light source that illuminates the spatial light modulator will result in a change in the display light that will be user-perceptible. If the light source shutoff criterion is satisfied, the controller can turn off the light source.

CONTINUOUSLY LEARNING AND OPTIMIZING ARTIFICIAL INTELLIGENCE (AI) ADAPTIVE NEURAL NETWORK (ANN) COMPUTER MODELING METHODS AND SYSTEMS

Continuously learning and optimizing artificial intelligence (AI) adaptive neural network (ANN) computer modeling methods and systems, designated human affect computer modeling (HACM) or affective neuron (AN), and, more particularly, to AI methods, systems and devices that can recognize, interpret, process and simulate human reactions and affects such as emotional responses to internal and external sensory stimuli, that provides real-time reinforcement learning modeling that reproduces human affects and/or reactions, wherein the human affect modeling (HACM) can be used singularly or collectively to modeling and predict complex human reactions and affects. 1. A continuously learning and optimizing artificial intelligence (AI) adaptive neural network (ANN) computer modeling method for predicting , modeling , and simulating human reactions to repeated human stress and/or affect responses to sensory inputs from both external and internal environmental stimuli , the method using learning control and multiple parallel processing neural network pathways , and not using pattern recognition , the AI ANN modeling method comprising:(a) executing at least one sensory input collection module on at least one computer system using non-transitory computer readable media operative to collect sensory input data representing at least one set of external environment stimuli inputs and at least one set of internal environmental stimuli inputs from at least one internal environment and at least one external environment;(b) executing at least one recording module on at least one computer system using non-transitory computer readable media operative for recording the sensory input data, wherein the sensory input data corresponds to at least two sensory input-specific features;(c) executing at least one context module on at least one computer system using non-transitory computer readable media operative to identify and generate at least one current context AI ANN model that processes said ...

Electronic device and control method of electronic device

An electronic device includes a tactile sensation providing unit 30 configured to provide a tactile sensation to a contact object being in contact with a panel 10 and a controller 50 configured to control the tactile sensation providing unit 30 based on an amount of change of data based on press to the panel 10.

Method, Device, Mobile User Apparatus and Computer Program for Controlling an Audio System of a Vehicle

In a method for controlling an audio system of a vehicle, an intention to communicate and/or a voice of at least one of a specific, occupant of the vehicle and/or of an occupant on a specific seat of the vehicle, are/is sensed, and at least one audio signal of the vehicle is changed as a function of the sensed intention to communicate and/or the voice of the occupant. 1. A method for controlling an audio system of a vehicle comprising:capturing at least one of an intention to communicate and a voice of an occupant of the vehicle or an occupant in a specific seat of the vehicle, andchanging an audio signal of the vehicle depending on the at least one of the intention to communicate and the voice.2. The method according to claim 1 , further comprising recognizing that the voice is the voice of a particular person or group of people claim 1 , and recognizing that a change to the audio signal depends on a recognition of the voice as the voice of the particular person or group of people.3. The method according to claim 1 , wherein the voice of a speaker in an interior of the vehicle is distinguished from a voice from a multimedia recorder of a vehicle sound system or a multimedia recorder connected to and carried along with the vehicle.4. The method according to claim 1 , wherein detecting the intention to communicate of at least one occupant of the vehicle is carried out by detecting claim 1 , by an interior camera claim 1 , at least one of a lip movement and a physical motion.5. The method according to claim 3 , whereinthe audio signal is adjusted depending on a position of the speaker and/or a relative direction from which spoken content comes or will come according to the intention to communicate.6. The method according to claim 1 , whereinat least one of an emotion detection and an intent detection for an occupant of the vehicle is recognized and is taken into account when a change of the audio signal is carried out.7. The method according to claim 1 , further ...

Method for objectively tracking and analyzing the social and emotional activity of a patient

A method and system for objectively tracking and analyzing the social and emotional activity of a patient using an augmented reality computing device is provided. A patient is permitted to manually manipulate a target object in the physical world while viewing an augmented version showing a unique animated character representing either an abstract language, emotions, or social skills, depending on the module. The present system tracks and records the active face and the time spent on the active face, where the active face is the face upon which the patient's focus is automatically estimated, through calculation, to be trained upon. An observer views the session, the data recorded, and an automatically generated graphical representation of the data, which permits the observer to speak to patient regarding the character or scene rendered on the face which is determined to be the active face, helping the student engage in the session.

System and method for controlling data transmissions using human state-based data

A system and method are provided to control the transmission of data based at least in part on a detected or sensed human state (e.g., emotion) of the user. Personal data of a user may be detected by a sensor of the system. Human state information may be determined based on the personal data. Human state information may be used to control transmission of an intended data transmission of the user. The user may be notified of data transmission control. The system may further user complementary information to determine to control data transmission.

Compensating Drift of a Sensor System for Measuring a Motion Direction of a User During Usage of a VR System

A method for compensating drift of a motion direction sensor system for measuring a motion direction of a user in a VR system includes receiving a measured viewing direction of the user from a viewing direction sensor system for measuring a viewing direction at a measurement time, receiving a measured motion direction of the user from the motion direction sensor system for measuring a motion direction at the same measurement time, and calculating a drift compensation from the difference between the measured viewing direction of the user and the measured motion direction of the user so that a drift compensated motion direction of the user can be determined by adding the calculated drift compensation to a subsequently measured motion direction of the user. One embodiment includes a computer program product and a device configured to perform the method. 1100. A method for iteratively compensating drift of a motion direction sensor system for measuring a motion direction of a user during usage of a VR system () , the method comprising:receiving a measured viewing direction of the user from a viewing direction sensor system for measuring an angular position indicative of the user's head orientation in the user's transverse ane at a measurement time;receiving a measured motion direction of the user from the motion direction sensor system for measuring an angular position indicative of a direction of the user's walking or running movements in the user's transverse plane at the same measurement time; andcalculating a drift compensation from the difference between the measured viewing direction of the user and the measured motion direction of the user,such that a drift compensated motion direction of the user can be determined by adding the calculated drift compensation to a subsequently measured motion direction of the user;wherein the drift compensation is only calculated provided that the viewing direction of the user at the measurement time does not deviate from a ...

SYSTEM AND METHOD FOR DETECTING INVISIBLE HUMAN EMOTION IN A RETAIL ENVIRONMENT

A system for detecting invisible human emotion in a retail environment is provided. The system comprises a camera and an image processing unit. The camera is configured in a retail environment to capture an image sequence of a person before and during when a price of a product or service becomes visible. The image processing unit is trained to determine a set of bitplanes of a plurality of images in the captured image sequence that represent the hemoglobin concentration (HC) changes of the person, and to detect the person's invisible emotional states based on HC changes. The image processing unit is trained using a training set comprising a set of subjects for which emotional state is known. 1. A system for detecting invisible human emotion in a retail environment within which a product is displayed in a product display to a person , the system comprising:a price display device for selectively displaying at least one price of the product, pursuant to a point of sale event;a camera configured to capture an image sequence of the person before and during the point of sale event; anda processing unit trained to determine a set of bitplanes of a plurality of images in the captured image sequence that represent the hemoglobin concentration (HC) changes of the person, to detect the person's invisible emotional states based on the HC changes, and to output the detected invisible emotional states, the processing unit being trained using a training set comprising HC changes of subjects with known emotional states.2. The system of claim 1 , wherein detecting the person's invisible emotional states based on the HC changes comprises generating an estimated statistical probability that the person's emotional state conforms to a known emotional state from the training set claim 1 , and a normalized intensity measure of such determined emotional state.3. The system of claim 1 , wherein the point of sale event comprises the price display device displaying a price.4. The system of ...

Substrate

A substrate includes: a plurality of wiring patterns arranged to face each other; an electronic component that is disposed between the wiring patterns and has electrodes at both end portions; and a conductive member that connects the wiring patterns to the electrodes, wherein the wiring patterns have such a shape that a distance between the wiring patterns changes in a region where the electronic component is disposed.

DISPLAY DEVICE

A display device includes a display panel, a first force sensor, a first vibration generator, and a first electromagnetic wave shielding member. The first force sensor is disposed under the display panel. The first vibration generator is disposed under the display panel and adjacent to the first force sensor. The first electromagnetic wave shielding member surrounds side surfaces of the first vibration generator. 1. A display device comprising:a display panel;a first force sensor disposed under the display panel;a first vibration generator disposed under the display panel and adjacent to the first force sensor; anda first electromagnetic wave shielding member surrounding side surfaces of the first vibration generator.2. The display device of claim 1 , wherein an upper surface of the first electromagnetic wave shielding member is closer to the display panel than an upper surface of the first vibration generator.3. The display device of claim 1 , further comprising:a middle frame disposed under the display panel.4. The display device of claim 3 , wherein the first electromagnetic wave shielding member is between a lower surface of the display panel and an upper surface of the middle frame.5. The display device of claim 3 , further comprising:a first adhesive layer attached to the first electromagnetic wave shielding member, the first adhesive layer being between a lower surface of the display panel and the first electromagnetic wave shielding member; anda second adhesive layer attached to the first electromagnetic wave shielding member and an upper surface of the middle frame.6. The display device of claim 3 , wherein:the first electromagnetic wave shielding member protrudes from an upper surface of the middle frame; andthe display device further comprises a third adhesive layer attached to the first electromagnetic wave shielding member, the third adhesive layer being between a lower surface of the display panel and the first electromagnetic wave shielding member.7. ...

Interval selection interface for a touchscreen device

A computer system provides a user interface for selecting intervals on a touchscreen device. A user interface is generated with a plurality of interval elements each representing an interval within a sequence. Contact is detected on the screen by a user at a location corresponding to the interval element and associated with a selected interval. A plurality of adjustment elements are generated proximate to the selected interval, wherein the adjustment elements enable modification of a span of the selected interval and a position of the selected interval in the sequence. A selection of one or more adjustment elements is received. One or more from a group of the span and position of the selected interval are modified based on the selected one or more adjustment elements. Embodiments of the present invention further include a method and program product for providing a user interface for selecting intervals on a touchscreen device in substantially the same manner described above.

HAPTIC FEEDBACK AND CAPACITIVE SENSING IN A TRANSPARENT TOUCH SCREEN DISPLAY

Consistent with an example embodiment, a user (touch screen) interface has haptic feedback. The user interface comprises, a substrate, a transparent bottom electrode on top of the substrate, a transparent wrinkling layer on top of the transparent bottom electrode, a transparent top electrode on top of the transparent wrinkling layer; and a transparent protective surface on top of the transparent top electrode. The transparent wrinkling layer changes from a smooth surface to a roughened surface upon application of a voltage between the top electrode and the bottom electrode; the voltage generates an electrostatic force mutually attracting the top and bottom electrodes to exert a compressive force upon the transparent wrinkling layer sufficient to generate a degree of surface wrinkling that is perceptible to the touch. 1. A user interface having haptic feedback , the user interface comprising:a substrate,a transparent bottom electrode on top of the substrate;a transparent wrinkling layer on top of the transparent bottom electrode; 'wherein the transparent wrinkling layer changes from a smooth surface to a roughened surface upon application of a voltage between the top electrode and the bottom electrode, the voltage generating an electrostatic force mutually attracting the top and bottom electrodes to exert a compressive force upon the transparent wrinkling layer sufficient to generate a degree of surface wrinkling perceptible to the touch; and', 'a transparent top electrode on top of the transparent wrinkling layer; and'}a transparent protective surface on top of the transparent top electrode.2. The user interface as recited in claim 1 , wherein the degree of surface wrinkling is a function of a spatial wavelength (λ) a modulation depth (a) claim 1 , a Poisson's ratio (ν) claim 1 , and a thickness (D) of the transparent wrinkling layer.3. The user interface as recited in claim 1 , wherein the voltage on the top electrode is conductively or capacitively supplied or ...

METHOD AND APPARATUS FOR CONTROLLING VIBRATION

A control method in an input device is provided. The control method includes receiving, from a portable device, event information corresponding to coordinates indicated by the input device, and controlling a display of the input device based on the received event information. 1. A control method in an input device , the control method comprising:receiving, from a portable device, event information corresponding to coordinates indicated by the input device; andcontrolling a display of the input device based on the received event information.2. The control method of claim 1 , wherein receiving the event information comprises receiving event information related to an object displayed on the portable device at a position corresponding to the coordinates indicated by the input device.3. The control method of claim 2 , wherein receiving the event information comprises receiving image data of an image at the spot corresponding to the coordinates indicated by the input device.4. The control method of claim 3 , wherein controlling the display comprises displaying the received image data on the display.5. The control method of claim 4 , wherein controlling the display comprises sequentially displaying at least a part of the image data to the whole image data.6. The control method of claim 4 , further comprising acquiring a selection of at least a part of the image data displayed on the display.7. The control method of claim 6 , further comprising transmitting an event execution command corresponding to the selected at least part of the image data to the portable device claim 6 , wherein the portable device operates based on the event execution command.8. The control method of claim 7 , wherein the portable device further operates based on the coordinates of the input device.9. The control method of claim 1 , further comprising receiving claim 1 , from the portable device claim 1 , pressure information indicating a contact pressure between the portable device and the input ...

ARTIFICIAL INTELLIGENCE APPARATUS USING SOUND SIGNAL CLASSIFICATION AND METHOD FOR THE SAME

A method for controlling an AI apparatus mounted on home appliance, the method comprising: receiving a sound signal at a predetermined time; removing noises of the received signal and separating the signal from which the noises are removed, into a signal by a user and a device signal; acquiring a result value outputted by an AI model by inputting the separated signal to the AI model using a multi-class separation; and executing a sleep mode of the home appliance and outputting a sleep mode switch notice when the result value is a user sleep, and requesting a feedback from the user when the result value is an unclear signal and updating the AI model using the feedback. 1. An artificial intelligence (AI) apparatus mounted on home appliance , comprising:an input interface configured to receive a sound signal using a microphone; and obtain, via the input interface, the sound signal,', 'provide the sound signal as an input value to an AI model,', 'control the home appliance to execute a sleep mode when an output value of the AI model is determined to be a user sleep., 'a processor configured to;'}2. The AI apparatus according to claim 1 , wherein the AI model comprises a multi-class classification model that classifies a user non-sleep claim 1 , a user sleep claim 1 , a device signal and an unclear signal as a result value according to previously learned data3. The AI apparatus according to claim 2 , wherein the multi-class classification model comprises a neural network configured to use a sound signal as the input value claim 2 , and adjust a weight by a training claim 2 ,wherein a weight of the neural network is adjusted by using a sound signal as the input value and labeling the user sleep, the user non-sleep and the unclear signal as the result value.4. The AI apparatus according to claim 2 , wherein the processor is configured to remove noises of the sound signal received from the input interface claim 2 , separate a signal from which the noises are removed claim 2 ...

Haptically Enabled User Interface

A device has a user interface that generates a haptic effect in response to user inputs or gestures. In one embodiment, the device receives an indication that the user is scrolling through a list of elements and an indication that an element is selected. The device determines the scroll rate and generates a haptic effect that has a magnitude that is based on the scroll rate. 1. A system comprising:a processor; and receive an indication that an object has been flicked by a user gesture and that the object has reached an end point that causes the object to bounce;', 'cause a haptic effect to be output when the object has reached the end point, wherein the haptic effect decreases in magnitude as the bounced object comes to rest; and', 'cause a second haptic effect to be output to confirm that the bounced object has come to rest., 'a memory on which instructions executable by the processor are stored to cause the processor to2. The system of claim 1 , wherein the memory further comprises instructions executable by the processor to cause the processor to determine a speed of the flick claim 1 , wherein a speed of the object is determined based on the speed of the flick.3. A device comprising:a processor; and store a gesture on the device, wherein the gesture comprises a user interaction associated with a directional motion on a touchscreen, and', 'cause a dynamic haptic effect that simulates the gesture to be output, wherein the dynamic haptic effect is applied to different individual portions of the touchscreen in series to simulate the directional motion., 'a memory on which instructions executable by the processor are stored to cause the processor to4. The device of claim 3 , wherein causing the dynamic haptic effect to be output comprises causing a haptic effect that changes amplitude to simulate a varied pressure portion of the gesture to be output claim 3 , wherein the varied pressure portion includes a varied finger pressure data pattern associated with the ...

Intelligent Alerting Method, Terminal, Wearable Device, and System

An intelligent alerting method and a terminal to obtain human body status information and determine an alerting occasion and mode according to the human body status information where the method includes: obtaining, by a terminal, human body status information of a user, where the human body status information is status information obtained after basic human body parameter data is combined, the human body status information representing a body status of the user, and the basic human body parameter data is vital sign data obtained through detection by the terminal or by a wearable device that has a communications connection relationship with the terminal determining, by the terminal, an alerting mode according to the human body status information and a predefined alerting policy, and providing, by the terminal, a corresponding alert according to the alerting mode.

Control apparatus and control program

An apparatus includes a housing having a holding portion for gripping by a hand of a user; a manipulation block having a first side that includes at least one of: (i) one or more pressable buttons, and (ii) a stick button, and having a second side that includes a trigger button; and at least one of: (i) a thumb sensor block, located proximate to the first side of the manipulation block, and operable to detect the presence of the thumb of the hand of the user when the holding portion is gripped by the user, (ii) a first finger sensor, located on the trigger button, and operable to detect the presence of the at least one finger of the hand of the user when the holding portion is gripped by the user, and (iii) a second finger sensor, located proximate to both the second side of the manipulation block and the holding portion of the housing, and operable to detect the presence of at least one of a middle finger, a ring finger, and a pinky finger of the hand of the user when the holding portion is gripped by the user.