Method and system for tracking objects

An object tracking system and method operable to minimize processing time for tracking objects is provided. The system includes a pair of filters operable to make associations between dynamic objects newly detected and previously detected. One of the pair of filters makes an association when the predicted location of the previously detected objects is within a predetermined distance of the newly detected object. The other of the pair of filters makes an association based upon the probability that a newly detected dynamic object is a previously detected dynamic object. The remaining unassociated dynamic objects are then localized so as to form discrete matrices for optimization filters.

SYSTEMS AND METHODS FOR VALIDATING AND CUSTOMIZING OLIGONUCLEOTIDES SEQUENCES

A system and method is provided to customize and validate an oligonucleotide plate and/or tube design. A graphical user interface enables a user to submit oligo design data in a series of steps. One or more rules are used to validate the oligo plate design data as it is submitted. The graphical user interface also enables the user to modify oligonucleotide design data to correct errors and/or to obtain a valid oligonucleotide plate design. 1. A method for generating and validating an oligonucleotide container design comprising oligonucleotide container design data , the method comprising:retrieving at least one oligonucleotide constraint from a memory at at least one processor;receiving at least one input identifying at least one portion of the oligonucleotide container design data at the at least one processor; andautomatically and continuously validating the oligonucleotide container design data with the at least one oligonucleotide constraint at the at least one processor.2. The method of claim 1 , further comprising:identifying an error with the oligonucleotide container design data;enabling at least one other input to correct the oligonucleotide container design data; andautomatically and continuously validating the corrected oligonucleotide container design data with the at least one oligonucleotide constraint.3. The method of claim 1 , wherein the oligonucleotide container design comprises at least one oligonucleotide claim 1 , each of the at least one oligonucleotides situated within a single container of at least one container claim 1 , wherein the single container is a tube or a well in a plate.4. The method of claim 3 , wherein the oligonucleotide container design data comprises format data claim 3 , sequence data claim 3 , specification data claim 3 , packaging options and any combination thereof.5. The method of claim 4 , further comprising:generating a display with the oligonucleotide container design data;identifying an error with the oligonucleotide ...

System and Method for Processing Messages in a Messaging Service

A method, system and server for processing messages sent from a client in a network are provided. The method comprises: for a message for a conversation to be transmitted from a client associated with a first user account of a plurality of user accounts associated with the network to a set of user accounts of the plurality of user accounts, upon activation of a command to send the message, sending to the set of user accounts a request message requesting acceptance of the conversation; receiving replies from the set of user accounts to the request message; and sending the message for the conversation to a first subset of accounts associated with the set of user accounts that generated an acceptance message for the request message and updating a message log associated with the conversation to indicate that the first subset of accounts has accepted the conversation as participants in the conversation. A method, system and server for message archiving are also provided. 1. A method for processing messages sent from a client in a network , the method comprising:for a message for a conversation to be transmitted from a client associated with a first user account of a plurality of user accounts associated with the network to a set of user accounts of the plurality of user accounts, upon activation of a command to send the message, sending to the set of user accounts a request message requesting acceptance of the conversation;receiving replies from the set of user accounts to the request message; andsending the message for the conversation to a first subset of accounts associated with the set of user accounts that generated an acceptance message for the request message and updating a message log associated with the conversation to indicate that the first subset of accounts has accepted the conversation as participants in the conversation.2. The method of claim 1 , further comprising:not providing the message to a second subset of accounts associated with the set of user ...

Tracking on-road vehicles with sensors of different modalities

A vehicle system includes a first sensor and a second sensor, each having, respectively, different first and second modalities. A controller includes a processor configured to: receive a first sensor input from the first sensor and a second sensor input from the second sensor; detect, synchronously, first and second observations from, respectively, the first and second sensor inputs; project the detected first and second observations onto a graph network; associate the first and second observations with a target on the graph network, the target having a trajectory on the graph network; select either the first or the second observation as a best observation based on characteristics of the first and second sensors; and estimate a current position of the target by performing a prediction based on the best observation and a current timestamp.

3D OBJECT SHAPE AND POSE ESTIMATION AND TRACKING METHOD AND APPARATUS

A method and apparatus for estimating and tracking a 3D object shape and pose estimation is disclosed A plurality of 3D object models of related objects varying in size and shape are obtained, aligned and scaled, and voxelized to create a 2D height map of the 3D models to train a principle component analysis model. At least one sensor mounted on a host vehicle obtains a 3D object image. Using the trained principle component analysis model, the processor executes program instructions to estimate the shape and pose of the detected 3D object until the shape and pose of the detected 3D object matches one principle component analysis model. The output of the shape and pose of the detected 3D object is used in one vehicle control function. 1. A method for estimating the shape and pose of a 3D object comprising:detecting a 3D object external to a host using at least one image sensor;using a processor, estimating at least one of the shape and pose of the detected 3D object relative to the host; andproviding an output of the estimated 3D object shape and pose.2. The method of further comprising:obtaining a plurality of 3D object models, where the models are related to a type of object, but differ in shape and size;using a processor, aligning and scaling the 3D object models;voxelizing the aligned and scaled 3D object models;creating a 2D height map of the voxelized 3D object models; andtraining a principle component analysis model for each of the unique shapes of the plurality of 3D object models.3. The method of further comprising:storing the principle component analysis model for 3D object models in a memory coupled to the processor.4. The method of further comprising:for each successive image of the detected 3D object, iterating the estimation of the shape and pose of the detected 3D object until the model of the 3D object matches the shape and pose of the detected 3D object.5. The method of wherein the 3D object is a vehicle and the host is a vehicle.6. The method of ...

Camera-Based Input Device

In embodiments of a camera-based input device, the input device includes an inertial measurement unit that collects motion data associated with velocity and acceleration of the input device in an environment, such as in three-dimensional (3D) space. The input device also includes at least two visual light cameras that capture images of the environment. A positioning application is implemented to receive the motion data from the inertial measurement unit, and receive the images of the environment from the at least two visual light cameras. The positioning application can then determine positions of the input device based on the motion data and the images correlated with a map of the environment, and track a motion of the input device in the environment based on the determined positions of the input device.

Augmenting a Moveable Entity with a Hologram

In embodiments of augmenting a moveable entity with a hologram, an alternate reality device includes a tracking system that can recognize an entity in an environment and track movement of the entity in the environment. The alternate reality device can also include a detection algorithm implemented to identify the entity recognized by the tracking system based on identifiable characteristics of the entity. A hologram positioning application is implemented to receive motion data from the tracking system, receive entity characteristic data from the detection algorithm, and determine a position and an orientation of the entity in the environment based on the motion data and the entity characteristic data. The hologram positioning application can then generate a hologram that appears associated with the entity as the entity moves in the environment. 1. An alternate reality device implemented for augmenting an entity with a hologram , the alternate reality device comprising:a tracking system configured to recognize the entity in an environment and track movement of the entity in the environment;a detection algorithm configured to identify the entity based on identifiable characteristics of the entity; receive motion data from the tracking system;', 'receive entity characteristic data from the detection algorithm;', 'determine a position and an orientation of the entity in the environment based on the motion data and the entity characteristic data; and', 'generate the hologram that appears associated with the entity as the entity moves in the environment., 'a memory and processor system configured to execute a hologram positioning application that is implemented to2. The alternate reality device as recited in claim 1 , wherein:the entity being tracked is a feature of a person; andthe tracking system comprises skeletal tracking configured to track the movement of the feature of the person in the environment based on the skeletal tracking.3. The alternate reality device as ...

SYSTEMS AND METHODS FOR CONTINUOUS IMAGE ALIGNMENT OF SEPARATE CAMERAS

A system for continuous image alignment of separate cameras identifies a reference camera transformation matrix between a base reference camera pose and an updated reference camera pose. The system also identifies a match camera transformation matrix between a base match camera pose and an updated match camera pose and an alignment matrix based on visual correspondences between one or more reference frames captured by the reference camera and one or more match frames captured by the match camera. The system also generates a motion model configured to facilitate mapping of a set of pixels of a reference frame captured by the reference camera to a corresponding set of pixels of a match frame captured by the match camera based on the reference camera transformation matrix, the match camera transformation matrix, and the alignment matrix. 1. A system for facilitating continuous image alignment of two cameras , the system comprising:one or more processors; and identify a reference camera transformation matrix between a base reference camera pose and an updated reference camera pose, the base reference camera pose being associated with a base reference camera timepoint that occurs prior to an updated reference camera timepoint;', 'identify a match camera transformation matrix between a base match camera pose and an updated match camera pose, the base match camera pose being associated with a base match camera timepoint that occurs prior to an updated match camera timepoint;', 'identify an alignment matrix based on visual correspondences between one or more reference frames captured by the reference camera and one or more match frames captured by the match camera; and', 'generate a motion model configured to facilitate mapping of a set of pixels of a reference frame captured by the reference camera to a corresponding set of pixels of a match frame captured by the match camera, the motion model being generated based on at least the reference camera transformation matrix, ...

Driving an Image Capture System to Serve Plural Image-Consuming Processes

A technique is described herein that employs a resource-efficient image capture system. The image capture system includes an active illumination system for emitting electromagnetic radiation within a physical environment. The image capture system also includes a camera system that includes one or more cameras for detecting electromagnetic radiation received from the physical environment, to produce image information. In one implementation, the technique involves using the same image capture system to produce different kinds of image information for consumption by different respective image processing components. The technique can perform this task by allocating timeslots over a span of time for producing the different kinds of image information. In one case, the image processing components include: a pose tracking component; a controller tracking component; and a surface reconstruction component, etc., any subset of which may be active at any given time. 1. A computing device , comprising: an active illumination system for emitting electromagnetic radiation within a physical environment; and', 'a camera system that includes one or more cameras for detecting electromagnetic radiation received from the physical environment, to produce image information;, 'an image capture system that includes receive one or more mode control factors;', 'identify a control mode based on said one or more mode control factors; and', 'in response to the control mode, drive the image capture system; and, 'a mode control system configured toone or more image processing components configured to process the image information provided by the camera system in different respective ways,the image capture system producing the image information over a span of time, andthe mode control system being configured to drive the image capture system by allocating timeslots within the span of time for producing component-targeted image information that is targeted for consumption by at least one particular ...

DISPLAY ACTIVE ALIGNMENT SYSTEM FOR WAVEGUIDE DISPLAYS

A display system includes a display alignment tracker configured track the position of a first signal and the position of a second signal. The display alignment tracker optically multiplexes a portion of a first signal and a portion of the second signal into a combined optical signal and measures a differential between the first signal and the second signal. 1. A system for rendering optical signals on a head-mounted display , the system comprising:a first waveguide configured to guide a first signal therethrough;a second waveguide configured to guide a second signal therethrough;an optical multiplexer in optical communication with the first waveguide and the second waveguide, the optical multiplexer configured to combine at least a portion of the first signal and at least a portion of the second signal; andan optical sensor in optical communication with the optical multiplexer and configured to receive a combined optical signal including at least a portion of the first signal and at least a portion of second signal.2. The system of claim 1 , wherein the first signal includes at least three optical channels.3. The system of claim 1 , further comprising a first diffraction optical element positioned between the first waveguide and the optical multiplexer and a second diffraction optical element positioned between the second waveguide and the optical multiplexer.4. The system of claim 1 , wherein the optical multiplexer is configured to combine all of the first signal and all of the second signal.5. The system of claim 1 , wherein the first signal and second signal include a test pattern.6. The system of claim 1 , wherein the optical multiplexer is a prism assembly.7. The system of claim 1 , wherein first waveguide and the second waveguide have an input surface and an output surface claim 1 , the optical multiplexer is positioned on the output surface of the first waveguide and the second waveguide.8. The system of claim 1 , wherein the first waveguide is mounted to a ...

DISPLAY ACTIVE ALIGNMENT SYSTEMS UTILIZING TEST PATTERNS FOR CALIBRATING SIGNALS IN WAVEGUIDE DISPLAYS

A display system includes a display alignment tracker configured track the position of a first signal in a first waveguide and the position of a second signal in a second waveguide. The display alignment tracker optically multiplexes a portion of a first signal and a portion of the second signal into a combined optical signal and measures a differential between the first signal and the second signal. The differential is used to adjust the position, dimensions, or a color attribute of the first signal relative to the second signal. 1. A method of display alignment tracking for a head-mounted device , the method comprising:sampling a first signal from a first waveguide;sampling a second signal from a second waveguide;combining the first signal and second signal optically into a combined optical signal;detecting a test pattern within the combined optical signal, the test pattern being included within each of the first signal and the second signal; andcomparing at least a first physical position corresponding to the test pattern within the first signal and a second physical position corresponding to the test pattern with the second signal to identify a differential between the first physical position and the second physical position.2. The method of claim 1 , wherein comparing the first and second physical positions includes comparing pixel locations of the test pattern within the first signal and the second signal at a subpixel level and thereafter adjusting a rendering position for at least one of the first signal and the second signal.3. The method of claim 1 , wherein the method further includes comparing a color level associated with a rendering of the first signal to a color level associated with a rendering of the second signal and thereafter adjusting a color level for rendering at least one of the first signal and the second signal.4. The method of claim 1 , wherein the method further includes:providing the test pattern during a startup procedure of a display ...

Amplitude and biphase control of mems scanning device

A MEMS scanning device (“Device”) includes at least (1) laser projector(s) controlled by a laser drive to project a laser beam, (2) MEMS scanning mirror(s) controlled by a MEMS drive to scan the laser beam to generate a raster scan, (3) a display configured to receive the raster scan, (4) a thermometer configured to detect a current temperature, (5) a display observing camera configured to capture an image of a predetermined area of the display, and (6) a computer-readable media that stores temperature model(s), each of which is custom-built using machine learning. The device uses the display observing camera to capture image(s) of predetermined pattern(s), which are then used to extract feature(s). The extracted feature(s) are compared with ideal feature(s) to identify a discrepancy. When the identified discrepancy is greater than a threshold, the temperature model(s) are updated accordingly.

Virtual Rigid Framework for Sensor Subsystem

An apparatus for dynamically determining a displacement of a target sensor in an electronic system is disclosed. The apparatus can comprise a non-line-of-sight sensor rigidly mounted on or proximate to the target sensor and configured to measure a parameter that varies with the displacement of the target sensor. The apparatus further can comprise at least one processor coupled to the non-line-of-sight sensor and configured to compute the displacement of the target sensor based on the parameter, and to compute an adjustment value based on the computed displacement. 1. A near-to-eye display (NED) device comprising:a display subsystem to generate an image and to direct light representing the image to an eye of a user;a target sensor coupled to the display subsystem;a second sensor mounted on or proximate to the target sensor to measure a parameter that varies with a displacement of the target sensor; anda processor coupled to the second sensor and configured to compute the displacement of the target sensor based on the parameter.2. The NED device of claim 1 , wherein the processor is further configured to compute an adjustment value based on the computed displacement.3. The NED device of claim 1 , wherein the target sensor is a camera.4. The NED device of claim 3 , wherein the second sensor is a magnetic field sensor.5. The NED device of claim 4 , wherein the magnetic field sensor comprises coil mounted to a lens barrel of the camera.6. The NED device of claim 5 , wherein the magnetic field sensor comprises a coil that encircles a lens barrel of the camera.7. The NED device of claim 1 , further comprising:a transmitter to transmit a non-line-of-sight signal detectable by the second sensor.8. The NED device of claim 7 , wherein the transmitter comprises a magnetic field generator.9. The NED device of claim 7 , further comprising an inertial measurement unit rigidly coupled to the transmitter and configured to measure an orientation of the transmitter.10. The NED device ...

System and Method for Tracking Messages in a Messaging Service

A system, server and a method for processing messages received at a server device in a network are provided. The method comprises: for a message being transmitted from a first account associated with a client device to a second account in the network, receiving a message event associated with the message at the server; determining whether the message event is associated with an existing conversation involving the first account, and if so setting a sequence number associated with the message event to a value incremented from a current sequence number associated with the existing conversation, otherwise setting the sequence number to a value to track a new conversation; and sending the sequence number to the first user account. 1. A method for processing messages received at a server device in a network , the method comprising:receiving a message event associated with a message being transmitted from a first account associated with a first client device to a second account in the network associated with a second client device at the server;determining whether the message event is associated with an existing conversation involving the first account, and if so setting a sequence number associated with the message event to a value incremented from a current sequence number associated with the existing conversation, otherwise setting the sequence number to a value to track a new conversation; andsending the sequence number to the first user account.2. The method of claim 1 , further comprising:after the sequence number has been set, forwarding the message event to the second client device.3. The method of claim 2 , further comprising:storing the sequence number and the message event in a database.4. The method of claim 3 , further comprising:after the message event has been sent to the second client device, evaluating sequences numbers associated with the existing conversation to determine if there is a gap in an expected sequence of the sequence numbers; andwhen the gap ...

MODULAR REINFORCEMENT SYSTEMS AND METHOD

The invention relates to modular reinforcement units for use in constructing a reinforcement structure, and associated systems and methods. The modular reinforcement units are designed to allow flexibility of design in the reinforcement structures that can be created for use in a wide variety of applications and products. 1. A modular assembly unit comprising:a body portion having a length, width and depth;at least one connector including a universal engagement member having a connecting portion extending outwardly from a periphery of the body portion, the connecting portion having a length, width and depth.2. The modular assembly unit of claim 1 , where the connecting portion includes at least a portion extending back toward the body portion.3. The modular assembly unit of claim 2 , where a plurality of connecting portions are associated with the body portion and the portion extending back toward the body portion of each connecting portion associated with each connector are oriented in the same direction.4. The modular assembly unit of claim 1 , where the connecting portion includes at least a curved or rectangular portion extending back toward the body portion.5. The modular assembly unit of claim 1 , where the body portion has a plurality of vertices and a connector extends from at least one vertex.6. The modular assembly unit of claim 5 , where the body portion includes a finished edge.7. The modular assembly unit of claim 1 , where the body portion has a polygonal shape with a plurality of vertices spaced from one another claim 1 , and a plurality of ligaments connect the vertices to define edges of the body portion claim 1 , with a connector associated with each of the plurality of vertices and the hook portions of each extending at angles relative to the other hook portions.8. The modular assembly unit of claim 1 , where a plurality of ligaments form at least a part of the body portion.9. The modular assembly unit of claim 8 , where the one or more voids are ...

OBJECT AND ENVIRONMENT TRACKING VIA SHARED SENSOR

One disclosed example provides a head-mounted device configured to control a plurality of light sources of a handheld object and acquire image data comprising a sequence of environmental tracking exposures in which the plurality of light sources are controlled to have a lower integrated intensity and handheld object tracking exposures in which the plurality of light sources are controlled to have a higher integrated intensity. The instructions are further executable to detect, via an environmental tracking exposure, one or more features of the surrounding environment, determine a pose of the head-mounted device based upon the one or more features of the surrounding environment detected, detect via a handheld object tracking exposure the plurality of light sources of the handheld object, determine a pose of the handheld object relative to the head-mounted device based upon the plurality of light sources detected, and output the pose of the handheld object. 1. A head-mounted device , comprising:an image sensing system;a logic device configured to execute instructions; and acquire image data of a surrounding environment, the image data comprising a sequence of environmental tracking exposures in which the plurality of light sources are controlled to have a lower integrated intensity and handheld object tracking exposures in which the plurality of light sources are controlled to have a higher integrated intensity;', 'detect, via an environmental tracking exposure, one or more features of the surrounding environment;', 'determine a pose of the head-mounted device based upon the one or more features of the surrounding environment detected;', 'detect, via a handheld object tracking exposure, the plurality of light sources of the handheld object;', 'determine a pose of the handheld object relative to the head-mounted device based upon the plurality of light sources detected; and', 'output the pose of the handheld object determined., 'a storage device comprising instructions ...

Tracking wearable device and handheld object poses

One disclosed example provides a computing device configured to receive from an image sensor of a head-mounted device environmental tracking exposures and handheld object tracking exposures, determine a pose of the handheld object with respect to the head-mounted device based upon the handheld object tracking exposures, determine a pose of the head-mounted device with respect to a surrounding environment based upon the environmental tracking exposures, derive a pose of the handheld object relative to the surrounding environment based upon the pose of the handheld object with respect to the head-mounted device and the pose of the head-mounted device with respect to the surrounding environment, and output the pose of the handheld object relative to the surrounding environment for controlling a user interface displayed on the head-mounted device.

CALIBRATION OF STEREO CAMERAS AND HANDHELD OBJECT

One disclosed example provides a head-mounted device including a stereo camera arrangement, a logic device configured to execute instructions, and a storage device storing instructions executable by the logic device to, for each camera in the stereo camera arrangement, receive image data of a field of view of the camera, detect light sources of a handheld object in the image data, and based upon the light sources detected, determine a pose of the handheld object. The instructions are executable to, based upon the pose of the handheld object determined for each camera in the stereo camera arrangement, calibrate the stereo camera arrangement. 1. A head-mounted device , comprising:a stereo camera arrangement;a logic device configured to execute instructions; and [ receive image data of a field of view of the camera,', 'detect a plurality of light sources of a handheld object in the image data, and', 'based upon the plurality of light sources detected, determine a pose of the handheld object; and, 'for each camera in the stereo camera arrangement,'}, 'based upon the pose of the handheld object determined for each camera in the stereo camera arrangement, calibrate the stereo camera arrangement., 'a storage device comprising instructions executable by the logic device to'}2. The head-mounted device of claim 1 , wherein the instructions are executable to calibrate the stereo camera arrangement during one or more of a motion of the head-mounted device and a motion of the handheld object.3. The head-mounted device of claim 1 , wherein the instructions are executable to calibrate intrinsic characteristics for each camera of the stereo camera arrangement claim 1 , the intrinsic characteristics comprising one or more of lens distortion claim 1 , focal length claim 1 , and principal point.4. The head-mounted device of claim 1 , wherein the instructions are executable to calibrate extrinsic characteristics for each camera of the stereo camera arrangement claim 1 , the extrinsic ...

Handheld object pose determinations

One disclosed example provides a method for determining a pose of a handheld object in a surrounding environment. Optical pose data is stored in an image queue of a first filter. IMU data is received from an IMU of the handheld object and stored in an IMU queue of the first filter. Using at least a portion of the optical pose data and the IMU data, an initial pose of the handheld object is determined and outputted. The method determines that either the image queue or the IMU queue is empty. A second filter comprising the one empty queue and the other non-empty queue is instantiated as a copy of the first filter. Using the data from the non-empty queue in the second filter, the initial pose of the handheld object is updated to an updated pose, and the updated pose is outputted.

OBJECT AND ENVIRONMENT TRACKING VIA SHARED SENSOR

One disclosed example provides a head-mounted device configured to control a plurality of light sources of a handheld object and acquire image data comprising a sequence of environmental tracking exposures in which the plurality of light sources are controlled to have a lower integrated intensity and handheld object tracking exposures in which the plurality of light sources are controlled to have a higher integrated intensity. The instructions are further executable to detect, via an environmental tracking exposure, one or more features of the surrounding environment, determine a pose of the head-mounted device based upon the one or more features of the surrounding environment detected, detect via a handheld object tracking exposure the plurality of light sources of the handheld object, determine a pose of the handheld object relative to the head-mounted device based upon the plurality of light sources detected, and output the pose of the handheld object. 1. A head-mounted device , comprising:an image sensing system;a logic device configured to execute instructions; and control a plurality of light sources of a handheld object;', 'acquire, via the image sensing system, image data of the surrounding environment, the image data comprising a sequence of environmental tracking exposures and handheld object tracking exposures;', 'determine whether the handheld object is detectable in one or more handheld object tracking exposures; and', 'based upon the handheld object not being detectable in the one or more handheld object tracking exposures, perform an optical time synchronization between a clock domain of the head-mounted device and a clock domain of the handheld object., 'a storage device comprising instructions executable by the logic device to'}2. The head-mounted device of claim 1 , wherein determining whether the handheld object is detectable in the one or more handheld object tracking exposures comprises determining whether a plurality of visible light sources of ...

INTEGRATED FREE SPACE AND SURFACE INPUT DEVICE

In various embodiments, methods and systems for implementing integrated free space and surface inputs are provided. An integrated free space and surface input system includes a mixed-input pointing device for interacting and controlling interface objects using free space inputs and surface inputs, trigger buttons, pressure sensors, and haptic feedback associated with the mixed-input pointing device. Free space movement data and surface movement data are tracked and determined for the mixed-input pointing device. An interface input is detected for the mixed-input pointing device transitioning from a first input to a second input, such as, from a free space input to a surface input or from the surface input to the free space input. The interface input is processed based on accessing the free space movement data and the surface movement data. An output for the interface input is communicated from the mixed-input pointing device to interact and control an interface. 1. A mixed-input pointing device comprising: 'determine free space movement data of the mixed-input pointing device;', 'a free space tracking component configured to 'determine surface movement data of the mixed-input pointing device;', 'a surface tracking component configured to [ identifying free space movement data;', 'identifying surface movement data; and', 'generating an output using the free space movement data and the surface movement data, wherein movement data indicates at least a transition from the first input to the second input; and, 'process an interface input for the mixed-input pointing device transitioning from a first input to a second input, wherein processing the interface input is based on, 'communicate the output for the interface input of the mixed-input pointing device for to control an interface, wherein the output is generated based on the free movement data and surface movement data., 'an integrated processing component to2. The mixed-input pointing device of claim 1 , wherein the ...

Display active alignment system for waveguide displays

A display system includes a display alignment tracker configured track the position of a first signal and the position of a second signal. The display alignment tracker optically multiplexes a portion of a first signal and a portion of the second signal into a combined optical signal and measures a differential between the first signal and the second signal.

Display active alignment systems utilizing test patterns for calibrating signals in waveguide displays

A display system includes a display alignment tracker configured track the position of a first signal in a first waveguide and the position of a second signal in a second waveguide. The display alignment tracker optically multiplexes a portion of a first signal and a portion of the second signal into a combined optical signal and measures a differential between the first signal and the second signal. The differential is used to adjust the position, dimensions, or a color attribute of the first signal relative to the second signal.

AUTOCALIBRATED NEAR-EYE DISPLAY

A near-eye display device comprises right and left display projectors, expansion optics, and inertial measurement units (IMUs), in addition to a plurality of angle-sensitive pixel (ASP) elements and a computer. The right and left expansion optics are configured to receive respective display images from the right and left display projectors and to release expanded forms of the display images. The right IMU is fixedly coupled to the right display projector, and the left IMU is fixedly coupled to the left display projector. Each ASP element is responsive to an angle of light of one of the respective display images as received into the right or left expansion optic. The computer is configured to receive output from the right IMU, the left IMU and the plurality of ASP elements, and render display data for the right and left display projectors based in part on the output. 1. A near-eye display device comprising:a right display projector and a left display projector;a right expansion optic configured to receive a right display image from the right display projector and to release an expanded form of the right display image;a left expansion optic configured to receive a left display image from the left display projector and to release an expanded form of the left display image;a right inertial measurement unit (IMU) fixedly coupled to the right display projector, and a left IMU fixedly coupled to the left display projector;a plurality of angle-sensitive pixel (ASP element) elements each responsive to an angle of light of a display image received into the right or left expansion optic; and receive output from each of the right IMU, the left IMU and the plurality of ASP elements, and', 'render display data for the right and left display projectors based in part on the output from each of the right IMU, the left IMU and the plurality of ASP elements, thereby providing predefined stereo disparity between the expanded forms of the right and left display images., 'a computer ...

Method and system for tracking objects

An object tracking system and method operable to minimize processing time for tracking objects is provided. The system includes a pair of filters operable to make associations between dynamic objects newly detected and previously detected. One of the pair of filters makes an association when the predicted location of the previously detected objects is within a predetermined distance of the newly detected object. The other of the pair of filters makes an association based upon the probability that a newly detected dynamic object is a previously detected dynamic object. The remaining unassociated dynamic objects are then localized so as to form discrete matrices for optimization filters.

Tracking on-road vehicles with sensors of different modalities

A vehicle system includes a first sensor and a second sensor, each having, respectively, different first and second modalities. A controller includes a processor configured to: receive a first sensor input from the first sensor and a second sensor input from the second sensor; detect, synchronously, first and second observations from, respectively, the first and second sensor inputs; project the detected first and second observations onto a graph network; associate the first and second observations with a target on the graph network, the target having a trajectory on the graph network; select either the first or the second observation as a best observation based on characteristics of the first and second sensors; and estimate a current position of the target by performing a prediction based on the best observation and a current timestamp.

System for providing integrated voice and data services

Embodiments of the use case-based management system enable non-technical users to manage devices, resources, and services that are remote to the premises where their integrated system management devices, applications, or appliances are located. This permits users to subscribe to remote voice, data, and other services without having to first configure their local equipment to ensure proper acceptance of these services. The users can simply select the desired remote services in the use case-based management system, enter a minimum amount of non-technical information such as account information provided by the service provider, and enable the service. The use case-based management system automatically creates generalized system management requests and passes them externally to the proper remote service, resource, or device managers, which then translate and broker these requests into proper low-level commands. Example remote services that can be managed include domain and sub-domain registration services, email seconding services, and Internet telephony services.

Calibrating sensor alignment with applied bending moment

Examples are disclosed that relate to calibration data related to a determined alignment of sensors on a wearable display device. One example provides a wearable display device comprising a frame, a first sensor and a second sensor, one or more displays, a logic system, and a storage system. The storage system comprises calibration data related to a determined alignment of the sensors with the frame in a bent configuration and instructions executable by the logic system. The instructions are executable to obtain a first sensor data and a second sensor data respectfully from the first and second sensors, determine a distance from the wearable display device to a feature based at least upon the first and second sensor data using the calibration data, obtain a stereo image to display based upon the distance from the wearable display device to the feature, and output the stereo image via the displays.

Method for safely parking vehicle near obstacles

Method, storage medium and system of optimizing a destination for a vehicle by obtaining a map corresponding to a desired destination of the vehicle and identifying objectives of the map based on multiple parameters including collision avoidance, driver time, legal constraints and social consensus. A cost function is constructed to determine an optimal destination based on a proximity to the desired destination and the identified objectives, and an optimal destination is identified by minimizing a value of the cost function.

Autocalibrated near-eye display

A near-eye display device comprises right and left display projectors, expansion optics, and inertial measurement units (IMUs), in addition to a plurality of angle-sensitive pixel (ASP) elements and a computer. The right and left expansion optics are configured to receive respective display images from the right and left display projectors and to release expanded forms of the display images. The right IMU is fixedly coupled to the right display projector, and the left IMU is fixedly coupled to the left display projector. Each ASP element is responsive to an angle of light of one of the respective display images as received into the right or left expansion optic. The computer is configured to receive output from the right IMU, the left IMU and the plurality of ASP elements, and render display data for the right and left display projectors based in part on the output.

Calibrating sensor alignment with applied bending moment

Examples are disclosed that relate to calibration data related to a determined alignment of sensors on a wearable display device. One example provides a wearable display device comprising a frame, a first sensor and a second sensor, one or more displays, a logic system, and a storage system. The storage system comprises calibration data related to a determined alignment of the sensors with the frame in a bent configuration and instructions executable by the logic system. The instructions are executable to obtain a first sensor data and a second sensor data respectfully from the first and second sensors, determine a distance from the wearable display device to a feature based at least upon the first and second sensor data using the calibration data, obtain a stereo image to display based upon the distance from the wearable display device to the feature, and output the stereo image via the displays.

Amplitude and biphase control of MEMS scanning device

A MEMS scanning device (“Device”) includes at least (1) laser projector(s) controlled by a laser drive to project a laser beam, (2) MEMS scanning mirror(s) controlled by a MEMS drive to scan the laser beam to generate a raster scan, (3) a display configured to receive the raster scan, (4) a thermometer configured to detect a current temperature, (5) a display observing camera configured to capture an image of a predetermined area of the display, and (6) a computer-readable media that stores temperature model(s), each of which is custom-built using machine learning. The device uses the display observing camera to capture image(s) of predetermined pattern(s), which are then used to extract feature(s). The extracted feature(s) are compared with ideal feature(s) to identify a discrepancy. When the identified discrepancy is greater than a threshold, the temperature model(s) are updated accordingly.

Calibration of stereo cameras and handheld object

Integrated free space and surface input device

In various embodiments, methods and systems for implementing integrated free space and surface inputs are provided. An integrated free space and surface input system includes a mixed-input pointing device for interacting and controlling interface objects using free space inputs and surface inputs, trigger buttons, pressure sensors, and haptic feedback associated with the mixed-input pointing device. Free space movement data and surface movement data are tracked and determined for the mixed-input pointing device. An interface input is detected for the mixed-input pointing device transitioning from a first input to a second input, such as, from a free space input to a surface input or from the surface input to the free space input. The interface input is processed based on accessing the free space movement data and the surface movement data. An output for the interface input is communicated from the mixed-input pointing device to interact and control an interface.

Calibrating sensor alignment with applied bending moment

Examples are disclosed that relate to calibration data related to a determined alignment of sensors on a wearable display device. One example provides a wearable display device comprising a frame, a first sensor and a second sensor, one or more displays, a logic system, and a storage system. The storage system comprises calibration data related to a determined alignment of the sensors with the frame in a bent configuration and instructions executable by the logic system. The instructions are executable to obtain a first sensor data and a second sensor data respectfully from the first and second sensors, determine a distance from the wearable display device to a feature based at least upon the first and second sensor data using the calibration data, obtain a stereo image to display based upon the distance from the wearable display device to the feature, and output the stereo image via the displays.

Amplitude and biphase control of mems scanning device

A MEMS scanning device (“Device”) includes at least (1) laser projector(s) controlled by a laser drive to project a laser beam, (2) MEMS scanning mirror(s) controlled by a MEMS drive to scan the laser beam to generate a raster scan, (3) a display configured to receive the raster scan, (4) a thermometer configured to detect a current temperature, (5) a display observing camera configured to capture an image of a predetermined area of the display, and (6) a computer-readable media that stores temperature model(s), each of which is custom-built using machine learning. The device uses the display observing camera to capture image(s) of predetermined pattern(s), which are then used to extract feature(s). The extracted feature(s) are compared with ideal feature(s) to identify a discrepancy. When the identified discrepancy is greater than a threshold, the temperature model(s) are updated accordingly.

Packingless pump and liquid spray system

Amplitude and biphase control of mems scanning device

A MEMS scanning device (“Device”) includes at least (1) laser projector(s) controlled by a laser drive to project a laser beam, (2) MEMS scanning mirror(s) controlled by a MEMS drive to scan the laser beam to generate a raster scan, (3) a display configured to receive the raster scan, (4) a thermometer configured to detect a current temperature, (5) a display observing camera configured to capture an image of a predetermined area of the display, and (6) a computer-readable media that stores temperature model(s), each of which is custom-built using machine learning. The device uses the display observing camera to capture image(s) of predetermined pattern(s), which are then used to extract feature(s). The extracted feature(s) are compared with ideal feature(s) to identify a discrepancy. When the identified discrepancy is greater than a threshold, the temperature model(s) are updated accordingly.

Amplitude and biphase control of mems scanning device

A MEMS scanning device ("Device") includes at least (1) laser projector(s) controlled by a laser drive to project a laser beam, (2) MEMS scanning mirror(s) controlled by a MEMS drive to scan the laser beam to generate a raster scan, (3) a display configured to receive the raster scan, (4) a thermometer configured to detect a current temperature, (5) a display observing camera configured to capture an image of a predetermined area of the display, and (6) a computer-readable media that stores temperature model(s), each of which is custom-built using machine learning. The device uses the display observing camera to capture image(s) of predetermined pattern(s), which are then used to extract feature(s). The extracted feature(s) are compared with ideal feature(s) to identify a discrepancy. When the identified discrepancy is greater than a threshold, the temperature model(s) are updated accordingly.

Amplitude and biphase control of mems scanning device

A MEMS scanning device ("Device") includes at least (1) laser projector(s) controlled by a laser drive to project a laser beam, (2) MEMS scanning mirror(s) controlled by a MEMS drive to scan the laser beam to generate a raster scan, (3) a display configured to receive the raster scan, (4) a thermometer configured to detect a current temperature, (5) a display observing camera configured to capture an image of a predetermined area of the display, and (6) a computer-readable media that stores temperature model(s), each of which is custom-built using machine learning. The device uses the display observing camera to capture image(s) of predetermined pattern(s), which are then used to extract feature(s). The extracted feature(s) are compared with ideal feature(s) to identify a discrepancy. When the identified discrepancy is greater than a threshold, the temperature model(s) are updated accordingly.

Calibration of stereo cameras and handheld object

One disclosed example provides a head-mounted device including a stereo camera arrangement, a logic device configured to execute instructions, and a storage device storing instructions executable by the logic device to, for each camera in the stereo camera arrangement, receive image data of a field of view of the camera, detect light sources of a handheld object in the image data, and based upon the light sources detected, determine a pose of the handheld object. The instructions are executable to, based upon the pose of the handheld object determined for each camera in the stereo camera arrangement, calibrate the stereo camera arrangement.

Object and environment tracking via shared sensor

One disclosed example provides a head-mounted device configured to control a plurality of light sources of a handheld object and acquire image data comprising a sequence of environmental tracking exposures in which the plurality of light sources are controlled to have a lower integrated intensity and handheld object tracking exposures in which the plurality of light sources are controlled to have a higher integrated intensity. The instructions are further executable to detect, via an environmental tracking exposure, one or more features of the surrounding environment, determine a pose of the head-mounted device based upon the one or more features of the surrounding environment detected, detect via a handheld object tracking exposure the plurality of light sources of the handheld object, determine a pose of the handheld object relative to the head-mounted device based upon the plurality of light sources detected, and output the pose of the handheld object.

Tracking wearable device and handheld object poses

One disclosed example provides a computing device configured to receive from an image sensor of a head-mounted device environmental tracking exposures and handheld object tracking exposures, determine a pose of the handheld object with respect to the head-mounted device based upon the handheld object tracking exposures, determine a pose of the head-mounted device with respect to a surrounding environment based upon the environmental tracking exposures, derive a pose of the handheld object relative to the surrounding environment based upon the pose of the handheld object with respect to the head-mounted device and the pose of the head-mounted device with respect to the surrounding environment, and output the pose of the handheld object relative to the surrounding environment for controlling a user interface displayed on the head-mounted device.

Tracking wearable device and handheld object poses

Tracking wearable device and handheld object poses

One disclosed example provides a computing device configured to receive from an image sensor of a head-mounted device environmental tracking exposures and handheld object tracking exposures, determine a pose of the handheld object with respect to the head-mounted device based upon the handheld object tracking exposures, determine a pose of the head-mounted device with respect to a surrounding environment based upon the environmental tracking exposures, derive a pose of the handheld object relative to the surrounding environment based upon the pose of the handheld object with respect to the head-mounted device and the pose of the head-mounted device with respect to the surrounding environment, and output the pose of the handheld object relative to the surrounding environment for controlling a user interface displayed on the head-mounted device.

Object and environment tracking via shared sensor

One disclosed example provides a head-mounted device configured to control a plurality of light sources of a handheld object and acquire image data comprising a sequence of environmental tracking exposures in which the plurality of light sources are controlled to have a lower integrated intensity and handheld object tracking exposures in which the plurality of light sources are controlled to have a higher integrated intensity. The instructions are further executable to detect, via an environmental tracking exposure, one or more features of the surrounding environment, determine a pose of the head-mounted device based upon the one or more features of the surrounding environment detected, detect via a handheld object tracking exposure the plurality of light sources of the handheld object, determine a pose of the handheld object relative to the head-mounted device based upon the plurality of light sources detected, and output the pose of the handheld object.

Combining driver and environment sensing for vehicular safety systems

An apparatus for assisting safe operation of a vehicle includes an environment sensor system detecting hazards within the vehicle environment, a driver monitor providing driver awareness data (such as a gaze track), and an attention-evaluation module identifying hazards as sufficiently or insufficiently sensed by the driver by comparing the hazard data and the gaze track. An alert signal relating to the unperceived hazards can be provided.

Amplitude and biphase control of mems scanning device

Systems and methods for continuous image alignment of separate cameras

A system for continuous image alignment of separate cameras identifies a reference camera transformation matrix between a base reference camera pose and an updated reference camera pose. The system also identifies a match camera transformation matrix between a base match camera pose and an updated match camera pose and an alignment matrix based on visual correspondences between one or more reference frames captured by the reference camera and one or more match frames captured by the match camera. The system also generates a motion model configured to facilitate mapping of a set of pixels of a reference frame captured by the reference camera to a corresponding set of pixels of a match frame captured by the match camera based on the reference camera transformation matrix, the match camera transformation matrix, and the alignment matrix.

Object and environment tracking via shared sensor

Combining driver and environment sensing for vehicular safety systems

An apparatus for assisting safe operation of a vehicle includes an environment sensor system detecting hazards within the vehicle environment, a driver monitor providing driver awareness data (such as a gaze track), and an attention-evaluation module identifying hazards as sufficiently or insufficiently sensed by the driver by comparing the hazard data and the gaze track. An alert signal relating to the unperceived hazards can be provided.

Amplitude and biphase control of mems scanning device

A MEMS scanning device ("Device") includes at least (1) laser projector(s) controlled by a laser drive to project a laser beam, (2) MEMS scanning mirror(s) controlled by a MEMS drive to scan the laser beam to generate a raster scan, (3) a display configured to receive the raster scan, (4) a thermometer configured to detect a current temperature, (5) a display observing camera configured to capture an image of a predetermined area of the display, and (6) a computer-readable media that stores temperature model(s), each of which is custom-built using machine learning. The device uses the display observing camera to capture image(s) of predetermined pattern(s), which are then used to extract feature(s). The extracted feature(s) are compared with ideal feature(s) to identify a discrepancy. When the identified discrepancy is greater than a threshold, the temperature model(s) are updated accordingly.

Amplitude and biphase control of mems scanning device

A MEMS scanning device ("Device") includes at least (1) laser projector(s) controlled by a laser drive to project a laser beam, (2) MEMS scanning mirror(s) controlled by a MEMS drive to scan the laser beam to generate a raster scan, (3) a display configured to receive the raster scan, (4) a thermometer configured to detect a current temperature, (5) a display observing camera configured to capture an image of a predetermined area of the display, and (6) a computer-readable media that stores temperature model(s), each of which is custom-built using machine learning. The device uses the display observing camera to capture image(s) of predetermined pattern(s), which are then used to extract feature(s). The extracted feature(s) are compared with ideal feature(s) to identify a discrepancy. When the identified discrepancy is greater than a threshold, the temperature model(s) are updated accordingly.