System for three dimensional visualization of a monitored item, sensors, and reciprocal rendering for a monitored item incorporating extended reality

An application is presented for providing a highly accurate and realistic 3D virtual model of monitored items. The 3D virtual model may include virtual icons that represent a set of sensors. Data visualizations are provided in the 3D virtual model depicting relevant information about the monitored items and the set of sensors. Alarms can be triggered if the sensor exceeds normal operating thresholds and a user directed to a specific sensor that is malfunctioning or subject to the alert. The user can rewind through the virtual model to view events leading up to the alarm or malfunctioning of the monitored item. Further, a 3D virtual model can be reciprocally rendered as a digital twin on a second user's computing device and any extended reality graphical manipulation shared with the second user whether the second user is physically adjacent to a monitored item or remote from a monitored item.

Booting and configuring a subsystem securely from non-local storage

According to one aspect, a multifunctional computing device having a wireless communications processor (e.g., cellular processor) and an application processor (e.g., general-purpose processor such as a CPU) share a storage device that is associated with or attached to the application processor. An example of such a multifunctional computing device may be a Smartphone device having a cellular phone and handheld computer functionalities. There is no specific storage device directly associated with or attached to the wireless communications processor (hereinafter simply referred to as a wireless processor). Instead, the wireless processor communicates with the application processor via a high speed communications link, such as a USB link, to access code and data stored in the storage device (e.g., flash memory device) associated with the application processor.

Group formation using anonymous broadcast information

A number of devices co-located at a geographic location can broadcast and receive tokens. Tokens can be exchanged using a communication link having limited communication range. Tokens that are received by a device can be stored locally on the device and/or transmitted to a trusted service operating remotely on a network. In some implementations, the tokens can be stored with corresponding timestamps to assist a trusted service in matching or otherwise correlating the tokens with other tokens provided by other devices. The trusted service can perform an analysis on the tokens and timestamps to identify devices that were co-located at the geographic location at or around a contact time which can be defined by the timestamps. A group can be created based on results of the analysis. Users can be identified as members of the group and invited to join the group.

BOOTING AND CONFIGURING A SUBSYSTEM SECURELY FROM NON-LOCAL STORAGE

According to one aspect, a multifunctional computing device having a wireless communications processor (e.g., cellular processor) and an application processor (e.g., general-purpose processor such as a CPU) share a storage device that is associated with or attached to the application processor. An example of such a multifunctional computing device may be a Smartphone device having a cellular phone and handheld computer functionalities. There is no specific storage device directly associated with or attached to the wireless communications processor (hereinafter simply referred to as a wireless processor). Instead, the wireless processor communicates with the application processor via a high speed communications link, such as a USB link, to access code and data stored in the storage device (e.g., flash memory device) associated with the application processor.

Group Formation Using Anonymous Broadcast Information

A number of devices co-located at a geographic location can broadcast and receive tokens. Tokens can be exchanged using a communication link having limited communication range. Tokens that are received by a device can be stored locally on the device and/or transmitted to a trusted service operating remotely on a network. In some implementations, the tokens can be stored with corresponding timestamps to assist a trusted service in matching or otherwise correlating the tokens with other tokens provided by other devices. The trusted service can perform an analysis on the tokens and timestamps to identify devices that were co-located at the geographic location at or around a contact time which can be defined by the timestamps. A group can be created based on results of the analysis. Users can be identified as members of the group and invited to join the group.

Group formation using anonymous broadcast information

A number of devices co-located at a geographic location can broadcast and receive tokens. Tokens can be exchanged using a communication link having limited communication range. Tokens that are received by a device can be stored locally on the device and/or transmitted to a trusted service operating remotely on a network. In some implementations, the tokens can be stored with corresponding timestamps to assist a trusted service in matching or otherwise correlating the tokens with other tokens provided by other devices. The trusted service can perform an analysis on the tokens and timestamps to identify devices that were co-located at the geographic location at or around a contact time which can be defined by the timestamps. A group can be created based on results of the analysis. Users can be identified as members of the group and invited to join the group.

DEVICE SOFTWARE UPGRADE USING A DYNAMICALLY SIZED PARTITION

According to one aspect of the invention, a software update image is received by a software updater from a server over a network and stored in an update volume to update one or more system components of a computing device, where the software update image is signed by the server and includes an identifier that uniquely identifies the computing device. A volume manager dynamically resizes the system volume based on a requirement of the one or more system components to be updated without physically relocating data stored in the data volume of the storage device. The software update image is then authenticated including verifying a signature of the image and matching the ID with a unique ID embedded within the device. The one or more system components are installed from the software update image from the update volume into the resized system volume.

SYSTEM FOR THREE DIMENSIONAL VISUALIZATION OF A MONITORED ITEM, SENSORS, AND RECIPROCAL RENDERING FOR A MONITORED ITEM INCORPORATING EXTENDED REALITY

An application is presented for providing a highly accurate and realistic 3D virtual model of monitored items. The 3D virtual model may include virtual icons that represent a set of sensors. Data visualizations are provided in the 3D virtual model depicting relevant information about the monitored items and the set of sensors. Alarms can be triggered if the sensor exceeds normal operating thresholds and a user directed to a specific sensor that is malfunctioning or subject to the alert. The user can rewind through the virtual model to view events leading up to the alarm or malfunctioning of the monitored item. Further, a 3D virtual model can be reciprocally rendered as a digital twin on a second user's computing device and any extended reality graphical manipulation shared with the second user whether the second user is physically adjacent to a monitored item or remote from a monitored item.

Group Formation Using Anonymous Broadcast Information

A number of devices co-located at a geographic location can broadcast and receive tokens. Tokens can be exchanged using a communication link having limited communication range. Tokens that are received by a device can be stored locally on the device and/or transmitted to a trusted service operating remotely on a network. In some implementations, the tokens can be stored with corresponding timestamps to assist a trusted service in matching or otherwise correlating the tokens with other tokens provided by other devices. The trusted service can perform an analysis on the tokens and timestamps to identify devices that were co-located at the geographic location at or around a contact time which can be defined by the timestamps. A group can be created based on results of the analysis. Users can be identified as members of the group and invited to join the group. 123-. (canceled)24. A method comprising:receiving, at a trusted service, tokens that do not identify a particular device, at least some of the tokens having been received by a first device from a first plurality of devices and at least some of the tokens having been received by a second device from a second plurality of devices;determining, at the trusted service, that the first device and the second device have collected one or more matching tokens within a first timeframe;identifying, at the trusted service, users associated with the first device and the second device; andcreating, at the trusted service, a group for the identified users.25. The method of claim 24 , further comprising:determining a geographic location of the first and second devices; andtargeting users in the group with location based services based on the geographic location.26. The method of claim 25 , where targeting further comprises:sending content to one or more users in the group.27. The method of claim 24 , where the tokens comprise cryptographic material.28. The method of claim 24 , where the tokens are periodically changed.29. The ...

TICKET-BASED PERSONALIZATION

Securely installing and booting software of a device to run OS authorized according to a ticket that is validated by a nonce generated by application processor (AP) in booted OS stage prior to entering a restore mode is described. AP in booted OS stage generates a pre-flight nonce that is stored in a trusted location (effaceable storage). AP in booted OS stage performs one-way hash of pre-flight nonce and sends the hashed pre-flight nonce to ticket authorization server. AP enters restore mode. AP in first stage bootloader receives a ticket from the ticket authorization server including a signed copy of the hashed pre-flight nonce. AP in first stage bootloader validates the signed ticket by comparing one-way hash of the pre-flight nonce stored in the trusted location and the hashed nonce in the signed ticket. Pre-flight nonce expires after timeout period and upon reboot of AP. Other embodiments are also described. 1. A method of generating a nonce in an application processor (AP) in the booted operating system (OS) stage that is trusted by a first stage bootloader in the application processor , the method comprising: generating the nonce,', 'storing the nonce in a trusted location,', 'hashing the nonce to obtain a first hashed nonce, and', 'sending the first hashed nonce to a server; and, 'in the booted OS stage,'} receiving a ticket from the server, the ticket including a signed copy of the first hashed nonce,', 'hashing the nonce from the trusted location to obtain a second hashed nonce, and', 'trusting the nonce if the first hashed nonce received from the server matches the second hashed nonce., 'in the first stage bootloader,'}2. The method of further comprising: 'determine if the nonce is stored in the trusted location, and', 'in the first stage bootloader,'}if the nonce is not stored in the trusted location, generating a bootloader-generated nonce.3. The method of claim 1 , wherein the trusted location is an effaceable storage.4. The method of claim 1 , wherein ...

ADAPTIVE VEHICLE AUGMENTED REALITY DISPLAY USING STEREOGRAPHIC IMAGERY

An AR system that leverages a pre-generated 3D model of the world to improve rendering of 3D graphics content for AR views of a scene, for example an AR view of the world in front of a moving vehicle. By leveraging the pre-generated 3D model, the AR system may use a variety of techniques to enhance the rendering capabilities of the system. The AR system may obtain pre-generated 3D data (e.g., 3D tiles) from a remote source (e.g., cloud-based storage), and may use this pre-generated 3D data (e.g., a combination of 3D mesh, textures, and other geometry information) to augment local data (e.g., a point cloud of data collected by vehicle sensors) to determine much more information about a scene, including information about occluded or distant regions of the scene, than is available from the local data. 1. A system , comprising:a projector; and obtain pre-generated 3D data for at least part of a real-world scene, wherein the pre-generated 3D data includes pre-generated 3D meshes for respective regions of the scene;', 'determine one or more of the pre-generated 3D meshes that include portions of a local region that is within range of one or more sensors;', 'use point cloud data obtained from the one or more sensors to generate a local 3D mesh for portions of the local region that are not included in the pre-generated 3D meshes; and', 'generate a 3D model of the scene using the local 3D mesh and the pre-generated 3D meshes., 'a controller configured to2. The system as recited in claim 1 , wherein the point cloud data comprises a plurality of data points claim 1 , wherein each data point indicates depth claim 1 , direction claim 1 , and elevation of a point on a surface within the local region as detected by the one or more sensors.3. The system as recited in claim 1 , wherein the pre-generated 3D meshes include portions of the scene that are out of range of the sensors and portions of the scene that are occluded by objects or terrain in the scene.4. The system as recited ...

Adaptive Vehicle Augmented Reality Display Using Stereographic Imagery

An AR system that leverages a pre-generated 3D model of the world to improve rendering of 3D graphics content for AR views of a scene, for example an AR view of the world in front of a moving vehicle. By leveraging the pre-generated 3D model, the AR system may use a variety of techniques to enhance the rendering capabilities of the system. The AR system may obtain pre-generated 3D data (e.g., 3D tiles) from a remote source (e.g., cloud-based storage), and may use this pre-generated 3D data (e.g., a combination of 3D mesh, textures, and other geometry information) to augment local data (e.g., a point cloud of data collected by vehicle sensors) to determine much more information about a scene, including information about occluded or distant regions of the scene, than is available from the local data. 1. A system , comprising:a display device; and one or more processors; and', obtain sensor data for an environment of a real-world scene captured by one or more sensors;', 'render virtual content for the environment based at least on the sensor data and pre-generated three-dimensional (3D) mesh data for the environment;', 'determine one or more colors or lighting information of a region of the environment on which the rendered virtual content is to be projected;', 'modify one or more colors of the virtual content based at least on the determined one or more colors or lighting information of the region; and', 'provide the virtual content to the display device., 'a memory storing instructions that, when executed on or across the one or more processors, cause the one or more processors to], 'a controller comprising2. The system of claim 1 , wherein the memory further comprises instructions that claim 1 , when executed on or across the one or more processors claim 1 , cause the one or more processors to:determine a surface normal of a surface within the region of the environment;determine direction of light from a light source in the environment;determine that the surface ...

SECURE FACTORY DATA GENERATION AND RESTORATION

In various embodiments, methods, devices and systems for securely generating, sealing, and restoring factory-generated calibration and provisioning data for an electronic device are described, in which calibration and provisioning data for an electronic device are generated in a distributed manner and stored on a storage system. The calibration data can be retrieved from the storage system during device assembly and finalized calibration and provisioning data for each electronic device can be stored to the storage system. In one embodiment, a sealing server, to attest to the authenticity of the factory generated data, seals the finalized calibration data. In one embodiment, an electronic device can access a data store containing the factory-generated data and can update or restore calibration or provisioning data for the device from the data store. 1. A system for managing factory-generated data for an electronic device , the system comprising:a first factory server coupled to one or more storage systems, to store calibration data generated for one or more modules of the electronic device, the calibration data associated with the one or more modules via a module identifier that is unique to each of the modules, and to transmit the calibration data to the one or more storage systems;a second factory server coupled to the one or more storage systems, to retrieve the calibration data associated with the one or more modules from the one or more storage systems, and to assemble a set of factory data for the electronic device, the factory data including the calibration data, the factory data associated with the electronic device via a device identifier that is unique to the electronic device; anda sealing server coupled to the one or more storage systems, the sealing server to, in response to a request from the electronic device, authenticate the set of factory data for the electronic device via the module identifier of each module, and to create a cryptographic ...

SYSTEMS AND METHODS FOR GENERATING AN INTERACTIVE USER INTERFACE

Implementations described and claimed herein provide systems and methods for interaction between a user and a machine. In one implementation, machine status information for the machine is received at a dedicated machine component. The machine status information is published onto a distributed node system network of the machine. The machine status information is ingested at a primary interface controller, and an interactive user interface is generated using the primary interface controller. The interactive user interface is generated based on the machine status information. In some implementations, input is received from the user at the primary interface controller through the interactive user interface, and a corresponding action is delegated to one or more subsystems of the machine using the distributed node system network. 141-. (canceled)42. A method for interaction with an autonomous vehicle , the method comprising:identifying one or more autonomous decisions of the autonomous vehicle;determining whether the one or more autonomous decisions correspond to an upcoming action or a series of actions over a duration of time;generating an indications interface having at least one indication based on whether the one or more autonomous decisions correspond to the upcoming action or the series of actions over the duration of time; andpresenting the indications interface using at least one output device of an interactive interface of the autonomous vehicle, the at least one indication presented in connection with the one or more autonomous decisions.43. The method of claim 42 , wherein the at least one indication includes an action indication where the one or more autonomous decisions correspond to the upcoming action.44. The method of claim 43 , wherein the action indication is presented in connection with the upcoming action.45. The method of claim 43 , wherein the upcoming action involves a movement of the autonomous vehicle.46. The method of claim 45 , wherein the ...

SECURE FACTORY DATA GENERATION AND RESTORATION

In various embodiments, methods, devices and systems for securely generating, sealing, and restoring factory-generated calibration and provisioning data for an electronic device are described, in which calibration and provisioning data for an electronic device are generated in a distributed manner and stored on a storage system. The calibration data can be retrieved from the storage system during device assembly and finalized calibration and provisioning data for each electronic device can be stored to the storage system. In one embodiment, a sealing server, to attest to the authenticity of the factory-generated data, seals the finalized calibration data. In one embodiment, an electronic device can access a data store containing the factory-generated data and can update or restore calibration or provisioning data for the device from the data store. 1. A system for managing factory-generated data for an electronic device , the system comprising:a first factory server coupled to one or more storage systems, to store calibration data generated for one or more modules of the electronic device, the calibration data associated with the one or more modules via a module identifier that is unique to each of the modules, and to transmit the calibration data to the one or more storage systems;a second factory server coupled to the one or more storage systems, to retrieve the calibration data associated with the one or more modules from the one or more storage systems, and to assemble a set of factory data for the electronic device, the factory data including the calibration data, the factory data associated with the electronic device via a device identifier that is unique to the electronic device; anda sealing server coupled to the one or more storage systems, the sealing server to, in response to a request from the electronic device, authenticate the set of factory data for the electronic device via the module identifier of each module, and to create a cryptographic ...

SYSTEMS AND METHODS FOR GENERATING AN INTERACTIVE USER INTERFACE

Implementations described and claimed herein provide systems and methods for interaction between a user and a machine. In one implementation, machine status information for the machine is received at a dedicated machine component. The machine status information is published onto a distributed node system network of the machine. The machine status information is ingested at a primary interface controller, and an interactive user interface is generated using the primary interface controller. The interactive user interface is generated based on the machine status information. In some implementations, input is received from the user at the primary interface controller through the interactive user interface, and a corresponding action is delegated to one or more subsystems of the machine using the distributed node system network. 1. A method for interaction with an autonomous vehicle , the method comprising:obtaining an origination point of the autonomous vehicle at a primary interface controller;receiving a destination point for the autonomous vehicle at the primary interface controller, the destination point captured with at least one input device of an interactive interface of the autonomous vehicle;determining a travel path for the autonomous vehicle from the origination point to the destination point using the primary interface controller;generating a timeline using the primary interface controller, the timeline including an interactive representation of a schedule of events including a duration of time of the travel path; andoutputting the timeline for interactive presentation using the interactive interface of the autonomous vehicle.2. The method of claim 1 , wherein the interactive representation of the schedule of events includes the origination point depicted as a first graphical icon and the destination point depicted as a second graphical icon claim 1 , the duration of time of the travel path depicted as a line connecting the first graphical icon to the ...

Systems and methods for generating an interactive user interface

Booting and configuring a subsystem securely from non-local storage

According to one aspect, a multifunctional computing device having a wireless communications processor (e.g., cellular processor) and an application processor (e.g., general-purpose processor such as a CPU) share a storage device that is associated with or attached to the application processor. An example of such a multifunctional computing device may be a Smartphone device having a cellular phone and handheld computer functionalities. There is no specific storage device directly associated with or attached to the wireless communications processor (hereinafter simply referred to as a wireless processor). Instead, the wireless processor communicates with the application processor via a high speed communications link, such as a USB link, to access code and data stored in the storage device (e.g., flash memory device) associated with the application processor.

Booting and configuring a subsystem securely from non-local storage

According to one aspect, a multifunctional computing device having a wireless communications processor (e.g., cellular processor) and an application processor (e.g., general-purpose processor such as a CPU) share a storage device that is associated with or attached to the application processor. An example of such a multifunctional computing device may be a Smartphone device having a cellular phone and handheld computer functionalities. There is no specific storage device directly associated with or attached to the wireless communications processor (hereinafter simply referred to as a wireless processor). Instead, the wireless processor communicates with the application processor via a high speed communications link, such as a USB link, to access code and data stored in the storage device (e.g., flash memory device) associated with the application processor.

Systems and methods for generating an interactive user interface

Implementations described and claimed herein provide systems and methods for interaction between a user and a machine. In one implementation, machine status information for the machine is received at a dedicated machine component. The machine status information is published onto a distributed node system network of the machine. The machine status information is ingested at a primary interface controller, and an interactive user interface is generated using the primary interface controller. The interactive user interface is generated based on the machine status information. In some implementations, input is received from the user at the primary interface controller through the interactive user interface, and a corresponding action is delegated to one or more subsystems of the machine using the distributed node system network.

Systems and methods for generating an interactive user interface

Implementations described and claimed herein provide systems and methods for interaction between a user and a machine. In one implementation, machine status information for the machine is received at a dedicated machine component. The machine status information is published onto a distributed node system network of the machine. The machine status information is ingested at a primary interface controller, and an interactive user interface is generated using the primary interface controller. The interactive user interface is generated based on the machine status information. In some implementations, input is received from the user at the primary interface controller through the interactive user interface, and a corresponding action is delegated to one or more subsystems of the machine using the distributed node system network.

Adaptive vehicle augmented reality display using stereographic imagery

An AR system that leverages a pre-generated 3D model of the world to improve rendering of 3D graphics content for AR views of a scene, for example an AR view of the world in front of a moving vehicle. By leveraging the pre-generated 3D model, the AR system may use a variety of techniques to enhance the rendering capabilities of the system. The AR system may obtain pre-generated 3D data (e.g., 3D tiles) from a remote source (e.g., cloud-based storage), and may use this pre-generated 3D data (e.g., a combination of 3D mesh, textures, and other geometry information) to augment local data (e.g., a point cloud of data collected by vehicle sensors) to determine much more information about a scene, including information about occluded or distant regions of the scene, than is available from the local data.

Adaptive Vehicle Augmented Reality Display Using Stereographic Imagery

An AR system that leverages a pre-generated 3D model of the world to improve rendering of 3D graphics content for AR views of a scene, for example an AR view of the world in front of a moving vehicle. By leveraging the pre-generated 3D model, the AR system may use a variety of techniques to enhance the rendering capabilities of the system. The AR system may obtain pre-generated 3D data (e.g., 3D tiles) from a remote source (e.g., cloud-based storage), and may use this pre-generated 3D data (e.g., a combination of 3D mesh, textures, and other geometry information) to augment local data (e.g., a point cloud of data collected by vehicle sensors) to determine much more information about a scene, including information about occluded or distant regions of the scene, than is available from the local data.

System for three dimensional visualization of a monitored item, sensors, and reciprocal rendering for a monitored item incorporating extended reality

An application is presented for providing a highly accurate and realistic 3D virtual model of monitored items. The 3D virtual model may include virtual icons that represent a set of sensors. Data visualizations are provided in the 3D virtual model depicting relevant information about the monitored items and the set of sensors. Alarms can be triggered if the sensor exceeds normal operating thresholds and a user directed to a specific sensor that is malfunctioning or subject to the alert. The user can rewind through the virtual model to view events leading up to the alarm or malfunctioning of the monitored item. Further, a 3D virtual model can be reciprocally rendered as a digital twin on a second user's computing device and any extended reality graphical manipulation shared with the second user whether the second user is physically adjacent to a monitored item or remote from a monitored item.

Secure factory data generation and restoration

In various embodiments, methods, devices and systems for securely generating, sealing, and restoring factory-generated calibration and provisioning data for an electronic device are described, in which calibration and provisioning data for an electronic device are generated in a distributed manner and stored on a storage system. The calibration data can be retrieved from the storage system during device assembly and finalized calibration and provisioning data for each electronic device can be stored to the storage system. In one embodiment, a sealing server, to attest to the authenticity of the factory-generated data, seals the finalized calibration data. In one embodiment, an electronic device can access a data store containing the factory-generated data and can update or restore calibration or provisioning data for the device from the data store.