SYSTEME UND VERFAHREN ZUM AUSFÜHREN VON FERNGESTEUERTEN AUTOMATISIERTEN FAHRZEUGEINPARKVORGÄNGEN

Die vorliegende Offenbarung stellt Systeme und Verfahren zum Ausführen von ferngesteuerten automatisierten Fahrzeugeinparkvorgängen bereit. Die Offenbarung ist im Allgemeinen auf ferngesteuerte automatisierte Fahrzeugeinparkvorgänge gerichtet. Ein Fahrer eines Fahrzeugs steht auf einem Bordstein und startet eine Softwareanwendung auf einer Handvorrichtung. Die Softwareanwendung verwendet eine Kamera der Handvorrichtung, um Bilder von dem Fahrzeug aufzunehmen, die von dem Fahrer betrachtet werden können. Die Softwareanwendung versucht dann, eine visuelle Verriegelung zwischen der Kamera und dem Fahrzeug zu erhalten. In einigen Fällen kann das Erhalten der visuellen Verriegelung aufgrund widriger Beleuchtungsbedingungen behindert werden. Licht kann von der Handvorrichtung übertragen werden, um das Fahrzeug für eine bessere Bildaufnahme zu beleuchten. Alternativ kann ein Befehl von der Handvorrichtung an eine Steuerung in dem Fahrzeug zum Einschalten einer Leuchte in dem Fahrzeug übertragen ...

ÜBERNAHME VON AUTONOMEM FAHREN MITTELS VIRTUELLER REALITÄT

Es werden Techniken und Beispiele beschrieben, die zur Übernahme von autonomem Fahren mittels virtueller Realität gehören. Ein Prozessor eines Steuersystems eines Fahrzeugs kann eine drahtlose Kommunikation mit einer Fernsteuerung aufbauen. Der Prozessor kann der Fernsteuerung einen Strom von Videobildern, der durch eine Kamera des Fahrzeugs aufgenommen wird, bereitstellen. Der Prozessor kann ein Manövriersignal von der Fernsteuerung empfangen. Der Prozessor kann eine Lenkung des Fahrzeugs, eine Geschwindigkeit des Fahrzeugs oder beide gemäß dem Manövriersignal steuern.

Virtual reality transmission system, relaying scene perceived by e.g. robot or telechir to operator, includes stereoscopic camera pair turning in sympathy with operators head movement

Integral stereoscopic cameras (1) are coupled through a transmission unit (2) to a projector (3) for each of the operators eyes (4). Projectors are integrated into a headset (5) such that with head (6) movement, eye focus remains constant. Movements of the operators head are transmitted synchronously to the cameras, hence training their view in the corresponding direction.

Verfahren zur Überwachung und Steuerung eines fernbedienten Park- oder Manövriervorgangs eines Fahrzeugs

Die Erfindung bezieht sich auf ein Verfahren zur Überwachung und Steuerung eines fernbedienten Park- oder Manövriervorgangs eines Fahrzeugs (1) umfassend folgende Schritte:- Erfassen von Bildinformationen im Umgebungsbereichs des Fahrzeugs (1) durch zumindest zwei Kameras des Fahrzeugs (1);- Erstellen von räumlich perspektivischen Umgebungsinformationen basierend auf den Bildinformationen der zumindest zwei Kameras;- Darstellen der räumlich perspektivischen Umgebungsinformationen an einem mobilen Fernbediengerät (2);- Steuern des Park- oder Manövriervorgangs mittels des mobilen Fernbediengeräts (2) basierend auf den räumlich perspektivischen Umgebungsinformationen.

Robot cleaning system using mobile communication network

A method of fishing with unmanned aerial vehicle

Teleoperation with a wearable sensor system

FOREIGN TITLE

Graphical user interface for a remote operated vehicle

Aerial reconnaissance drone and method

An aerial reconnaissance system includes an aerial drone 1 with an elongate fuselage 2 and four wings 3 providing lift by flapping (i.e. a dragonfly or ornithopter arrangement), and a remote control unit 6. A first camera 4’ is arranged at a front end of the fuselage pointing forwards, a second camera 4’’ is arranged at a rear end of the fuselage pointing rearwards. Each camera has a respective square/rectangular field of view, the second camera has a diagonal field of view angle 5’’ that is at most half that of the first cameras diagonal field of view angle 5’. The remote control unit wirelessly transmits instructions to the drone and receives images from the drone; the remote control unit also provides a user with an option 7 to switch between two imagery modes, which rotates the drone to reverse the orientation of the cameras and change the images displayed on a user interface of the remote control unit from one camera to the other camera. Preferably, the first camera is an illuminator ...

Augmented reality enabled autonomous vehicle command centre

REMOTE CONTROL FOR VEHICLE

PROCEDURE AND SYSTEM FOR LEADING A REMOTE VEHICLE ACROSS A TIME-DELAYED COMMUNICATION CHANNEL

INTUITIVE VEHICLE AND PRESS CONTROL

Mobile robot and control method for same

The present invention relates to a mobile robot and a control method for same. The mobile robot is configured to travel through at least one intermediate point set on a travel path from the current location of the mobile robot to a destination point on a map. Accordingly, the travel path can be conveniently set in consideration of the location of a boundary or an obstacle; can be set as the shortest distance, enabling the mobile robot to quickly reach the destination point; can be conveniently corrected even in the event of a location error; and even when the travel path cannot be traveled due to an obstacle, travel can be made feasible by altering the intermediate point.

Operator assistance for autonomous vehicles

Disclosed are autonomous vehicles that may autonomously navigate at least a portion of a route defined by a service request allocator. The autonomous vehicle may, at a certain portion of the route, request remote assistance. In response to the request, an operator may provide input to a console that indicates control positions for one or more vehicle controls such as steering position, brake position, and/or accelerator position. A command is sent to the autonomous vehicle indicating how the vehicle should proceed along the route. When the vehicle reaches a location where remote assistance is no longer required, the autonomous vehicle is released from manual control and may then continue executing the route under autonomous control.

REMOTE LAND BASED PILOTAGE

The invention relates to a system and method to remotely pilot a ship such as through fairways or a harbour. More particularly but not exclusively it relates to a kit, system and method of allowing a pilot located on land to command a ship in passage of water via an array of command and feedback apparatus and systems. The kit is configured to be set up on a ship and comprises recording equipment including cameras and microphone, a ship data communication unit, navigation sensor and a communication system. 'a ...

Weapon robot with situational awareness

System and method to remotely control a vehicle

A system increases an operator's situational awareness while the operator controls a remote vehicle. The system comprises an operator control unit having a point-and-click interface configured to allow the operator to view an environment surrounding the remote vehicle and control the remote vehicle, and a payload attached to the remote vehicle and in communication with at least one of the remote vehicle and the operator control unit. The payload comprises an integrated sensor suite including GPS, an inertial measurement unit, a stereo vision camera, and a range sensor, and a computational module receiving data from the GPS, the inertial measurement unit, the stereo vision camera, and the range sensor and providing data to a CPU including at least one of an autonomous behavior and a semi-autonomous behavior that utilize data from the integrated sensor suite.

Robot cleaning system using mobile communication network

Arrangement for determining position of unmanned mining vehicles

System and method of operation for remotely operated vehicles with superimposed 3D imagery

The present invention provides a system and method of utilizing superimposed 3D imagery for remotely operated vehicles, namely 3D, reconstructed images of the environment of the ROV. In another aspect, it includes generating a virtual video of 3D elements in the operation environment, synchronizing the angle and position of the camera of a virtual video with the angle and position of a real camera, superimposing the virtual video and the real video from the real camera; superimposing these video feeds such that one is manipulated to show transparencies in areas of less interest, in order to show through the other video. It furthermore may include superimposing information, whether graphic, textual or both on to the hybrid virtual-real 3D imagery. The subject invention is also networked, such that the immersive visual interface described above is accessible to a plurality of users operating from a plurality of locations.

Mobile robot system

A robot system (1600) includes a mobile robot (100) having a controller (500) executing a control system (510) for controlling operation of the robot, a cloud computing service (1620) in communication with the controller of the robot, and a remote computing device (310) in communication with the cloud computing service. The remote computing device communicates with the robot through the cloud computing service.

SYSTEM AND METHOD OF OPERATION FOR REMOTELY OPERATED VEHICLES WITH SUPERIMPOSED 3D IMAGERY

The present invention provides a system and method of utilizing superimposed 3D imagery for remotely operated vehicles, namely 3D, reconstructed images of the environment of the ROV. In another aspect, it includes generating a virtual video of 3D elements in the operation environment, synchronizing the angle and position of the camera of a virtual video with the angle and position of a real camera, superimposing the virtual video and the real video from the real camera; superimposing these video feeds such that one is manipulated to show transparencies in areas of less interest, in order to show through the other video. It furthermore may include superimposing information, whether graphic, textual or both on to the hybrid virtual-real 3D imagery. The subject invention is also networked, such that the immersive visual interface described above is accessible to a plurality ofusers operating from a plurality of locations. C~j C\j Ccjj cjca cv~I - - - - - - - - ccj I In I' Lo) L - - - - - - ...

Mobile robot and mobile robot system

The present invention provides a mobile robot comprising: a body forming an external appearance; a travelling unit for moving the body; a boundary signal sensing unit for sensing a boundary signal generated in a boundary area of a travelling area; and a control unit for controlling the travelling unit to perform pattern travelling in the travelling area at multiple times, and controlling a travelling angle of first pattern travelling and a travelling angle of second pattern travelling to be different from each other. Therefore, when pattern travelling is performed multiple times, the mobile robot moves at different angles with respect to a reference axis to minimize an area which fails to be mowed, so as to improve the efficiency.

MONITORING SYSTEM FOR POWER LINES AND RIGHT-OF-WAY USING REMOTELY PILOTED DRONE

Application Of: Roosevelt A. Fernandes For: Monitoring System For Power Lines and Right-Of-Way Using Remotely Piloted Drone A monitoring system using a unique Remotely Piloted Drone with dual counter rotating propellers and carrying electric field sensing, thermal infra-red imaging, video imaging, acoustic and corona discharge sensing equipment. The compact Remotely Piloted Drone flies along a power corridor and is maintained at a fixed distance from an outer phase conductor using on board electric field detection circuitry, video/infra-red imagery and an RF/laser altimeter. The counter rotating, twin-turbo driven configuration for the propellers mounted on coaxial vertical shafts provides a highly stable platform, unlike conventional manned helicopters presently used for routine right-of-way patrols. Dual, counter-rotating saucer-shaped auxiliary propellers provide a degree of stability far superior to a conventional helicopter, particularly in gusty winds. On board sensors and video cameras ...

REMOTELY CONTROLLABLE AERONAUTICAL ORDNANCE

An ordnance for air-borne delivery to a target under remotely controlled in-flight navigation. In one embodiment, self-powered aerial ordnance includes upper and lower cases. A plurality of co-axial, deployable blades is powered by a motor positioned in the upper case. When deployed, the blades are rotatable about the upper case to impart thrust and bring the vehicle to a first altitude above a target position. An explosive material and a camera are positioned in a lower case which is attached to the upper case. The camera generates a view along the ground plane and above the target when the ordinance is in flight. When the vehicle is deployed it is remotely controllable to deliver the vehicle to the target to detonate the explosive at the target. The ordnance may drop directly on a target as a bomb does.

INSPECTION ROBOT

An inspection robot incudes a robot body, at least two sensors, a drive module, a stability assist device and an actuator. The at least two sensors are positioned to interrogate an inspection surface and are communicatively coupled to the robot body. The drive module includes at least two wheels that engage the inspection surface. The drive module is coupled to the robot body. The stability assist device is coupled to at least one of the robot body or the drive module. The actuator is coupled to the stability assist device at a first end, and coupled to one of the drive module or the robot body at a second end. The actuator is structured to selectively move the stability assist device between a first position and a second position. The first position includes a stored position. The second position includes a deployed position.

ADAPTIVE CYBER-PHYSICAL SYSTEM FOR EFFICIENT MONITORING OF UNSTRUCTURED ENVIRONMENTS

The present disclosure provides a system for monitoring unstructured environments. A predetermined path can be determined according to an assignment of geolocations to one or more agronomically anomalous target areas, where the one or more agronomically anomalous target areas are determined according to an analysis of a plurality of first images that automatically identifies a target area that deviates from a determination of an average of the plurality of first images that represents an anomalous place within a predetermined area, where the plurality of first images of the predetermined area are captured by a camera during a flight over the predetermined area. A camera of an unmanned vehicle can capture at least one second image of the one or more agronomically anomalous target areas as the unmanned vehicle travels along the predetermined path ...

AUTONOMOUS ROBOT FOR A MOBILE DEVICE

A robotic device (200) includes a housing (202) configured to house a mobile device (210). The robotic device (200) also includes an articulating image director (204) aligned with a field of view of a camera of the mobile device (210). The housing (202) of the robotic device (210) is positioned at an angle to provide a forward view or rear facing view to the camera via the articulating image director (204).

WORK VEHICLE START SYSTEM AND METHOD WITH OPTICAL VERIFICATION FOR AUTHORIZING REMOTE START

A remote start system for a work vehicle includes a communication unit configured to receive a remote start input signal; optical sensors providing a first image of the work vehicle or work vehicle environment; and a controller including at least a start module and a verification module. The start module is configured to generate a verification request in response to the remote start input signal. In response to the verification request, the verification module is configured to confirm that the first image satisfies a verification condition and to generate a verification confirmation when the first image satisfies the verification condition. The start module is configured to generate a start command in response to the verification confirmation. The remote start system further includes a starter device coupled to the controller and configured to energize a prime mover of the work vehicle upon receipt of the start command from the controller.

SELF-ORIENTING RETICLE

There is described a method and a system for providing a sighting reticle oriented to aim at a target from a vehicle within an environment of the tar get. The method improves the situational awareness of the operator regardles s of the orientation and motion of the aiming instrument and thus finds appl ications for the control of Unmanned Aerial Vehicle (UAV). The method compri ses providing a graphical image representing the environment as seen from th e vehicle when aiming at the target; determining a state of the vehicle with respect to a spatial reference point; overlaying the sighting reticle onto the graphical image, the sighting reticle indicating the target on the graph ical image with respect to the spatial reference point, the sighting reticle comprising a marking defining the spatial reference point; positioning the sighting reticle to orient the marking based on the state of the vehicle; an d displaying on a display device the sighting reticle positioned on the grap hical image ...

MOBILE ROBOT SYSTEM

A robot system (1600) includes a mobile robot (100) having a controller (500) executing a control system (510) for controlling operation of the robot, a cloud computing service (1620) in communication with the controller of the robot, and a remote computing device (310) in communication with the cloud computing service. The remote computing device communicates with the robot through the cloud computing service.

METHOD AND DEVICE FOR THE COMBINED SIMULATION AND CONTROL OF REMOTE-CONTROLLED VEHICLES

The invention relates to a device and a method for the combined simulation and control of remote-controlled vehicles in a simulator. A driver's/pilot's compartment comprising real operating elements and emulating the vehicle to be controlled is provided with a six-axis industrial robot connected to ground via a support system that can be designed as an undercarriage. A display emulating the contours of the driver's/pilot's compartment serves to convey a simulated view of the exterior. The invention is characterized by the following: a) a receiving unit for receiving optical data of the vehicle to be controlled, b) a receiving unit for receiving acoustic data of the vehicle to be controlled, c) a transmitting and receiving unit for the bidirectional transmission of motion-relevant data, d) a control unit which uses mathematical models to process any signals that are mechanically produced by the user of the simulator, and transmits them to the controls of the vehicle, and e) a sensor unit ...

Equipment for assistance in underwater exploration and robotic craft for the equipment.

L’invention concerne un équipement qui comprend un robot sous-marin (1) et un dispositif (2) de pilotage à distance du robot, aptes à communiquer l’un avec l’autre, dans lequel le robot comprend des moyens de déplacement sous-marin et un dispositif de capture d’images; le dispositif de pilotage comprend des lunettes de vision 3D adaptées pour qu’un utilisateur portant les lunettes visualise l’environnement sous-marin du robot en trois dimensions à partir des images capturées par le robot et des moyens de guidage en déplacement à distance du robot à partir de l’environnement sous-marin en trois dimensions visualisé.

Equipment for assistance in underwater exploration and subsea robot for the equipment.

L’équipement comprend un robot sous-marin (1) et un dispositif (2) de pilotage à distance du robot, aptes à communiquer l’un avec l’autre, dans lequel • le robot comprend des moyens de déplacement sous-marin et un dispositif de capture d’images pour la visualisation en trois dimensions; • le dispositif de pilotage comprend des lunettes de vision 3D adaptées pour qu’un utilisateur portant les lunettes visualise l’environnement sous-marin du robot en trois dimensions à partir des images capturées par le robot et des moyens de guidage en déplacement à distance du robot à partir de l’environnement sous-marin en trois dimensions visualisé.

SYSTEMS AND METHODS FOR AUGMENTED STEREOSCOPIC DISPLAY

Virtual reality autonomous driving connecting pipe

PROCESS OF Remote VIDEO-COMMANDE Of MACHINES IN PARTICULAR OF VEHICLES, AND DEVICE OF IMPLEMENTATION

Le dispositif de vidéo-commande de l'invention comporte un poste de commande éloigné (1) et un poste (2) à bord de l'engin à télécommander. Ce dernier comporte essentiellement plusieurs caméras (15), un ensemble de mixage en temps réel (20), un émetteur vidéo et audio (21) et un récepteur de télécommande (17). Le poste de commande comporte plusieurs moniteurs (7A à 7D), un récepteur vidéo-audio (11) et un émetteur de télécommande (4). Application: télécommande d'engins de travaux publics.

DEVICE Of ASSISTANCE TO the PILOTING Of a VEHICLE IN ANY GROUND

AUTONOMOUS CAMERA ANIMATED BY A DRONE WITH TARGET TRACKING AND MAINTAINING THE VIEWING ANGLE OF THE TARGET.

Together of guidance

L'ensemble pour le guidage par un opérateur d'un engin (1) doté de moyens d'autopropulsion (2) comporte, d'une part, sur l'engin (1) une unité de commande (U), une caméra (3), un imageur (5) tridimensionnel, et, d'autre part, une station extérieure (S) comportant un écran (9) et un stylo (10) qui est interactif avec cet écran. L'unité de commande (11) transmet une image toutes les deux secondes à la station de commande (S). L'opérateur choisit avec le stylo (10) un pixel (O) de l'image qui correspond à un point vers lequel l'engin (1) est à diriger.

PROCESS AND DEVICE INTERACTIVES OF DIFFUSION Of IMAGES EMITTED BY a CAMERAVIDEO ASSEMBLED ON a ROBOT

AUTONOMOUS CAMERA ANIMATED BY A DRONE WITH TARGET TRACKING AND MAINTAINING THE VIEWING ANGLE OF THE TARGET.

L'invention concerne un système de prise de vues animées, comprenant un drone (D) pourvu d'une caméra (C) et une station au sol (S) communiquant avec le drone, la caméra (C) étant orientée selon un axe de visée (3), les déplacements du drone étant définis par des instructions de vol appliquées à un ensemble de groupes propulseurs du drone, le drone étant apte à se déplacer de façon autonome pour réaliser une prise de vues animée d'une cible (T) se déplaçant avec la station au sol (S). Le système comprend des moyens de commande (2) configurés pour générer lesdites instructions de vol de sorte à maintenir sensiblement constant l'angle entre l'axe de visée de la caméra et la direction de déplacement de la cible sur activation du suivi de la cible. La station au sol comprend des moyens, commandés par au moins un moyen de pilotage formant bouton d'activation du suivi de la cible, pour faire basculer alternativement le mode de pilotage du drone entre un mode d'activation du système de suivi de ...

CAPTURE SYSTEM AND METHOD (E), COMPUTER PROGRAM, AND ELECTRONIC SYSTEM ASSOCIATED VIDEO CAPTURE

L'invention concerne un procédé de capture d'une vidéo à l'aide d'une caméra embarquée sur un drone (14) à voilure fixe, la caméra comprenant un capteur d'image(s) (28), le drone (14) à voilure fixe comprenant une centrale inertielle (56) configurée pour mesurer l'angle de roulis, de l'angle de tangage et/ou l'angle de lacet du drone à voilure fixe. Ce procédé comprend l'obtention (106) d'image(s) correspondant à une zone du capteur de dimensions réduites par rapport à celles du capteur et associée à un repère de prise de vue, la position de la zone étant déterminée (108) à partir de l'orientation du repère de prise de vue obtenue (110) en fonction de l'angle de roulis, de l'angle de tangage et/ou de l'angle de lacet du drone à voilure fixe.

MONITORING SYSTEM BY PLANE WITHOUT PILOT ALLOWING the LOCALIZATION Of OBJECTIVE

Drone for fire suppression of super high building

SYSTEM AND METHOD FOR TRACING LOCATION OF GOLF BALL IN REAL TIME USING UNMANNED AERIAL VEHICLE

The present invention relates to a system and a method for tracing a golf ball in real time using an unmanned aerial vehicle. The method of the present invention comprises the steps of: having an unmanned aerial vehicle fly to a point where a hit golf ball is expected to be fallen and locate the unmanned aerial vehicle on the midair at the point; when a golfer hits a golf ball, stopping a wireless communication between a user terminal and a golf ball and transmitting GPS information on the current location of the user terminal; a camera capturing images surrounding the point where the golf ball is expected to be fallen; an image processing module analyzing the captured images in real time; when the hit golf ball is detected in the image in the analyzed result, moving the unmanned aerial vehicle to the point; after moving down the unmanned aerial vehicle from the moving point, an RFID reader recognizing wireless signals from an RFID tag embedded in the golf ball, and identifying an ID number ...

METHOD FOR MONITORING THE ENVIRONMENT OF A VEHICLE

The invention proposes a method for monitoring the environment of a vehicle, said method comprising the following steps: • recording environment data using an environment sensor system of a transmitter; • transmitting the environment data from the transmitter to a receiver • displaying at least one detail of the recorded vehicle environment on a display apparatus of the receiver, wherein the transmitter or the receiver is designed as a mobile unit and the displayed detail is determined by orientating the mobile unit. The invention also proposes a driving assistance system.

A SYSTEM FOR EXTENDING THE OBSERVATION, SURVEILLANCE, AND NAVIGATIONAL CAPABILITIES OF A ROBOT

The invention is a system that is integrated with an existing robotic system in order to extend its observation, surveillance, and navigational capabilities. The system comprises: a sensor module comprising imaging and other types of sensors that is attached to the robotic device of the robotic system and a system control station comprising a communication link to the robot control station of the existing robotic system. Both the system control station and the sensor module comprise processing units that are configured to work in complete harmony. These processing units are each supplied with software that enables using information supplied by the sensors and other components in the sensor module to provide the robotic systems with many advanced capabilities that could not be achieves prior to attachment of the sensor module to the robot.

AUTONOMOUS BEHAVIORS FOR A REMOTE VEHICLE

A system and method for allowing an operator to switch between remote vehicle tele-operation and one or more remote vehicle autonomous behaviors, or for implementing remote vehicle autonomous behaviors. The system comprises an operator control system receiving input from the operator including instructions for the remote vehicle to execute an autonomous behavior, and a control system on the remote vehicle for receiving the instruction to execute an autonomous behavior from the operator control system. Upon receiving the instruction to execute an autonomous behavior, the remote vehicle executes that autonomous behavior.

TELEPRESENCE SYSTEM AND METHOD FOR THE REMOTE STEERING OF A BOAT

The system comprises an on-board system (1) mounted on board of a boat and a remote bridge (2) away from the boat, which are communicated by means of a telepresence's link (3). The on-board system (1) includes modules for computer platform, communications, interaction, audio-visual, security and lifesaving purposes. The remote bridge (2) includes the modules for computer platform, communications, interaction, security, lifesaving purposes and the control station from which an operator (5) can steer the boat. The telepresence's link (3) provides the telecommunication channels based on radio, satellite, telephone system and the like. The method is characterized in that the operator can control from the remote bridge and through telecommunication links the instruments of the boat, can select and obtain all the information he requires about the boat, including audio-visual information and can actuate all the steering means of the boat from said control or steering station. The system can be ...

MAPPING OF INTELLIGENT TRANSPORT SYSTEMS TO REMOTE SUPPORT AGENTS

A remote support system facilitates assignment of vehicles to remote support agents for providing teleoperation or other remote support services. The remote support system may generate assignments based on a mapping function that optimizes various parameters based on sensed data associated with the vehicle, a requested service mode of the vehicle, or other factors. In some situations, the remote support server assigns a redundant set of remote support agents to a vehicle that provide similar command streams. The vehicle selects between the command streams to minimize latency or another performance parameter. Alternatively, the remote support server assigns multiple diverse remote support agents to a vehicle that generate diverse command streams. A proxy agent then generates a consensus command stream for providing to the vehicle.

PARACHUTE CONTROL SYSTEM FOR AN UNMANNED AERIAL VEHICLE

Disclosed is a technique for landing a drone using a parachute. The technique includes a parachute deployment system (PDS) that can deploy a parachute installed in a drone and land the drone safely. The parachute may be deployed automatically, e.g., in response to a variety of failures such as a free fall, or manually from a base unit operated by a remote user. For example, the PDS can determine the failure of the drone based on data obtained from an accelerometer, a gyroscope, a magnetometer and a barometer of the drone and automatically deploy the parachute if any failure is determined. In another example, the remote user can “kill” the drone, that is, cut off the power supply to the drone and deploy the parachute by activating an onboard “kill” switch from the base unit.

VEHICLE CONTROL DEVICE AND VEHICLE TRAVEL CONTROL SYSTEM

A vehicle control device including: a remote operation signal reception section configured to be input with a remote operation signal based on an operation by an operator at a command center external to a vehicle; a control section configured to control the vehicle in a remote operation mode, based on the remote operation signal output from the command center, in a state in which remote operation of the vehicle from the command center side has been enabled; and a speech communication device configured to enable conversation between an occupant of the vehicle and an operator at the command center.

Tele-robotic system used to provide remote consultation services

... a robotic system that allows a consultant to provide remote consulting services through a remotely controlled robot. The robot provides a video image to a remote station that is manned by the consultant. The video image may include a therapist performing a therapeutic routine on a patient. The consultant can view the therapeutic routine and provide consultant information such as instructions to modify or otherwise change the routine. The consultant information is transmitted to the robot and conveyed to the therapist. The system allows a consultant to provide consulting services without have to be physically present at the site of the patient. The remote station also allows the consultant to control movement of the robot so that the video image tracks movement of the therapist and/or patient.

Multi-agent autonomous system

A multi-agent autonomous system for exploration of hazardous or inaccessible locations. The multi-agent autonomous system includes simple surface-based agents or craft controlled by an airborne tracking and command system. The airborne tracking and command system includes an instrument suite used to image an operational area and any craft deployed within the operational area. The image data is used to identify the craft, targets for exploration, and obstacles in the operational area. The tracking and command system determines paths for the surface-based craft using the identified targets and obstacles and commands the craft using simple movement commands to move through the operational area to the targets while avoiding the obstacles. Each craft includes its own instrument suite to collect information about the operational area that is transmitted back to the tracking and command system. The tracking and command system may be further coupled to a satellite system to provide additional image ...

Omni-directional wheel and associated methods

An omni-directional wheel for providing multi-directional movement is provided. The omni-directional wheel preferably includes a wheel hub formed of a plastic material, a plurality of pairs of spaced-apart wheel member mounting arms integrally formed of substantially the same plastic material as the wheel hub, and a plurality of separate and spaced-apart wheel members each formed of a plastic material including a wheel main body having a bulbous shape. Each of the plurality of wheel members are preferably connected between the wheel member mounting arms and within a respective one of the plurality of recesses so that each of the plurality of wheel members is adapted to operate independently of other ones of the plurality of wheel members and independently of the wheel hub.

Pool cleaning system and method to automatically clean surfaces of a pool using images from a camera

A pool cleaning system for cleaning debris from a submerged surface of a swimming pool includes a self-propelled pool cleaner having rotatably-mounted supports for supporting and guiding the cleaner on the pool surface; an electric motor for enabling the rotation of the rotatably-mounted supports on the pool surface; at least one camera to capture imagery of the pool surface; a controller, in electronic communication with the at least one camera, to determine a cleanliness characteristic of the pool surface on which the cleaner has passed based on the camera imagery and generate a control signal to direct movement of the cleaner based on the cleanliness characteristic of the pool surface, and a portable electronic device configured to present a graphic on a display, the graphic depicting the submerged surface of the pool and those portions of the surface that remain uncleaned as the cleaner traverses the pool surface.

Throw type compact reconnaissance robot

Provided is a throw-type compact reconnaissance robot, which is used for military purposes or counter-terrorism and is capable of ensuring a long operational time as well as drop safety by efficient spatial layout of a battery. The throw-type compact reconnaissance robot includes a cylindrical body (100) with a camera (140), drivers (200) made up of two tires (270) that are disposed on opposite sides of the body (100) and is drivable individually, and battery units (300) supplying power used to operate the robot and disposed in inner spaces of the tires (270) of the drivers (200) on the opposite outermost sides of the robot.

VEHICLE CONTROLLER AND COMPUTER-READABLE STORAGE MEDIUM

A vehicle controller that controls a vehicle having a first driving mode in which the vehicle travels according to a first control signal based on manual driving or automated driving, and has a second driving mode in which the vehicle travels according to the second control signal based on remote driving is provided, the vehicle controller including a signal comparing unit that compares, to a first control signal, a second control signal acquired by a second control signal acquiring unit while a vehicle control unit is controlling the travelling of the vehicle according to the first control signal, and a mode control unit that causes the vehicle to exit the first driving mode and enter the second driving mode when a comparison result by a signal comparing unit satisfies a predetermined condition.

Multi-stage operation of autonomous vehicles

Systems and methods for operating a vehicle by switching between an autonomous control system within the vehicle and a remote operator are described herein. For the handover between the autonomous control system and the remote operator, the system can process current maneuvering parameters of the vehicle to at least select a teleoperation control type. The system can also generate a concurrent feature profile including a set of automated features that are configured to be implemented during teleoperation of the vehicle. The system can implement the handover of vehicle control according to the teleoperation control type while the vehicle autonomously or semi-autonomously operates according to the concurrent feature profile.

TERMINAL AND METHOD FOR CONTROLLING TERMINAL

A terminal control unit 20 causes a touch panel 9 to display a vehicle control screen on which an operation button allowing touch operation is displayed, moves a position of the operation button following a movement of the position of the touch operation, and maintains a start where the touch operation is performed on the operation button when the position of the touch operation moves after the touch operation is performed on the operation button displayed on the vehicle control screen, transmits a propulsion instruction signal instructing propulsion of the vehicle to an information processing device 4 provided in a vehicle while the touch operation is being performed on the operation button displayed on the vehicle control screen, and stops transmission of the propulsion instruction signal in response to ending of the touch operation on the operation button.

Unmanned aerial vehicle, remote controller, and control method thereof

The present disclosure provides a control method for an UAV (Unmanned Aerial Vehicle) and a remote controller. The method includes transmitting a signal to the remote controller through a first communication network; receiving a first signal switching command; and switching from the first communication network to a second communication network to transmit the signal to the remote controller.

Method and Controller for the Situational Transmission of Surroundings Information of a Vehicle

The disclosure relates to a method for the situational transmission of surroundings data of a vehicle, comprising the steps: determining a driving situation of the vehicle; determining relevant surroundings data from recorded surroundings data based on the driving situation, wherein the relevant surroundings data are a subset of the recorded surroundings data that are relevant to the driving situation; and providing the relevant surroundings data to an external data processing device.

METHOD AND APPARATUS FOR DETERMINING STEREOSCOPIC MULTIMEDIA INFORMATION

Disclosed is a method, device and system for determining stereoscopic multimedia information. The method includes: acquiring multimedia information collected by respective multimedia collection apparatuses of two or more aerial vehicles; and, determining corresponding stereoscopic multimedia information according to the acquired multimedia information. In the present disclosure, a same object is shot by respective loaded multimedia collection apparatuses of two or more aerial vehicles at different angles. In comparison with conventionally shooting a same object by a single unmanned aerial vehicle at a same angle, more stereoscopic multimedia information may be obtained, and a user is more likely to feel the stereoscopic impression of the multimedia information when viewing the multimedia information. In this way, both the visual enjoyment of the user and the user experience are improved.

IMAGE MONITORING AND DISPLAY FROM UNMANNED VEHICLE

An image capture and display system comprises an image capture array positioned on a vehicle, the image capture array comprising a plurality of image sensing members. At least one transmitter is provided for transmitting images from the image sensing members. The system also includes a monitor display array positioned remotely from the image capture array. The monitor display array comprises a display monitor for and corresponding to each image sensing member, and a receiver for receiving the images corresponding to each transmitter.

UNMANNED AERIAL VEHICLE ROOFTOP INSPECTION SYSTEM

Methods, systems, and apparatus, including computer programs encoded on computer storage media, for an unmanned aerial system inspection system. One of the methods is performed by a UAV and includes receiving, by the UAV, flight information describing a job to perform an inspection of a rooftop. A particular altitude is ascended to, and an inspection of the rooftop is performed including obtaining sensor information describing the rooftop. Location information identifying a damaged area of the rooftop is received. The damaged area of the rooftop is traveled to. An inspection of the damaged area of the rooftop is performed including obtaining detailed sensor information describing the damaged area. A safe landing location is traveled to.

Remote control and flying apparatus

The present application relates to a remote control and a flying apparatus. The remote control includes a remote control body and a display assembly including a display screen and being rotatably connected to the remote control body, so that the remote control has its own display screen. When the remote control is used, the display screen can be seen by turning the display assembly open, and the operation is relatively convenient. When the remote control is not used, the display assembly is closed, so that the space needed for packing the remote control is relatively small, facilitating carriage of the remote control. The remote control body is disposed separate from the display screen, so that an operation region and a display region do not affect each other, and the display area of the display screen can be configured larger, thereby improving the visual experience of a user.

URGENT VEHICLE DRIVING SYSTEM, SERVER DEVICE, AND URGENT VEHICLE DRIVING PROGRAM

An urgent vehicle driving system includes: an acquisition unit that acquires driving information relating to a driving state of a first vehicle that is an urgent vehicle; and a switching unit that, on the basis of the driving information acquired by the acquisition unit, switches a second vehicle, which is in a manual driving mode or a remote driving mode and is located within a predetermined range from the first vehicle, to an autonomous driving mode configured to avoid the first vehicle.

Mobile robot system

A robot system includes a mobile robot having a controller executing a control system for controlling operation of the robot, a cloud computing service in communication with the controller of the robot, and a remote computing device in communication with the cloud computing service. The remote computing device communicates with the robot through the cloud computing service.

ROBOT SENSOR INSTALLATION

Methods, systems, and apparatus a drone for installing sensors. A method includes determining to emulate a view of a camera at a particular location with a drone, deploying the drone to the particular location, obtaining an image captured by a drone, and emulating the view of the camera with the image.

System and method for automated flight plan reporting in an electric aircraft

A system for automated flight plan reporting for an electric aircraft, the system including a flight controller coupled to the electric aircraft configured to receive a digital datum from a remote device, generate a plan adjustment datum as a function of the digital datum, and transmit the plan adjustment datum to a pilot display, a pilot display coupled to the electric aircraft, wherein the pilot display is configured to receive the plan adjustment datum from the flight controller, display the plan adjustment datum to a user; and receive a confirmation datum from the user.

Restricting areas available to autonomous and teleoperated vehicles

A vehicle policy server maintains a set of policies for constraining operations of one or more remote vehicles. The policies may specify areas, locations, or routes that specified vehicles are restricted from accessing based on a set of acquired information. An application programming interface (API) enables programmatic updates of the policies or related information. Policies may be enforced by transmitting control signals fully or in part to onboard vehicle computers or to a teleoperation support module providing remote support to the vehicles using human teleoperators and/or artificial intelligence agents. The control signals may directly control the vehicles or teleoperation, or may cause a navigation system to present known restrictions in a suitable fashion such as generating an augmented reality display or mapping overlays.

INFORMATION PROCESSING METHOD AND INFORMATION PROCESSING SYSTEM

An information processing method is an information processing method executed by a computer, and includes: detecting a first operation by a supervising party that supervises a moving body which drives autonomously from a remote location where the moving body cannot be supervised directly; and when the first operation is detected, relaxing an execution condition for autonomous driving of the moving body more than an execution condition applied when the first operation is not detected, and causing the moving body to drive autonomously under the execution condition that has been relaxed.

VIDEO TRANSMISSION METHOD, VIDEO TRANSMISSION SYSTEM, AND CONTROL DEVICE

A plurality of pieces of video data are respectively captured by a plurality of cameras mounted on a moving body. Before data transmission from the moving body to an external device, a data reduction process is executed to reduce the transmission data amount. The data reduction process includes at least two of: a selection process that omits at least one of the plurality of pieces of video data from the transmission video data according to a scene where the moving body is placed; a reduction process that reduces at least one of the plurality of pieces of video data; and a uniting process that combines first video data and second video data such that a screen of the second video data is displayed in a screen of the first video data.

Event identifying method of smart detection system

There is provided a smart detection system including multiple sensors and a central server. The central server confirms a model of every sensor and a position thereof in an operation area. The central server confirms an event position and predicts a user action according to event signals sent by the multiple sensors.

AUTONOMOUS BEHAVIORS FOR A REMOTE VEHICLE

Remote vehicle control

INTUITIVE VEHICLE AND MACHINE CONTROL

A control machine/operator interface (100) and a method for controlling complex machines (108) or moving vehicles are provided. The method uses a high level of automation and the man-machine interface to achieve an intuitive control method and a substantial reduction in required operator skill level and training. The method also makes the operation of such machine or vehicle virtually the same when the operator is in the machine or vehicle as when the machine or vehicle is controlled from a remote location.

NAVIGATION METHOD AND APPARATUS, ELECTRONIC DEVICE, READABLE STORAGE MEDIUM AND COMPUTER PROGRAM PRODUCT

A navigation method and apparatus, an electronic device, a readable storage medium, and a computer program product are provided, which relate to a field of vehicle networking technology, and in particular to a field of navigation technology. The navigation method includes: acquiring a real world image and a navigation information; converting the real world image to obtain a projection image, wherein the projection image is matched with an eyebox of at least one pair of vehicle-mounted glasses; superimposing the navigation information on the projection image to obtain a navigation image; and transmitting to the vehicle-mounted glasses the navigation image so that the navigation image is displayed by the vehicle-mounted glasses. In the solution, the AR navigation is implemented based on the vehicle-mounted glasses, and an influence on the effect of the AR navigation caused by the change of the position of the user's head may be avoided, so as to ensure the effect of the AR navigation and ...

IMAGE CAPTURE DEVICES FOR AUTONOMOUS MOBILE ROBOTS AND RELATED SYSTEMS AND METHODS

IMAGE QUALITY ENHANCEMENT FOR AUTONOMOUS VEHICLE REMOTE OPERATIONS

METHOD AND DEVICE FOR OPERATING A VEHICLE

AUTONOMOUS CONTROL SYSTEM OF STERILIZING ROBOT WITH DOUBLE MISTORIZER GUNS BASED ON INTELLIGENT VISION ALGORITHM

УСТРОЙСТВО УПРАВЛЕНИЯ В КИБЕРФИЗИЧЕСКИХ СИСТЕМАХ, ПРЕИМУЩЕСТВЕННО ДЛЯ УПРАВЛЕНИЯ МОБИЛЬНЫМИ РОБОТАМИ И/ИЛИ БЕСПИЛОТНЫМИ ЛЕТАТЕЛЬНЫМИ АППАРАТАМИ

... 1. Устройство управления в киберфизических системах, включающее центральный процессор, к которому подключенызапоминающее устройство; 3-осевой акселерометр и/или 3-осевой гироскоп; интерфейс внешних устройств и пользовательский интерфейс, отличающееся тем, что включаетпериферийный процессор, подключенный к центральному процессору, и интерфейс контроля оборудования объекта управления, подключенный к периферийному процессору.2. Устройство по п.1, отличающееся тем, что интерфейс контроля оборудования объекта управления включает средства, выбранные из перечня, содержащего, по меньшей мере:средства управления электрическими двигателями;средства управления электрическими приводами;средства контроля датчиков угловой скорости (энкодеров);средства контроля датчиков электромагнитных величин;средства контроля датчиков термодинамических величин;средства контроля датчиков пространственного положения.3. Устройство по п.1, отличающееся тем, что интерфейс внешних устройств включает средства, выбранные из ...

ÜBERWACHUNGS- UND STEUERUNGSSYSTEM, ÜBERWACHUNGS- UND STEUERUNGSVORRICHTUNG SOWIE ÜBERWACHUNGS- UND STEUERUNGSVERFAHREN

... [Aufgabe]In einem System zur Fernsteuerung eines Bewegungskörpers Sicherheit sicherzustellen und eine kurze Bewegungszeit zu realisieren.[Mittel zum Lösen]Überwachungs- und Steuerungssystem mit einem Bewegungskörper und einem Servergerät, das über ein Netzwerk mit dem Bewegungskörper kommuniziert, wobei der Bewegungskörper einen ersten Kommunikationsteil, eine Kamera, einen Codierteil, der aus einem von der Kamera aufgenommenen Bild Bilddaten erzeugt, die aus einem Schlüsselrahmen und einem Differenzrahmen bestehen, einen Sendeteil, der die Bilddaten sendet, und einen Bewegungssteuerteil aufweist, der nach einem über den ersten Kommunikationsteil vom Servergerät empfangenen Steuersignal die Bewegung des Bewegungskörpers steuert, und wobei das Servergerät einen zweiten Kommunikationsteil, der über das Netzwerk mit dem Bewegungskörper kommuniziert, und einen Notsteuersignal-Sendeteil aufweist, der, wenn in den vom Bewegungskörper gesendeten Bilddaten zumindest ein Teil des Schlüsselrahmens ...

DROHNENGESTÜTZTE BEDIENERRUNDEN

Drohnen (z.B. unbemannte Luftfahrzeuge oder „UAVs“), die mit Kameras und Sensoren ausgestattet sind, können dazu konfiguriert sein, sich in der Feldumgebung einer Prozessanlage zu bewegen und Prozessanlagenbedingungen zu überwachen. Zu den Drohnen gehörige Bordcomputergeräte steuern die Bewegung der Drohnen durch die Feldumgebung der Prozessanlage. Zu den Drohnen gehörige Bordcomputergeräte bilden eine Schnittstelle zu den Kameras und anderen Sensoren und kommunizieren über ein Netzwerk mit Benutzerschnittstellengeräten, Steuerungen, Servern und/oder Datenbanken. Die Bordcomputergeräte können von Benutzerschnittstellengeräten und/oder Servern Drohnen-Befehle empfangen oder auf Drohnen-Befehle zugreifen, die in einer oder mehreren Datenbanken gespeichert sind. Die Bordcomputergeräte können die von den Kameras und/oder anderen Sensoren erfassten Daten an Benutzerschnittstellengeräte, Steuerungen, Server usw. übertragen. Dadurch können die Benutzerschnittstellengeräte einem Bediener in einer ...

Verfahren und Vorrichtung zum Führen eines unbemannten Fluggerätes

Bislang erfolgt ein Verfahren zum Führen eines unbemannten Fluggerätes durch die folgenden Schritte: Aufnehmen von Bewegtbildern des Flugsichtbereiches an Bord des Fluggerätes, Übertragen der aufgenommenen Bewegtbilder an eine Bodenstation, Anzeigen der übertragenen Bewegtbilder. Mit Hilfe des neuen Verfahrens und der neuen Vorrichtung soll ein Führen des unbemannten Fluggeräts nach Sichtflugregeln möglich sein. DOLLAR A Erfindungsgemäß erfolgt das Aufnehmen der Bewegtbilder mit mindestens zwei unterschiedlichen Bildaufnahmewinkeln (30-32), werden die derart aufgenommenen Bewegtbilder einem Bodenpiloten (22) in passender Überlagerung angezeigt und erfolgt das Aufnehmen zumindest eines wesentlichen Teils der Bewegtbilder entsprechend der Blickrichtung (21) des Bodenpiloten (22), wobei bei Feststellung anderer potentiell auf Kollisionskurs befindlicher Fluggeräte Ausweichmanöver durchgeführt werden. DOLLAR A Führen von unbemannten Fluggeräten nach Sichtflugregeln vom Boden aus.

Verfahren und Vorrichtung zur Fernsteuerung

Die Erfindung betrifft ein Verfahren und eine Vorrichtung zur Fernsteuerung eines zu einem Fahrzeugverbund gehörenden, fahrerlosen Fahrzeuges (1), dessen Verbindung zu einem Führungsfahrzeug (2) unterbrochen ist und das Fahrzeug (1) an einer Fortführung seiner Fahraufgabe gehindert ist. Erfindungsgemäß ist vorgesehen, dass das Führungsfahrzeug (2) in einen sicheren Stillstand überführt wird oder mittels des Führungsfahrzeuges (2) eine Führungsaufgabe in Bezug auf den Fahrzeugverbund automatisiert übernommen und ausgeführt wird oder das Führungsfahrzeug (2) über eine elektronische Deichsel an ein weiteres Fahrzeug gekoppelt wird,- anschließend ein Prozess einer Fahrzeugübernahme gestartet wird, indem die Kommunikationsverbindung zwischen dem Führungsfahrzeug (2) und dem Fahrzeug (1) hergestellt wird,- bei bestehender Kommunikationsverbindung ein Lenkrad des Führungsfahrzeuges (2) von einem Lenkgetriebe und eine Pedalanlage des Führungsfahrzeuges (2) von einer jeweiligen Einrichtung entkoppelt ...

Verfahren und Vorrichtung zur Überwachung eines Innenraums eines Fahrzeugs

Die Erfindung betrifft ein Verfahren (1) zur Überwachung eines Innenraums eines Fahrzeugs (2), wobei über zumindest einen optischen Sensor (3) Unregelmäßigkeiten im Innenraum erfasst werden.Die Erfindung ist dadurch gekennzeichnet, dass bei Erkennung einer Unregelmäßigkeit die Führung des Fahrzeugs (2) ferngesteuert erfolgt.Des Weiteren betrifft die Erfindung eine Vorrichtung für ein erfindungsgemäßes Verfahren (1).

Watercraft

A watercraft 2 including a ship functionality management system 10 and an augmented reality system 12 is described. The mixed reality system is, at least partially, wearable by a user of the ship and provides augmented reality image data (20, Fig. 4) to the user, based on the interaction between the boat control and mixed reality systems. The ship control system may be a combat management computer. The wearable part of the augmented reality system may interact wirelessly with another part of the augmented reality system and/or the management system and may comprise goggles and/or glasses and/or a headset (52, Fig. 5). The mixed reality image data may be presented in binocular (54, 56, Fig. 5) and/or stereoscopic form. The wearable part of the augmented reality system might comprise sensors (58, Figure 5) for sensing user movement and/or location and/or orientation. The watercraft control system may comprise a camera (40, Fig. 4) providing images to the mixed reality system, and the latter ...

A method of abstracting mobile robot environmental data

Abstracting robot environmental data by receiving a sequence 1615 of images 1611 of the environment from the robot at a receiving rate; receiving annotations or data 1613 associated with the images 1611; performing batch processing to reduce or lower data within the images 1611 to a data set 1607,1617 representing at least a portion of the images 1611, the batch processing task comprising processing the images 1611 into a 3D model 1609 of the environment and transmitting the data set or 3D model 1617 to the robot, the data set or three dimension model 1607,1617 excluding raw image data of the images 1611. The batch processing can be undertaken as part of a cloud computing operation.

A method of operating a mobile robot

Method of presenting visual information

A method and apparatus are disclosed for presenting visual information to an operator. The apparatus comprises a movable camera (13,14) for producing an image or means for producing an image which simulates that produced by a movable camera. A monitor (19,20) presents the image to the operator in such a way that the location of the image in space moves in correspondence with the movement of the movable camera or simulation thereof. The operator may be provided with means for moving the monitor, such movement being sensed and caused to produce corresponding movement of the camera. The apparatus may be used, inter alia, for controlling and observing movement of a vehicle (12) which carries a manipulator (11). ...

REMOTE CONTROL OF A VEHICLE

ARRANGEMENT FOR THE DETERMINATION OF THE POSITION OF UNMANNED ONES OF MINE VEHICLES

Arrangement for determining position of unmanned mining vehicles

Mobile robot and method for controlling mobile robot

A mobile robot and a method for controlling a mobile robot, according to the present invention, perform first pattern traveling in a first traveling area, and start second pattern traveling in the direction intersecting with that of the first pattern traveling when traveling in the first traveling area is complete.

Human-Robot Interface Apparatuses and Methods of Controlling Robots

A method of controlling a robot using a human-robot interface apparatus in two-way wireless communication with the robot includes displaying on a display interface a two-dimensional image, an object recognition support tool library, and an action support tool library. The method further includes receiving a selected object image representing a target object, comparing the selected object image with a plurality of registered object shape patterns, and automatically recognizing a registered object shape pattern associated with the target object if the target object is registered with the human-robot interface. The registered object shape pattern may be displayed on the display interface, and a selected object manipulation pattern selected from the action support tool library may be received. Control signals may be transmitted to the robot from the human-robot interface. Embodiments may also include human-robot apparatuses (HRI) programmed to remotely control a robot.

METHOD FOR PILOTING A ROTARY WING DRONE FOR TAKING AN EXPOSURE THROUGH AN ONBOARD CAMERA WITH MINIMIZATION OF THE DISTURBING MOVEMENTS

The drone () comprises an onboard video camera () picking up a sequence of images to be transmitted to a remote control. The user selects an exposure mode such as forward or sideways, panoramic or boom plane, tracking, defining a trajectory to be transmitted to the drone. Corresponding setpoint values are generated and applied to a processing subsystem controlling the motors of the drone. Once the drone is stabilized on the prescribed trajectory (), the exposure by the video camera () is activated and the trajectory is stabilized by an open loop control avoiding the oscillations inherent in a servocontrol with feedback loop. 1161012110. A method for piloting , by means of a remote control apparatus () , a rotary wing drone () with multiple rotors () driven by respective motors () that can be controlled in a differentiated manner to pilot the drone attitude-wise and speed-wise ,{'b': '14', 'the drone comprising an onboard video camera () suitable for picking up a sequence of images of a target seen from the drone and for transmitting this sequence to the apparatus,'} [{'b': 46', '48', '58', '64', '66', '72, 'selection by the user of a predetermined exposure mode, defined by a set of parameters (-; -; -) describing a trajectory to be transmitted to the drone, these parameters belonging to the group comprising: exposure mode at a fixed point or in displacement; type of displacement, translational or rotational; speed of displacement; direction or axis of displacement; direction of displacement; duration of displacement; exposure altitude;'}, {'b': 152', '160', '164', '100', '150, 'generation (, , ) of setpoint values from said set of parameters, and application of these setpoints to a processing subsystem (-) for controlling the motors of the drone;'}, {'b': '14', 'once the drone is stabilized on a trajectory conforming to said parameters, activation of the exposure by the video camera ().'}], 'characterized by the following steps2. The method of claim 1 , in which:the ...

Portable proprioceptive peripatetic polylinear video player

Departing from one-way linear cinema played on a single rectangular screen, this multi-channel virtual environment involves a cinematic paradigm that undoes habitual ways of framing things, employing architectural concepts in a polylinear video/sound construction to create a type of experience that allows the world to reveal itself and permits discovery on the part of participants. Techniques are disclosed for peripatetic navigation through virtual space with a handheld computing device, leveraging human spatial memory to form a proprioceptive sense of location, allowing a participant to easily navigate amongst a plurality of simultaneously playing videos and to center in front of individual video panes in said space, making it comfortable for a participant to rest in a fixed posture and orientation while selectively viewing any one of the video streams, and providing spatialized 3D audio cues that invite awareness of other content unfolding simultaneously in the virtual environment.

AUTONOMOUS MONITORING ROBOT SYSTEMS

An autonomous mobile robot includes a chassis, a drive supporting the chassis above a floor surface in a home and configured to move the chassis across the floor surface, a variable height member being coupled to the chassis and being vertically extendible, a camera supported by the variable height member, and a controller. The controller is configured to operate the drive to navigate the robot to locations within the home and to adjust a height of the variable height member upon reaching a first of the locations. The controller is also configured to, while the variable height member is at the adjusted height, operate the camera to capture digital imagery of the home at the first of the locations. 120-. (canceled)21. A method comprising:receiving, by a user computing device in communication with a communication network, imagery captured by an autonomous mobile robot in an environment, the imagery representing at least a portion of an electronic device in the environment, and the autonomous mobile robot and the electronic device being in communication with the communication network;receiving, by the user computing device, data indicative of a status of the electronic device; andpresenting, by the user computing device, a representation of the imagery captured by the autonomous mobile robot and an indicator of a status of the electronic device, the indicator being overlaid on the representation of the imagery.22. The method of claim 21 , further comprising transmitting claim 21 , to the autonomous mobile robot claim 21 , one or more commands to cause the autonomous mobile robot to be moved to a user-selected location within the environment claim 21 , wherein the autonomous mobile robot at the user-selected location captures the imagery representing at least the portion of the electronic device.23. The method of claim 22 , wherein transmitting the one or more commands to cause the autonomous mobile robot to be moved to the user-selected location within the environment ...

SERVER CONNECTIVITY CONTROL FOR TELE-PRESENCE ROBOT

A robot system with a robot that has a camera and a remote control station that can connect to the robot. The connection can include a plurality of privileges. The system further includes a server that controls which privileges are provided to the remote control station. The privileges may include the ability to control the robot, joint in a multi-cast session and the reception of audio/video from the robot. The privileges can be established and edited through a manager control station. The server may contain a database that defines groups of remote control station that can be connected to groups of robots. The database can be edited to vary the stations and robots within a group. The system may also allow for connectivity between a remote control station at a user programmable time window. 1. A remote controlled robot , comprising:a robot that has a camera;a remote control station that can connect to said robot, said connection including a plurality of privileges;a server that controls which privileges are provided to said remote control station; and,a manager control station that can access said server to establish and edit said privileges.2. The system of claim 1 , wherein said robot includes a monitor.3. The system of claim 2 , wherein said robot includes a mobile platform.4. The system of claim 1 , wherein said privileges include an ability to operate said robot.5. The system of claim 1 , wherein said privileges include an ability to participate in a session with another remote station.6. The system of claim 1 , wherein said privileges include an ability to view a video image captured by said robot camera.7. The system of claim 1 , wherein said privileges include an ability to hear audio captured by a robot microphone.8. The system of claim 2 , wherein said privileges include an ability for the video image captured by a control station camera to be displayed on said robot monitor.9. The system of claim 1 , wherein said privileges include an ability for the ...

Obstacle avoidance device

An obstacle avoidance device for detecting surroundings of an unmanned mobile device is disclosed, which includes a stabilization platform connected with the unmanned mobile device, wherein the stabilization platform includes a stabilizer for ensuring stably bearing at least one platform camera; and an obstacle avoidance module fixed with the stabilization platform, so as to reduce interferences to detecting the surroundings by the obstacle avoidance module when the unmanned mobile device acts. The obstacle avoidance device of the present invention is able to keep a stable attitude while the unmanned mobile device is unstable and changes an attitude thereof, so as to effectively avoid obstacles. 1. An obstacle avoidance device for detecting surroundings of an unmanned mobile device , which comprises:a stabilization platform connected with the unmanned mobile device, which comprises a stabilizer for ensuring stably bearing at least one platform camera; andan obstacle avoidance module fixed with the stabilization platform, so as to reduce interferences to detecting the surroundings by the obstacle avoidance module when the unmanned mobile device acts.2. The obstacle avoidance device claim 1 , as recited in claim 1 , wherein the stabilization platform comprises a rotation shaft unit and a stabilization holder; the obstacle avoidance module is installed on the stabilization holder; the stabilization holder is movably connected with the unmanned mobile device through the rotation shaft unit claim 1 , so that the obstacle avoidance module moves relatively to the unmanned mobile device and maintains the attitude when the unmanned mobile device acts.3. The obstacle avoidance device claim 1 , as recited in claim 1 , wherein through the rotation shaft unit claim 1 , the stabilization holder rotates in three mutually perpendicular planes claim 1 , or two mutually perpendicular planes claim 1 , or in a single plane.4. The obstacle avoidance device claim 2 , as recited in claim ...

UNMANNED AERIAL VEHICLES AND RELATED METHODS AND SYSTEMS

Unmanned aerial vehicles and related methods and systems are disclosed. An example apparatus includes a processor to determine whether a first location of an unmanned vehicle and a second location of a virtual event is within a threshold distance; and a game experience controller to: control the unmanned vehicle based on a first command associated with a non-augmented state of the unmanned vehicle in response to the first location of the unmanned vehicle and the second location of the virtual event being outside of the threshold distance; and in response to the first location of the unmanned vehicle and the second location of the virtual event being within the threshold distance, control the unmanned vehicle based on a second command associated with an augmented state of the unmanned vehicle to simulate the unmanned vehicle being affected by the virtual event. 1. An apparatus for use with an unmanned vehicle , comprising:a processor to determine whether a first location of an unmanned vehicle and a second location of a virtual event is within a threshold distance; and control the unmanned vehicle based on a first command associated with a non-augmented state of the unmanned vehicle in response to the first location of the unmanned vehicle and the second location of the virtual event being outside of the threshold distance; and', 'in response to the first location of the unmanned vehicle and the second location of the virtual event being within the threshold distance, control the unmanned vehicle based on a second command associated with an augmented state of the unmanned vehicle to simulate the unmanned vehicle being affected by the virtual event., 'a game experience controller to2. The apparatus of claim 1 , wherein the game experience controller is further to execute at least one of an audio command or a visual command that simulates the unmanned vehicle being affected by the virtual event in response to the first location of the unmanned vehicle and the second ...

DATA TRANSMISSION AND CONTROL OVER POWER CONDUCTORS

A system for controlling a subsea device comprises a complimentary set of data communication interfaces operatively coupled to an electronically interrogatable component of a subsea device and a remotely disposed device controller via a power conductor which defined data pathway between the subsea device and the remotely disposed device controller. A data transceiver is operatively coupled to the electronically interrogatable component and the remotely disposed device controller via the complimentary set of data communication interfaces over the power conductor. In configurations, control and/or telemetry or other data may be unidirectionally and/or bidirectionally transmitted between the electronically interrogatable component of a subsea device and a remotely disposed device controller. In configurations, data faults may be monitored in a primary data path and, if a fault detected, control and/or telemetry or other data transmission switched to the power conductor data pathway, manually and/or automatically. 1) A method of controlling a subsea device , comprising:a) establishing a data communication path between an electronically interrogatable component of a subsea device and a remotely disposed device controller over a power conductor operatively coupled to a complimentary set of data communication interfaces, the power conductor configured to provide power to the subsea device, one of the data communication interfaces operatively in communication with the electronically interrogatable component and the other of the data communication interfaces operatively in communication with the remotely disposed device controller; andb) using the data communication path to transmit data between the electronically interrogatable component and the remotely disposed device controller over the power conductor via the complimentary set of data communication interfaces.2) The method of claim 1 , wherein the subsea device comprises a remotely operated vehicle.3) The method of ...

Unmanned Aerial Vehicle Weapon System and Method of Operation

An unmanned aerial vehicle weapon system and method of operation which includes an unmanned aerial vehicle having navigational and weapon aiming cameras, remote controlled flight controls and a rifle type of weapon mounted in the wing transversely to the axis of the fuselage where the aerial vehicle is directed to a general target area and controlled to fly in a circular trajectory above and around a specific target within the target area until acquiring the target with the aiming camera and adjusting the bank angle of the vehicle to direct the weapon to the specific target. 1. A method of acquiring and destroying a target comprising the steps of;remotely control a weapon carrying unmanned aerial vehicle to a target area,identify a target within the target area,acquire the distance to the target and compute a circular trajectory of the unmanned aerial vehicle around the target,execute the computed circular trajectory around the target,remotely control the unmanned aerial vehicle to aim the weapon at the identified target along a radius of the circular trajectory.2. The method of and further including the step of claim 1 ,controlling the unmanned aircraft autonomously to maintain the target on sight throughout the circular trajectory.3. The method of and further including the step of claim 2 ,remotely controlling the firing of the weapon radially of the circular trajectory.4. An unmanned aerial vehicle weapon system comprising claim 2 ,an unmanned aerial vehicle including a fuselage having a longitudinal axis, power plant, flight controls and at least one rigid lifting surface structure,a wide-angle video camera, having a rangefinder, carried by the at least one rigid lifting surface structure,a telescopic aiming camera, having a rangefinder, carried by the at least one rigid lifting surface structure,a weapon having a barrel and carried within the at least one rigid lifting surface structure where the barrel is positioned and arranged perpendicularly to the ...

REMOTE SYSTEM FOR AN AUTONOMOUS VEHICLE

A remote system for an autonomous vehicle, includes a receiver, a controller, and a display device. The receiver is configured to receive road information. The controller is programmed to receive input related to the road information and create a supervision zone when the road information impacts road drivability. The display device is disposed at a control center area and configured to display a visual indication on a map of the supervision zone. 1. A remote system for an autonomous vehicle , comprising:a non-moveable receiver remote from the autonomous vehicle and configured to receive road information;a controller programmed to receive input related to the road information and create a supervision zone when the road information impacts road drivability; anda display device disposed at a control center area and configured to display a visual indication on a map of the supervision zone.2. The remote system of claim 1 , whereinthe input is received by the controller directly from the receiver and the controller is programmed to determine whether the road information impacts road drivability.3. The remote system of claim 1 , whereinthe input is received by the controller from a user input.4. The remote system of claim 1 , whereinthe controller is programmed to remove the visual indication of the supervision zone after a predetermined amount of time.5. The remote system of claim 1 , whereinthe controller is programmed to receive user input to remove the visual indication of the supervision zone.6. The remote system of claim 1 , whereinthe receiver is configured to receive an emergency vehicle signal, and the controller is programmed to determine that the emergency vehicle signal is road information that impacts road drivability.7. The remote system of claim 1 , whereinthe controller is programmed to receive input data enabling a route to be created to avoid the supervision zone.8. The remote system of claim 7 , further comprisinga transmitter configured to transmit ...

Method and System for Remotely Controlling a Vehicle

A method of remotely controlling a vehicle involves creating an exterior situation image for the vehicle () using a sensor system () for detecting the surroundings of the vehicle. A trajectory of the vehicle is specified by a driver assistance system () of the vehicle. The exterior situation image and the trajectory are transmitted wirelessly to a remote control () that is arranged spatially separately from the vehicle. The vehicle is controlled by the remote control based on the trajectory and the exterior situation image. 1. A method of remotely controlling a vehicle , the method comprising steps:creating an exterior situation image for the vehicle using a sensor system that detects surroundings of the vehicle;specifying a trajectory for the vehicle using a driver assistance system of the vehicle;wirelessly transmitting the exterior situation image and the trajectory from the vehicle to a remote control that is arranged spatially separately from the vehicle; andcontrolling the vehicle by the remote control based directly or indirectly on at least the trajectory and the exterior situation image.2. The method according to claim 1 , wherein the step of controlling the vehicle comprises using an operating element of the remote control.3. The method according to claim 1 , further comprising correcting trajectory by the remote control to produce a corrected trajectory claim 1 , and wherein the controlling of the vehicle by the remote control is based on the corrected trajectory and the exterior situation image.4. The method according to claim 3 , further comprising transmitting a supplementary image of the surroundings of the vehicle to the remote control claim 3 , and wherein the correcting of the trajectory by the remote control is based on the exterior situation image and the supplementary image.5. The method according to claim 1 , further comprising continuously determining a quality of a data link for the wireless transmitting from the vehicle to the remote control ...

MOBILE BODY, INFORMATION PROCESSOR, MOBILE BODY SYSTEM, INFORMATION PROCESSING METHOD, AND INFORMATION PROCESSING PROGRAM

A mobile body includes: an imaging unit; a movement mechanism that moves itself; a wireless communication unit that performs wireless communication; and an information generator that generates, on a basis of external information received from outside by the wireless communication unit, route guidance information for use in allowing the movement mechanism to move itself. 1. A mobile body comprising:a movement mechanism configured to move the mobile body;an imaging unit configured to obtain image data; and receive external information,', 'generate route guidance information for use in allowing the movement mechanism to move the mobile body based on the image data, the external information, position information of the mobile body, and map information, and', 'communicate a negotiation with other mobile bodies to perform a predetermined operation., 'circuitry configured to2. The mobile body according to claim 1 ,wherein the circuitry generates the route guidance information with use of a correspondence relationship between mode setting information, which sets an autonomous move mode of a plurality of autonomous move modes, and a plurality of kinds of information for each of the plurality of autonomous move modes, andwherein the route guidance information includes at least two selectable routes.3. The mobile body according to claim 1 , wherein the external information includes one or both of:GPS information, andsearch history information stored in a memory associated with an information processor.4. The mobile body according to claim 1 ,wherein the image data, the position information, and the map information are stored together with data update time information regarding the image data, andwherein the circuitry generates the route guidance information on a regular basis with use of the data update time information, with updated image data being stored as the image data on a regular basis, and with the map information being automatically updated on a regular basis.5. The ...

DISPLAY CONTROL DEVICE AND DISPLAY CONTROL METHOD

A display control device includes an acquisition unit for acquiring a difficulty level of an automated traveling control of a mobile object, and a control unit for causing a display device for visual recognition by a person outside the mobile object whose difficulty level has been acquired to perform display according to the difficulty level. 1. A display control device , comprising:an acquisition unit for acquiring a difficulty level of an automated traveling control of a mobile object; anda control unit for causing a display device for visual recognition by a person outside the mobile object whose difficulty level has been acquired to perform display according to the difficulty level.2. The display control device according to claim 1 , wherein the control unit causes the display device to perform display in a mode according to the difficulty level.3. The display control device according to claim 1 , wherein the display device is mounted on the mobile object whose difficulty level is acquired by the acquisition unit.4. The display control device according to claim 1 , wherein the display device is mounted on a mobile object different from the mobile object whose difficulty level is acquired by the acquisition unit.5. The display control device according to claim 1 , wherein the display device is a display device for visual recognition by a user of a remote driving device that provides a remote driving service to the mobile object whose difficulty level is acquired by the acquisition unit.6. The display control device according to claim 5 , wherein the control unit is configured to display an image related to the mobile object in any one of a first display mode or a second display mode claim 5 , and causes the display device to display the image related to the mobile object in the second display mode in a case where the difficulty level of the automated traveling control of the mobile object is higher than a threshold.7. The display control device according to claim ...

Uav hardware architecture

An unmanned aerial vehicle (UAV) includes one or more propulsion units that effect flight of the UAV, an application processing circuit configured to verify a validity of a system image of the UAV in a secure environment, and a flight control circuit operably coupled to the application processing circuit. Generation and/or transmission of control signals from the flight control circuit to one or more electronic speed controllers (ESC controllers) is prevented prior to verification of the validity of the system image.

DISPLAY DEVICE AND CONTROL METHOD FOR DISPLAY DEVICE

An HMD includes an image display section configured to display an image to enable visual recognition of an outside scene by transmitting external light, a mobile-body-position acquiring section configured to acquire a position of a mobile machine, an operation detecting section configured to detect operation, and a display control section configured to cause the image display section to display the image. The display control section executes visibility control processing for controlling, on the basis of the position of the mobile machine acquired by the mobile-body-position acquiring section and the operation detected by the operation detecting section, visibility of the image displayed by the image display section with respect to the external light transmitted through the image display section. 1. A display device for use with a user , the display device comprising:a display configured to display an image to enable visual recognition of an outside scene by transmitting external light;a mobile-body-position sensor configured to acquire a position of a mobile body;an operation sensor configured to detect an operation; and execute visibility control processing based on the acquired position of the mobile body and the detected operation, and', 'cause the display to display the image based on the executed visibility control processing., 'a processor or circuit configured to2. The display device according to claim 1 , wherein the visibility control processing includes switching between:a mobile machine preferential mode for setting a first visibility of a mobile machine greater than a second visibility of the image displayed by the display, anda displayed image preferential mode for increasing the visibility of the image displayed by the display with respect to the external light that is emitted by the display.3. The display device according to claim 1 , whereinwhen the line of sight of the user or the direction of the head of the user wearing the image display faces the ...

DATA MANAGEMENT OF CONNECTED CARS CAMERAS FOR HOMELAND SECURITY AND SMART CITIES

Disclosed is a method, apparatus, and system for collecting video data relating to a security event at a security operations center (SOC), the operations comprising: receiving video data captured through one or more cameras installed at one or more vehicles within a predetermined range of the security event at the SOC from the one or more vehicles; and compiling the video data into viewable format usable in an investigation of the security event. 1. A computer-implemented method for collecting video data relating to a security event at a security operations center (SOC) , the method comprising:receiving video data captured through one or more cameras installed at one or more vehicles within a predetermined range of the security event at the SOC from the one or more vehicles; andcompiling the video data into viewable format usable in an investigation of the security event.2. The method of claim 1 , wherein the SOC continuously receive reported locations of vehicles claim 1 , wherein a trigger message is transmitted subsequent to the security event from the SOC to the one or more vehicles within the predetermined range of the security event claim 1 , and wherein in response to the trigger message claim 1 , the one or more vehicles transmit the video data to the SOC.3. The method of claim 1 , wherein the SOC does not receive reported locations of vehicles claim 1 , wherein a broadcast message comprising a location of the security event is transmitted subsequent to the security event from the SOC claim 1 , and wherein the one or more vehicles claim 1 , in response to determining at the vehicles that they are within the predetermined rage of the security event based on the broadcast message claim 1 , transmit the video data to the SOC.4. The method of claim 1 , wherein at least some of the one or more cameras are part of vehicle onboard systems.5. The method of claim 1 , wherein at least some of the one or more cameras are comprised in mobile devices that are detachably ...

LOW GRAVITY ALL-SURFACE VEHICLE

Vehicles are disclosed which have a lower center of gravity than existing all-terrain, amphibious, and unmanned ground vehicles due to the location of propulsion units and other vehicle components inside the wheels of the vehicle. The vehicles can climb over large obstacles yet are also able to corner at high speeds. The vehicles can be configured for direct manual operation or operation by remote control, and can also be configured for a wide variety of missions. 1. A vehicle comprising:a frame; and an axle extending through the inner volume and having one end positioned outside of the inner volume, the one end attached to the frame;', 'a propulsion unit supported within the inner volume by the axle and drivingly coupled to the wheel; and', 'a frame mount positioned within the inner volume and connected to the axle, the frame mount having a portion extending below an axis of the axle, which portion supports a control unit and an energy source for powering the propulsion unit and the control unit;, 'a plurality of self-contained motorized wheels, each wheel defining an inner volume and comprisingwherein the center of gravity of each self-contained motorized wheel is below the axis of the axle thereof.2. The vehicle of claim 1 , further comprising a mounting bar attached to the frame.3. The vehicle of claim 2 , further comprising at least one suspension element attached to the frame.4. The vehicle of claim 3 , wherein the at least one suspension element is operable to raise and lower the mounting bar.5. The vehicle of claim 2 , further comprising a stretcher attached to the mounting bar.6. The vehicle of claim 5 , further comprising a first camera mounted to a forward portion of the vehicle and positioned to capture imagery of an area in front of the vehicle and a second camera mounted above the stretcher and positioned to capture imagery of the stretcher.7. The vehicle of claim 2 , further comprising a cargo rack attached to the mounting bar.8. The vehicle of claim ...

DRONE SYSTEM, DRONE, MOVABLE BODY, DRONE SYSTEM CONTROL METHOD, AND DRONE SYSTEM CONTROL PROGRAM

A drone system that includes a drone and a movable body which is movable with loading the drone and where the drone can take off and land, cooperate to operate and that is able to maintain a high level of safety even during autonomous flight, is provided. The drone has a flight controller controlling a flight of the drone, and a drone transmitter transmitting an information possible to distinguish whether the drone is in flight. The movable body has a take-off and landing area where the drone is loaded, takes off and lands, a movement controller loading the drone on the take-off and landing area and moving the movable body with the drone, a movable body receiver receiving an information from the drone, and a display unit. 1. A drone system comprising:a drone; anda movable body, which is movable with loading the drone, and where the drone can take off and land;wherein the drone and the movable body cooperate to operate,wherein the drone comprising:a flight controller controlling a flight of the drone; anda drone transmitter transmitting an information possible to distinguish whether the drone is in flight;wherein the movable body comprising:a take-off and landing area which becomes a take-off and landing point where the drone is loaded and where the drone takes off and lands;a movement controller loading the drone on the take-off and landing area and moving the movable body with the drone;a movable body receiver receiving an information from the drone; anda display unit indicating an information based on the information received from the drone;wherein when the information indicating that the drone is in flight is received by the movable body receiver, at least one of a restriction of an operation of the movable body or an indication of the display unit is made different from a case when the drone is not in flight.2. The drone system according to claim 1 , wherein when the information indicating that the drone is in flight is received by the movable body receiver and ...

STRUCTURAL WALL INSPECTION SYSTEM USING DRONES TO PERFORM NONDESTRUCTIVE TESTING (NDT)

A system for nondestructive inspection of structures. The system includes an omni-directional unmanned aerial vehicle (UAV) and a support arm extending outward from the UAV body from a first end attached to the body to a second distal end, which is used to support a nondestructive testing (NDT) sensor. The system includes an autopilot module stabilizing the flight of the omni-directional platform. The autopilot includes a wall-tracking mode, which determines the normal of the structure's surface, and the omni-directional UAV is stabilized to fly with the support arm aligned with normal to the surface and with the second end proximate to the surface with the UAV body in any orientation in space. The UAV operates to follow a flight path whereby a longitudinal axis of the support arm coincides with the normal and the sensor is positioned in predefined measurement position relative to the structure surface to take the measurements. 1. A system for inspecting a structure in a nondestructive manner , comprising:an omni-directional unmanned aerial vehicle (UAV) including a body;a support arm extending outward from the body from a first end attached to the body to a second end distal to the body;a nondestructive testing (NDT) sensor mounted on or in the support arm at or near the second end;an autopilot module stabilizing flight of the omni-directional UAV during at least one of free flight when in proximity to the structure; anda surface tracking module, active when the omni-directional UAV is in proximity to the structure, determining a normal of a surface of the structure, wherein the autopilot performs the stabilizing of flight to orient the body with the support arm aligned with the normal to the surface and with the second end of the support arm proximate to the surface.2. The system of claim 1 , wherein the omni-directional UAV operates in response to control signals generated by the autopilot module or received from a radio controller based on user input to follow a ...

SYSTEMS AND METHODS TO DETERMINE OBJECT POSITION USING IMAGES CAPTURED FROM MOBILE IMAGE COLLECTION VEHICLE

An object identification method is disclosed. The method includes obtaining images of a target geographical area and telemetry information of an image-collection vehicle at a time of capture, analyzing each image to identify objects, and determining a position of the objects. The method further includes determining an image capture height, determining a position of the image using the capture height and the telemetry information, performing a transform on the image based on the capture height and the telemetry information, identifying the objects in the transformed image, determining first pixel locations of the objects within the transformed image, performing a reverse transform on the first pixel locations to determine second pixel locations in the image, and determining positions of the objects within the area based on the second pixel locations within the captured image and the determined image position. 1. A method , comprising:obtaining a first image of a geographical area;performing a homography transform on the first image to generate a second image having uniform-pixel-distances based on a capture height and avionic telemetry information associated with an aerial vehicle that captured the first image;performing image recognition on the second image to identify an object in the second image based on trained object parameters;determining a first pixel location of the object within the second image;performing a reverse homography transform on the first pixel location to determine a second pixel location in the first image for the object;determining a position of the object within the geographical area based on the second pixel location within the first image and an image position associated with the aerial vehicle capturing the image; andstoring the determined position of the object.2. The method of claim 1 , wherein obtaining the first image of the geographical comprises:capturing, via a camera on the aerial vehicle, the first image; andrecording the avionic ...

SYSTEM AND METHOD FOR REMOTE CONTROL OF UNMANNED VEHICLES

An open architecture control system is provided that may be used for remote and semi-autonomous operation of commercial off the shelf (COTS) and custom robotic systems, platforms, and vehicles to enable safer neutralization of explosive hazards and other services. In order to effectively deal with rapidly evolving threats and highly variable operational environments, the control system is built using an open architecture and includes a high level of interoperability. The control system interfaces with a large range of robotic systems and vehicles, autonomy software packages, perception systems, and manipulation peripherals to enable prosecution of complex missions effectively. Because the control system is open and does not constrain the end user to a single robotics system, mobile platform, or peripheral hardware and software, the control system may be used to assist with a multitude of missions beyond explosive hazard detection and clearance. 1. A method comprising:receiving a current location of an operator at an instrument control system of an unmanned vehicle;determining a leading distance of the unmanned vehicle by the instrument control system;determining a current location of the unmanned vehicle by the instrument control system;determining if a difference between the current location of the operator and the current location of the unmanned vehicle is less than the leading distance; andif so, increasing the speed of the unmanned vehicle by the instrument control system.2. The method of claim 1 , further comprising:determining if a difference between the current location of the operator and the current location of the unmanned vehicle is greater than the leading distance; andif so, decreasing the speed of the unmanned vehicle by the instrument control system.3. The method of claim 1 , wherein the current location of the operator is received from a hand held controller.4. The method of claim 1 , wherein the leading distance is randomly generated.5. The method ...

Control device, control method, computer program product, and robot control system

A control system, method and computer program product cooperate to assist control for an autonomous robot. The system includes a communications interface that exchanges information with the autonomous robot. A user interface displays a scene of a location in which the autonomous robot is positioned, and also receives an indication of a user selection of a user selected area within the scene. The communications interface transmits an indication of said user selected area to the autonomous robot for further processing of the area by said autonomous

SYSTEMS AND METHODS FOR CENTRALIZED CONTROL OF AUTONOMOUS VEHICLES

Disclosed are systems, methods and devices for centralized control of autonomous vehicles. In some embodiments, a system and method allow an autonomous control system on-board an autonomous vehicle to pass control of the autonomous vehicle to an offboard panel of experts upon encountering an anomaly. In some embodiments, a system and method allow a regulatory entity to proactively distribute rules and requirements to autonomous vehicles while operating within a regulated space. 1. A method implemented with an autonomous control system that includes a processor and a memory , the method comprising:autonomously operating a vehicle;monitoring an internal state of the vehicle and an environment in which the vehicle is operating;based on the monitoring, upon detecting an anomaly, determining if it is safe to pass control of the vehicle to an external entity; andpassing the control of the vehicle to the external entity when it is determined to be safe.2. The method of claim 1 , wherein the anomaly includes any of an environmental condition or an attained internal state of the vehicle under which the autonomous control system cannot ensure safe control of the vehicle within a predetermined level of uncertainty.3. The method of claim 1 , further comprising:once the anomaly is resolved by the external entity, resuming autonomous operation of the vehicle.4. The method of claim 1 , wherein the external entity includes a panel of one or more experts.5. The method of claim 1 , wherein the passing control of the vehicle to the external entity is determined to be safe when the anomaly does not require resolution within a predetermined period of time.6. The method of claim 1 , wherein the passing control of the vehicle to the external entity is determined to be safe after the autonomous control system maneuvers the vehicle to a passively safe state.7. The method of claim 1 , further comprising:passing control to a driver of the vehicle to resolve the anomaly when it is determined ...

Aircraft control device and remote control aircraft

An aircraft control device and a remote controller aircraft are disclosed. The aircraft control device includes a first channel configured to receive first control information outputted by a remote controller and transmit the first control information to an aircraft; a second channel configured to receive second control information outputted by the remote controller and transmit the second control information to a camera and/or a gimbal; and a switch unit configured to switch that the first control information is received by the second channel and transmitted to the aircraft when the first channel is disturbed or a distance between the remote controller and the aircraft is larger than a distance threshold. The present invention is able to switch the transmission route of the first control information between the first channel and the second channel in accordance with situations of the first channel and the second channel. 1. An aircraft control device , comprising:a first channel configured to receive first control information outputted by a remote controller and transmit the first control information to an aircraft;a second channel configured to receive second control information outputted by the remote controller and transmit the second control information to a camera and/or a gimbal; anda switch unit configured to switch that the first control information is received by the second channel and transmitted to the aircraft when the first channel is disturbed or a distance between the remote controller and the aircraft is larger than a distance threshold.2. The aircraft control device claim 1 , as recited in claim 1 , wherein the switch unit is further configured to determine whether the first channel is disturbed through judging an amount of the first control information received by the first channel in a first time period.3. The aircraft control device claim 2 , as recited in claim 2 , wherein determining whether the first channel is disturbed through judging the ...

FLIGHT AIDING METHOD AND SYSTEM FOR UNMANNED AERIAL VEHICLE, UNMANNED AERIAL VEHICLE, AND MOBILE TERMINAL

A flight aiding method for an unmanned aerial vehicle includes receiving a receiving, from a mobile terminal that controls the unmanned aerial vehicle, a flight aiding instruction to execute a flight aiding function. The flight aiding method further includes in response to receiving the flight aiding instruction, controlling, regardless of a head direction that a head of the unmanned aerial vehicle is pointing, the unmanned aerial vehicle to fly by controlling both a velocity of the unmanned aerial vehicle along a reference direction and a velocity of the unmanned aerial vehicle perpendicular to the reference direction. The reference direction is defined for the unmanned aerial vehicle based on a position of a point of interest and a current location of the unmanned aerial vehicle. 1. A flight aiding method for an unmanned aerial vehicle comprising:receiving, from a mobile terminal that controls the unmanned aerial vehicle, a flight aiding instruction to execute a flight aiding function; andin response to receiving the flight aiding instruction, controlling, regardless of a head direction that a head of the unmanned aerial vehicle is pointing, the unmanned aerial vehicle to fly by controlling both a velocity of the unmanned aerial vehicle along a reference direction and a velocity of the unmanned aerial vehicle perpendicular to the reference direction, the reference direction being defined for the unmanned aerial vehicle based on a position of a point of interest and a current location of the unmanned aerial vehicle.2. The flight adding method according to claim 1 , further comprising:controlling, in response to receiving a forward flight instruction, the unmanned aerial vehicle to fly along the reference direction regardless of the head direction.3. The flight adding method according to claim 2 , further comprising:receiving the forward flight instruction sent from the mobile terminal in response to a pitch stick of the mobile terminal controlling the unmanned ...

METHODS AND SYSTEMS FOR TARGET TRACKING

A method includes obtaining an image frame captured by an imaging device carried by an unmanned vehicle and containing the target object, extracting one or more features of a target object from a region selected by a user on the image frame, and determining whether the target object is a predetermined recognizable object type based on a comparison of the one or more features with one or more characteristics associated with the predetermined recognizable object type. In response to the target object being the predetermined recognizable object type, tracking functions associated with the predetermined recognizable object type are initiated. In response to the target object not belonging to the predetermined recognizable object type, tracking functions associated with a general object type are initiated. 1. A method for tracking a target object , comprising: obtaining an image frame captured by an imaging device carried by an unmanned vehicle, the image frame containing the target object;', 'extracting one or more features of the target object from the image frame, the target object being within a region selected by a user on the image frame;', 'determining whether the target object is a predetermined recognizable object type based on a comparison of the one or more features with one or more characteristics associated with the predetermined recognizable object type;', 'in accordance with a determination that the target object is the predetermined recognizable object type, initiating tracking functions provided in the computing system and associated with the predetermined recognizable object type; and', determining a spatial relationship between the target object and the unmanned vehicle using the one or more features, the spatial relationship including a horizontal distance between the target object and the unmanned vehicle;', 'determining whether the horizontal distance is within a predetermined distance range; and', 'in accordance with a determination that the ...

CONTROL METHOD, CONTROL SYSTEM, AND SMART GLASSES FOR FIRST PERSON VIEW UNMANNED AERIAL VEHICLE FLIGHT

A system for controlling an unmanned aerial vehicle (UAV) includes smart glasses and a remote controller. The smart glasses are configured to establish a first channel directly with the UAV, receive first person view (FPV) image data directly from the UAV through the first channel, and display the FPV image data. The remote controller is configured to establish a second channel directly with the UAV, and send a flight control instruction directly to the UAV through the second channel. 1. A system for controlling an unmanned aerial vehicle (UAV) comprising: establish a first channel directly with the UAV;', 'receive first person view (FPV) image data directly from the through the first channel; and', 'display the FPV image data; and, 'smart glasses configured to establish a second channel directly with the UAV; and', 'send a flight control instruction directly to the UAV through the second channel., 'a remote controller configured to2. The system according to claim 1 , art glasses are further configured to receive flight status data directly from the UAV through the first channel and display the flight status data.3. The system according to claim 2 , wherein the smart glasses are further configured to display the flight status data by superimposing the flight status data on the FPV image data in an augmented reality mode.4. The system according to claim 1 , the smart glasses are further configured to:sense an attitude of the smart glasses;generate a gimbal control instruction according to the attitude; andsend the gimbal control instruction directly to the UAV through the first channel.5. The system according to claim 1 , wherein the smart glasses are further configured to:sense a user gesture;generate a glasses control instruction according to the user gesture; andperform an operation according to the glasses control instruction.6. The system according to claim 1 , wherein:the flight control instruction is a first flight control instruction; and sense a user gesture ...

INTERACTIONS BETWEEN VEHICLE AND TELEOPERATIONS SYSTEM

A method for autonomously operating a driverless vehicle along a path between a first geographic location and a destination may include receiving communication signals from the driverless vehicle. The communication signals may include sensor data from the driverless vehicle and data indicating occurrence of an event associated with the path. The communication signals may also include data indicating that a confidence level associated with the path is less than a threshold confidence level due to the event. The method may also include determining, via a teleoperations system, a level of guidance to provide the driverless vehicle based on data associated with the communication signals, and transmitting teleoperations signals to the driverless vehicle. The teleoperations signals may include guidance to operate the driverless vehicle according to the determined level of guidance, so that a vehicle controller maneuvers the driverless vehicle to avoid, travel around, or pass through the event. 1. A teleoperations system for assisting with operating a driverless vehicle , the driverless vehicle comprising a vehicle controller and configured to autonomously operate via the vehicle controller along a road network according to a path from a first geographic location to a destination separated from the first geographic location , the teleoperations system comprising: at least a portion of sensor data from one or more sensors associated with the driverless vehicle, the at least a portion of sensor data related to operation of the driverless vehicle; and', 'data indicating occurrence of an event associated with the path, wherein the data indicating occurrence of the event comprises data indicating a confidence level associated with the path is less than a threshold confidence level;, 'a teleoperations receiver configured to receive communication signals from the driverless vehicle, the communication signals comprising reviewing the at least a portion of sensor data and the data ...

MOVING BODY REMOTE CONTROL SYSTEM AND MOVING BODY REMOTE CONTROL METHOD

Provided is a moving body remote control system retains path information of a path along which a moving body autonomously travels and camera information of a camera provided in the moving body; stores the position of the moving body and an acquisition time thereof; outputs, upon receiving an image taken by the camera and an imaging time of the image, data of the received image, and stores the imaging time; estimates the position and direction of the moving body at the imaging time; identifies a part of the path included in the range of the image based on the path information, the camera information, and the estimated position and direction of the moving body; and converts the coordinates of the identified part of the path into coordinates of the image and outputs data of the image on which the path is superposed, at the position of the converted coordinates. 1. A moving body remote control system having a processor , an interface unit that is coupled to the processor and that communicates with the moving body , a storage unit coupled to the processor , and a display unit coupled to the processor , wherein:the storage unit retains path information showing the position of a path along which the moving body autonomously travels and camera information including the position, direction, and angle of view of a camera provided in the moving body; andthe processor is configured:to store, upon receiving the position of the moving body and the acquisition time of the position via the interface unit, the received position and acquisition time in the storage unit;to output, upon receiving an image taken by the camera and an imaging time at which the image was taken via the interface unit, data of the received image to the display unit and store the imaging time in the storage unit;to estimate, based on the imaging time and the position of the moving body at the acquisition time, the position and direction of the moving body at the imaging time;to identify a part of the path ...

METHODS AND SYSTEMS FOR TARGET TRACKING

A method includes obtaining an image frame captured by an imaging device carried by an unmanned vehicle and containing the target object, extracting one or more features of a target object from a region selected by a user on the image frame, and determining whether the target object is a predetermined recognizable object type based on a comparison of the one or more features with one or more characteristics associated with the predetermined recognizable object type. If the target object is the predetermined recognizable object type, tracking functions associated with the predetermined recognizable object type are initiated. IF the target object does not belong to the predetermined recognizable object type, tracking functions associated with a general object type are initiated. 1. A method for tracking a target object , comprising: obtaining an image frame captured by an imaging device carried by an unmanned vehicle, the image frame containing the target object;', 'extracting one or more features of the target object from the image frame, the target object being within a region selected by a user on the image frame;', 'determining whether the target object is a predetermined recognizable object type based on a comparison of the one or more features with one or more characteristics associated with the predetermined recognizable object type;', 'in accordance with a determination that the target object is the predetermined recognizable object type, initiating tracking functions provided in the computing system and associated with the predetermined recognizable object type; and', 'in accordance with a determination that the target object does not belong to the predetermined recognizable object type, initiating tracking functions provided in the computing system and associated with a general object type., 'at a computing system having one or more processors and memory storing programs executed by the one or more processors2. The method of claim 1 , wherein the tracking ...

User Display Providing Obstacle Avoidance

A visual display for use by a user for navigation and obstacle avoidance. A typical user employs the invention in operating a vehicle. The user may be located in the vehicle but will more typically be remotely located. The display may include a conventional video feed. A visual arch metaphor is also provided. If used in conjunction with a video feed, the arch metaphor preferably extends from the left side of the video, over the top of the video, and on to the right side of the video. A ranging device mounted on the vehicle collects ranging data around the vehicle. As an example, the ranging device might collect 180 degrees of ranging data extending from the vehicle's left side, across the vehicle's front, and over to the vehicle's right side. The ranging data is then correlated to a predefined color scale. The ranging data is also correlated to a position on the arch metaphor. 1. A method of providing a display for an operator of a vehicle , said vehicle having a right boundary , a left boundary , a video camera , and a ranging device , comprising:a. providing a video display, including a left side, a top, and a right side, wherein said video display displays images from said video camera on said vehicle;b. providing an arch metaphor, extending from said left side of said video display, over said top, to said right side of said video display; i. said ranging data is dividing into ranging sectors,', 'ii. each of said ranging sectors is correlated to an arc sector on said arch metaphor,', 'iii. a range for each ranging sector is correlated to a color selected from a predefined color scale, and', 'iv. said ranging data is displayed on said arch metaphor according to said correlated arc sector and said correlated color,, 'c. displaying ranging data collected by said ranging device on said arch metaphor, wherein,'}d. providing a right clearance indicator movable along said arch metaphor, with a position of said right clearance indicator along said arch metaphor being ...

Method of remotely obtaining drone footage.

This invention is directed toward a method by which a user desiring drone footage from a location can hire a drone owner near that location to set up the drone for remote control flight at the location. The user and owner can agree to a set of parameters prior to the flight which determine the environmental conditions under which the flight can take place, the duration of the flight, any safety protocols the parties agree to, etc. One the parameters are met, the drone owner takes the drone to the location, the user remotely connects to the drone and flies the drone subject to the parameters, then downloads the footage taken by the drone during the flight. 1. A method of remotely obtaining drone footage , comprising the steps of , first , hiring an owner , where the owner is a drone owner and scheduling a drone flight , second , having the drone owner place a drone at a predetermined location at a predetermined time on a predetermined day , second , having a user who remotely accesses the drone , third , the user performing a drone flight where the user controls the drone with a drone signal , fourth , downloading drone video and drone photographs from the drone flight , fifth , landing the drone.2. The method of claim 1 , additionally comprising a contract claim 1 , where the contract is negotiated between and agreed upon by the owner and the user.3. The method of claim 2 , where the contract includes a date and a time for the drone flight.4. The method of claim 3 , where the contract includes at least one environmental condition5. The method of claim 2 , where the at least one environmental condition includes precipitation at the time of the flight.6. The method of claim 2 , where the at least one environmental condition includes wind velocity at the time of the flight.7. The method of claim 2 , where the at least one environmental condition includes the presence of humans a set distance from the predetermined location.8. The method of claim 2 , where the at least ...

Virtual Moving Safety Limits For Vehicles Transporting Objects

Example systems and methods are disclosed for implementing vehicle operation limits to prevent vehicle load failure during vehicle teleoperation. The method may include receiving sensor data from sensors on a vehicle that carries a load. The vehicle may be controlled by a remote control system. The load weight and dimensions may be determined based on the sensor data. In order to prevent a vehicle load failure, a forward velocity limit and an angular velocity limit may be calculated. Vehicle load failures may include the vehicle tipping over, the load tipping over, the load sliding off of the vehicle, or collisions. The vehicle carrying the load may be restricted from exceeding the forward velocity limit and/or the angular velocity limit during vehicle operation. The remote control system may display a user interface indicating to a remote operator the forward velocity limit and the angular velocity limit. 1. A method comprising:receiving sensor data from one or more sensors on a vehicle that is moving within an environment while carrying a load;determining, by a processor, a load weight and one or more load dimensions based on the sensor data;determining, by the processor based on the load weight and the one or more load dimensions, an envelope of permissible pairs of angular velocity values and forward velocity values for the vehicle while carrying the load to prevent vehicle load failure; andpreventing, by the processor, operation of the vehicle outside of the envelope of permissible pairs of angular velocity values and forward velocity values.2. The method of claim 1 , further comprising providing for display of a graphical representation of the envelope with a first axis representative of angular velocity and a second axis representative of forward velocity.3. The method of claim 2 , further comprising providing for display of a current pair of forward velocity and angular velocity values within the graphical representation of the envelope.4. The method of ...

Control system for mobile robot

A telepresence robot uses three separately controlled omni-wheels and a computer processing arrangement to reposition the robot based on received positional signals. The telepresence robot captures and transmits visual information of a limited field of view and visual information of a broad field of view. The visual information is received and displayed on a remote input device and portions of the displayed information are selected to send an appropriate signal to reposition the robot based on the selected portion. A method of remotely controlling a telepresence robot is also disclosed.

DISPLAY SYSTEM, DISPLAY DEVICE, AND CONTROL METHOD FOR DISPLAY DEVICE

An HMD includes a display section configured to display an image to enable visual recognition of an outside scene by transmitting external light, an operation detecting section configured to detect operation, a HMD control section configured to generate, according to the operation detected by the operation detecting section, a command for operating a first mobile body, a communication control section configured to acquire first mobile body image data concerning a captured image captured by the mobile body, and a display control section configured to cause the display section to display an image based on the first mobile body image data acquired by the communication control section. The display control section controls visibility of the outside scene in the display section. 1. A display system comprising:a first data acquiring section; a first display section, and', 'a first control device which controls the first data acquiring section, receives first data from the first data acquiring section using first radio signals, and displays a first image based on the first data on the first display section; and, 'a first display device including'} a second display section, and', 'a second control device which receives the first data from the first data acquiring section using the first radio signals and displays a second image based on the first data on the second display section., 'a second display device including'}2. The display system according to claim 1 , whereinthe first data acquiring section is configured to move, and the first control device controls a motion of the first data acquiring section.3. The display system according to claim 1 , whereinthe first display section displays the first image to enable visual recognition of an outside scene by transmitting external light, andthe first control device controls visibility of the outside scene in the first display section.4. The display system according to claim 1 , further comprisinga second data acquiring section ...

METHOD FOR ASSISTING A USER IN THE REMOTE CONTROL OF A MOTOR VEHICLE, COMPUTER PROGRAM PRODUCT, REMOTE-CONTROL DEVICE AND DRIVER ASSISTANCE SYSTEM FOR A MOTOR VEHICLE

The invention relates to a method for assisting a user in the remote control of a motor vehicle () by means of a remote-control device (), wherein depending on sensor data () provided by means of at least one environment sensor () of the motor vehicle () a first surroundings image () of at least one part () of the surroundings () of the motor vehicle () from a determined perspective () is provided and displayed by means of the remote-control device (). In this case, the determined perspective () is selected from a plurality of selectable perspectives () as a perspective () that is independent of a position of the at least one environment sensor (), depending on a user input effected by the user and detected by means of the remote-control device (). 1. A method for assisting a user in the remote control of a motor vehicle by a remote-control device , comprising:depending on sensor data provided by at least one environment sensor of the motor vehicle, providing a first surroundings image of at least one part of the surroundings of the motor vehicle from a determined perspective;displaying the first surroundings image by the remote-control device; andselecting the determined perspective from a plurality of selectable perspectives as a perspective that is independent of a position of the at least one environment sensor, depending on a user input effected by the user and detected by the remote-control device.2. The method according to claim 1 , wherein depending on the selected perspective a view window on a defined projective surface is determined and the first surroundings image is calculated as part of a 3D all-round view around the motor vehicle claim 1 , said 3D all-round view being able to be provided from the sensor data claim 1 , depending on the determined view window on the defined projective surface claim 1 , such that the first surroundings image represents the part of the surroundings that lies within the view window from the selected perspective.3. The ...

CONTROL METHOD AND SYSTEM FOR ROBOT

A robot control method includes receiving, from a robot located in a space, location information of the robot; specifying, based on the received location information, at least one external camera from among a plurality of external cameras located in the space, the at least one external camera being located at a first location in the space, the first location corresponding to the received location information; receiving a robot image and at least one a space image, the robot image being an image obtained by a robot camera included in the robot and the at least one space image including at least one image obtained by the specified at least one external camera; and outputting the received robot image and at least one space image to a display unit. 1. A robot control method , comprising:receiving, from a robot located in a space, location information of the robot;specifying, based on the received location information, at least one external camera from among a plurality of external cameras located in the space,the at least one external camera being located at a first location in the space, the first location corresponding to the received location information;receiving a robot image and at least one a space image, the robot image being an image obtained by a robot camera included in the robot and the at least one space image including at least one image obtained by the specified at least one external camera; andoutputting the received robot image and at least one space image to a display unit.2. The method of claim 1 , 'specifying, based on a driving direction of the robot, a first camera having an angle of view that corresponds to a first area of the space, the first area corresponding to the driving direction of the robot,', 'wherein the specifying of the at least one external camera comprises 'outputting a first image obtained by the first camera to a first area on the display unit, and', 'wherein in the outputting of the at least one space image to the display unit ...

REMOTE CONTROL METHOD AND SYSTEM FOR ROBOT

A robot remote control method and system capable of remotely controlling navigation of a robot. The robot remote control method includes outputting both a map image and an ambient image to a display, the map image including location information corresponding to the ambient image, the ambient image being of surroundings of a robot, and the ambient image being received from a camera at the robot, generating a control command for controlling the robot in response to an input to the display during the outputting, and causing the robot to drive according to the control command by transmitting the control command to the robot. 1. A remote control method for a robot , comprising:outputting both a map image and an ambient image to a display, the map image including location information corresponding to the ambient image, the ambient image being of surroundings of a robot, and the ambient image being received from a camera at the robot;generating a control command for controlling the robot in response to an input to the display during the outputting; andcausing the robot to drive according to the control command by transmitting the control command to the robot.2. The method of claim 1 , whereina display area of the display includes a main area and a sub-area that overlaps with a part of the main area; andthe outputting includes outputting one of the ambient image or the map image to the main area, and another one of the ambient image or the map image to the sub-area.3. The method of claim 2 , wherein the generating the control command comprises controlling the display area according to whether the input is applied to the main area or the sub-area.4. The method of claim 3 , wherein the generating the control command comprises:controlling the display area in response to the input being applied to the sub-area; andnot controlling the display in response to the input being applied to the main area.5. The method of claim 4 , wherein the controlling the display area includes ...

Trailer Reverse Assist With Follow-Me System

A method for maneuvering a vehicle-trailer system in a reverse direction is provided. The method includes receiving images from a camera positioned on a rear portion of the trailer. The method includes: identifying one or more guide representations within the received images; and transmitting the received images to a user interface. The method also includes receiving from the user interface, an indication of a guide representation from the one or more guide representations. The method includes determining a path that includes maneuvers configured to move the vehicle-trailer system along the path to follow the guide associated with the identified guide representation while maintaining a minimum distance from the guide positioned behind the trailer. The method also includes transmitting to a drive system of the vehicle, one or more commands causing the vehicle-trailer system to autonomously move the vehicle-trailer system along the vehicle-trailer path in the reverse direction. 1. A method for maneuvering a vehicle-trailer system in a reverse direction , the vehicle-trailer system having a vehicle attached to a trailer at a hitch , the method comprising:receiving, at data processing hardware, one or more images from a camera in communication with the data processing hardware and positioned on a rear portion of the trailer;identifying, using the data processing hardware, one or more guide representations within the one or more received images;transmitting, from the data processing hardware to a user interface in communication with the data processing hardware, the one or more received images;receiving, at the data processing hardware from the user interface, an indication of a guide representation from the one or more guide representations;determining, at the data processing hardware, a vehicle-trailer path comprising maneuvers configured to move the vehicle-trailer system along the vehicle-trailer path to follow the guide associated with the identified guide ...

COMPUTER-IMPLEMENTED METHOD AND SYSTEM FOR CONTROLLING OPERATION OF AN AUTONOMOUS DRIVERLESS VEHICLE IN RESPONSE TO OBSTACLE DETECTION

A computer-implemented method and system for controlling operation of an autonomous driverless vehicle in response to detection of a hazard in the path of the vehicle. 1. A computer-implemented method for controlling operation of an autonomous driverless vehicle in response to detection of a hazard in a path of the vehicle , the method performed by a vehicle control system in the vehicle comprising the steps of:(a) detecting presence of a hazard in the path of the vehicle using an obstacle detection system in the vehicle;(b) transmitting a hazard alert message to a computer system operated by a human operator; and(c) receiving a command from the computer system operated by the human operator responsive to the hazard alert message, and operating the vehicle in accordance with said command.2. The method of claim 1 , wherein the computer system operated by the human operator is located remotely from the vehicle claim 1 , and wherein the hazard alert message and the command are transmitted over a wireless network.3. The method of claim 1 , wherein the computer system operated by the human operator is located within the vehicle.4. The method of claim 1 , further comprising receiving location information from a location detection system in the vehicle claim 1 , and determining the position of the hazard based on the location information.5. The method of claim 1 , wherein the hazard alert message includes information on a shape of the hazard claim 1 , a location of the hazard claim 1 , or a measure of confidence in detection of the hazard.6. The method of claim 1 , wherein the command comprises a command to ignore the detected obstacle upon determination by the operator of a false positive event.7. The method of claim 6 , wherein operating the vehicle in accordance with said command comprises:determining a given region-to-ignore comprising an area in the path of the vehicle containing at least a portion of the detected obstacle;after a given period of time, clearing the ...

MOBILE ROBOT WITH A HEAD-BASED MOVEMENT MAPPING SCHEME

A robotic system that includes a mobile robot and a remote input device. The input device may be a joystick that is used to move a camera and a mobile platform of the robot. The system may operate in a mode where the mobile platform moves in a camera reference coordinate system. The camera reference coordinate system is fixed to a viewing image provided by the camera so that movement of the robot corresponds to a direction viewed on a screen. This prevents disorientation during movement of the robot if the camera is panned across a viewing area. 1. A mobile robot system that is controlled through an input device , comprising:a robot that has a camera within a camera reference coordinate system fixed to said camera and a mobile platform; and,an input device that causes movement of said camera and said mobile platform within the camera reference coordinate system.2. The system of claim 1 , wherein said input device is a joystick.3. The system of claim 1 , wherein said input device includes a mode button that allows the system to be switched between a mode wherein said mobile platform moves within the camera reference coordinate system or a mode wherein said mobile platform moves within a platform reference coordinate system.4. The system of claim 1 , wherein said mobile platform rotates to align an axis of a platform reference coordinate system fixed to said mobile platform with an axis of the camera reference coordinate system.5. The system of claim 1 , wherein movement of said mobile platform is accompanied by a movement of said camera.6. The system of claim 2 , wherein twisting said joystick causes rotation of said camera and pivoting said joystick causes said mobile platform to move.7. The system of claim 1 , further comprising a computer coupled to said input device and said robot.8. The system of claim 1 , further comprising a wireless base station coupled to said robot and said input device.9. The system of claim 8 , further comprising a broadband network that ...

RESTRICTING AREAS AVAILABLE TO AUTONOMOUS AND TELEOPERATED VEHICLES

A vehicle policy server maintains a set of policies for constraining operations of one or more remote vehicles. The policies may specify areas, locations, or routes that specified vehicles are restricted from accessing based on a set of acquired information. An application programming interface (API) enables programmatic updates of the policies or related information. Policies may be enforced by transmitting control signals fully or in part to onboard vehicle computers or to a teleoperation support module providing remote support to the vehicles using human teleoperators and/or artificial intelligence agents. The control signals may directly control the vehicles or teleoperation, or may cause a navigation system to present known restrictions in a suitable fashion such as generating an augmented reality display or mapping overlays. 1. A method for restricting navigation of a vehicle via interactions with a remote server , the method comprising:storing, at a policy database, a set of policies specifying rules constraining permissible geographic regions where the vehicle is permitted to navigate;obtaining, from the vehicle, first input data relating to a first state of the vehicle at a first time while the vehicle is controlled by an autonomous drive system of the vehicle;determining, by a processor, a first set of one or more applicable policies from the set of policies that apply to the vehicle based on the obtained first state of the vehicle;responsive to detecting that the vehicle is within a threshold distance of restricted geographic region specified by the first set of one or more applicable policies, establishing a teleoperation session in which an artificial intelligence agent executing on a remote server receives sensor data from the vehicle over a network and generates teleoperation controls to remotely control navigation of the vehicle based on the sensor data and the one or more applicable policies;transmitting, by the remote server over the network, the ...

HOVER CONTROL

A hover control method includes obtaining a flight velocity of an unmanned aerial vehicle (UAV), obtaining an image frame as a keyframe in response to that the flight velocity satisfies a preset condition, and controlling hovering of the UAV using the keyframe as a reference object. 1. A hover control method comprising:obtaining a flight velocity of an unmanned aerial vehicle (UAV);obtaining an image frame as a keyframe in response to that the flight velocity satisfies a preset condition; andcontrolling hovering of the UAV using the keyframe as a reference object.2. The method of claim 1 , wherein controlling the hovering of the UAV using the keyframe as the reference object includes:obtaining an image frame after the keyframe as a correction frame; andcontrolling the hovering of the UAV by correcting a displacement of the UAV according to the correction frame and the keyframe.3. The method of claim 2 , wherein correcting the displacement of the UAV includes:obtaining, according to the correction frame and the keyframe, a flight displacement vector of the UAV between a time corresponding to the correction frame and a time corresponding to the keyframe; andcontrolling the displacement of the UAV to be less than or equal to a preset value according to the flight displacement vector.4. The method of claim 2 , wherein correcting the displacement of the UAV includes:selecting a stationary feature from the keyframe; anddetermining the displacement of the UAV according to the stationary feature.5. The method of claim 2 ,wherein the correction frame is a first correction frame; obtaining an image frame after the first correction frame as a second correction frame; and', 'correcting the displacement of the UAV according to the second correction frame and the keyframe., 'the method further comprising6. The method of claim 1 , wherein the preset condition includes the flight velocity being zero.7. The method of claim 1 ,wherein the flight velocity is a first flight velocity, ...

Mobile Robot Cleaning System

A method for operating or interacting with a mobile robot includes determining, using at least one processor, a mapping between a first coordinate system associated with a mobile device and a second coordinate system associated with the mobile robot, in which the first coordinate system is different from the second coordinate system. The method includes providing at the mobile device a user interface to enable a user to interact with the mobile robot in which the interaction involves usage of the mapping between the first coordinate system and the second coordinate system. 1. A method comprising:determining, using at least one processor, a mapping between a first coordinate system associated with a mobile device and a second coordinate system associated with a mobile robot, in which the first coordinate system is different from the second coordinate system; andproviding at the mobile device a user interface to enable a user to interact with the mobile robot in which the interaction involves usage of the mapping between the first coordinate system and the second coordinate system.2. The method of in which the user interface is configured to enable the user to use the mobile device to instruct the mobile robot to perform a specified action at a specified location.3. The method of claim 2 , comprising:configuring the user interface to enable the user to specify a location on an image shown on a display module of the mobile device,identifying, using at least one processor, coordinates of the location specified by the user, andsending an instruction from the mobile device to the mobile robot to instruct the mobile robot to perform the cleaning operation at the location specified by the user, in which the instruction includes the coordinates of the location specified by the user.4. The method of claim 3 , comprising:determining first coordinates of the location specified by the user, in which the first coordinates are based on the first coordinate system,converting the ...

Techniques for image recognition-based aerial vehicle navigation

A control terminal for controlling an unmanned aerial vehicle (UAV) includes a processor and a storage medium storing instructions that, when executed by the processor, cause the processor to render an image on a user interface of the control terminal. The image is captured by an imaging device coupled to the UAV and is associated with a view of the imaging device. The instructions further cause the processor to detect, via the user interface, a gesture-based input including one or more reference points in the image and indicating a view change of the imaging device, determine a type of the gesture-based input by analyzing the one or more reference points, and generate control data based on the type of the gesture-based input to control at least one of the UAV or the imaging device for the view change of the imaging device.

DISPLAY CONTROL SYSTEM, DISPLAY CONTROL DEVICE AND DISPLAY CONTROL METHOD

Provided are a display control system, a display control device, and a display control method, which are capable of appropriately controlling a display state of an image photographed by a camera included in an unmanned aerial vehicle. A sensing data acquisition module acquires an aerial vehicle photographing image photographed by the camera included in the unmanned aerial vehicle in flight. A determiner determines whether an operator of the unmanned aerial vehicle is able to visually recognize the unmanned aerial vehicle based on sensing data on at least one of the unmanned aerial vehicle or the operator. A display controller controls a display state of the aerial vehicle photographing image on a display depending on a result of determination by the determiner. 1. A display control system , comprising:at least one processor; andat least one memory device that stores a plurality of instructions which, when executed by the at least one processor, causes the at least one processor to:acquire an aerial vehicle photographing image photographed by a camera included in an unmanned aerial vehicle in flight;determine whether an operator of the unmanned aerial vehicle is able to visually recognize the unmanned aerial vehicle based on sensing data on at least one of the unmanned aerial vehicle or the operator; andcontrol a display state of the aerial vehicle photographing image on a display depending on a result of the determining.2. The display control system according to claim 1 , wherein the at least one memory device that stores the plurality of instructions which further causes the at least one processor to control whether to display the aerial vehicle photographing image on the display depending on the result of the determining.3. The display control system according to claim 1 , wherein the at least one memory device that stores the plurality of instructions which further causes the at least one processor to control a size of the aerial vehicle photographing image ...

REMOTE ASSISTANCE FOR AN AUTONOMOUS VEHICLE IN LOW CONFIDENCE SITUATIONS

Example systems and methods enable an autonomous vehicle to request assistance from a remote operator when the vehicle's confidence in operation is low. One example method includes operating an autonomous vehicle in a first autonomous mode. The method may also include identifying a situation where a level of confidence of an autonomous operation in the first autonomous mode is below a threshold level. The method may further include sending a request for assistance to a remote assistor, the request including sensor data representative of a portion of an environment of the autonomous vehicle. The method may additionally include receiving a response from the remote assistor, the response indicating a second autonomous mode of operation. The method may also include causing the autonomous vehicle to operate in the second autonomous mode of operation in accordance with the response from the remote assistor. 120-. (canceled)21. A computer-implemented method comprising:identifying, by a control system of an autonomous vehicle, that a field of view is obstructed;sending, by the control system of the autonomous vehicle, a request for assistance to a remote assistor, the request comprising sensor data representative of a portion of an environment of the autonomous vehicle;receiving, by the control system of the autonomous vehicle, a response from the remote assistor, the response indicating an instruction for the autonomous vehicle to perform; andcausing the autonomous vehicle to operate the instruction.22. The method of claim 21 , wherein the sensor data representation comprises camera data.23. The method of claim 21 , wherein the sensor data representation comprises radar data.24. The method of claim 21 , wherein the sensor data representation comprises LIDAR data.25. The method of claim 21 , wherein identifying that field of view is obstructed comprises receiving a warning signal from one or more sensor systems of the autonomous vehicle.26. The method of claim 21 , wherein ...

Methods and Systems for Providing Remote Assistance via Pre-Stored Image Data

Examples described may enable provision of remote assistance for an autonomous vehicle. An example method includes a computing system operating in a rewind mode. In the rewind mode, the system may be configured to provide information to a remote assistance operated based on a remote-assistance triggering criteria being met, such as a detected object having a low detection confidence. When the triggering criteria is met, the remote assistance system may provide data from the time leading up to when the remote-assistance triggering criteria was met that was capture of the environment of autonomous vehicle to the remote assistance operator. Based on viewing the data, the remote assistance operator may provide and input to the system that causes a command to be issued to the autonomous vehicle. 1. A method comprising:receiving, at a computing system coupled to a vehicle, sensor data representative of an environment of the vehicle from a vehicle sensor;determining, by the computing system, a detection confidence for an object in the environment is below a threshold confidence;based on determining the detection confidence for the object in the environment is below the threshold confidence, transmitting, by the computing system, a request for remote assistance to a remote computing device, wherein the request for remote assistance includes sensor data obtained by the vehicle sensor prior to determining the detection confidence for the object in the environment is below the threshold confidence; andcontrolling, by the computing system, the vehicle based on an input received from the remote computing device.2. The method of claim 1 , wherein receiving sensor data representative of the environment of the vehicle from the vehicle sensor comprises:receiving one or more images of the environment from a vehicle camera system.3. The method of claim 2 , wherein determining the detection confidence for the object in the environment is below the threshold confidence comprises: ...

COMPUTATION LOAD DISTRIBUTION

A computation load distribution method includes determining a processing task associated with a mobile vehicle, and determining one or more processing resources for performing the processing task based at least partially on characteristics of the processing task. Determining the one or more processing resources includes determining whether to perform the processing task locally at the mobile vehicle and/or remotely at a remote terminal. 1. A computation load distribution method comprising:determining a processing task associated with a mobile vehicle; anddetermining one or more processing resources for performing the processing task based at least partially on characteristics of the processing task, including determining whether to perform the processing task locally at the mobile vehicle and/or remotely at a remote terminal.2. The method of claim 1 , wherein determining the one or more processing resources includes:determining to perform the processing task locally in response to the processing task being related to movement of the mobile vehicle; ordetermining to perform the processing task remotely in response to the processing task being not related to the movement of the mobile vehicle.3. The method of claim 1 , further comprising claim 1 , in response to determining to perform the processing task remotely:transmitting at least one of data or instructions related to the processing task to the remote terminal via a transmission link between the mobile vehicle and the remote terminal; andreceiving a processing result from the remote terminal.4. The method of claim 3 , further comprising claim 3 , before transmitting the at least one of data or instructions to the remote terminal: a timestamp,', 'information related to one or more of an attitude, a speed, and a position of the mobile vehicle, or', 'information related to an attitude of a carrier arranged at the mobile vehicle., 'adding auxiliary information to the data, the auxiliary information including at least ...

Object identification and sensing system and method

An object identification method is disclosed. The method includes obtaining images of a target geographical area and telemetry information of an image-collection vehicle at a time of capture, analyzing each image to identify objects, and determining a position of the objects. The method further includes determining an image capture height, determining a position of the image using the capture height and the telemetry information, performing a transform on the image based on the capture height and the telemetry information, identifying the objects in the transformed image, determining first pixel locations of the objects within the transformed image, performing a reverse transform on the first pixel locations to determine second pixel locations in the image, and determining positions of the objects within the area based on the second pixel locations within the captured image and the determined image position.

Management and display of object-collection data

An object identification and collection method is disclosed. The method includes receiving a pick-up path that identifies a route in which to guide an object-collection system over a target geographical area to pick up objects, determining a current location of the object-collection system relative to the pick-up path, and guiding the object-collection system along the pick-up path over the target geographical area based on the current location. The method further includes capturing images in a direction of movement of the object-collection system along the pick-up path, identifying a target object in the images; tracking movement of the target object through the images, determining that the target object is within range of an object picker assembly on the object-collection system based on the tracked movement of the target object, and instructing the object picker assembly to pick up the target object.

FLIGHT CONTROL METHOD AND APPARATUS

A flight control method includes: determining a positional relationship between an aircraft and a control device; determining a polar coordinate system with the control device as an origin according to the positional relationship; receiving a flight direction control instruction sent by the control device, the flight direction control instruction being generated on the basis of the polar coordinate system; and driving, according to coordinate information about the aircraft in the polar coordinate system, the aircraft to fly in accordance with the flight direction control instruction. 1. A flight control method , comprising:determining a positional relationship between an aircraft and a control device;determining a polar coordinate system with the control device as an origin according to the positional relationship;receiving a flight direction control instruction sent by the control device, the flight direction control instruction being generated on the basis of the polar coordinate system; anddriving, according to coordinate information about the aircraft in the polar coordinate system, the aircraft to fly in accordance with the flight direction control instruction.2. The method of claim 1 , wherein the driving the aircraft to fly in accordance with the flight direction control instruction comprises:when the flight direction control instruction instructs the aircraft to perform forward flight or backward flight, driving the aircraft to fly along a direction of a line connecting the aircraft and the control device so that a length value in the coordinate information varies and an angle value in the coordinate information does not vary.3. The method of claim 1 , wherein the driving the aircraft to fly in accordance with the flight direction control instruction comprises:when the flight direction control instruction instructs the aircraft to make a left turn or a right turn, driving the aircraft to fly along a direction perpendicular to a line connecting the aircraft ...

SYSTEMS, DEVICES, AND METHODS FOR ON-BOARD SENSING AND CONTROL OF MICRO AERIAL VEHICLES

Systems, devices, and methods for on-board sensing and control of robotic vehicles (e.g., MAVs) using commercial off-the-shelf hand-held electronic devices as a sensing and control system are provided. In one aspect, a system for controlling a micro aerial vehicle may include one or more sensors, a state estimation module in communication with the one or more sensors, the state estimation module being configured to generate an estimated pose of the micro aerial vehicle based on inputs from the one or more sensors, and a position controller in communication with the state estimation module and configured to communicate attitude commands to an attitude controller of the micro aerial vehicle. Each of the one or more sensors, the state estimation module, and the position controller may be contained in a commercial off-the-shelf hand-held electronic device that is configured to be coupled to the micro aerial vehicle. 1. A system for controlling a micro aerial vehicle comprising:one or more sensors;a state estimation module in communication with the one or more sensors, the state estimation module being configured to generate an estimated pose of the micro aerial vehicle based on inputs from the one or more sensors; anda position controller in communication with the state estimation module and configured to communicate attitude commands to an attitude controller of the micro aerial vehicle;wherein each of the one or more sensors, the state estimation module, and the position controller are contained in a commercial off-the-shelf hand-held electronic device that is configured to be coupled to the micro aerial vehicle.2. The system of claim 1 , wherein the one or more sensors comprise one or more of a gyroscope and/or an accelerometer.3. The system of claim 1 , wherein the one or more sensors comprise one or more cameras.4. The system of claim 3 , wherein the state estimation module comprises a visual inertial odometry system in communication with the one or more cameras.5. ...

SYSTEM FOR DANGEROUS CURRENT IDENTIFICATION, CHARACTERIZATION, ALERTING AND FOR DISTRESSED SWIMMER LOCATION AND ASSISTANCE

A vessel includes a body, such as surfboard, that floats in water. One or more thrusters, and one or more sensors are provided on the body. A controller is configured to selectively activate the thrusters to cause the vessel to move along a path through the water, receive sensor data from the one or more sensors while the vessel is moving along the path, determine, based on the sensor data, whether a dangerous condition is present in the water; and output a warning when the dangerous condition is present in the water. For example, the collected sensor data may relate to locations and directions of currents in the water, the dangerous condition may relate to a rip current, and the warning may identify at least one attribute of the rip current. A map identifying a location of the dangerous condition may be generated and forwarded to other devices. 1. A vessel comprising:a body that floats in water, the body including a board,one or more thrusters provided on a bottom surface of the board;one or more sensors provided on the body; and selectively activate the thrusters to cause the vessel to move along a path through the water;', 'receive sensor data from the one or more sensors while the vessel is moving along the path;', 'determine, based on the sensor data, when a dangerous condition is present in the water; and', 'output a warning when the dangerous condition is present in the water., 'a controller configured to2. The vessel of claim 1 , wherein the path extends along a shore claim 1 , the sensor data relates to locations and directions of currents in the water claim 1 , the dangerous condition relates to a rip current claim 1 , and the warning identifies at least one attribute of the rip current.3. The vessel of claim 2 , wherein the controller further identifies at least one of a location of the rip current claim 2 , a velocity of the rip current claim 2 , a width of the rip current claim 2 , a depth of the water at the rip current claim 2 , or a change in the rip ...

ANTI-PERSONNEL AUTONOMOUS VEHICLE

An anti-personnel autonomous vehicle (APAV) system has a fuselage formed by a directional fragmentation weapon (DFW). An unmanned aerial vehicle (UAV) assembly is engaged to the DFW, the UAV assembly having a plurality of lift units positioned to provide balanced lift on the DFW. A control module integrated in the UAV assembly has a wireless transmitter/receiver communicating with a remote controller. 1. An anti-personnel autonomous vehicle (APAV) system comprising:a fuselage formed by a directional fragmentation weapon (DFW);an unmanned aerial vehicle (UAV) assembly engaged to the DFW and having a plurality of lift units positioned to provide balanced lift on the DFW;a control module integrated in the UAV assembly having a wireless transmitter/receiver communicating with a remote controller.2. The APAV system as defined in wherein the UAV assembly comprises a harness employing at least one longitudinal strap and at least two lateral straps adapted to be engaged around the DFW.3. The APAV system as defined in wherein the at least one longitudinal strap is positioned in the harness proximate a midline of the DFW.4. The APAV system as defined in where in the at least two lateral straps are fixed to the at least one longitudinal strap at connection points on an upper surface and a bottom surface of the DFW.5. The APAV system as defined in wherein the plurality of lift units comprises four lift units and at least two lateral straps comprise two lateral straps that engage the lift units in a quadrilateral configuration and the connection points are spaced longitudinally to provide clearance of propellers in the lift units.6. The APAV system as defined in wherein relative positioning of the connection points fixing the longitudinal strap and the lateral straps provides balanced lift by the lift units on the DFW.7. The APAV system as defined in wherein the control module is engaged to the at least one longitudinal at a central position intermediate the connection points on ...

PERFORMANCE TUNING OF A MATERIALS HANDLING VEHICLE

A materials handling vehicle receives a wirelessly communicated performance tuning profile, and responsive thereto, adjusts at least one operating capability. The performance tuning profile can be updated dynamically as the materials handling vehicle is operated in a work environment based upon a number of different factors including operational, operator, environmental, other, or combinations thereof. Additional aspects provide a graphical user interface that allows an individual such as a supervisor to create a library of performance tuning profiles, and create and/or program a rules engine to automatically convey an appropriate performance tuning profile to a corresponding materials handling vehicle responsive to detecting a corresponding event associated with a programmed rule. 1. A system for controlling the performance of a fleet of materials handling vehicles , comprising:a central database that stores electronic performance tuning profiles;a remote processor that is coupled to memory, the remote processor programmed by instructions in the memory that cause the remote processor to monitor activity of a fleet of materials handling vehicles to detect triggering events, wherein, upon detecting a triggering event, the remote processor wirelessly transmits an electronic performance tuning profile selected from the electronic performance tuning profiles stored in the central database, to a corresponding materials handling vehicle in the fleet of materials handling vehicles;wherein:the corresponding materials handling vehicle includes a control module having a processor that receives the wirelessly transmitted electronic performance tuning profile, and communicates at least one command across a vehicle network of the materials handling vehicle to modify performance of the materials handling vehicle according to a setting in the received electronic performance tuning profile; anda display on the materials handling vehicle that outputs an indication that a performance ...

UNMANNED AIR VEHICLE SYSTEM

An unmanned air vehicle system includes an unmanned air vehicle including a camera unit, a pilot terminal capable of piloting the unmanned air vehicle, and a display that displays images captured by the camera unit. The camera unit includes a first camera that captures a first image and a second camera that captures a second image. An angle of view of the first camera is narrower than an angle of view of the second camera. 1. An unmanned air vehicle system comprising:an unmanned air vehicle including a camera unit;a pilot terminal capable of piloting the unmanned air vehicle; anda display that displays an image captured by the camera unit,wherein the camera unit includes a first camera that captures a first image and a second camera that captures a second image, andan angle of view of the first camera is narrower than an angle of view of the second camera.2. The unmanned air vehicle system according to claim 1 , wherein the display displays an image in which the first image and the second image are superimposed.3. The unmanned air vehicle system according to claim 1 , wherein the display displays an image in which the second image and a region frame corresponding to a region of the first image inside the second image are superimposed.4. The unmanned air vehicle system according to claim 2 , wherein the display further displays a region frame corresponding to a region of the first image superimposed inside the second image.5. The unmanned air vehicle system according to claim 2 , wherein the display displays the image in which the second image is superimposed inside the first image.6. The unmanned air vehicle system according to claim 5 , wherein the display changes at least one of a size of the second image and a position at which the second image is displayed inside the first image to perform display.7. The unmanned air vehicle system according to claim 4 , further comprising:an image processor that performs a superimposition process for superimposing the first ...

SECURITY DRONE SYSTEM

A security drone includes a drone housing defining a cavity and an actuator coupled to the drone housing and designed to move the drone housing through the predetermined area. The security drone further includes a camera designed to detect image data corresponding to the predetermined area and a network access device designed to transmit and receive data via a network. The security drone further includes a drone processor positioned within the cavity and coupled to the actuator, the camera, and the network access device. The drone processor is designed to control the actuator to move the drone housing through the predetermined area, identify a potential threat in the predetermined area based on the image data as the drone housing is moved through the predetermined area, and transmit potential threat data corresponding to the potential threat to a remote device when the potential threat is identified. 1. A security drone for monitoring a predetermined area comprising:a drone housing defining a cavity;an actuator coupled to the drone housing and configured to move the drone housing through the predetermined area;a camera coupled to the drone housing and configured to detect image data corresponding to the predetermined area as the drone housing moves through the predetermined area;a network access device positioned within the cavity and configured to transmit and receive data via a network; and control the actuator to move the drone housing through the predetermined area,', 'identify a potential threat in the predetermined area based on the image data as the drone housing is moved through the predetermined area,', 'transmit potential threat data corresponding to the potential threat to a remote device when the potential threat is identified,', 'determine that a portion of the predetermined area is inaccessible to the security drone, and', 'at least one of avoid the inaccessible portion of the predetermined route, transmit additional potential threat data to the remote ...

REMOTE CONTROL SYSTEM AND MAIN CONTROL DEVICE

A master acquires, from a slave, a surrounding image obtained by capturing an image of surroundings of a construction machine from inside a cab seat of the construction machine, determines whether or not a working device is included in the surrounding image, and in a case of determining that the working device is not included in the surrounding image, calculates a position of the working device from a posture of the construction machine and displays, on a display device, a display object for informing an operator of the calculated position, together with the surrounding image. 1. A remote control system which remotely controls a construction machine including a working device , the remote control system comprising:a main control device for remotely controlling the construction machine; anda slave control device which is mounted on the construction machine and controls the working device based on operation accepted by the main control device, a camera which acquires a surrounding image obtained by capturing an image of surroundings of the construction machine from inside a cab seat of the construction machine;', 'a posture detecting unit which detects a posture of the working device; and', 'a first communication unit which transmits to the main control device the surrounding image and posture information indicating the posture of the working device detected by the posture detecting unit, and, 'wherein the slave control device includes a control member which accepts operation of an operator;', 'a second communication unit which receives the surrounding image and the posture information transmitted from the slave control device;', 'a display device which displays a display screen including the surrounding image received by the second communication unit;', 'a determination unit which determines whether or not the working device is included in the surrounding image received by the second communication unit; and', 'a display control unit which, in a case where the ...

Vehicle remote operation system

A vehicle remote operation system includes: a communication device that performs wireless communication with a mobile device; a position determination portion that determines whether the mobile device exists in an activation area; a remote operation acceptance portion that accepts a remote operation as a user instruction operation to move the vehicle; a control execution portion that performs control corresponding to a content of the remote operation; and a notification processor that notifies a user that a position of the mobile device changes from an inside of the activation area to an outside of the activation area.

SYSTEM AND METHOD FOR CONTROLLING AN AUTONOMOUS VEHICLE

The present disclosure is directed to systems and techniques for controlling an autonomous vehicle. While the autonomous vehicle is travelling to a destination, the autonomous vehicle may encounter a situation preventing the autonomous vehicle from travelling to the destination. A control center may receive information from the autonomous device and use a graphical user interface to provide instructions with limited controls for the autonomous vehicle to navigate to an intermediate position. In such an intermediate position, the vehicle may make way for an emergency vehicle, obtain additional sensor data for continued autonomous planning, signal intent to other objects in the environment, and the like. 1. A method , comprising:receiving at least a portion of sensor data from a sensor on an autonomous vehicle, traversing an environment to a destination;causing a display to display a first representation of the autonomous vehicle in the environment;causing the display to display a second representation of the sensor data;receiving input indicating an intermediate location to which the autonomous vehicle is to travel, the indication being limited to a radius of the autonomous vehicle in the first representation and comprising one or more of a position or an orientation; andtransmitting, based at least in part on the input, an instruction to the autonomous vehicle to cause the autonomous vehicle to travel to the intermediate location.2. The method of claim 1 , wherein the first representation comprises a map of the environment proximate the autonomous vehicle and a bounding box representing an object in the environment.3. The method of claim 2 , wherein the object comprises an emergency vehicle claim 2 , and wherein the intermediate location comprises a location in the environment to enable the emergency vehicle to pass from behind the autonomous vehicle.4. The method of claim 1 , wherein the portion of sensor data comprises information indicative of the autonomous ...

Vehicle control system and vehicle control method

A vehicle selection server is configured to refer to a memory, which stores vehicle information representing each of a plurality of vehicles, and to transmit the vehicle information regarding each of the plurality of vehicles to a remote operation terminal. The remote operation terminal is configured to display the vehicle information regarding each of the plurality of vehicles on a display section, to acquire selection information, input by a remote operator, for one of the plurality of vehicles, and to transmit the selection information to the vehicle selection server. The vehicle selection server is configured to transmit identification information regarding the remote operation terminal to a vehicle control device. The vehicle control device is configured to perform control in response to vehicle operation information transmitted from the remote operation terminal corresponding to the identification information so as to cause the host vehicle to travel in the remote driving mode.

SYSTEM AND METHOD FOR PROVIDING A TELEOPERATION INSTRUCTION TO AN AUTONOMOUS VEHICLE

The present disclosure is directed to systems and techniques for providing a teleoperation instruction to an autonomous vehicle. While the autonomous vehicle is travelling to a destination, the autonomous vehicle may encounter a situation preventing the autonomous vehicle from travelling to the destination. A control center may receive information from the autonomous device and provide instructions with limited controls for the autonomous vehicle to navigate to an intermediate position. In such an intermediate position, the may make way for an emergency vehicle, obtain additional sensor data for continued autonomous planning, signal intent to other objects in the environment, and the like. 1. A system , comprising:one or more processors; and receiving sensor data from a sensor on an autonomous vehicle navigating to a destination;', 'determining, based at least in part on the sensor data, whether conditions are present in an environment through which the autonomous vehicle is travelling which prevent the autonomous vehicle from proceeding to the destination;', 'transmitting at least a subset of the sensor data to a second system with a request for guidance;', 'receiving a response to the request that comprises an instruction to navigate the autonomous vehicle to an intermediate destination within a radius of a current position of the autonomous vehicle; and', 'controlling the autonomous vehicle to traverse the environment to the intermediate destination., 'non-transitory computer readable memory including instructions that, when executed by the one or more processors, cause the system to perform operations comprising2. The system of claim 1 , wherein determining whether conditions are present in the environment through which the autonomous vehicle is travelling which prevent the autonomous vehicle from proceeding to the destination comprises one or more of:determining that the autonomous vehicle has remained in a current position for a specified amount of time, ...

VEHICLE CONTROL SYSTEM AND VEHICLE CONTROL METHOD

A vehicle control system, comprising a remote operator selection server, a vehicle control device, and a remote operation terminal. The vehicle control device is configured to transmit a manual operation information to the remote operator selection server. The remote operator selection server is configured to acquire the manual operation information transmitted from the vehicle control device, to compute a difference between the manual operation information and a remote operation information for each of the plurality of remote operators, to select a remote operator for whom the difference satisfies a predetermined criterion as a remote operator to remotely operate the vehicle. 1. A vehicle control system , comprising: a first memory, and', 'a first processor coupled to the first memory;, 'a remote operator selection server comprising a second memory, and', 'a second processor coupled to the second memory, the second processor being configured to control a vehicle configured to travel in an independent autonomous driving mode, a remote driving mode, and a manual driving mode; and a remote operation terminal comprising:', 'a third memory, and', 'a third processor coupled to the third memory, the third processor being configured to operate a vehicle remotely, wherein:, 'a vehicle control device comprisingthe second processor is configured to refer to the second memory, which stores manual operation information representing details of actual operation by an occupant of the vehicle when in the manual driving mode, and to transmit the manual operation information for the occupant stored in the second memory from the vehicle control device to the remote operator selection server;the first processor is configured to acquire the manual operation information transmitted from the vehicle control device, to refer to the first memory, which stores remote operation information for each of a plurality of remote operators, the remote operation information representing details of ...

System, Method, and Computer Readable Medium for Autonomous Airport Runway Navigation

Example implementations relate to autonomous airport runway navigation. An example system includes a first sensor and a second sensor coupled to an aircraft at a first location and a second location, respectively, and a computing system configured to receive sensor data from one or both of the first sensor and the second sensor to detect airport markings positioned proximate a runway. The computing system is further configured to identify a centerline of the runway based on the airport markings and receive sensor data from both of the first sensor and the second sensor to determine a lateral displacement that represents a distance between a reference point of the aircraft and the centerline of the runway. The computing system is further configured to control instructions that indicate adjustments for aligning the reference point of the aircraft with the centerline of the runway during subsequent navigation of the aircraft. 1. A system , comprising:a first sensor coupled to an aircraft at a first location;a second sensor coupled to the aircraft at a second location; receive a first set of sensor data that includes sensor data from one or both of the first sensor and the second sensor;', 'detect one or more airport markings positioned proximate a runway using the first set of sensor data, wherein the aircraft is positioned on the runway;', 'identify a centerline of the runway based on the one or more airport markings;', 'receive a second set of sensor data that includes sensor data from both of the first sensor and the second sensor;', 'determine a lateral displacement that represents a distance between a reference point of the aircraft and the centerline of the runway using the second set of sensor data, wherein the lateral displacement is determined based on a comparison of a first position of the reference point relative to the centerline of the runway as represented in sensor data from the first sensor with a second position of the reference point relative to the ...

Vehicle Video System

Images are obtained using cameras mounted on a vehicle, and at least a portion of the obtained images are displayed on a screen. Motion of the vehicle can be controlled such that it moves toward a physical destination selected from images obtained using cameras mounted on a vehicle. 1. A method , comprising:obtaining images using one or more cameras mounted on a vehicle;sending data representing at least a portion of the obtained images to a display device;receiving data representing a selected part of the obtained images;correlating the selected part of the obtained images with a geolocation; andmoving the vehicle toward the geolocation.2. The method of claim 1 , wherein correlating the selected part of the obtained images with the geolocation comprises determining a geolocation of an object represented in the selected part of the obtained images.3. The method of claim 2 , wherein determining the geolocation of the object includes determining a distance to the object using at least parts of obtained images from two or more of the cameras mounted on the vehicle.4. The method of claim 3 , wherein determining the geolocation of the object includes determining geolocations from which the obtained images were obtained.5. The method of claim 2 , wherein moving the vehicle toward the geolocation comprises obtaining additional images using the one or more cameras mounted on the vehicle as the vehicle moves toward the geolocation claim 2 , and determining a distance to the object using the additional images.6. The method of claim 1 , wherein sending data representing at least the portion of the obtained images to the display device comprises sending the data via wireless communication to a display device external to the vehicle.7. The method of claim 1 , further comprising:determining whether the geolocation permits parking, andin accordance with a determination that the geolocation permits parking, stopping the vehicle at the geolocation.8. A vehicle claim 1 , comprising: ...

Systems and Methods for Utilizing Machine-Assisted Vehicle Inspection to Identify Insurance Buildup or Fraud

A remotely-controlled (RC) and/or autonomously operated inspection device, such as a ground vehicle or drone, may capture one or more sets of imaging data indicative of at least a portion of an automotive vehicle, such as all or a portion of the undercarriage. The one or more sets of imaging data may be analyzed based upon data indicative of at least one of vehicle damage or a vehicle defect being shown in the one or more sets of imaging data. Based upon the analyzing of the one or more sets of imaging data, damage to the vehicle or a defect of the vehicle may be identified. The identified damage or defect may be compared to a claimed damage or defect to determine whether the claimed damage or defect occurred. 1. A computer-implemented method comprising:analyzing, via one or more processors, one or more sets of imaging data to identify at least one of damage to a vehicle or a defect of the vehicle;analyzing, via the one or more processors, the identified at least one of the damage to the vehicle or defect of the vehicle with respect to reported damage indicated in an insurance claim, to determine whether the reported damage indicated in the insurance claim is accurate;in response to determining that the reported damage to the vehicle is accurate, processing, via the one or more processors, the insurance claim; andtransmitting, via the one or more processors or via one or more transceivers, to a mobile device, an indication of the identified at least one of the damage or the defect.2. The computer-implemented method of claim 1 , wherein analyzing the one or more sets of imaging data includes receiving the one or more sets of imaging data via an autonomously operated inspection device.3. The computer-implemented method of claim 1 , further comprising scheduling claim 1 , via the one or more processors claim 1 , a service to correct the identified at least one of the damage to the vehicle or defect of the vehicle.4. The computer-implemented method of claim 3 , wherein ...

CONTROLLER, CONTROL METHOD, AND PROGRAM

The present technology relates to a controller, a control method, and a program that enable self-localization with lower power consumption. 1. A controller comprisinga selection unit that selects, from a horizontal camera mounted in a horizontal direction and a downward camera mounted in a downward direction, a camera used for self-localization depending on speed, anda self-localization unit that performs self-localization using an image obtained by imaging with the horizontal camera or the downward camera selected by the selection unit.2. The controller according to claim 1 , whereinthe selection unit selects the horizontal camera in a case where the speed is equal to or higher than a predetermined speed, and selects the downward camera in a case where the speed is not equal to or higher than the predetermined speed.3. The controller according to claim 2 , whereinthe selection unit selects a horizontal camera predicted to capture an area from which features are easily extracted from among a plurality of the horizontal cameras.4. The controller according to further comprisinga setting unit that sets the area from which features are easily extracted, andan omnidirectional camera that captures an image of surroundings of the omnidirectional camera, whereinthe setting unit divides an image captured by the omnidirectional camera by the number of the horizontal cameras, and selects the horizontal camera that images an area including a large number of feature points in which a direction that the feature point extracted from each of the divided images moves over time matches a self-moving direction based on a self-localization result.5. The controller according to claim 1 , whereina first algorithm for self-localization in a case where the horizontal camera is selected by the selection unit and a second algorithm for self-localization in a case where the downward camera is selected by the selection unit are different algorithms.6. The controller according to claim 5 , ...

Unmanned vehicle

An unmanned vehicle includes a vehicle body and at least one arm assembly. The arm assembly is coupled to the vehicle body. The arm assembly includes a first rotating member, a second rotating member, and a propeller. The second rotating member is coupled to the first rotating member. The propeller includes a propeller rim encircling an outer edge of the propeller and a rotatable axle coupled to the second rotating member. The the rotatable axle extends along a rotating axis. The second rotating member is configured to turn the propeller by rotating the rotatable axle about the rotating axis. The first rotating member is configured to rotate and effect a movement of the second rotating member so as to selectively adjust the rotatable axle to align the rotating axis at least with a first axial direction and a second axial direction.

Remote controlled vehicle with augmented reality overlay

In some embodiments, extemporaneous control of remote objects can be made more natural using the invention, enabling a participant to pivot, tip and aim a head-mounted display apparatus to control a remote-controlled toy or full-sized vehicle, for example, hands-free. If the vehicle is outfitted with a camera, then the participant may see the remote location from first-person proprioceptive perspective.

IMAGE DISPLAY DEVICE

An image display device includes: an external sensor data acquisition unit acquired external sensor data detected at a first time point; an internal sensor data acquisition unit acquired internal sensor data detected at the first time point; a determination unit determined a position of the vehicle at a second time point that is a future time point after a predetermined time has elapsed from the first time point, based on the internal sensor data at the first time point; and a display control unit displayed a monitoring image indicating surroundings of the vehicle on the display unit based on the external sensor data at the first time point, wherein, the display control unit superimposes an object indicating the position of the vehicle at the second time point at the position on the monitoring image corresponding to the position of the vehicle at the second time point. 1. An image display device connected to a display unit that displays information to a remote operator that remotely instructs a vehicle , comprising:an external sensor data acquisition unit configured to acquire external sensor data detected at a first time point by an external sensor that detects information on an external environment of the vehicle from the vehicle via communication;an internal sensor data acquisition unit configured to acquire internal sensor data detected at the first time point by an internal sensor that detects a travel state of the vehicle from the vehicle via communication;a determination unit configured to determine a position of the vehicle at a second time point that is a future time point after a predetermined time has elapsed from the first time point, based on the internal sensor data at the first time point; anda display control unit configured to display a monitoring image indicating surroundings of the vehicle on the display unit based on the external sensor data at the first time point,wherein the display control unit is configured to superimpose an object indicating ...

SYSTEMS AND METHODS FOR TARGET TRACKING

The present invention provides systems, methods, and devices related to target tracking by UAVs. The UAV may be configured to receive target information from a control terminal related to a target to be tracked by an imaging device coupled to the UAV. The target information may be used by the UAV to automatically track the target so as to maintain predetermined position and/or size of the target within one or more images captured by the imaging device. The control terminal may be configured to display images from the imaging device as well as allowing user input related to the target information. 1. A system for controlling an unmanned aerial vehicle (UAV) comprising:one or more receivers, individually or collectively, configured to receive from a remote user (1) one or more navigation commands to move the UAV, and (2) target information of a target to be tracked by an imaging device on the UAV; andone or more processors, individually or collectively, configured to dynamically adjust allocation of control over a tracking process between the user and the UAV based on factors including a surrounding of the UAV, speed of the UAV, altitude of the UAV, user preferences, or available computing resources.2. The system of claim 1 , wherein the tracking process utilizes a selection between (1) an automatic tracking mode in which the user can specify a type of target to track claim 1 , and (2) a manual tracking mode in which the user can specify a specific target to track.3. The system of claim 1 , further comprising a control terminal configured to receive from the user (1) a type of target to track claim 1 , or (2) a specific target to track.4. The system of claim 3 , wherein the type of target to track comprises at least one or the following target characteristics: a color claim 3 , texture claim 3 , pattern claim 3 , size claim 3 , shape claim 3 , or dimension of the target.5. The system of claim 4 , wherein the type of target to track comprises at least two different ...

System and methods for autonomously backing a vehicle to a trailer

In some embodiments, techniques are provided for autonomously backing a vehicle (such as a Class 8 truck) to a trailer. In some embodiments, environment sensors such as image sensors and range sensors mounted to the vehicle detect a trailer and determine distances between the trailer and the vehicle as well as relative angles of the trailer and the vehicle. In some embodiments, the vehicle determines a path to the trailer based on this information, and autonomously controls braking, torque, and/or steering of the vehicle to autonomously back the vehicle along the determined path.

MOBILE TERMINAL AND METHOD FOR CONTROLLING THE SAME

Disclosed are a mobile terminal and a method for controlling the same. The mobile terminal which wirelessly communicates with an unmanned aircraft including a camera, includes a wireless communication unit configured to receive a capturing image including a plurality of images captured by the camera; a memory configured to store flight information of the unmanned aircraft corresponding to each of the plurality of images; a display unit configured to output the captured image; and a controller configured to transmit a flight control command which is formed by flight information corresponding to at least one image to the unmanned aircraft, based on a recapturing command to at least one image among the plurality of images. 1. A mobile terminal configured to wirelessly communicate with an unmanned aircraft that includes a camera , comprising:a wireless communication unit in wireless communication with the unmanned aircraft to receive a captured image from the camera;a memory configured to store flight information of the unmanned aircraft corresponding to the captured image;a display unit configured to output the captured image; anda controller configured to generate a recapturing command associated with the captured image,wherein, in response to the recapturing command, the controller generates a flight control command based on the stored flight information corresponding to the captured image and transmits the flight control command to the unmanned aircraft.2. The mobile terminal of claim 1 , wherein the display unit is configured to output a map screen including a flight route of the unmanned aircraft.3. The mobile terminal of claim 2 , wherein the controller is configured to set a recapturing route for recapturing the captured image based on a touch applied to the map screen.4. The mobile terminal of claim 3 , wherein the captured image includes a plurality of images along the flight route and claim 3 , when a touch is applied to select a region of the flight route ...

REMOTE CONTROLLED VEHICLE WITH A HEAD-MOUNTED DISPLAY APPARATUS

In some embodiments, extemporaneous control of remote objects can be made more natural using the invention, enabling a participant to pivot, tip and aim a head-mounted display apparatus to control a remote-controlled toy or full-sized vehicle, for example, hands-free. If the vehicle is outfitted with a camera, then the participant may see the remote location from first-person proprioceptive perspective. 1. A remote controlled vehicle system , comprising a remote vehicle with an on-board camera and a head-mounted apparatus , wherein the head-mounted apparatus comprises a microprocessor , a visual display and one or more sensors , wherein the head-mounted apparatus is positioned on a person's face such that the visual display is positioned in front of the eye(s) of the person and the person's line of sight aligns more closely with the z-axis of the visual display than with the y-axis of the visual display , wherein the head-mounted apparatus is configured to:a. generate a signal to display video and/or audio from the remote vehicle's camera;b. generate a signal to control the movement of the remote vehicle;c. generate a signal to establish an orientation of the remote vehicle's camera;d. generate a signal to update the location of the remote vehicle along the axis of the orientation of the remote vehicle's camera using x-axisometer data from at least one of the sensors indicating pivot down or pivot up of the head-mounted apparatus and an x-axisometer sensor reference data; ande. generate a signal to update the orientation of the remote vehicle's camera using v-axisometer data from at least one of the sensors indicating pivot left or pivot right of the head-mounted apparatus and a v-axisometer sensor reference data.2. The system of claim 1 , wherein the video and/or audio from the vehicle's camera is produced to appear three-dimensional.3. The system of claim 2 , wherein the video and/or audio from the vehicle's camera comprises a videoconference stream.4. The system ...

System For, and Method of, Controlling Operation of a Vehicle in A Defined Area

A system for controlling operation of a vehicle in a defined area includes a perimeter defining a boundary of the defined area A user interface is provided for at least one of controlling and monitoring movement of the vehicle as it traverses the area and monitoring the location of the vehicle relative to the perimeter The system further includes a controller to which the vehicle is responsive, the vehicle having a plurality of modes of operation, one of which is an autonomous mode and another of which is an operator controlled mode. The controller is operative, when the vehicle is operating in the autonomous mode and the vehicle comes within a predetermined range of the perimeter, to inhibit the vehicle from crossing the perimeter and, when the vehicle is operating in the operator controlled mode or is converted from autonomous mode to operator controlled mode, to permit the vehicle to cross the perimeter under control of the operator. 1. A system for controlling operation of a vehicle in a defined area , the system includinga perimeter associated with the defined area;a user interface for at least one of controlling and monitoring movement of the vehicle and monitoring the location of the vehicle relative to the perimeter; anda controller in communication with the user interface and to which the vehicle is responsive, the vehicle having a plurality of modes of operation, one of which is an autonomous mode and another of which is an operator controlled mode, and the controller being operative, when the vehicle is operating in the autonomous mode and the vehicle comes within a predetermined range of the perimeter, to switch from the autonomous mode to the operator controlled mode to enable an operator to manoeuvre the vehicle relative to the perimeter.2. The system of in which the perimeter defines a boundary of the defined area.3. The system of in which the controller is configured to place the vehicle in an idle mode when the vehicle comes within the predetermined ...

Remote information collection, situational awareness, and adaptive response system (ricsaars) for improving advance threat awareness and hazardous risk avoidance with respect to a mobile platform or entity along a path of travel including systems and methods for identifying combinations of elements of interest including hazardous combinations of detected signals and other elements with respect to the mobile platform or entity along the path or expected path of the mobile platform or entity

An adaptive situational awareness, decision support, and automated response system operable to receive sensor data or situational awareness data for a region of interest along or in advance of a path of travel of a vehicle obtained from at least a mobile reconnaissance sensor platform and select/execute one or more response programming or plans to operate one or more vehicle equipment items, e.g., a remote interaction, control or jamming system, from a stored database, manual inputs, or a distributive network based on matching of plans/programs with at least one of the sensor outputs or situational awareness data is provided. Apparatus and methods are also provided that enable an exemplary system to obtain data associated with an area surrounding the vehicle and provide this data to other system, subsystems, and personnel.

MACHINE FOR CLEANING FURNACE REGENERATION CHAMBERS FOR THE PRODUCTION OF GLASSWARE

A machine for cleaning regeneration chambers of furnaces, the regeneration chambers having stacks of hollow refractory elements delimiting vertical passages, which define chimneys includes a self-propelled support structure to be introduced into a compartment, below the regeneration chamber to be cleaned, which communicates with the regeneration chamber. The machine further includes at least one lance, applied to the self-propelled support structure and configured to send within the vertical passages a stream of cleaning material powder and compressed air generated by a compressor positioned outside of the regeneration chamber to be cleaned, and at least one suction mouth, applied to said support structure and configured to suck cleaning material dust and aspirable materials from the ground, which were removed during the cleaning operation. At least one video camera is mounted on the support structure and at least one monitor controls from outside, through the video camera, operation of the machine. 125656. Machine () for cleaning regeneration chambers () of furnaces , for the production of glass articles , the regeneration chambers () having stacks of hollow refractory elements delimiting vertical passages , which define chimneys for combustion fumes from said furnaces , the machine comprising:{'b': 55', '56', '56, 'a self-propelled support structure to be introduced into a compartment (), which is below said regeneration chamber () to be cleaned and which communicates with said regeneration chamber (),'}{'b': 24', '50', '56, 'at least one lance (), applied to said self-propelled support structure and configured to send within said vertical passages a stream of cleaning material powder and compressed air generated by a compressor () which is intended to be positioned outside of said regeneration chamber () to be cleaned,'}{'b': 8', '55', '56, 'at least one suction mouth (), applied to said support structure and configured to suck cleaning material dust and ...

AUGMENTED REALITY GAMING SYSTEM

An augmented reality gaming system is disclosed. Example embodiments include: an augmented reality game system hub including: a video receiver configured to receive a vehicle video feed from a remotely controlled vehicle; a first interface configured to communicate with a data processing system executing a game engine, the first interface configured to receive augmented reality information from the game engine; and a video multiplexer to generate a combined video feed by combining at least a portion of the vehicle video feed with at least a portion of the augmented reality information; the data processing system executing the game engine; and a player unit configured to control the remotely controlled vehicle. 1. An augmented reality game system hub comprising:a video receiver configured to receive a vehicle video feed from a remotely controlled vehicle;a first interface configured to communicate with a data processing system executing a game engine, the first interface configured to receive augmented reality information from the game engine; anda video multiplexer to generate a combined video feed by combining at least a portion of the vehicle video feed with at least a portion of the augmented reality information.2. The augmented reality game system hub of further including a video output interface to provide the combined video feed to a rendering component.3. The augmented reality game system hub of wherein the rendering component is a display device or an audio device.4. The augmented reality game system hub of further including a second data interface configured to receive sensor data from the remotely controlled vehicle claim 1 , information indicative of the sensor data being included in the combined video feed.5. The augmented reality game system hub of wherein the video receiver claim 1 , configured to receive the vehicle video feed from the remotely controlled vehicle claim 1 , is a wireless receiver.6. The augmented reality game system hub of further ...

Delayed Telop Aid

The proposed system, Delayed Telop Aid (DTA), improves the teleoperator's ability to control the vehicle in a three step process. First, DTA predicts robot motion given the operators commands. Second, DTA creates synthetic images to produce a video feed that looks as if the robot communication link had no delay and no reduced bandwidth. Finally, DTA performs closed loop control on the robot platform to ensure that the robot follows the operator's commands. A closed loop control of the platform makes sure that the predicted pose after the delay (and therefore the image presented to the operator) is achieved by the platform. This abstracts away the latency-sensitive parts of the robot control, making the robot's behavior stable in the presence of poorly characterized latency between the operator and the vehicle. 1. A method for teleoperation of a robotic vehicle , the method comprising:at a first time, using a camera of the robotic vehicle, detecting a first image of an environment in which the robotic vehicle is disposed;using a two-way communication medium, transmitting the first image from the robotic vehicle to an Operator Control Unit (OCU), the transmission being received by the OCU after a first delay;receiving, from an operator at the OCU, one or more first commands to move the robotic vehicle;simulating, based on the one or more commands, motion of the robotic vehicle so as to predict a position and pose of the robotic vehicle within the environment at a second time after the first time;displaying, based on the simulated motion and the transmitted first image, a synthetic image to the operator, the synthetic image including a projection of the robotic vehicle within the environment based on the predicted position and pose;using the two-way communication medium, transmitting the predicted position and pose from the OCU to the robotic vehicle, the transmission being received by the robotic vehicle after a second delay; andusing a closed loop control mechanism ...

METHOD AND SYSTEM FOR REMOTE MACHINE CONTROL

A system and method for secure remote control of a machine includes transmitting video data from a camera on the machine to an operator controller located at a remote operation station, and receiving, at a machine controller of the machine, an operator control message from the operator controller. The operator control message is based on an input device actuated in response to the video data. The method further includes confirming validity of the operator control message based, at least in part, on the video data transmitted from the camera to the operator controller, and controlling the machine with the operator control message when validity of the operator control message is confirmed. 1. A secure remote control system comprising:a machine including at least one plant, a machine controller configured to control operation of the at least one plant, and a camera;an operation station located remote from the machine, the operation station comprising at least one input device, a display, and an operator controller operatively connected to the at least one input device and to the display; anda wireless connection enabling data transfer between the machine controller and the operator controller;wherein the machine controller is configured to transmit video data from the camera to the operator controller over the wireless connection;wherein the operator controller is configured to display the video data on the display and to transmit an operator control messages based on the at least one input device to the machine controller over the wireless connection; andwherein the machine controller is configured to confirm validity of the operator control message based, at least in part, on the video data transmitted to the operator controller and to control operation of the at least one plant based on the operator control message when validity of the operator control message is confirmed.2. The system according to claim 1 , wherein the video data comprises a compressed image ...

Autonomous 2D Datacenter Rack Imager

An automated rack imaging system is provided, including an automated guided vehicle having a housing and a propulsion system configured to move the housing. The automated rack imaging system may include an imaging system coupled to the housing. The imaging system may include a plurality of cameras. The cameras each may be configured to have a respective field of view. The fields of view may be at least partially non-overlapping with one another. The automated rack imaging system may also include an image processor configured to combine a plurality of images taken by the cameras into a single mosaic image. A method of imaging a datacenter rack with the automated guided vehicle is also provided. The method may include moving the automated guided vehicle to a first target location aligned with the datacenter rack, taking the plurality of images, and combining the plurality of images into the single mosaic image.

TELEPRESENCE ROBOT

A telepresence robot for use in association with a remote computing device includes a base, a body, a neck, a head and a tilt mechanism. The base has a drive system in communication with the remote computing device. The body is operably attached to the base. The neck is operably attached to the body. The head is operably attached to the neck. The head has a screen and the screen is in communication with the remote computing device. The tilt mechanism connects the head to the neck. The tilt mechanism includes a chain and sprocket assembly whereby the head tilts at least 10 degrees forwardly from a generally upright position and at least 10 degrees backwardly form the generally upright position. 1. A telepresence robot for use in association with a remote computing device comprising:a base having a drive system in communication with the remote computing device;a body operably attached to the base;a neck operably attached to the body;a head operably attached to the neck, the head having a screen, the screen being in communication with the remote computing device; anda tilt mechanism connecting the head to the neck, the tilt mechanism includes a chain and sprocket assembly whereby the head tilts at least 10 degrees forwardly from a generally upright position and at least 10 degrees backwardly from the generally upright position.2. The telepresence robot of wherein the tilt mechanism can tilt the head at least 40 degrees forwardly from the generally upright position and at least 90 degrees backwardly from the generally upright position.3. The telepresence robot of wherein the chain and sprocket assembly of the tilt mechanism includes a main shaft assembly and a spring operably connected to the main shaft assembly whereby the spring counterbalances the head.4. The telepresence robot of wherein the tilt mechanism further includes a clutch operably attached to the chain and sprocket assembly and the main shaft assembly whereby responsive to a force on the head over a ...

Systems and methods for autonomously loading and unloading autonomous vehicles

An autonomous system for loading or unloading an autonomous vehicle, in accordance with aspects of the present disclosure, includes one or more module(s) that include at least one of a compartment or a sub-compartment where the module(s) are located in an autonomous vehicle, a robotic movement apparatus configured to autonomously move items to or from the module(s), one or more processors, and at least one memory storing instructions which, when executed by the processor(s), cause the autonomous system to autonomously move an item, using the robotic movement apparatus, to or from the at least one module of the autonomous vehicle.

ELECTRONIC DEVICE FOR CONTROLLING UNMANNED AERIAL VEHICLE AND CONTROL METHOD THEREFOR

The present invention relates to an electronic device for controlling an unmanned aerial vehicle and a control method therefor. The electronic device for controlling an unmanned aerial vehicle according to the present invention comprises: a first sensor for sensing a first direction; a second sensor for sensing a second direction opposite to the first direction; and a processor electrically connected to the first sensor and the second sensor, wherein the processor may be configured to: determine whether the unmanned aerial vehicle is located in a first environment on the basis of at least one sensing data obtained by the first sensor; control sensing operations of the first sensor and the second sensor according to the determination result; and control motion of the unmanned aerial vehicle on the basis of at least one sensing data obtained by the first sensor and the second sensor. 1. An electronic device for controlling an unmanned aerial vehicle (UAV) , the electronic device comprising:a first sensor configured to sense a first direction;a second sensor configured to sense a second direction that is opposite to the first direction; anda processor electrically connected to the first sensor and the second sensor,wherein the processor is configured to:determine based on at least one sensing data obtained by the first sensor whether the UAV is located in a first environment, control sensing operations of the first sensor and the second sensor based on a result of the determination, and control movement of the UAV based on at least one sensing data obtained by the first sensor and the second sensor.2. The electronic device of claim 1 , wherein the first sensor and the second sensor comprise at least one of an ultrasonic sensor claim 1 , an infrared sensor claim 1 , a proximity sensor claim 1 , an image sensor claim 1 , and an optical flow sensor.3. The electronic device of claim 2 , wherein the first sensor and the second sensor comprise a plurality of sensors having ...

ENABLING REMOTE CONTROL OF A VEHICLE

It is provided a method for enabling remote control of a vehicle with autonomous propulsion capability. The method is performed by a vehicle data provider and comprises: detecting a need for manual assistance of the vehicle by an operator being remote from the vehicle; obtaining a stream of vehicle data, the vehicle data relating to a time prior to when remote control starts; modifying the vehicle data, which comprises adjusting a duration of playback of the vehicle data; providing the modified vehicle data for playback to the operator; providing, once the playback of modified vehicle data has ended, vehicle data in real-time to the operator; and enabling remote control of the vehicle by the operator. 1. A method for enabling remote control of a vehicle with autonomous propulsion capability , the method being performed by a vehicle data provider and comprising:detecting a need for manual assistance of the vehicle by an operator being remote from the vehicle;obtaining a stream of vehicle data, the vehicle data relating to a time prior to when remote control starts;modifying the vehicle data, which comprises adjusting a duration of playback of the vehicle data;providing the modified vehicle data for playback to the operator;providing, once the playback of modified vehicle data has ended, vehicle data in real-time to the operator; andenabling remote control of the vehicle by the operator.2. The method according to claim 1 , wherein the vehicle data comprises a video stream captured by a camera of the vehicle.3. The method according to claim 1 , wherein the vehicle data provider forms part of the vehicle and wherein the detecting the need for manual assistance comprises receiving an estimated takeover position (Pstart) where the need for remote control the vehicle is expected;and wherein the method further comprises:adapting operation of the vehicle such that the vehicle is expected to arrive at the takeover position based on the time when the playing back of the ...

Advertising on autonomous or semi-autonomous vehicle exterior

Provided herein is an autonomous or semi-autonomous vehicle fleet comprising a plurality of electric autonomous vehicle for apportioned display of a media, operating autonomously and a fleet management module for coordination of the autonomous vehicle fleet. Each autonomous or semi-autonomous vehicle comprising a screen configured to display the media. Activation, deactivation, brightness modification, in combination with specific media selection enables more efficient media display.

SYSTEM AND METHOD FOR CONDUCTING A DRONE RACE OR GAME

A system and method of conducting a drone race or game in a contained area is disclosed herein. The system may also include cameras attached to the drones and the video feed from the camera is transmitted to a computing device used to control the drone and to display the video feed. The system may also use computing devices and monitors to display the video feeds from the cameras attached to the drones. The system may also be configured as a game with information points. 1. A system for conducting a drone race or game in a contained area , comprising:a plurality of sensor readers attached to a plurality of obstacle structures;a plurality of drones, wherein each drone comprises a camera and a radio transmitter connected to the camera;a plurality of computing devices, wherein each computing device comprises a graphical user interface and corresponds to one of the plurality of drones to control the drone;a web server connected to a communication network, and to the plurality of computing devices via the communication network; andwherein each of the plurality of sensor readers sends a customized timestamp to the web server in response to an indication by at least one sensor reader of the plurality of sensor readers that at least one of the plurality of drones is detected by at least one sensor reader of the plurality of sensor readers in response to at least one of detecting by the at least one sensor reader a change in an amplitude of a transmitted signal of the radio transmitter and detecting by the at least one sensor reader a temporarily attached sensor attached to the at least one drone of the plurality of drones.2. The system of claim 1 , wherein the camera of each of the plurality of drones transmits a video feed to a corresponding computing device via the web server.3. The system of claim 1 , wherein the temporarily attached sensor of a set of the plurality of drones is a tracking tag and a set of the plurality of sensor readers are able to detect and read the ...

FLYING DEVICE, CONTROL DEVICE, COMMUNICATION CONTROL METHOD, AND CONTROL METHOD

A flying device that flies by being controlled from an external location, the flying device including a determination unit that determines a communication quality on a first wireless communication channel used for transmitting data to a control device that controls the flying device within a prescribed range from a flight position at which the flying device is flying; and a transmission control unit that controls a type of data to be transmitted to the control device on the basis of the communication quality determined by the determination unit. 135.-. (canceled)36. A control device comprising:a reception unit configured to receive, from a communication terminal, via a base station in a mobile telephone network, a usage request for a wireless communication channel on the mobile telephone network;a determination unit configured to, on the basis of terminal information contained in the usage request received by the reception unit, determine a terminal type of the communication terminal and a data type of data transmitted by the communication terminal; anda priority level control unit configured to, when a first condition that the terminal type determined by the determination unit is a flying device and the data type is flight data indicating a flight state of the flying device is satisfied, or when a second condition that the terminal type of the communication terminal is a flight control device for controlling the flying device and the data type is control data for controlling the flying device is satisfied, make a priority level for allocation of wireless resources higher than a priority level for allocation of wireless resources when the first condition and the second condition are not satisfied.37. The control device as claimed in claim 36 , wherein:the reception unit receives electric field strength information indicating an electric field strength in a vicinity of the flying device; andthe priority level control unit determines the priority level on the basis of ...

FLYING CAMERA AND A SYSTEM

There is provided a control device including an image display unit configured to acquire, from a flying body, an image captured by an imaging device provided in the flying body and to display the image, and a flight instruction generation unit configured to generate a flight instruction for the flying body based on content of an operation performed with respect to the image captured by the imaging device and displayed by the image display unit. 1: A flying camera comprising:a body component;a camera;at least four rotors configured to be rotated respectively for flying; and control wireless transmission of an image being captured to a control device for displaying the image on a touch panel display, and', 'control flying of the flying camera to a flight position for capturing an image of a target, based on image recognition recognizing the target in the image, and image capturing setting information indicating a position of the target and a size of the target in the image, the image capturing setting information being input by a touch operation on the touch panel display., 'circuitry configured to'}2: The flying camera according to claim 1 , wherein the camera is configured to capture the image of the target while the flying camera is flying.3: The flying camera according to claim 1 , wherein the circuitry is configured to control the flight position so that the position of the target and the size of the target are maintained according to the image capturing setting information.4: The flying camera according to claim 1 , wherein the circuitry is configured to control flying of the flying camera by controlling the at least four rotors.5: The flying camera according to claim 1 , wherein the circuitry is configured to capture the image of the target when a predetermined condition is satisfied.6: The flying camera according to claim 5 , wherein the predetermined condition is associated with a composition of the target.7: The flying camera according to claim 1 , wherein ...

FLYING CAMERA AND A SYSTEM

There is provided a control device including an image display unit configured to acquire, from a flying body, an image captured by an imaging device provided in the flying body and to display the, image, and a flight instruction generation unit configured to generate a flight instruction for the flying body based on content of an operation performed with respect to the image captured by the imaging device and displayed by the image display unit. 1. A flying camera comprising:a body;a camera configured to capture an image;circuitry configured to control wireless transmission of the image to a control device that is configured to display the image and receive a flight instruction of the flying camera from the control device;at least four rotors configured to be driven and control a flight of the flying camera; andat least four support components that respectively support each of the four rotors and are respectively rotatable on a plurality of axes to extend the four rotors away from the body, whereineach of the at least four support components are foldable about the plurality of axes so as to be arranged at a predetermined position with respect to the camera in a folded state for portability, and the at least four support components are extendable from the arranged position toward an outside of the body to an extended state for flying, the image being transmitted and the flight instruction being received with the at least four of the support components in the extended state,the at least four support components being divided into two groups separated relative to a position of the camera, andin the folded state, a first rotor of the at least four rotors that is supported by a first support component of a first group of the two groups is arranged vertically with respect to a second rotor of the at least four rotors that is supported by a second support component of the first group of the two groups.2. The flying camera according to claim 1 , wherein at least the first ...

SIGNALING INFORMATION ON A DETECTED PARKING SPACE TO THE OPERATOR OF A REMOTE CONTROL FOR A PARKING ASSISTANCE SYSTEM WHICH CAN BE CONTROLLED BY REMOTE CONTROL FOR AUTOMATICALLY PARKING A MOTOR VEHICLE

One aspect of the invention relates to a method for signaling information to the operator of the remote control for a parking assistance system which can be controlled by remote control from outside of a motor vehicle for automatically parking the motor vehicle into a parking space. The method includes detecting surroundings information with respect to the vehicle surroundings on the motor vehicle side using a surrounding sensor system of the motor vehicle. The parking assistance system in the motor vehicle detects a parking space on the basis of the surroundings information, and information on the detection of a parking space is transmitted from the motor vehicle to the remote control via a wireless communication connection. On the basis of the received information, the remote control signals the presence of the detected parking space to the operator. 1. A method for signaling information to an operator of a remote control for a parking assistance system that is controllable by remote control from outside a motor vehicle , for automatically parking the motor vehicle in a parking space , wherein the method comprises:determining, by the motor vehicle, surroundings information regarding the vehicle surroundings using an ambient sensor system of the motor vehicle;identifying, by the motor vehicle, a parking space based on the surroundings information;sending information about the parking space from the motor vehicle to the remote control via a wireless communication link;receiving, by the remote control, information about the parking space; andsignaling, by the remote control based on the received information, a presence of an identified parking space to the operator of the remote control.2. The method as claimed in claim 1 , whereinusing, by the motor vehicle, one or more criteria regarding an ability of the parking space to be parked in order to establish that the parking space can be parked in from a current vehicle position by remote control using the parking ...

FIXED-WING DRONE, IN PARTICULAR OF THE FLYING-WING TYPE, WITH ASSISTED MANUAL PILOTING AND AUTOMATIC PILOTING

A drone that includes an automatic piloting system that receives internal and/or external piloting instructions, as well as data of instantaneous attitude (φ*, θ*), altitude (z*) and speed (V*) delivered by sensors. Set point calculation circuits calculate, as a function of a model of the aerodynamic behaviour of the drone in flight, roll (φ) and/or pitch (θ) set points and/or speed set points (V) and/or altitude set points (z) corresponding to the internal and/or external piloting instructions received. Correction and control circuits control the propulsion system and the drone control surface servomechanisms. A system further allows generating internally piloting instructions for autonomous flight modes such as automatic take-off or automatic landing. 1. A fixed-wing drone , comprising:a propulsion system, control surfaces and an automatic pilot, wherein the automatic pilot is configured to:{'img': {'@id': 'CUSTOM-CHARACTER-00001', '@he': '3.22mm', '@wi': '2.46mm', '@file': 'US20180039271A1-20180208-P00001.TIF', '@alt': 'custom-character', '@img-content': 'character', '@img-format': 'tif'}, 'calculate set points as a function of instructions, said instructions comprising internal piloting instructions generated by the automatic pilot and external instructions received by the drone, said internal instructions and external instructions comprising turn instructions, move up/move down instructions and speed change instructions, said set points including a roll angle set point (φ), a pitch angle set point () and a speed set point (V) for the implementation of the internal and/or external instructions; and'}control the propulsion system and the control surfaces as a function of the calculated set points,{'img': {'@id': 'CUSTOM-CHARACTER-00002', '@he': '3.22mm', '@wi': '2.46mm', '@file': 'US20180039271A1-20180208-P00001.TIF', '@alt': 'custom-character', '@img-content': 'character', '@img-format': 'tif'}, 'upon application of a turn instruction and/or a speed change ...

Vehicle display device, vehicle control system, vehicle control method, and storage medium

A vehicle display device is provided, the vehicle display device including a communication section configured to receive an image of a remote driver remotely operating a vehicle, an external vehicle display section provided to an outer shell of the vehicle and configured to display an image externally to the vehicle, and a display control section configured to cause the image of the remote driver received by the communication section to be displayed on the external vehicle display section.

DELIVERY SYSTEM HAVING ROBOT VEHICLES WITH TEMPERATURE AND HUMIDITY CONTROL COMPARTMENTS

An autonomous robot vehicle in accordance with aspects of the present disclosure includes a conveyance system and a compartment coupled to the conveyance system. The conveyance system autonomously drives the autonomous robotic vehicle between one or more storage locations and one or more delivery locations. The compartment receives one or more items stored at the one more storage locations. The compartment includes a temperature control module configured to maintain the compartment within a predetermined temperature range to provide temperature control for the one or more items as the conveyance system drives between the one or more storage locations and the one or more delivery locations. 1. An autonomous vehicle comprising:a conveyance system configured to autonomously drive the autonomous robotic vehicle between a first location and a second location; andat least one storage compartment, the at least one storage compartment including at least one sub-compartment, the at least one storage compartment being removable from the autonomous vehicle for selective replacement of the at least one storage compartment, the at least one sub-compartment configured to receive at least one item at the first location, the at least one storage compartment being operatively coupled to a temperature control module configured to maintain the at least one compartment within a predetermined temperature range to provide temperature control for the at least one item as the conveyance system drives the autonomous vehicle between the first location and the second location.2. The autonomous vehicle of claim 1 , wherein the at least one item is a grocery item.3. The autonomous vehicle of claim 2 , wherein the first location is a grocery storage location.4. The autonomous vehicle of claim 1 , wherein the at least one item is a food item.5. The autonomous vehicle of claim 1 , wherein the temperature control module is configured to maintain the at least one sub-compartment within the ...

MULTI-STAGE OPERATION OF AUTONOMOUS VEHICLES

Systems and methods for operating a vehicle by switching between an autonomous control system within the vehicle and a remote operator are described herein. For the handover between the autonomous control system and the remote operator, the system can process current maneuvering parameters of the vehicle to at least select a teleoperation control type. The system can also generate a concurrent feature profile including a set of automated features that are configured to be implemented during teleoperation of the vehicle. The system can implement the handover of vehicle control according to the teleoperation control type while the vehicle autonomously or semi-autonomously operates according to the concurrent feature profile. 120-. (canceled)21. A method of operating a system for controlling a vehicle , the method com prising:generating a concurrent feature profile, wherein the concurrent feature profile represents one or more automated or semi-automated features to be implemented during teleoperation of the vehicle; andprocessing one or more teleoperation commands from a remote operator while the vehicle operates according to the concurrent feature profile, wherein the one or more teleoperation commands correspond to the teleoperation of the vehicle for operating the vehicle according to control inputs from the remote operator located remotely from the vehicle.22. The method of claim 21 , further comprising:initiating the teleoperation based on sending a handover request from the vehicle to the teleoperation center;whereinprocessing the one or more teleoperation commands includes implementing the one or more teleoperation commands at the vehicle.23. The method of claim 21 , further comprising:receiving, at the teleoperation center, a handover request from the vehicle;wherein:initiating the teleoperation based on notifying a remote operator based on receiving the handover request; andprocessing the one or more teleoperation commands includes sending the one or more ...

Headset Computer That Uses Motion And Voice Commands To Control Information Display And Remote Devices

A wireless hands-free portable headset computer with a micro display arranged near but below a wearer's eye in a peripheral vision area not blocking the wearer's main line of sight. The headset computer can display an image or portions of an image, wherein the portions can be enlarged. The headset computer also can be equipped with peripheral devices, such as light sources and cameras that can emit and detect, respectively, visible light and invisible radiation, such as infrared radiation and ultraviolet radiation. The peripheral devices are controllable by the wearer by voice command or by gesture. The headset computer also can be broken down into component parts that are attachable to another article worn by an individual, such as a helmet or respirator mask. 1. A headset computer system comprising:a first housing including a processor;a second housing including a boom with an integrated microdisplay and microphone;a third housing including a power supply, each of the housings separately packaged and individually attachable to a headgear;one or more signal and power connections between the first, second and third housings; andfasteners for separately attaching and detaching the first, second and third housing to and from the headgear.2. The headset computer system of claim 1 , wherein the headgear is a helmet.3. The headset computer system of claim 1 , wherein the fasteners include hook and loop fasteners.4. The headset computer system of claim 1 , wherein the first housing further encloses noise cancellation circuits.5. The headset computer system of claim 4 , wherein the noise cancellation circuits are configured to reduce background noise of a rebreather.6. The headset computer system of wherein the boom is configured to support the microdisplay.7. The headset computer system of claim 1 , wherein the fasteners include a mechanical clip configured to attach the boom to the headgear.8. The headset computer system of claim 1 , wherein the first claim 1 , second ...

Modelling Operating Zones For Manufacturing Resources Using Virtual Model And Graphics Based Simulation

Embodiments are directed to methods and systems for automatically determining a resource layout. An example embodiment begins by obtaining data indicating a position and a task performed by each resource of a plurality of resources. Then, for each resource of the plurality, a respective zone on a plane of interest occupied by the resource is automatically determined using the obtained data indicating the position and the task performed by the resource. In turn, determined zones of two or more resources of the plurality of resources are automatically combined into a combined zone based upon criteria and a file, e.g., a CAD/CAM file, indicating a layout of the plurality of resources on the plane of interest is automatically created based upon the determined zones and the combined zone.

HARDWARE AND SOFTWARE MECHANISMS ON AUTONOMOUS VEHICLE FOR PEDESTRIAN SAFETY

An autonomous robot vehicle includes a front side and an energy absorbing system. The front side includes a front bumper and a front face including a frame defining a cavity. The energy absorbing system includes an energy absorbing member mounted in the cavity of the frame, and an inflatable airbag. The energy absorbing member is configured to reduce impact on an object struck by the autonomous robot vehicle. The inflatable airbag is mounted on the front side of the autonomous robot vehicle such that when the inflatable airbag is deployed, the inflatable airbag is external to the autonomous robot vehicle. 1. An autonomous robot vehicle comprising:a front side including a front bumper facing a first direction and a front face including a frame; andan energy absorbing system comprising an energy absorbing member mounted on the frame of the front face, wherein the energy absorbing member is configured to reduce impact on an object struck by the autonomous robot vehicle, and wherein the energy absorbing member faces the first direction and extends between a top portion of the front side and a top portion of a recess defining at least one cavity having a first side facing the first direction that is covered by a lens.2. The autonomous robot vehicle according to claim 1 , wherein the energy absorbing system further includes an inflatable airbag mounted on the front side of the autonomous robot vehicle claim 1 , and wherein when the inflatable airbag is deployed claim 1 , the inflatable airbag is external to the autonomous robot vehicle.3. The autonomous robot vehicle according to claim 2 , wherein the energy absorbing system further includes an interior airbag disposed within a storage compartment of the autonomous robot vehicle.4. The autonomous robot vehicle according to claim 3 , wherein the energy absorbing system further includes detection sensors configured to detect obstacles in a direction of travel of the autonomous robot vehicle.5. The autonomous robot vehicle ...