Merging LIDAR information and camera information

A system for an autonomous vehicle comprising merging LiDAR information and camera information. A vehicle including at least one LiDAR device configured to detect electromagnetic radiation; at least one camera configured to generate camera information of objects proximate to the vehicle; at least one processor communicatively coupled to the at least one LiDAR device and the at least one camera and a control circuit communicatively coupled to the at least one processor, wherein the control circuit is configured to operate the vehicle based on a location of the object. The control circuit receiving the LIDAR data and object information, the object information includes at least one pixel of the camera information representing the object and categorisation information representing a classification of the object. The control circuit merging the LIDAR and object information to generated merged data. he system determining the location of the object based on the merged data and passing the location ...