23-06-2023 дата публикации
Номер: CN116303550A
Принадлежит:
The invention discloses a Spark SQL (structured query language) acceleration method based on a GPU (graphics processing unit), which comprises the following steps: Spark SQL consists of projections, data and conditions which respectively correspond to results, data and operations in an SQL query process, and SQL statements are described according to the sequence of the results, the data and the operations; and analyzing the read SQL statement, distinguishing keywords and expressions in the SQL statement so as to judge whether the SQL statement is standard or not, further forming an execution tree, binding and executing the execution tree and a data dictionary, and selecting an optimal plan from the plans for execution. The GPU can realize common operations such as data combination and sorting in the SQL by using the Cuda statement, so that the operations such as data query are greatly accelerated. According to the method, the GPU and the Spark platform are combined, the SQL operation is ...
Подробнее