18-08-2023 дата публикации
Номер: CN116610739A
Принадлежит:
The embodiment of the invention provides a data processing method, device and system. The method comprises the following steps: receiving a data acquisition task, acquiring data by using a visual acquisition tool, and caching the acquired data into middleware; using a built-in calculation engine of the distributed file management system to consume the cache data in the message queue in the middleware, and storing the processed data; the method comprises the following steps: receiving a data query request, analyzing the query request by using a distributed query engine, determining a query node corresponding to the query request, querying data corresponding to the query request through the query node, and returning a query result. According to the data processing method provided by the embodiment of the invention, the user can control the start and stop of the data source and the acquisition tool, the mass data can be quickly and efficiently acquired, analyzed, summarized and processed, ...
Подробнее