17-03-2022 дата публикации
Номер: US20220083402A1
Systems and methods for connecting datasets are disclosed. For example, a system may include a memory unit storing instructions and a processor configured to execute the instructions to perform operations. The operations may include receiving a plurality of datasets and a request to identify a cluster of connected datasets among the received plurality of datasets. The operations may include selecting a dataset. In some embodiments, the operations include identifying a data schema of the selected dataset and determining a statistical metric of the selected dataset. The operations may include identifying foreign key scores. The operations may include generating a plurality of edges between the datasets based on the foreign key scores, the data schema, and the statistical metric. The operations may include segmenting and returning datasets based on the plurality of edges. 1. A dataset connector system comprising:one or more memory units storing instructions; and{'claim-text': ['receiving, by the dataset connector system, a plurality of datasets;', 'receiving, by the dataset connector system, a request to identify a cluster of connected datasets among the received plurality of datasets;', 'selecting, by the dataset connector system, a dataset from among the received plurality of datasets;', 'identifying, by a data profiling model, a data schema of the selected dataset;', 'determining, by the data profiling model, a statistical metric of the elected dataset;', 'identifying, by the data profiling model, a plurality of candidate foreign keys of the selected dataset;', 'determining, by a data mapping model, respective foreign key scores for individual ones of the plurality of candidate foreign keys;', 'generating, by the data mapping model, a plurality of edges between the selected dataset and the received plurality of datasets based on the foreign key scores, the data schema, and the statistical metric;', 'segmenting, by a data classification model, a cluster of connected ...
Подробнее