06-08-2020 дата публикации
Номер: US20200250032A1
Принадлежит:
This disclosure describes a programmable device, referred to generally as a data processing unit, having multiple processing units for processing streams of information, such as network packets or storage packets. This disclosure also describes techniques that include enabling data durability coding on a network. In some examples, such techniques may involve storing data in fragments across multiple fault domains in a manner that enables efficient recovery of the data using only a subset of the data. Further, this disclosure describes techniques that include applying a unified approach to implementing a variety of durability coding schemes. In some examples, such techniques may involve implementing each of a plurality of durability coding and/or erasure coding schemes using a common matrix approach, and storing, for each durability and/or erasure coding scheme, an appropriate set of matrix coefficients. 1. A method comprising:receiving, by a data processing unit, a set of data to be stored;identifying, by the data processing unit, a durability scheme from among a plurality of available durability schemes for data reliability;determining, by the data processing unit and based on the identified durability scheme, a coefficient matrix appropriate for the identified durability scheme; andgenerating, by data durability circuitry within the data processing unit and by applying the coefficient matrix to the set of data, parity data.2. The method of claim 1 , further comprising:storing, by the data processing unit, the set of data and the parity data.3. The method of claim 1 , further comprising:caching, by the data processing unit, the coefficient matrix appropriate for the identified durability scheme.4. The method of claim 1 , further comprising:receiving, by the data processing unit, a request to access at least a portion of the set of data;identifying, by the data processing unit, available data from the stored set of data and the stored parity data;generating, by the ...
Подробнее