FogMeta-Data-Rebuilder

FogMeta Data Rebuilder (Replication and Repair) is a guaranteed storage service based on FEVM contract. It guarantees N replicas stored on filecoin network, 50% of the storage fund locked in FEVM contract will be used for the initial storage copies and the remaining 50% will be used for future replication when the data replicas loss occurs within the term. The reserved fee percentile is based on the current average storage provider failure rate. Assuming the current failure rate per SP is 30% in the term, with 99.99% SLA, we need to maintain 8 replicas all the time. When a replicas loss occurs, a 5% fee will be used for the fee of the replica deal, and unused funds in the contract will be refunded to the user after the term expired.

Users also can manually rebuild the files from the Filecoin network using the locked funds.

The project won the Data Dao hackathon in 2022. The v1 has provided the following functions: Build (IPFS To Filecoin), upload the data to the IPFS gateway, and keep 8 replicas to the Filecoin network, Reload (Filecoin To IPFS). More details can be found https://github.com/FogMeta/Rebuilder/blob/main/README.md

• Build (IPFS To Filecoin): Use the @MCS SDK to upload the data to the IPFS node, and build at least 5 cold backups to the Filecoin network.

• Rebuild (Filecoin To IPFS): (1) Find the storage providers' peerIds by the @Indexer (2) Get the storage providers IDs from the @Filecoin Network (3) Retrieve the data from the storage providers using @Lotus (4) Rebuild the data to the @IPFS nodes

• CID-Discover (IPFS): Rebuilder will check if the data content available on the IPFS gateway

• Auto-Rebuild: once the lost data cid is found, the auto-rebuild process will trigger and reload data from the storage provider to the target IPFS gateway.