search
Ctrlk

hard-driveStorage

Storage should be done during gossipsub communication and stored locally; this way, all peers or certain roles will all have the same data, allowing them to come to the same conclusion when scoring one another.

Alternatives to using the gossipsub for specific use cases can use the DHT record storage or DHT providers.

hashtag
GossipSub + Local Storage

In most cases, using a GossipSub and storing the messages locally is preferred, especially in cases where all peers, specific roles, or a subset of peers should have replicated data. This is achieved because messages are broadcast across the network, and each receiving peer validates and persists them locally, causing the same data to be consistently stored across all peers, specific roles, or a subset of peers.

This mirrors how Bitcoin and Ethereum propagate data: blocks and transactions are broadcast across the network, and each node validates and stores them locally, resulting in a replicated state.

hashtag
Usage

In most cases, using the GossipSub and storing the gossiped messages locally, especially for more frequent messages, such as:

  • heartbeats

  • status updates

  • attestations

  • commit-reveals

  • live network events

  • data all peers or a subset of peers should replicate

hashtag
DHT

The ServerBase class automatically exposes the subnet to the DHT class.

hashtag
DHT Records

Records in a Distributed Hash Table (DHT) are stored by assigning keys (content hashes) and values (data or provider addresses) to specific peers whose Node IDs are closest to the key based on a distance metric, such as XOR.

In short, DHT records are stored by a subset of peers responsible for a key. When queried, multiple peers return the data, and the requester verifies consistency (e.g., via signatures or hashes). This enables fully decentralized data storage.

circle-info

DHT records should only be used for use cases where GossipSub can't work.

hashtag
Usage

Use DHT records when there is low-frequency data, such as:

  • storing an IPFS link to a file that will never change

  • storing peer info

  • data that should be retrieved under a low frequency

hashtag
DHT Provider

A DHT provider is a peer within a Distributed Hash Table (DHT) network that advertises and stores data, making it searchable by other peers. It maps specific content identifiers (such as file hashes) to its own address, enabling decentralized content discovery and file sharing.

hashtag
Usage

  • Content discovery (files, datasets, models)

  • Service discovery (APIs, inference providers, roles)

  • Dynamic data ownership/location tracking

  • Compute / resource marketplaces (I have this hardware)

  • Selective data hosting (partial network storage)

  • Capability advertisement (what a peer can do)

Last updated