AvionDB Under the hood: AvionDB P2P Syncing One of the big challenges while working with distributed databases is to sync/replicate data between the peers. There are multiple things that make replication challenging in distributed systems: Access
AvionDB AvionDB: A MongoDB-like Distributed Database In the past few months we have been getting this question a lot: What do I use for managing dynamic data for my Decentralized App? We have InterPlanetary File System
Ethereum How to Write Upgradable Smart Contracts Smart contracts are immutable, by design. On the other hand, software quality heavily depends on the ability to upgrade and patch source code to produce iterative releases. Even though blockchain-based
IPFS Cluster Building a Twitter Bot using IPFS Cluster 🤖 Till now, we have explored a number of fun examples using InterPlanetary File System (IPFS), InterPlanetary Linked Data (IPLD) & Libp2p. We have built Websites on IPFS, Youtube on IPFS,
ipld Hands-on IPLD Tutorial in Golang: PART 2 In this article of the IPLD series, we will enhance the current code to handle document entries instead of key-value entries.
IPFS Cluster Joining a Collaborative Cluster Collaborative clusters allow people to join forces to backup and distribute interesting content on the IPFS-network.
IPFS Cluster Collaborative Cluster Setup In order to create your own collaborative cluster that other people can subscribe to you will need to: Setup your regular production deployment of IPFS Cluster in CRDT mode (these
IPFS Cluster IPFS Cluster Production deployment This section is meant for administrators looking to setup IPFS and  IPFS Cluster on a production environment. Administrators are expected to  be familiar with IPFS and with the deployment of
ipfs-cluster-follow ipfs-cluster-follow The ipfs-cluster-follow command line application is a  user-friendly way of running follower peers to join collaborative IPFS  Clusters. You can obtain more information about collaborative clusters  in the respective section.
Ethereum Getting Deep Into Ethereum: How Data Is Stored In Ethereum? In this post, we will see how states and transactions are stored in Ethereum and how it is different from Bitcoin.
Ethereum Getting Deep Into EVM: How Ethereum Works Backstage This post is a continuation of my Getting Deep Into Series started in an effort to provide a deeper understanding of the internal workings and other cool stuff about Ethereum and blockchain in general which you will not find easily on the web.
Ethereum Ethereum for Dummies Ethereum is a decentralized platform that runs smart contracts: applications that run exactly as programmed without any possibility of downtime, censorship, fraud or third party interference.
IPFS Cluster Collaborative Clusters This section documents the collaborative clusters feature in  IPFS Cluster. Collaborative clusters allow individual, untrusted peers  to join an IPFS Cluster as “followers” (without permission to modify or  edit the
NewsLetter Jan 2020, Web 3.0 Grants, Meetups, Hackathons & Jobs Hey There! I hope you are having a lovely week. This week I'm trying something new with the newsletter. It is hard for us to find and keep track of
ipld Hands-on IPLD Tutorial in Golang: PART 1 In this first post of the hands-on series, we will understand the basic concepts of IPLD followed by coding in Golang to persist key-value entries.
Directed Acyclic Graphs Intro to Directed Acyclic Graphs The purpose of this post is to clearly understand the idea behind the Directed Acyclic Graphs or DAGs. The best way to fully understand DAGs to a deep level is
Layer2 Difference Between SideChains and State Channels State Channels and Sidechains are the two terms in Ethereum community that are often used interchangeably, thus causing mass confusion. But today we will get it clear. Go make a
IPFS Cluster IPFS Cluster Configuration All IPFS Cluster configurations and persistent data can be found, by default, at the ~/.ipfs-cluster folder. For more information about the persistent data in this folder, see the Data, backups
IPFS Cluster IPFS Cluster Service The ipfs-cluster-service is a command line application that runs a full cluster peer: ipfs-cluster-service init initializes configuration and identity.ipfs-cluster-service daemon launches a cluster peer.ipfs-cluster-service state allows to export,
IPFS Cluster IPFS Cluster CTL The ipfs-cluster-ctl command line application is a  user-friendly REST API client for IPFS Cluster. It allows to perform all  the operations supported by a Cluster peer: PinningUnpinningAddingListing items in the
Ipfs IPFS Proxy The IPFS Proxy is an endpoint which presents the IPFS HTTP API in the following way: Some requests are intercepted and trigger cluster operationsAll non-intercepted requests are forwarded to the
IPFS Cluster IPFS Cluster REST API Reference IPFS Cluster peers include an API component which provides HTTP-based  access to the peer’s functionality. The API attempts to be REST-ful in form and behaviour. It is enabled by
IPFS Cluster Running Cluster on Kubernetes This guide will show you how to: Run a simple Cluster on KubernetesUsing Kustomize, adapt the Cluster Kubernetes resources to your scenarioThis guide assumes you have a running Kubernetes cluster
IPFS Cluster Tracing and Monitoring IPFS Cluster IPFS Cluster supports exposing a Prometheus endpoint for metric-scraping as well as submitting trace information to Jaeger. These are configured in the observations section of the configuration and can be
IPFS Cluster Troubleshooting IPFS Cluster This sections contain a few tips to identify and correct problems when running IPFS Cluster. IPFS Cluster fails to buildPlease read the Download page. It has instructions on how to
IPFS Cluster Upgrading IPFS Cluster The IPFS Cluster project releases new versions regularly. This  section describes the procedure to upgrade Clusters with minimal or no  downtime. The main consideration is that: All the cluster peers
IPFS Cluster IPFS Cluster Metrics Cluster peers run a “monitor” component which is in charge of: Distributing arbitrary metrics from the current peer to all the others. Metrics have an associated expiry date.Detecting peer-health
IPFS Cluster IPFS Cluster Peerset Management Adding and removing peers from the Cluster might be a simpler or  trickier operation depending on the “consensus” component used by the  cluster (the consensus component is in charge on
IPFS Cluster Data, Backups, and Recovery The configurations and data persisted by a running IPFS Cluster peer (with ipfs-cluster-service) is, by default, in the $HOME/.ipfs-cluster/ folder. A Cluster peer persists several types of information on
IPFS Cluster IPFS Cluster Security & Ports This section explores some security considerations when running IPFS Cluster. There are four types of endpoints in IPFS Cluster to be taken into  account when protecting access to the system.
IPFS Cluster IPFS Cluster Consensus Components IPFS Cluster peers can be started using different choices for the  implementations of some components. The most important one is the  “consensus” one. The “consensus component” is in charge of:
IPFS Cluster Adding and pinning Cluster usage mostly consists on adding and removing pins. This is usually performed using the ipfs-cluster-ctl utility or talking to one of the Cluster APIs. You can get help and
IPFS Cluster Deployment Automation We have a number of automations to facilitate configuring and deploying IPFS Clusters: Ansible rolesDockerKubernetes with KustomizeAnsible rolesAnsible roles for configuring and deploying ipfs-cluster-service, ipfs-cluster-ctl and go-ipfs (including templated configuration
IPFS Cluster Bootstrapping the Cluster This section explains how to start a Cluster for the first time depending on the consensus choice (crdt or raft) made during initialization. The first start of the Cluster is
IPFS Cluster Download and Installation IPFS Cluster In order to run an IPFS Cluster peer and perform actions on the Cluster, you will need to obtain the ipfs-cluster-service and ipfs-cluster-ctl binaries. The former runs the Cluster peer.
IPFS Cluster IPFS Cluster Architecture Before jumping in to install and run IPFS Cluster, it is important to clarify some basic concepts. IPFS Cluster ArchitectureThe IPFS Cluster software consists of two binary files: ipfs-cluster-service runs
Libp2p Stream Multiplexing Stream Multiplexing (often abbreviated as “stream muxing”) allows multiple independent logical streams to all share a common underlying transport medium. Libp2p applications often open many independent streams of communication between
Libp2p Publish/Subscribe Publish/Subscribe is a system where peers congregate around topics they are interested in. Peers interested in a topic are said to be subscribed to that topic: Peers can send
Libp2p Addressing Flexible networks need flexible addressing systems. Since libp2p is designed to work across a wide variety of networks, we need a way to work with a lot of different addressing
Libp2p Peer Identity A Peer Identity (often written PeerId) is a unique reference to a specific peer within the overall peer-to-peer network. As well as serving as a unique identifier for each peer,
Libp2p Protocols There are protocols everywhere you look when you’re writing network applications, and libp2p is especially thick with them. The kind of protocols this article is concerned with are the
Libp2p Circuit Relay Circuit relay is a transport protocol that routes traffic between two peers over a third-party “relay” peer. In many cases, peers will be unable to traverse their NAT in a
Libp2p Nat Traversal The internet is composed of countless networks, bound together into shared address spaces by foundational transport protocols. As traffic moves between network boundaries, it’s very common for a process
Libp2p Transport When you make a connection from your computer to a machine on the internet, chances are pretty good you’re sending your bits and bytes using TCP/IP, the wildly
ipld Building an Online Publishing Platform on IPLD In this tutorial, we will go through how IPLD works and build an online publishing platform. Understanding IPLDCreating an IPLD nodeConnecting IPLD objectsReading Nested data using LinksCreating a Publication SystemYou
merkle-dag Merkle-DAGs The Merkle-DAG spec has been deprecated in favor of IPLD. It offers a clearer description of how to link different kinds of hash-based structures (e.g. linking a file in
