Big Dipper (#10)

Author: VictorTrustyDev

.gitignore

@@ -5,7 +5,8 @@ override-env.sh
 
 EVMOS-source-code*/
 Hermes-source-code/
-bdjuno-source-code/
+bdjuno-source-code*/
+bd2-source-code*/
 
 *genesis.json
 *config.toml

README.md

@@ -8,41 +8,44 @@ I wrote hundred lines of comments which explains every steps in each script file
 - [yq + tomlq (build on top of jq)](https://github.com/kislyuk/yq)
 - [Rust 1.60+](https://www.rust-lang.org/tools/install) (for Hermes - IBC relayer)
 - [docker](https://docs.docker.com/engine/install/) & [docker compose](https://docs.docker.com/compose/install/)
+- Node JS (for Big Dipper 2.0 Cosmos)
 
-I created all of the following samples on an Ubuntu 22.04 LTS machine with 4 CPU 4 GB RAM. It can run 
-- 2 EVMOS networks
-- 1 Hermes as IBC relayer to connect them
-- 2 bdjuno as block explorer's backend
-- 2 hasura as graphql service
+I created all of the following samples on an Ubuntu 22.04 LTS machine with 4 CPU 16 GB RAM. It can run 
+- 2 [EVMOS](https://github.com/evmos/evmos/tree/v5.0.0) networks
+- 1 [Hermes](https://github.com/informalsystems/ibc-rs/tree/v0.15.0) as IBC relayer to connect them
+- 2 [bdjuno & hasura](https://github.com/forbole/bdjuno/tree/chains/evmos/mainnet) as block explorer's backend & graphql service
+- 2 [Big Dipper 2.0](https://github.com/forbole/big-dipper-2.0-cosmos/tree/chains/evmos) as block explorer's backend
 
-without any performance issue (CPU ~20% per core, ram ~45% via htop).
+without any performance issue (CPU ~20-80% per core, ram ~50% via htop).
 
 ### List of samples:
 - [Script to build EVMOS networks and run with docker compose](https://github.com/VictorTrustyDev/EVMOS-sample-scripts/blob/main/evmos-on-docker)
 - [Script to build & setup Hermes as an IBC relayer](https://github.com/VictorTrustyDev/EVMOS-sample-scripts/blob/main/hermes-as-ibc-relayer)
-- [Script to setup bdjuno (back-end of Big Dipper block explorer) with hasura as graphql service](https://github.com/VictorTrustyDev/EVMOS-sample-scripts/blob/main/bdjuno)
-- [(Comming soon) Script to setup [Big Dipper 2.0 For Cosmos] (front-end of Big Dipper block explorer)](https://github.com/VictorTrustyDev/EVMOS-sample-scripts/blob/main/bd2)
+- [Script to setup Big Dipper (backend bdjuno with hasura as graphql service & frontend Big Dipper 2.0 for Cosmos based chains)](https://github.com/VictorTrustyDev/EVMOS-sample-scripts/blob/main/big-dipper-as-block-explorer)
 
 ### Software versions:
 
 - [Evmos v5.0.0](https://github.com/evmos/evmos/tree/v5.0.0)
 - [Hermes v0.15.0](https://github.com/informalsystems/ibc-rs/tree/v0.15.0)
+- [bdjuno branch evmos](https://github.com/forbole/bdjuno/tree/chains/evmos/mainnet)
+- [Big Dipper 2.0 for Cosmos chains branch evmos](https://github.com/forbole/big-dipper-2.0-cosmos/tree/chains/evmos)
 
-You can change version EVMOS and Hermes by updating file [env.sh](https://github.com/VictorTrustyDev/EVMOS-sample-scripts/blob/main/env.sh)
+You can change their version by updating file [env.sh](https://github.com/VictorTrustyDev/EVMOS-sample-scripts/blob/main/env.sh)
 - This sample is using keyring `test`, you may need to change to `file` for secure your test env if needed
-- You can create `override-env.sh` file and override values there (git ignores this file)
+- You can create `override-env.sh` file and override values there
 
 #### Default ports used in these samples
 
 | Sample name | Port No. for network 1 | Port No. for network 2 | Desc |
 | --- | --- | --- | --- |
-| EVMOS on docker | 26657 | 36657 | RPC |
-| EVMOS on docker | 8545 | 18545 | Json RPC |
-| EVMOS on docker | 1317 | 11317 | REST API |
+| EVMOS on docker | 26657 | 36657 | **RPC** |
+| EVMOS on docker | 8545 | 18545 | **Json RPC** |
+| EVMOS on docker | 1317 | 11317 | **REST API** |
 | EVMOS on docker | 9090 | 19090 | gRPC |
 | EVMOS on docker | 26656 | 36656 | P2P |
-| bdjuno | 8080 | 8082 | Hasura's graphql service |
-| bdjuno | 3000 | 3002 | bdjuno hasura action base |
+| Big Dipper as Block Explorer | 3800 | 3802 | **Big Dipper front end** |
+| Big Dipper as Block Explorer | 8080 | 8082 | Hasura's graphql service |
+| Big Dipper as Block Explorer | 3000 | 3002 | bdjuno hasura action base |
 
 #### Default service name & container name used in these samples
 | Sample name | Name for network 1 | Name for network 2 | Desc |
@@ -51,6 +54,7 @@ You can change version EVMOS and Hermes by updating file [env.sh](https://github
 | EVMOS on docker | vtevmos11 | vtevmos21 | Node 1 (validator 2) of EVMOS network run via docker-compose |
 | EVMOS on docker | vtevmos12 | vtevmos22 | Node 2 (validator 3) of EVMOS network run via docker-compose |
 | Hermes as IBC relayer | (hermes-svc as a shared service) | (hermes-svc as a shared service) | Hermes connects both networks (Debian* daemon service) |
-| bdjuno | bdjuno-svc1 | bdjuno-svc2 | bdjuno app (Debian* daemon service) |
-| bdjuno | bdjdb1 | bdjdb2 | bdjuno & hasura database |
-| bdjuno | bdjhasura1 | bdjhasura2 | Hasura graphql service |
+| Big Dipper as Block Explorer | bdjuno-svc1 | bdjuno-svc2 | bdjuno app (Debian* daemon service) |
+| Big Dipper as Block Explorer | bdjdb1 | bdjdb2 | bdjuno & hasura database (docker) |
+| Big Dipper as Block Explorer | bdjhasura1 | bdjhasura2 | Hasura graphql service (docker) |
+| Big Dipper as Block Explorer | bd2-svc1 | bd2-svc2 | Big Dipper front end (Debian* daemon service) |

bd2/README.md

@@ -0,0 +1 @@
+.bdjuno*/

bdjuno/.gitignore

@@ -15,7 +15,7 @@ if [ -f "./_config.sh" ]; then
  source "./_config.sh"
 else
  echo "ERR: Wrong working directory"
- echo "ERR: Scripts must be executed within [bdjuno] directory"
+ echo "ERR: Scripts must be executed within [big-dipper-as-block-explorer] directory"
  exit 1
 fi
 

bdjuno/cleanup.sh

@@ -12,7 +12,7 @@ if [ -f "./_config.sh" ]; then
  source "./_config.sh"
 else
  echo "ERR: Wrong working directory"
- echo "ERR: Scripts must be executed within [bdjuno] directory"
+ echo "ERR: Scripts must be executed within [big-dipper-as-block-explorer] directory"
  exit 1
 fi
 
@@ -75,7 +75,10 @@ if [ $DISABLE_SYSTEMCTL -eq 0 ]; then
  echo "sudo vi $SERVICE_FILE"
  echo
 
+ CUR_DIR=$(pwd)
+ cd "$BD_HOME"
  WORKING_DIR=$(pwd)
+ cd "$CUR_DIR"
 
  SCRIPT_CONTENT="[Unit]
 \nDescription=BDJuno parser
@@ -84,6 +87,7 @@ if [ $DISABLE_SYSTEMCTL -eq 0 ]; then
 
 \n[Service]
 \nUser=$USER
+\nWorkingDirectory=$WORKING_DIR
 \nExecStart=$BD_BINARY start --home $BD_HOME
 \nRestart=always
 \nRestartSec=3

big-dipper-as-block-explorer/.gitignore

@@ -15,7 +15,7 @@ if [ -f "./_config.sh" ]; then
  source "./_config.sh"
 else
  echo "ERR: Wrong working directory"
- echo "ERR: Scripts must be executed within [bdjuno] directory"
+ echo "ERR: Scripts must be executed within [big-dipper-as-block-explorer] directory"
  exit 1
 fi
 

bdjuno/1_install-bdjuno.sh renamed to big-dipper-as-block-explorer/1_install-bdjuno.sh

@@ -0,0 +1,151 @@
+#!/bin/bash
+
+command -v npm > /dev/null 2>&1 || { echo >&2 "npm is required"; exit 1; }
+
+source ../env.sh
+
+CHAIN_NO=$1
+
+if [ -f "./override-env.sh" ]; then
+ source "./override-env.sh"
+fi
+
+if [ -f "./_config.sh" ]; then
+ source "./_config.sh"
+else
+ echo "ERR: Wrong working directory"
+ echo "ERR: Scripts must be executed within [big-dipper-as-block-explorer] directory"
+ exit 1
+fi
+
+# Validate input
+if [ "$CHAIN_NO" = "1" ]; then
+ echo "Network 1"
+elif [ "$CHAIN_NO" = "2" ]; then
+ echo "Network 2"
+else
+ echo 'Missing or incorrect chain no as first argument, valid input is 1 or 2'
+ echo 'For example:'
+ echo " $0 1"
+ echo " or: $0 2"
+ exit 1
+fi
+
+# Stop service if exists
+[ $DISABLE_SYSTEMCTL -eq 0 ] && {
+echo "Stopping $BD2_SERVICE_NAME service"; 
+sudo systemctl stop $BD2_SERVICE_NAME > /dev/null 2>&1;
+sudo systemctl disable $BD2_SERVICE_NAME > /dev/null 2>&1;
+}
+
+# Check Big Dipper 2.0 source
+if [ -d "$BD2_SOURCE_DIR" ]; then
+ echo "Big Dipper 2.0 repo was downloaded"
+else
+ echo "Downloading Big Dipper 2.0 source code from branch $BD2_BRANCH"
+ git clone "https://github.com/forbole/big-dipper-2.0-cosmos.git" --branch "$BD2_BRANCH" --single-branch "$BD2_SOURCE_DIR"
+
+ if [ $? -ne 0 ]; then
+ echo "Git clone Big Dipper 2.0 from branch $BD2_BRANCH was failed"
+ exit 1
+ fi
+fi
+
+# npm environment variables
+NPM_ENV="$BD2_SOURCE_DIR/.env"
+echo "Setting up file $NPM_ENV"
+echo -e "
+NEXT_PUBLIC_GRAPHQL_URL=http://$BD2_PUBLIC_DOMAIN:$BD_HASURA_PORT/v1/graphql
+\nNEXT_PUBLIC_GRAPHQL_WS=ws://$BD2_PUBLIC_DOMAIN:$BD_HASURA_PORT/v1/graphql
+\nNODE_ENV=test
+\nPORT=$BD2_PORT
+\nNEXT_PUBLIC_URL=http://$BD2_PUBLIC_DOMAIN:$BD2_PORT
+\nNEXT_PUBLIC_RPC_WEBSOCKET=ws://$BD2_PUBLIC_RPC_26657/websocket
+\nNEXT_PUBLIC_CHAIN_TYPE=mainnet
+" > "$NPM_ENV"
+
+# BD2 chain config
+BD2_CHAIN_CONFIG_MAINNET="$BD2_SOURCE_DIR/src/configs/chain_config.mainnet.json"
+BD2_CHAIN_CONFIG_TESTNET="$BD2_SOURCE_DIR/src/configs/chain_config.testnet.json"
+BD2_CHAIN_CONFIG_TMP="$BD2_SOURCE_DIR/src/configs/tmp_chain_config.json"
+echo "Setting up file mainnet chain config"
+cat "$BD2_CHAIN_CONFIG_MAINNET" | jq '.title="'$DENOM_SYMBOL' Block Explorer"' > $BD2_CHAIN_CONFIG_TMP && mv $BD2_CHAIN_CONFIG_TMP $BD2_CHAIN_CONFIG_MAINNET
+cat "$BD2_CHAIN_CONFIG_MAINNET" | jq '.network="'$CHAIN_ID'"' > $BD2_CHAIN_CONFIG_TMP && mv $BD2_CHAIN_CONFIG_TMP $BD2_CHAIN_CONFIG_MAINNET
+cat "$BD2_CHAIN_CONFIG_MAINNET" | jq '.prefix["consensus"]="'$DENOM_SYMBOL'valcons"' > $BD2_CHAIN_CONFIG_TMP && mv $BD2_CHAIN_CONFIG_TMP $BD2_CHAIN_CONFIG_MAINNET
+cat "$BD2_CHAIN_CONFIG_MAINNET" | jq '.prefix["validator"]="'$DENOM_SYMBOL'valoper"' > $BD2_CHAIN_CONFIG_TMP && mv $BD2_CHAIN_CONFIG_TMP $BD2_CHAIN_CONFIG_MAINNET
+cat "$BD2_CHAIN_CONFIG_MAINNET" | jq '.prefix["account"]="'$ACCOUNT_PREFIX'"' > $BD2_CHAIN_CONFIG_TMP && mv $BD2_CHAIN_CONFIG_TMP $BD2_CHAIN_CONFIG_MAINNET
+cat "$BD2_CHAIN_CONFIG_MAINNET" | jq '.primaryTokenUnit="'$MIN_DENOM_SYMBOL'"' > $BD2_CHAIN_CONFIG_TMP && mv $BD2_CHAIN_CONFIG_TMP $BD2_CHAIN_CONFIG_MAINNET
+cat "$BD2_CHAIN_CONFIG_MAINNET" | jq '.votingPowerTokenUnit="'$MIN_DENOM_SYMBOL'"' > $BD2_CHAIN_CONFIG_TMP && mv $BD2_CHAIN_CONFIG_TMP $BD2_CHAIN_CONFIG_MAINNET
+cat "$BD2_CHAIN_CONFIG_MAINNET" | jq '.tokenUnits["'$MIN_DENOM_SYMBOL'"]["display"]="'$DENOM_SYMBOL'"' > $BD2_CHAIN_CONFIG_TMP && mv $BD2_CHAIN_CONFIG_TMP $BD2_CHAIN_CONFIG_MAINNET
+cat "$BD2_CHAIN_CONFIG_MAINNET" | jq '.tokenUnits["'$MIN_DENOM_SYMBOL'"]["exponent"]='$DENOM_EXPONENT > $BD2_CHAIN_CONFIG_TMP && mv $BD2_CHAIN_CONFIG_TMP $BD2_CHAIN_CONFIG_MAINNET
+echo "Setting up file testnet chain config"
+cp "$BD2_CHAIN_CONFIG_MAINNET" "$BD2_CHAIN_CONFIG_TESTNET"
+
+# BD2 codegen config
+BD2_CODEGEN_YML="$BD2_SOURCE_DIR/codegen.yml"
+BD2_CODEGEN_YML_TMP="$BD2_SOURCE_DIR/tmp_codegen.yml"
+echo "Setting up file $BD2_CODEGEN_YML"
+cat "$BD2_CODEGEN_YML" | yq '.generates["./src/graphql/types/general_types.tsx"]["schema"]="http://'$BD2_PUBLIC_DOMAIN':'$BD_HASURA_PORT'/v1/graphql"' -Y > "$BD2_CODEGEN_YML_TMP" && mv "$BD2_CODEGEN_YML_TMP" "$BD2_CODEGEN_YML"
+
+CUR_DIR=$(pwd)
+cd "$BD2_SOURCE_DIR"
+WORKING_DIR=$(pwd)
+# Build
+## Install graphql-codegen 
+npm i -D @graphql-codegen/cli > /dev/null 2>&1
+[ $? -eq 0 ] || { echo "Failed to install @graphql-codegen/cli"; exit 1; }
+## Gen code
+echo 'Generating code'
+npm run graphql:codegen
+[ $? -eq 0 ] || { echo "Failed to run graphql:codegen"; exit 1; }
+#echo 'Build'
+#npm run build
+#[ $? -eq 0 ] || { echo "Failed to build"; exit 1; }
+
+cd "$CUR_DIR"
+
+# Re-Start service
+if [ $DISABLE_SYSTEMCTL -eq 0 ]; then
+ SERVICE_FILE="/etc/systemd/system/$BD2_SERVICE_NAME.service"
+echo
+ if [ -f "$SERVICE_FILE" ]; then
+ echo "You are ready to restart $BD2_SERVICE_NAME service (sudo systemctl restart $BD2_SERVICE_NAME)"
+
+[ $EXTRA_FUNC -eq 1 ] && sudo systemctl start $BD2_SERVICE_NAME
+ else
+ echo "You can paste the following content to $SERVICE_FILE file to create a daemon service"
+ echo "sudo vi $SERVICE_FILE"
+ echo
+
+ SCRIPT_CONTENT="[Unit]
+\nDescription=Big Dipper 2.0 for $DENOM_SYMBOL chain (network $CHAIN_NO)
+\nAfter=network-online.target
+
+\n[Service]
+\nUser=$USER
+\nWorkingDirectory=$WORKING_DIR
+\nExecStart=$(which npm) run dev
+\nRestart=always
+\nRestartSec=3
+\nLimitNOFILE=4096
+
+\n[Install]
+\nWantedBy=multi-user.target"
+echo -e $SCRIPT_CONTENT
+ echo
+ echo "sudo systemctl enable $BD2_SERVICE_NAME"
+ echo "sudo systemctl start $BD2_SERVICE_NAME"
+
+ [ $EXTRA_FUNC -eq 1 ] && {
+ echo 'Creating service '$BD2_SERVICE_NAME;
+ echo -e $SCRIPT_CONTENT | sudo tee $SERVICE_FILE > /dev/null;
+ sudo systemctl daemon-reload;
+ sudo systemctl enable $BD2_SERVICE_NAME;
+sudo systemctl start $BD2_SERVICE_NAME;
+ sudo journalctl -fu $BD2_SERVICE_NAME;
+ }
+ fi
+else
+ echo "OK, you can run it now"
+ echo "Hint: npm run dev"
+fi