Skip to content

Github Scraper written in Go to compare against the previous version written in Node

alextanhongpin/go-github-scraper

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

62 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

go-github-scraper

A Github Scraper and recommendation engine written in Go, to replace the previous version written in NodeJS (TypeScript).

Development

Create a .env that contains minimum the following environment variables:

GITHUB_TOKEN=<your_github_token> DB_NAME=<mgo_db_name> DB_HOST=<mgo_db_host> DB_USER=<mgo_db_user> DB_AUTH=<mgo_db_auth> DB_PASS=<mgo_db_pass>

Start

$ make start

Build Docker Image

$ make docker

Tracing

Using opencensus to add jaeger tracing capabilities:

tracing.png

Additional metadata (key-value pairs) can be added for more information:

additional-metadata.png

Stats

------------------------------------------------------------------------------- Language Files Lines Code Comments Blanks ------------------------------------------------------------------------------- Dockerfile 1 56 29 11 16 Go 66 5788 4572 241 975 Makefile 1 40 29 1 10 Markdown 1 41 41 0 0 YAML 1 35 21 12 2 ------------------------------------------------------------------------------- Total 70 5960 4692 265 1003 -------------------------------------------------------------------------------

About

Github Scraper written in Go to compare against the previous version written in Node

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published