Merge pull request #153 from flrdv/master

Remove mentioning excluded packages, add indigo framework

Author: smallnest

README.md

@@ -15,9 +15,7 @@ This benchmark suite aims to compare the performance of Go web frameworks. It is
 
 **Only test those webframeworks which are stable**
 
-* [ace](https://github.com/plimble/ace)
 * [atreugo](https://github.com/savsgio/atreugo)
-* [aurora](https://github.com/aurora-go/aurora)
 * [baa](https://github.com/go-baa/baa)
 * [beego](https://github.com/astaxie/beego)
 * [bone](https://github.com/go-zoo/bone)
@@ -27,48 +25,38 @@ This benchmark suite aims to compare the performance of Go web frameworks. It is
 * [denco](https://github.com/naoina/denco)
 * [don](https://github.com/abemedia/go-don)
 * [echo](https://github.com/labstack/echo)
-* [echo-slim](https://github.com/partialize/echo-slim)
 * [fasthttp-routing](https://github.com/qiangxue/fasthttp-routing)
 * [fasthttp/router](https://github.com/fasthttp/router)
 * [fasthttp](https://github.com/valyala/fasthttp)
-* [fasthttprouter](https://github.com/buaazp/fasthttprouter)
-* [fastRouter](https://github.com/razonyang/fastrouter)
 * [fiber](https://gofiber.io/)
-* [flygo](https://github.com/billcoding/flygo)
 * [gear](http://github.com/teambition/gear)
 * [gearbox](https://github.com/gogearbox/gearbox)
 * [gem](https://github.com/go-gem/gem)
 * [gin](https://github.com/gin-gonic/gin)
 * [goframe](https://github.com/gogf/gf)
-* [go-json-rest](https://github.com/ant0ine/go-json-rest)
 * [go-ozzo](https://github.com/go-ozzo/ozzo-routing)
 * [go-restful](https://github.com/emicklei/go-restful)
 * [go-tigertonic](https://github.com/rcrowley/go-tigertonic)
 * [goji](https://github.com/zenazn/goji/web)
 * [goji](http://goji.io)
 * [golf](https://github.com/dinever/golf)
-* [gongular](https://github.com/mustafaakin/gongular)
 * [gorilla](https://github.com/gorilla/mux)
 * [gorouter](https://github.com/vardius/gorouter)
 * [goyave](https://github.com/System-Glitch/goyave)
-* [~~gramework~~](https://github.com/gramework/gramework):its init function pollutes the test so it has been removed from test.
 * [httprouter](https://github.com/julienschmidt/httprouter)
 * [httptreemux](https://github.com/dimfeld/httptreemux)
+* [indigo](https://github.com/indigo-web/indigo)
 * [lars](https://github.com/go-playground/lars)
 * [lion](https://github.com/celrenheit/lion)
 * [macaron](https://github.com/Unknwon/macaron)
-* [martini](https://github.com/go-martini/martini)
 * [muxie](https://github.com/kataras/muxie)
 * [negroni](https://github.com/urfave/negroni)
-* [neo](https://github.com/ivpusic/neo)
 * [pat](https://github.com/bmizerany/pat)
 * [pulse](https://github.com/gopulse/pulse)
 * [pure](https://github.com/go-playground/pure)
 * [r2router](https://github.com/vanng822/r2router)
-* [siris](https://github.com/go-siris/siris)
 * [tango](https://github.com/lunny/tango)
 * [tinyrouter](https://github.com/go101/tinyrouter)
-* [traffic](https://github.com/pilu/traffic)
 * [treemux](https://github.com/vmihailenco/treemux)
 * [violetear](https://github.com/nbari/violetear)
 * [vulcan](https://github.com/mailgun/route)
@@ -158,7 +146,7 @@ It takes a while to install a large number of dependencies that need to be downl
 
 ```
 cd $GOPATH/src/github.com/smallnest/go-web-framework-benchmark
-go build -o  gowebbenchmark *.go
+go build -o gowebbenchmark .
 ./test.sh
 ```
 
@@ -183,7 +171,7 @@ It will generate test results in processtime.csv and concurrency.csv. You can m
 * If you want to test some of web frameworks, you can modify the test script and only keep your selected web frameworks:
 ```
 ……
-web_frameworks=( "default" "ace" "beego" "bone" "denco" "echov1" "echov2standard" "echov2fasthttp" "fasthttp-raw" "fasthttprouter" "fasthttp-routing" "gin" "gocraftWeb" "goji" "gojiv2" "gojsonrest" "gorestful" "gorilla" "httprouter" "httptreemux" "lars" "lion" "macaron" "martini" "pat" "r2router" "tango" "tiger" "traffic" "violetear" "vulcan")
+web_frameworks=("default" "atreugo" "beego" "bone" "chi" "denco" "don" "echo" "fasthttp" "fasthttp-routing" "fasthttp/router" "fiber" "gear" "gearbox" "gin" "goframe" "goji" "gorestful" "gorilla" "gorouter" "gorouterfasthttp" "go-ozzo" "goyave" "httprouter" "httptreemux" "indigo" "lars" "lion" "muxie" "negroni" "pat" "pulse" "pure" "r2router" "tango" "tiger" "tinyrouter" "violetear" "vulcan" "webgo")
 ……
 ```
 * If you want to test all cases, you can run:
@@ -192,9 +180,12 @@ web_frameworks=( "default" "ace" "beego" "bone" "denco" "echov1" "echov2standard
 ./test-all.sh
 ```
 
-## Plot
-you can run the shell script `plot.sh` in testresults directory and it can generate all images in its parent directory.
+NOTE: comparing 2 webframeworks consumes approx. 11-13 minutes (doesn't depend on the machine). Just `test.sh` with all
+the webframeworks enabled will take a couple of hours to run.
 
+## Plot
+All the graphs are generated automatically as the `./test.sh` finishes. However, if the run was interrupted, you can
+generate them manually of partial data by executing `plot.sh` in testresults directory.
 
 ### Add new web framework
 Welcome to add new Go web frameworks. You can follow the below steps and send me a pull request.

go.mod

@@ -3,21 +3,18 @@ module github.com/smallnest/go-web-framework-benchmark
 go 1.20
 
 require (
-clevergo.tech/clevergo v0.6.0
 github.com/abemedia/go-don v0.2.1
 github.com/ant0ine/go-json-rest v3.3.2+incompatible
 github.com/astaxie/beego v1.12.3
 github.com/bmizerany/pat v0.0.0-20210406213842-e4b6760bdd6f
 github.com/bnkamalesh/webgo/v7 v7.0.0
-github.com/buaazp/fasthttprouter v0.1.1
 github.com/claygod/Bxog v0.0.0-20220907175109-bec75fbdd5e7
 github.com/dimfeld/httptreemux v5.0.1+incompatible
 github.com/dinever/golf v0.3.0
 github.com/emicklei/go-restful v2.16.0+incompatible
 github.com/fasthttp/router v1.4.22
 github.com/gin-gonic/gin v1.9.1
 github.com/go-chi/chi/v5 v5.0.10
-github.com/go-martini/martini v0.0.0-20170121215854-22fa46961aab
 github.com/go-ozzo/ozzo-routing v2.1.4+incompatible
 github.com/go-playground/lars v4.0.1+incompatible
 github.com/go-playground/pure v4.2.0+incompatible
@@ -28,26 +25,19 @@ require (
 github.com/gogf/gf/v2 v2.5.7
 github.com/gopulse/pulse v1.1.0
 github.com/gorilla/mux v1.8.1
-github.com/gowww/router v1.0.0
-github.com/indigo-web/indigo v0.15.7
-github.com/ivpusic/neo v0.3.0
+github.com/indigo-web/indigo v0.15.8
 github.com/julienschmidt/httprouter v1.3.0
 github.com/kataras/muxie v1.1.2
 github.com/labstack/echo/v4 v4.11.3
 github.com/lunny/log v0.0.0-20160921050905-7887c61bf0de
 github.com/lunny/tango v0.5.6
 github.com/mailgun/route v0.0.0-20191025171320-daa4df6c711a
-github.com/mustafaakin/gongular v0.0.0-20200705144045-a428565ae628
 github.com/naoina/denco v0.0.0-20180930074809-8475105a6b4c
 github.com/nbari/violetear v0.0.0-20210524103009-ce83b52538c9
-github.com/partialize/echo-slim/v4 v4.9.1
-github.com/pilu/traffic v0.5.3
 github.com/qiangxue/fasthttp-routing v0.0.0-20160225050629-6ccdc2a18d87
-github.com/razonyang/fastrouter v0.1.0
 github.com/rcrowley/go-tigertonic v0.0.0-20170420123839-fe6b9f080eb7
 github.com/savsgio/atreugo/v11 v11.12.0
 github.com/teambition/gear v1.27.3
-github.com/tockins/fresh v0.0.0-20181012144221-d8b891ad12e4
 github.com/urfave/negroni v1.0.0
 github.com/valyala/fasthttp v1.51.0
 github.com/vanng822/r2router v0.0.0-20150523112421-1023140a4f30
@@ -57,27 +47,23 @@ require (
 golang.org/x/net v0.19.0
 gopkg.in/baa.v1 v1.2.32
 gopkg.in/celrenheit/lion.v1 v1.0.0-20161101201550-7c6ce5d22d64
-gopkg.in/macaron.v1 v1.5.0
 goyave.dev/goyave/v4 v4.4.11
 )
 
 require (
-clevergo.tech/log v0.3.0 // indirect
 gitea.com/lunny/log v0.0.0-20190322053110-01b5df579c4e // indirect
 github.com/BurntSushi/toml v1.3.2 // indirect
 github.com/Code-Hex/uniseg v0.2.0 // indirect
 github.com/abemedia/fasthttpfs v0.0.0-20220405193636-731805b0c723 // indirect
 github.com/abemedia/httprouter v0.0.0-20230505023925-232e0e5a4b1b // indirect
 github.com/andybalholm/brotli v1.0.6 // indirect
-github.com/asaskevich/govalidator v0.0.0-20230301143203-a9d515a09cc2 // indirect
 github.com/beorn7/perks v1.0.1 // indirect
 github.com/bytedance/sonic v1.10.2 // indirect
 github.com/celrenheit/htest v0.0.0-20170621160705-e34d50431e7f // indirect
 github.com/cespare/xxhash/v2 v2.2.0 // indirect
 github.com/chenzhuoyu/base64x v0.0.0-20230717121745-296ad89f973d // indirect
 github.com/chenzhuoyu/iasm v0.9.1 // indirect
 github.com/clbanning/mxj/v2 v2.7.0 // indirect
-github.com/codegangsta/inject v0.0.0-20150114235600-33e0aa1cb7c0 // indirect
 github.com/common-nighthawk/go-figure v0.0.0-20210622060536-734e95fb86be // indirect
 github.com/davecgh/go-spew v1.1.1 // indirect
 github.com/fatih/color v1.16.0 // indirect
@@ -88,15 +74,14 @@ require (
 github.com/go-http-utils/negotiator v1.0.0 // indirect
 github.com/go-logr/logr v1.3.0 // indirect
 github.com/go-logr/stdr v1.2.2 // indirect
-github.com/go-macaron/inject v0.0.0-20200308113650-138e5925c53b // indirect
 github.com/go-playground/form v3.1.4+incompatible // indirect
 github.com/go-playground/locales v0.14.1 // indirect
 github.com/go-playground/universal-translator v0.18.1 // indirect
 github.com/go-playground/validator/v10 v10.16.0 // indirect
 github.com/goccy/go-json v0.10.2 // indirect
-github.com/golang-jwt/jwt v3.2.2+incompatible // indirect
 github.com/golang/gddo v0.0.0-20210115222349-20d68f94ee1f // indirect
 github.com/google/uuid v1.4.0 // indirect
+github.com/gopherjs/gopherjs v0.0.0-20190430165422-3e4dfb77656c // indirect
 github.com/gorilla/websocket v1.5.1 // indirect
 github.com/gravitational/trace v1.3.1 // indirect
 github.com/grokify/html-strip-tags-go v0.1.0 // indirect
@@ -105,10 +90,6 @@ require (
 github.com/indigo-web/chunkedbody v0.1.0 // indirect
 github.com/indigo-web/iter v0.1.0 // indirect
 github.com/indigo-web/utils v0.6.1 // indirect
-github.com/ivpusic/go-clicolor v0.0.0-20150828210804-23f0b77f328a // indirect
-github.com/ivpusic/golog v0.0.0-20170608213328-28640bee649f // indirect
-github.com/ivpusic/httpcheck v0.0.0-20170215120547-c49b174389ac // indirect
-github.com/ivpusic/urlregex v0.0.0-20160128000749-4dd86e784405 // indirect
 github.com/jinzhu/inflection v1.0.0 // indirect
 github.com/jinzhu/now v1.1.5 // indirect
 github.com/jonboulle/clockwork v0.4.0 // indirect
@@ -126,8 +107,6 @@ require (
 github.com/modern-go/reflect2 v1.0.2 // indirect
 github.com/olekukonko/tablewriter v0.0.5 // indirect
 github.com/pelletier/go-toml/v2 v2.1.0 // indirect
-github.com/pilu/config v0.0.0-20131214182432-3eb99e6c0b9a // indirect
-github.com/pilu/miniassert v0.0.0-20140522125902-bee63581261a // indirect
 github.com/pmezard/go-difflib v1.0.0 // indirect
 github.com/prometheus/client_golang v1.17.0 // indirect
 github.com/prometheus/client_model v0.5.0 // indirect
@@ -138,12 +117,12 @@ require (
 github.com/savsgio/gotils v0.0.0-20230208104028-c358bd845dee // indirect
 github.com/shiena/ansicolor v0.0.0-20230509054315-a9deabde6e02 // indirect
 github.com/sirupsen/logrus v1.9.3 // indirect
+github.com/smartystreets/assertions v1.0.1 // indirect
 github.com/smartystreets/goconvey v1.6.4 // indirect
 github.com/stretchr/testify v1.8.4 // indirect
 github.com/teambition/trie-mux v1.5.2 // indirect
 github.com/twitchyliquid64/golang-asm v0.15.1 // indirect
 github.com/ugorji/go/codec v1.2.12 // indirect
-github.com/unknwon/com v1.0.1 // indirect
 github.com/valyala/bytebufferpool v1.0.0 // indirect
 github.com/valyala/fasttemplate v1.2.2 // indirect
 github.com/valyala/tcplisten v1.0.0 // indirect
@@ -157,10 +136,8 @@ require (
 golang.org/x/sys v0.15.0 // indirect
 golang.org/x/term v0.15.0 // indirect
 golang.org/x/text v0.14.0 // indirect
-golang.org/x/time v0.5.0 // indirect
 google.golang.org/protobuf v1.31.0 // indirect
 gopkg.in/go-playground/assert.v1 v1.2.1 // indirect
-gopkg.in/ini.v1 v1.67.0 // indirect
 gopkg.in/yaml.v2 v2.4.0 // indirect
 gopkg.in/yaml.v3 v3.0.1 // indirect
 gorm.io/gorm v1.25.5 // indirect