Request routing by echo is not stable as httpserver default

[vuhoanghiep1993]

I have a problem when use echo as http router
When use default server like https://gobyexample.com/http-servers and use echo as router

func main() {
  e := echo.New()
  // add middleware and routes
  // ...
  s := http.Server{
    Addr:        ":8080",
    Handler:     e,
    //ReadTimeout: 30 * time.Second, // customize http.Server timeouts
  }
  if err := s.ListenAndServe(); err != http.ErrServerClosed {
    log.Fatal(err)
  }
}

I found the response time by echo is increase and not stable as golang httpserver default when use jmeter to test ? I don't know why? Does anyone test this case

[aldas]

You should start by excluding you own code from the tests to pinpoint the problem area.

For example start with:

func main() {
	e := echo.New()

	e.GET("/", func(c echo.Context) error {
		return c.String(http.StatusOK, "OK")
	})

	s := http.Server{
		Addr:        ":8080",
		Handler:     e,
	}
	if err := s.ListenAndServe(); err != nil && !errors.Is(err, http.ErrServerClosed) {
		log.Fatal(err)
	}
}

does this cause response time to increase? For your own code try to see if this is caused by some specific routes. For how long/how many requests you need to run to see decrease? Are there errors in logs?

NB: e.Start and s.ListenAndServe have almost no difference with these settings.

[vuhoanghiep1993]

I write log middleware to calculate processing time of next(c) function, the processing time is still low but the enlapse time in jmeter is high, I think request is pending in a queue before send to handler to processing?

[aldas]

Are you sure that your logger it not slowing it down? remove that middleware and see if performance still degrades. It could be that your logger can not handle many concurrent writes.

[vuhoanghiep1993]

Thank you for your support, I found problem because my middleware handle request not right, when I comment it work perfectly

[aldas]

My recommendation is to create Benchmark test for your middleware and profile it with pprof. There are articles that showcase this approach. First thing I found from google https://medium.com/@felipedutratine/profile-your-benchmark-with-pprof-fb7070ee1a94

This is example how to benchmark middlewares

echo/middleware/compress_test.go

Line 185 in 40eb889

func BenchmarkGzip(b *testing.B) {