Is there any benchmark for hmq?

[heliping]

who has the experience for the hmq's benchmark? comparing with emqx or others brokers....

[lucasvmx]

tested with ./mqtt-stresser -broker tcp://localhost:1883 -num-clients=500 -num-messages=100. You can download it from here: https://github.com/inovex/mqtt-stresser

Configuration: 500 concurrent clients and 100 messages per client
Total: 50000 messages
QoS: 0

Mosquitto version 2.0.11

# Configuration
Concurrent Clients: 500
Messages / Client:  50000

# Results
Published Messages: 50000 (100%)
Received Messages:  50000 (100%)
Completed:          500 (100%)
Errors:             0 (0%)

# Publishing Throughput
Fastest: 229259 msg/sec
Slowest: 2715 msg/sec
Median: 12763 msg/sec

  < 25369 msg/sec  66%
  < 48024 msg/sec  77%
  < 70678 msg/sec  81%
  < 93333 msg/sec  84%
  < 115987 msg/sec  91%
  < 138641 msg/sec  93%
  < 161296 msg/sec  94%
  < 183950 msg/sec  96%
  < 206605 msg/sec  98%
  < 229259 msg/sec  100%
  < 251913 msg/sec  100%

# Receiving Througput
Fastest: 52674 msg/sec
Slowest: 912 msg/sec
Median: 1391 msg/sec

  < 6088 msg/sec  97%
  < 11264 msg/sec  100%
  < 26793 msg/sec  100%
  < 57850 msg/sec  100%

EMQX version 4.4.4

# Configuration
Concurrent Clients: 500
Messages / Client:  50000

# Results
Published Messages: 50000 (100%)
Received Messages:  50000 (100%)
Completed:          500 (100%)
Errors:             0 (0%)

# Publishing Throughput
Fastest: 229252 msg/sec
Slowest: 1132 msg/sec
Median: 16301 msg/sec

  < 23944 msg/sec  54%
  < 46756 msg/sec  65%
  < 69568 msg/sec  76%
  < 92380 msg/sec  84%
  < 115192 msg/sec  91%
  < 138004 msg/sec  94%
  < 160816 msg/sec  96%
  < 183628 msg/sec  97%
  < 206440 msg/sec  100%
  < 229252 msg/sec  100%
  < 252064 msg/sec  100%

# Receiving Througput
Fastest: 1318166 msg/sec
Slowest: 1116 msg/sec
Median: 2457 msg/sec

  < 132821 msg/sec  98%
  < 791346 msg/sec  99%
  < 1054756 msg/sec  99%
  < 1186461 msg/sec  99%
  < 1318166 msg/sec  100%
  < 1449871 msg/sec  100%

HMQ (commit 5dc2114)

# Configuration
Concurrent Clients: 500
Messages / Client:  50000

# Results
Published Messages: 50000 (100%)
Received Messages:  50000 (100%)
Completed:          500 (100%)
Errors:             0 (0%)

# Publishing Throughput
Fastest: 250470 msg/sec
Slowest: 996 msg/sec
Median: 5256 msg/sec

  < 25943 msg/sec  75%
  < 50891 msg/sec  81%
  < 75838 msg/sec  88%
  < 100786 msg/sec  91%
  < 125733 msg/sec  94%
  < 150681 msg/sec  95%
  < 175628 msg/sec  96%
  < 200575 msg/sec  97%
  < 225523 msg/sec  99%
  < 250470 msg/sec  100%
  < 275418 msg/sec  100%

# Receiving Througput
Fastest: 1272977 msg/sec
Slowest: 1083 msg/sec
Median: 9457 msg/sec

  < 128272 msg/sec  84%
  < 255462 msg/sec  86%
  < 382651 msg/sec  87%
  < 509840 msg/sec  87%
  < 637030 msg/sec  88%
  < 764219 msg/sec  88%
  < 891409 msg/sec  89%
  < 1018598 msg/sec  90%
  < 1145788 msg/sec  93%
  < 1272977 msg/sec  100%
  < 1400167 msg/sec  100%