This test was conducted on Huawei Cloud. It mainly tested ten million MQTT connections test and various combinations of message throughput test. The related test results are shown below.
Note: Unless otherwise specified, all connections are set as 300 seconds of Ping packet by default.
10 million connections test: This test only tests the connection of MQTT. Except for the fixed time Ping packet, each client does not pub/sub any MQTT message:
- 90% average response time < 2ms; maximum response time is 2.3 seconds
- The average CPU usage per node is about 8%, and the maximum is no more than 20%.
- Average memory usage per node is approximately 9GB
Message throughput test: Background connection of 9 million for simulating clients with connection and sending ping packets, while the remaining 1 million simulates clients for sending actual business data:
- Message body is 88 bytes
- 90% average response time <70ms
- CPU usage increases as message throughput increases
- Average memory usage per node is 9 - 10GB
Message Throughput Test Type 1: Pub Message Test
Except for the 9 million background connections in this type of test, the remaining 1 million business connections only do pub message operations. Test results show that the response time is very small, the CPU usage is less than 25%, and the memory usage is 9GB.
Message throughput test type 2: 500,000 topic usage
Except for the 9 million background connections in this type of test, the remaining 1 million connections mainly conduct message forwarding test using a large number of topics. The test results show that in the case of using 500,000 topics, when the QoS is 0, the throughput of Pub and Sub can reach 200,000/sec respectively. When the QoS is 1, the throughput of Pub and Sub can stably reach 100,000/sec respectively. EMQ X performed well in the scenarios of a large number of topics usage.
Message Throughput Test Type 3: Message Broadcast Test
Except for the 9 million background connections in this type of test, the remaining 1 million connections are mainly used for message broadcast test. In this test scenario, a small number of Pubs are used to send messages to topics, and a large number of Subs subscribe to related topics to broadcast messages to these Subs. The test results show that the message throughput of broadcasting can reach 1.8 million/sec when the QoS is 0, and that of broadcasting can reach 900,000/sec when the QoS is 1.