Performance Test Report for EMQX Cloud: 50,000 CONN / 50,000 TPS

The purpose of this test is to demonstrate that EMQ X Cloud with the SPEC of 50,000 CONN / 50,000 TPS can support 50,000 concurrent connections and 50,000 message TPS.

To verify the capability, we picked two scenarios.

The first was the Pub:Sub 1:1 scenario, where the number of pub clients was the same as the sub clients, and each pub client had a dedicated topic to publish messages, meanwhile, each sub client subscribed to one different topic. It meant for a message EMQ X Cloud received, it only forwarded to one sub client.

In this testing, the 1:1 scenario had 25,000 pub clients and 25,000 subscribers with 25,000 different topics (1 subscriber per topic), and each pub client published 1 message per second with different size of payload, meaning that “message in” throughput and “message out” were the same. Hence, the total message throughput was 50,000 per second.

The second scenario was fan-out, where 50,000 clients were subscribed to 1 topic. It meant, for a message EMQ X Cloud received, it forwarded to 50,000 subscribers. So, if the pub client published 1 message per second, the message-out throughput was 50,000.

The detailed test cases we executed are as follows:

Pub:Sub 1:1

1. 50,000 concurrent connections, 5,0000 QoS 0 message TPS with 10k payload size (25,000 pub+25,000 sub)
2. 50,000 concurrent connections, 50,000 QoS 0 message TPS with 20k payload size (25,000 pub+25,000 sub)

Fan-out

1. 50,000 concurrent connections, 50,000 QoS 0 message TPS with 10k payload size (1 pub+50,000 sub)
2. 50,000 concurrent connections, 50,000 QoS 0 message TPS with 32k payload size (1 pub+50,000 sub)

Test Results