Streaming Your IoT Data to Kafka with EMQX
Experience a hassle-free integration of MQTT and Kafka with minimal coding and setup. Say goodbye to complex processes and embrace streamlined data ingestion.
Why MQTT & Kafka Using EMQX
MQTT
MQTT is the de-facto standard messaging protocol for the Internet of Things (IoT), known for its lightweight and efficient design. It is perfect for connecting millions of IoT devices, even over unreliable networks, while ensuring scalability and reliability.
Kafka
Apache Kafka is a data streaming platform connecting and exchanging data between enterprise systems. However, Kafka is not built for the IoT because it requires a stable network, consumes more resources, and only supports thousands of clients and topics.
EMQX
EMQX is a highly scalable MQTT messaging broker with built-in Kafka integration. EMQX makes MQTT and Kafka a perfect match for connecting millions of IoT devices to enterprise systems and unlocking business value from IoT data.
Full MQTT & Kafka Integration with Minimal Effort
EMQX’s out-of-the-box integration effortlessly streams MQTT messages into Kafka's data flow. With the help of EMQX's built-in SQL-based rule engine, you can easily filter, extract, enrich, and transform MQTT messages, making their ingestion into Kafka seamless and flexible.
Capabilities
Bi-directional Data Bridging
With the built-in data bridge and rule engine, EMQX can consume from and produce message batches to Kafka.
'%3e%3ccircle%20cx='18'%20cy='18'%20r='16'%20stroke='%235E4EFF'%20stroke-width='2'%20stroke-linecap='round'%20stroke-linejoin='round'/%3e%3cpath%20d='M28.5726%2010.1346C26.1706%206.91101%2022.3291%204.82324%2018%204.82324C10.7228%204.82324%204.82349%2010.7225%204.82349%2017.9997'%20stroke='%235E4EFF'%20stroke-width='2'%20stroke-linecap='round'%20stroke-linejoin='round'/%3e%3cpath%20d='M20%2019.4995C17.296%2021.9342%2015.9276%2020.3519%2015.9276%2020.3519C15.9276%2020.3519%2014.4448%2018.7676%2017.1488%2016.3329C19.8528%2013.8982%2025.7196%2011.5352%2025.7196%2011.5352C25.7196%2011.5352%2022.704%2017.0648%2020%2019.4995Z'%20stroke='%235E4EFF'%20stroke-width='2'%20stroke-linecap='round'%20stroke-linejoin='round'/%3e%3c/g%3e%3c/svg%3e){kind=small}
Higher Performance and Reliability
EMQX can write up to 1 million MQTT messages per second to Kafka thanks to the asynchronous and batch processing mechanism.
'%3e%3cpath%20d='M4%2018H25.5'%20stroke='%235E4EFF'%20stroke-width='2'%20stroke-linecap='round'%20stroke-linejoin='round'/%3e%3cpath%20d='M4%2012.5H12L15.5%209'%20stroke='%235E4EFF'%20stroke-width='2'%20stroke-linecap='round'%20stroke-linejoin='round'/%3e%3cpath%20d='M4.5%2024H12.5L16.5%2027'%20stroke='%235E4EFF'%20stroke-width='2'%20stroke-linecap='round'%20stroke-linejoin='round'/%3e%3crect%20x='15.5'%20y='2'%20width='7'%20height='7'%20stroke='%235E4EFF'%20stroke-width='2'%20stroke-linecap='round'%20stroke-linejoin='round'/%3e%3crect%20x='25.5'%20y='14'%20width='7'%20height='7'%20stroke='%235E4EFF'%20stroke-width='2'%20stroke-linecap='round'%20stroke-linejoin='round'/%3e%3crect%20x='16.5'%20y='27'%20width='7'%20height='7'%20stroke='%235E4EFF'%20stroke-width='2'%20stroke-linecap='round'%20stroke-linejoin='round'/%3e%3c/g%3e%3c/svg%3e){kind=small}
Automatic Capacity Expansion
EMQX can automatically discover the partition scale-ups in Kafka without having to re-configure or restart, making it easy to scale up the capacity as your business grows.
'%3e%3ccircle%20cx='18.5'%20cy='21.25'%20r='13.5'%20stroke='%235E4EFF'%20stroke-width='2'%20stroke-linecap='round'%20stroke-linejoin='round'/%3e%3cpath%20d='M18.9717%2012.2041V22.7317L26.9458%2025.7041'%20stroke='%235E4EFF'%20stroke-width='2'%20stroke-linecap='round'%20stroke-linejoin='round'/%3e%3cpath%20d='M18.0178%207.77736V1.96387'%20stroke='%235E4EFF'%20stroke-width='2'%20stroke-linecap='round'%20stroke-linejoin='round'/%3e%3cpath%20d='M12.7144%201.48214H24.1147'%20stroke='%235E4EFF'%20stroke-width='2'%20stroke-linecap='round'%20stroke-linejoin='round'/%3e%3c/g%3e%3c/svg%3e){kind=small}
Low-code Integration with Flows
With the built-in Flow Designer, you can extract, filter, enrich, and transform IoT data and write to a specific Kafka topic without writing code.
Setup in 3 Minutes
With just a few clicks, you can filter, extract, transform, and ingest your IoT data into Kafka using EMQX’s rule engine and flow designer.
