54

Spark Streaming 与 Kafka 整合的改进 | SmartSi

 6 years ago
source link: http://smartsi.club/2018/03/18/improvements-to-kafka-integration-of-spark-streaming/?
Go to the source link to view the article. You can view the picture content, updated content and better typesetting reading experience. If the link is broken, please click the button below to view the snapshot at that time.
Apache Kafka 正在迅速成为最受欢迎的开源流处理平台之一。我们在 Spark Streaming 中也看到了同样的趋势。因此，在 Apache Spark 1.3 中，我们专注于对 Spark Streaming 与 Kafka 集成进行重大改进。主要增加如下： 为 Kafka 新增了 Direct API - 这允许每个 Kafka 记录在发生故障时只处理一次，并且不使用 Write

report

Recommend

About Joyk


Aggregate valuable and interesting links.
Joyk means Joy of geeK