60

大数据平台日志存储分析系统解决方案 | 斑斓

 6 years ago
source link: http://zhangyi.xyz/log-storage-and-analysis-based-on-big-data/?
Go to the source link to view the article. You can view the picture content, updated content and better typesetting reading experience. If the link is broken, please click the button below to view the snapshot at that time.
大数据平台日志存储分析系统是在大数据平台下,针对业务系统产生的日志记录进行存储和分析。日志数据来自ElasticSearch存储的日志历史数据,并将需要存储和分析的日志数据从ElasticSearch中读取到Kafka中。Kafka的消费者在侦听到数据消息进入后,以流方式获取数据写入到HBase中。存储在HBase中的数据则是为日志数据的检索与分析提供服务。Web前端通过调用后端API检索HBas

About Joyk


Aggregate valuable and interesting links.
Joyk means Joy of geeK