分享web开发知识

注册/登录|最近发布|今日推荐

主页 IT知识网页技术软件开发前端开发代码编程运营维护技术分享教程案例
当前位置:首页 > 教程案例

大数据新手之路二:安装Flume

发布时间:2023-09-06 01:44责任编辑:熊小新关键词:暂无标签

WIN7+Ubuntu16.04+Flume1.8.0

1.下载apache-flume-1.8.0-bin.tar.gz

http://flume.apache.org/download.html

2.解压到/usr/local/flume中

3.设置配置文件/etc/profile文件,增加flume的路径

①vi /etc/profile

export FLUME_HOME=/usr/local/flumeexport PATH=$PATH:$FLUME_HOME/bin

②让配置文件立即生效

source /etc/profile

4.检查flume环境是否生效

flume-ng version

5.在/etc/local/flume/conf中增加一个example.conf文件

# example.conf: A single-node Flume configuration# Name the components on this agenta1.sources = r1a1.sinks = k1a1.channels = c1# Describe/configure the sourcea1.sources.r1.type = netcata1.sources.r1.bind = localhosta1.sources.r1.port = 44444# Describe the sinka1.sinks.k1.type = logger# Use a channel which buffers events in memorya1.channels.c1.type = memorya1.channels.c1.capacity = 1000a1.channels.c1.transactionCapacity = 100# Bind the source and sink to the channela1.sources.r1.channels = c1a1.sinks.k1.channel = c1

6.启动flume

flume-ng agent --conf /usr/local/flume/conf --conf-file /usr/local/flume/conf/example.conf --name a1 -Dflume.root.logger=INFO,console

7.使用telnet连接到flume并发送数据

$ telnet localhost 44444Trying 127.0.0.1...Connected to localhost.localdomain (127.0.0.1).Escape character is ‘^]‘.Hello world! <ENTER>OK

8.在flume的进程中可以看到如下信息

[INFO - org.apache.flume.sink.LoggerSink.process(LoggerSink.java:95)] Event: { headers:{} body: 48 65 6C 6C 6F 20 57 6F 72 6C 64 21 0D ?????????Hello World!. }

以上。

大数据新手之路二:安装Flume

原文地址:https://www.cnblogs.com/chevin/p/8510735.html

知识推荐

我的编程学习网——分享web前端后端开发技术知识。 垃圾信息处理邮箱 tousu563@163.com 网站地图
icp备案号 闽ICP备2023006418号-8 不良信息举报平台 互联网安全管理备案 Copyright 2023 www.wodecom.cn All Rights Reserved