一、安装Hadoop集群
二、编写servlet接口,并配置log4j将数据传送至flume
三、flume安装并配置,将数据传送至hdfs
hadoop和flume的安装这里不写,主要是接口代码和flume配置文件
1、servlet接口,并配置log4j将数据传送至flume
(1)接口代码,将数据写入log4j
public class Pvstat_web extends HttpServlet {
private static final long serialVersionUID = 1L;
private static final Log logger = LogFactory.getLog("weblogger");
@Override
protected void doGet(HttpServletRequest req, HttpServletResponse resp) throws IOException {
List<String> logList = new ArrayList<String>();
...(获取参数值,并添加到list集合)
StringBuffer line = new StringBuffer();
Boolean isfirst = Boolean.valueOf(true);
Iterator<String> it = logList.iterator();
while (it.hasNext()) {
if (isfirst.booleanValue())
isfirst = Boolean.valueOf(false);
else
line.append("