fluent安装(fluent安装包)

本文链接地址: Kubernetes EFK(Elastic Search, Fluentd, Kibana)搭建 - 慢慢的回味

上一次，我们完成了搭建单节点Kubernetes环境。现在在其基础上继续搭建EFK(Elastic Search, Fluentd, Kibana)日志收集系统。

目录

Elasticarch 安装时需要开启HTTPS。

kubectl create namespace efk cat <<EOF > es_extracfg.yaml xpack: curity: enabled: "true" authc: api_key: enabled: "true"EOF helm upgrade --install my-elasticarch bitnami/elasticarch -n efk --t curity.enabled=true --t curity.elasticPassword=YourPassword --t curity.tls.autoGenerated=true --t-file extraConfig=es_extracfg.yaml

需要修改Stateful Set “my-elasticarch-coordinating-only”和“my-elasticarch-master”的内容如下，否则数据传输不成功：

resources: requests: cpu: 25m memory: 512MiKibana 安装

Kibana 安装的时候需要指定Elastic Search服务器的地址，密码为Elastic Search服务器的密码。这儿必须连接HTTPS接口。

helm upgrade --install my-kibana bitnami/kibana -n efk --t elasticarch.hosts[0]=my-elasticarch-coordinating-only --t elasticarch.port=9200 --t elasticarch.curity.auth.enabled=true --t elasticarch.curity.auth.kibanaPassword=YourPassword --t elasticarch.curity.tls.enabled=true --t elasticarch.curity.tls.verificationMode=noneFluentd 安装

手动添加如下配置，通过@type elasticarch把日志转发到Elastic Search服务器上面。

kind: ConfigMapapiVersion: v1metadata: name: elasticarch-output namespace: efkdata: fluentd.conf: | # Prometheus Exporter Plugin # input plugin that exports metrics <source> @type prometheus port 24231 </source> # input plugin that collects metrics from MonitorAgent <source> @type prometheus_monitor <labels> host ${hostname} </labels> </source> # input plugin that collects metrics for output plugin <source> @type prometheus_output_monitor <labels> host ${hostname} </labels> </source> # Ignore fluentd own events <match fluent.**> @type null </match> # TCP input to receive logs from the forwarders <source> @type forward bind 0.0.0.0 port 24224 </source> # HTTP input for the liveness and readiness probes <source> @type http bind 0.0.0.0 port 9880 </source> # Throw the healthcheck to the standard output instead of forwarding it <match fluentd.healthcheck> @type stdout </match> # Send the logs to the standard output <match **> @type elasticarch include_tag_key true scheme https host my-elasticarch-coordinating-only port 9200 ur elastic password YourPassword ssl_verify fal logstash_format true logstash_prefix k8s request_timeout 30s <buffer> @type file path /opt/bitnami/fluentd/logs/buffers/logs.buffer flush_thread_count 2 flush_interval 5s </buffer> </match>

helm upgrade --install my-fluentd bitnami/fluentd -n efk --t aggregator.configMap=elasticarch-outputKibana 管理界面

添加Index Pattern后可以查看log