graylog-server 未绑定在端口 12900 上

graylog-server 未绑定在端口 12900 上

我遇到的情况是,无论我做什么,graylog-server 都不会绑定到端口 12900。我已使用 github.com/graylog2/graylog-ansible-role 在两个 CentOS 7 VM 上安装了 graylog-server-1.1.6-1.noarch、elasticsearch-1.6.2-1.noarch、mongodb-org-server-2.6.10-1.x86_64、nginx-1.8.0-1.el7.ngx.x86_64 的 rpm。graylog-server 启动,在 /var/log/graylog/server.log 中不记录任何错误,但无法绑定到端口 12900。

[root@doru2 deploy]# ps -eaf | grep graylog-server
graylog   26140  26137  7 19:01 ?        00:02:50 java -Xms1g -Xmx1g -XX:NewRatio=1 -server -XX:+ResizeTLAB -XX:+UseConcMarkSweepGC -XX:+CMSConcurrentMTEnabled -XX:+CMSClassUnloadingEnabled -XX:+UseParNewGC -XX:-OmitStackTraceInFastThrow -jar -Dlog4j.configuration=file:///etc/graylog/server/log4j.xml -Djava.library.path=/usr/share/graylog-server/lib/sigar /usr/share/graylog-server/graylog.jar server -f /etc/graylog/server/server.conf -np

[root@doru2 deploy]# netstat -tunelp
Active Internet connections (only servers)
Proto Recv-Q Send-Q Local Address           Foreign Address         State       User       Inode      PID/Program name    
tcp        0      0 127.0.0.1:27017         0.0.0.0:*               LISTEN      991        100234     25747/mongod        
tcp        0      0 0.0.0.0:111             0.0.0.0:*               LISTEN      0          16996      820/rpcbind         
tcp        0      0 0.0.0.0:80              0.0.0.0:*               LISTEN      0          22667      1563/nginx: master  
tcp        0      0 0.0.0.0:22              0.0.0.0:*               LISTEN      0          22086      1504/sshd           
tcp        0      0 127.0.0.1:25            0.0.0.0:*               LISTEN      0          24601      1994/master         
tcp6       0      0 :::111                  :::*                    LISTEN      0          16999      820/rpcbind         
tcp6       0      0 10.1.10.134:9200        :::*                    LISTEN      990        53978      10878/java          
tcp6       0      0 10.1.10.134:9300        :::*                    LISTEN      990        52910      10878/java          
tcp6       0      0 :::22                   :::*                    LISTEN      0          22088      1504/sshd           
tcp6       0      0 ::1:25                  :::*                    LISTEN      0          24602      1994/master         
udp        0      0 0.0.0.0:111             0.0.0.0:*                           0          16934      820/rpcbind         
udp        0      0 0.0.0.0:123             0.0.0.0:*                           0          17863      813/chronyd         
udp        0      0 127.0.0.1:323           0.0.0.0:*                           0          17865      813/chronyd         
udp        0      0 0.0.0.0:18893           0.0.0.0:*                           0          21509      1311/dhclient       
udp        0      0 0.0.0.0:53726           0.0.0.0:*                           70         18826      793/avahi-daemon: r 
udp        0      0 0.0.0.0:973             0.0.0.0:*                           0          16995      820/rpcbind         
udp        0      0 0.0.0.0:5353            0.0.0.0:*                           70         18825      793/avahi-daemon: r

[root@doru2 deploy]# firewall-cmd --list-all
public (default, active)
  interfaces: eno16777736
  sources: 
  services: dhcpv6-client ssh
  ports: 9200/tcp 9300/udp 12900/tcp 9300/tcp
  masquerade: no
  forward-ports: 
  icmp-blocks: 
  rich rules: 

[root@doru2 deploy]# systemctl status iptables
iptables.service - IPv4 firewall with iptables
   Loaded: loaded (/usr/lib/systemd/system/iptables.service; disabled)
   Active: inactive (dead)

[root@doru2 deploy]# semanage port -l | grep 12900
http_port_t                    tcp      12900, 80, 81, 443, 488, 8008, 8009, 8443, 9000

SElinux 审计日志未显示相关异常。

[root@doru2 deploy]# grep -v -w graylog-web /var/log/audit/audit.log | grep -v -w crond_t
type=MAC_POLICY_LOAD msg=audit(1438973046.052:25205): policy loaded auid=1001 ses=2
type=SYSCALL msg=audit(1438973046.052:25205): arch=c000003e syscall=1 success=yes exit=3770462 a0=4 a1=7f7f2403e010 a2=39885e a3=7ffeb5dd0760 items=0 ppid=69239 pid=69302 auid=1001 uid=0 gid=0 euid=0 suid=0 fsuid=0 egid=0 sgid=0 fsgid=0 tty=pts0 ses=2 comm="load_policy" exe="/usr/sbin/load_policy" subj=unconfined_u:unconfined_r:unconfined_t:s0-s0:c0.c1023 key=(null)
type=MAC_POLICY_LOAD msg=audit(1438973101.674:25222): policy loaded auid=1001 ses=2
type=SYSCALL msg=audit(1438973101.674:25222): arch=c000003e syscall=1 success=yes exit=3770418 a0=4 a1=7f41b3048010 a2=398832 a3=7ffde8b85280 items=0 ppid=69492 pid=69562 auid=1001 uid=0 gid=0 euid=0 suid=0 fsuid=0 egid=0 sgid=0 fsgid=0 tty=pts0 ses=2 comm="load_policy" exe="/usr/sbin/load_policy" subj=unconfined_u:unconfined_r:unconfined_t:s0-s0:c0.c1023 key=(null)
type=USER_AVC msg=audit(1438973169.169:25243): pid=1 uid=0 auid=4294967295 ses=4294967295 subj=system_u:system_r:init_t:s0 msg='avc:  received policyload notice (seqno=2)  exe="/usr/lib/systemd/systemd" sauid=0 hostname=? addr=? terminal=?'
type=USER_AVC msg=audit(1438973169.169:25244): pid=1 uid=0 auid=4294967295 ses=4294967295 subj=system_u:system_r:init_t:s0 msg='avc:  received policyload notice (seqno=3)  exe="/usr/lib/systemd/systemd" sauid=0 hostname=? addr=? terminal=?'
type=SERVICE_STOP msg=audit(1438973169.174:25245): pid=1 uid=0 auid=4294967295 ses=4294967295 subj=system_u:system_r:init_t:s0 msg=' comm="graylog-server" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success'
type=SERVICE_START msg=audit(1438973169.195:25246): pid=1 uid=0 auid=4294967295 ses=4294967295 subj=system_u:system_r:init_t:s0 msg=' comm="graylog-server" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success'

Graylog 服务器日志显示,即使配置为仅使用单播地址,它也会继续注册 zen 多播传输处理程序。

2015-08-06T18:42:36.749-07:00 INFO  [CmdLineTool] Loaded plugins: [Anonymous Usage Statistics 1.1.1 [org.graylog.plugins.usagestatistics.UsageStatsPlugin]]
2015-08-06T18:42:36.879-07:00 INFO  [CmdLineTool] Running with JVM arguments: -Xms256m -Xmx1g -XX:NewRatio=1 -XX:+ResizeTLAB -XX:+UseConcMarkSweepGC -XX:+CMSConcurrentMTEnabled -XX:+CMSClassUnloadingEnabled -XX:+UseParNewGC -XX:-OmitStackTraceInFastThrow -Dlog4j.configuration=file:///etc/graylog/server/log4j.xml -Djava.library.path=/usr/share/graylog-server/lib/sigar
2015-08-06T18:42:40.871-07:00 INFO  [InputBufferImpl] Message journal is enabled.
2015-08-06T18:42:41.234-07:00 INFO  [LogManager] Loading log 'messagejournal-0'
2015-08-06T18:42:41.304-07:00 INFO  [KafkaJournal] Initialized Kafka based journal at /var/lib/graylog-server/journal
2015-08-06T18:42:41.316-07:00 INFO  [InputBufferImpl] Initialized InputBufferImpl with ring size <65536> and wait strategy <BlockingWaitStrategy>, running 2 parallel message handlers.
2015-08-06T18:42:41.486-07:00 INFO  [NodeId] Node ID: 22261716-e535-47eb-a02b-395b2f2983ee
2015-08-06T18:42:41.713-07:00 INFO  [node] [doru2] version[1.6.2], pid[17622], build[6220391/2015-07-29T09:24:47Z]
2015-08-06T18:42:41.713-07:00 INFO  [node] [doru2] initializing ...
2015-08-06T18:42:41.782-07:00 INFO  [plugins] [doru2] loaded [graylog2-monitor], sites []
2015-08-06T18:42:43.988-07:00 WARN  [transport] [doru2] Registered two transport handlers for action internal:discovery/zen/multicast, handlers: org.elasticsearch.discovery.zen.ping.multicast.MulticastZenPing$MulticastPingResponseRequestHandler@171228a4, org.elasticsearch.discovery.zen.ping.multicast.MulticastZenPing$MulticastPingResponseRequestHandler@292a32d1
2015-08-06T18:42:44.727-07:00 WARN  [transport] [doru2] Registered two transport handlers for action internal:discovery/zen/multicast, handlers: org.elasticsearch.discovery.zen.ping.multicast.MulticastZenPing$MulticastPingResponseRequestHandler@22e2821f, org.elasticsearch.discovery.zen.ping.multicast.MulticastZenPing$MulticastPingResponseRequestHandler@171228a4
2015-08-06T18:42:44.729-07:00 WARN  [transport] [doru2] Registered two transport handlers for action internal:discovery/zen/multicast, handlers: org.elasticsearch.discovery.zen.ping.multicast.MulticastZenPing$MulticastPingResponseRequestHandler@7ff210cf, org.elasticsearch.discovery.zen.ping.multicast.MulticastZenPing$MulticastPingResponseRequestHandler@22e2821f
2015-08-06T18:42:44.731-07:00 WARN  [transport] [doru2] Registered two transport handlers for action internal:discovery/zen/multicast, handlers: org.elasticsearch.discovery.zen.ping.multicast.MulticastZenPing$MulticastPingResponseRequestHandler@6d2dc7a8, org.elasticsearch.discovery.zen.ping.multicast.MulticastZenPing$MulticastPingResponseRequestHandler@7ff210cf
2015-08-06T18:42:44.743-07:00 WARN  [transport] [doru2] Registered two transport handlers for action internal:discovery/zen/multicast, handlers: org.elasticsearch.discovery.zen.ping.multicast.MulticastZenPing$MulticastPingResponseRequestHandler@4099f1f0, org.elasticsearch.discovery.zen.ping.multicast.MulticastZenPing$MulticastPingResponseRequestHandler@6d2dc7a8
2015-08-06T18:42:44.744-07:00 WARN  [transport] [doru2] Registered two transport handlers for action internal:discovery/zen/multicast, handlers: org.elasticsearch.discovery.zen.ping.multicast.MulticastZenPing$MulticastPingResponseRequestHandler@3adae4b2, org.elasticsearch.discovery.zen.ping.multicast.MulticastZenPing$MulticastPingResponseRequestHandler@4099f1f0

在 20 分钟的时间跨度内记录了 2300 条警告。/etc/graylog/server/server.conf 的本质是:

[root@doru2 deploy]# grep -v ^\# /etc/graylog/server/server.conf | sort -u
allow_highlighting = false
allow_leading_wildcard_searches = false
dead_letters_enabled = false
elasticsearch_analyzer = standard
elasticsearch_cluster_discovery_timeout = 5000
elasticsearch_cluster_name = graylog-cluster
elasticsearch_config_file = /etc/graylog/server/elasticsearch.yml
elasticsearch_discovery_zen_ping_multicast_enabled = False
elasticsearch_discovery_zen_ping_unicast_hosts = ['10.1.10.133:9300', '10.1.10.134:9300']
elasticsearch_http_enabled = false
elasticsearch_index_prefix = graylog2
elasticsearch_max_docs_per_index = 20000000
elasticsearch_max_number_of_indices = 20
elasticsearch_network_bind_host = 
elasticsearch_network_host = 
elasticsearch_network_publish_host = 
elasticsearch_node_data = false
elasticsearch_node_master = false
elasticsearch_node_name = doru2
elasticsearch_replicas = 0
elasticsearch_shards = 4
elasticsearch_transport_tcp_port = 9300
is_master = false
lb_recognition_period_seconds = 3
message_journal_dir = /var/lib/graylog-server/journal
message_journal_enabled = true
message_journal_max_age = 12h
message_journal_max_size = 5gb
mongodb_max_connections = 100
mongodb_password = 
mongodb_replica_set = localhost:27017
mongodb_threads_allowed_to_block_multiplier = 5
mongodb_uri = mongodb://127.0.0.1:27017/graylog
mongodb_useauth = false
mongodb_user = 
node_id_file = /etc/graylog/server/node-id
output_batch_size = 25
outputbuffer_processors = 3
output_flush_interval = 1
password_secret = 2jueVqZpwLLjaWxV
plugin_dir = /usr/share/graylog-server/plugin
processbuffer_processors = 5
processor_wait_strategy = blocking
rest_enable_cors = true
rest_enable_gzip = true
rest_listen_uri = http://127.0.0.1:12900/
rest_transport_uri = http://127.0.0.1:12900/
retention_strategy = delete
root_email = 
root_password_sha2 = 8c6976e5b5410415bde908bd4dee15dfb167a9c873fc4bb8a81f6f2ab448a918
root_timezone = UTC
root_username = admin
rotation_strategy = count
stream_processing_max_faults = 3
stream_processing_timeout = 2000
telemetry_enabled = false
transport_email_auth_password = 
transport_email_auth_username = 
transport_email_enabled = false
transport_email_from_email = 
transport_email_hostname = 
transport_email_port = 587
transport_email_subject_prefix = [graylog]
transport_email_use_auth = true
transport_email_use_ssl = true
transport_email_use_tls = true
transport_email_web_interface_url = 

我看到的唯一错误是在 /var/log/messages

Aug  7 12:32:59 localhost systemd: Started Graylog server.
Aug  7 12:37:20 localhost graylog-server: Exception in thread "main" java.lang.OutOfMemoryError: Java heap space
Aug  7 12:37:20 localhost graylog-server: at java.util.Arrays.copyOf(Arrays.java:2367)
Aug  7 12:37:20 localhost graylog-server: at java.lang.AbstractStringBuilder.expandCapacity(AbstractStringBuilder.java:130)
Aug  7 12:37:20 localhost graylog-server: at java.lang.AbstractStringBuilder.ensureCapacityInternal(AbstractStringBuilder.java:114)
Aug  7 12:37:20 localhost graylog-server: at java.lang.AbstractStringBuilder.append(AbstractStringBuilder.java:415)
Aug  7 12:37:20 localhost graylog-server: at java.lang.StringBuilder.append(StringBuilder.java:132)
Aug  7 12:37:20 localhost graylog-server: at java.lang.StringBuilder.append(StringBuilder.java:179)
Aug  7 12:37:20 localhost graylog-server: at java.lang.StringBuilder.append(StringBuilder.java:72)
Aug  7 12:37:20 localhost graylog-server: at java.util.Formatter$FormatSpecifier.print(Formatter.java:2865)
Aug  7 12:37:20 localhost graylog-server: at java.util.Formatter$FormatSpecifier.printString(Formatter.java:2838)
Aug  7 12:37:20 localhost graylog-server: at java.util.Formatter$FormatSpecifier.print(Formatter.java:2718)
Aug  7 12:37:20 localhost graylog-server: at java.util.Formatter.format(Formatter.java:2488)
Aug  7 12:37:20 localhost graylog-server: at java.util.Formatter.format(Formatter.java:2423)
Aug  7 12:37:20 localhost graylog-server: at org.elasticsearch.common.inject.internal.Errors.format(Errors.java:474)
Aug  7 12:37:20 localhost graylog-server: at org.elasticsearch.common.inject.CreationException.getMessage(CreationException.java:55)
Aug  7 12:37:20 localhost graylog-server: at java.lang.Throwable.getLocalizedMessage(Throwable.java:391)
Aug  7 12:37:20 localhost graylog-server: at java.lang.Throwable.toString(Throwable.java:480)
Aug  7 12:37:20 localhost graylog-server: at java.util.Formatter$FormatSpecifier.printString(Formatter.java:2838)
Aug  7 12:37:20 localhost graylog-server: at java.util.Formatter$FormatSpecifier.print(Formatter.java:2718)
Aug  7 12:37:20 localhost graylog-server: at java.util.Formatter.format(Formatter.java:2488)
Aug  7 12:37:20 localhost graylog-server: at java.util.Formatter.format(Formatter.java:2423)
Aug  7 12:37:20 localhost graylog-server: at java.lang.String.format(String.java:2792)
Aug  7 12:37:20 localhost graylog-server: at com.google.inject.internal.Errors.format(Errors.java:556)
Aug  7 12:37:20 localhost graylog-server: at com.google.inject.internal.Errors.addMessage(Errors.java:539)
Aug  7 12:37:20 localhost graylog-server: at com.google.inject.internal.Errors.errorInUserCode(Errors.java:421)
Aug  7 12:37:20 localhost graylog-server: at com.google.inject.internal.Errors.errorInProvider(Errors.java:376)
Aug  7 12:37:20 localhost graylog-server: at com.google.inject.internal.BoundProviderFactory.provision(BoundProviderFactory.java:74)
Aug  7 12:37:20 localhost graylog-server: at com.google.inject.internal.ProviderInternalFactory.circularGet(ProviderInternalFactory.java:61)
Aug  7 12:37:20 localhost graylog-server: at com.google.inject.internal.BoundProviderFactory.get(BoundProviderFactory.java:62)
Aug  7 12:37:20 localhost graylog-server: at com.google.inject.internal.ProviderToInternalFactoryAdapter$1.call(ProviderToInternalFactoryAdapter.java:46)
Aug  7 12:37:20 localhost graylog-server: at com.google.inject.internal.InjectorImpl.callInContext(InjectorImpl.java:1103)
Aug  7 12:37:20 localhost graylog-server: at com.google.inject.internal.ProviderToInternalFactoryAdapter.get(ProviderToInternalFactoryAdapter.java:40)
Aug  7 12:37:20 localhost graylog-server: at com.google.inject.internal.SingletonScope$1.get(SingletonScope.java:145)

我使用的 VM 有 4GB 的 RAM,而 JVM 配置为使用 1G。我想知道内存不足错误是否是由于启动了大量多播传输处理程序造成的。有什么想法吗?

答案1

我将其追溯到 /etc/graylog/server/server.conf 中的 elasticsearch_discovery_zen_ping_unicast_hosts 值。这是一个 Java 属性文件,因此值需要格式化如下:

elasticsearch_discovery_zen_ping_unicast_hosts = 10.1.10.134:9300
elasticsearch_discovery_zen_ping_unicast_hosts = 10.1.10.134:9300,10.1.10.133:9300

避免使用此类 YAML 格式。Graylog 代码(如 1.1.6 版)不会标记格式不正确的值。

elasticsearch_discovery_zen_ping_unicast_hosts = "10.1.10.134:9300"
elasticsearch_discovery_zen_ping_unicast_hosts = [ "10.1.10.134:9300" ]

相关内容