linux - Logstash too many files opened? -
i running logstash 1.4.1
, on running getting following on console:
failed open /home/desktop/input/2014-11-03/abc.log: permission denied - /home/desktop/input/2014-11-03/abc.log {:level=>:warn} failed open /home/desktop/input/2014-10-14/abc.log: permission denied - /home/desktop/input/2014-10-14/abc.log {:level=>:warn} failed open /home/desktop/2014-10-16/abc.log: permission denied - /home/desktop/input/2014-10-16/abc.log {:level=>:warn} .............. log4j, [2014-11-13t16:20:04.583] warn: org.elasticsearch.discovery.zen: [logstash-hp-pro-3330-mt-7573-11818] failed connect master [[kyle gibney][em0zmukaqpaxd6_n4jwjza][-hp-pro-3330-mt][inet[/xx.xx..xx..xx:9300]]], retrying... org.elasticsearch.transport.connecttransportexception: [kyle gibney][inet[/xx.xx.xx.xx:9300]] general node connection failure @ org.elasticsearch.transport.netty.nettytransport.connecttonode(nettytransport.java:668) @ org.elasticsearch.transport.netty.nettytransport.connecttonode(nettytransport.java:615) @ org.elasticsearch.transport.transportservice.connecttonode(transportservice.java:129) @ org.elasticsearch.discovery.zen.zendiscovery.innerjoincluster(zendiscovery.java:338) @ org.elasticsearch.discovery.zen.zendiscovery.access$500(zendiscovery.java:79) @ org.elasticsearch.discovery.zen.zendiscovery$1.run(zendiscovery.java:286) @ java.util.concurrent.threadpoolexecutor.runworker(threadpoolexecutor.java:1145) @ java.util.concurrent.threadpoolexecutor$worker.run(threadpoolexecutor.java:615) @ java.lang.thread.run(thread.java:744) caused by: org.elasticsearch.common.netty.channel.channelexception: failed open socket. @ org.elasticsearch.common.netty.channel.socket.nio.nioclientsocketchannel.newsocket(nioclientsocketchannel.java:43) @ org.elasticsearch.common.netty.channel.socket.nio.nioclientsocketchannel.<init>(nioclientsocketchannel.java:82) @ org.elasticsearch.common.netty.channel.socket.nio.nioclientsocketchannelfactory.newchannel(nioclientsocketchannelfactory.java:212) @ org.elasticsearch.common.netty.channel.socket.nio.nioclientsocketchannelfactory.newchannel(nioclientsocketchannelfactory.java:82) @ org.elasticsearch.common.netty.bootstrap.clientbootstrap.connect(clientbootstrap.java:212) @ org.elasticsearch.common.netty.bootstrap.clientbootstrap.connect(clientbootstrap.java:182) @ org.elasticsearch.transport.netty.nettytransport.connecttochannels(nettytransport.java:702) @ org.elasticsearch.transport.netty.nettytransport.connecttonode(nettytransport.java:647) ... 8 more caused by: java.net.socketexception: many open files @ sun.nio.ch.net.socket0(native method) @ sun.nio.ch.net.socket(net.java:423) @ sun.nio.ch.net.socket(net.java:416) @ sun.nio.ch.socketchannelimpl.<init>(socketchannelimpl.java:104) @ sun.nio.ch.selectorproviderimpl.opensocketchannel(selectorproviderimpl.java:60) @ java.nio.channels.socketchannel.open(socketchannel.java:142) @ org.elasticsearch.common.netty.channel.socket.nio.nioclientsocketchannel.newsocket(nioclientsocketchannel.java:41) ... 15 more
so logstash opening files upto threshold , after giving permission denied files after threshold , saying many files opened.
any idea?
you need check what's limit of file handle linux user. 1 place check is:
cat /etc/security/limits.conf
where define hard , soft limit. way use ulimit command below:
ulimit -a | grep nofiles ##or ulimit -n
Comments
Post a Comment