linux - Logstash too many files opened? -


i running logstash 1.4.1 , on running getting following on console:

    failed open /home/desktop/input/2014-11-03/abc.log: permission denied - /home/desktop/input/2014-11-03/abc.log {:level=>:warn}     failed open /home/desktop/input/2014-10-14/abc.log: permission denied - /home/desktop/input/2014-10-14/abc.log {:level=>:warn}     failed open /home/desktop/2014-10-16/abc.log: permission denied - /home/desktop/input/2014-10-16/abc.log {:level=>:warn}  ..............      log4j, [2014-11-13t16:20:04.583]  warn: org.elasticsearch.discovery.zen: [logstash-hp-pro-3330-mt-7573-11818] failed connect master [[kyle gibney][em0zmukaqpaxd6_n4jwjza][-hp-pro-3330-mt][inet[/xx.xx..xx..xx:9300]]], retrying...     org.elasticsearch.transport.connecttransportexception: [kyle gibney][inet[/xx.xx.xx.xx:9300]] general node connection failure         @ org.elasticsearch.transport.netty.nettytransport.connecttonode(nettytransport.java:668)         @ org.elasticsearch.transport.netty.nettytransport.connecttonode(nettytransport.java:615)         @ org.elasticsearch.transport.transportservice.connecttonode(transportservice.java:129)         @ org.elasticsearch.discovery.zen.zendiscovery.innerjoincluster(zendiscovery.java:338)         @ org.elasticsearch.discovery.zen.zendiscovery.access$500(zendiscovery.java:79)         @ org.elasticsearch.discovery.zen.zendiscovery$1.run(zendiscovery.java:286)         @ java.util.concurrent.threadpoolexecutor.runworker(threadpoolexecutor.java:1145)         @ java.util.concurrent.threadpoolexecutor$worker.run(threadpoolexecutor.java:615)         @ java.lang.thread.run(thread.java:744)     caused by: org.elasticsearch.common.netty.channel.channelexception: failed open socket.         @ org.elasticsearch.common.netty.channel.socket.nio.nioclientsocketchannel.newsocket(nioclientsocketchannel.java:43)         @ org.elasticsearch.common.netty.channel.socket.nio.nioclientsocketchannel.<init>(nioclientsocketchannel.java:82)         @ org.elasticsearch.common.netty.channel.socket.nio.nioclientsocketchannelfactory.newchannel(nioclientsocketchannelfactory.java:212)         @ org.elasticsearch.common.netty.channel.socket.nio.nioclientsocketchannelfactory.newchannel(nioclientsocketchannelfactory.java:82)         @ org.elasticsearch.common.netty.bootstrap.clientbootstrap.connect(clientbootstrap.java:212)         @ org.elasticsearch.common.netty.bootstrap.clientbootstrap.connect(clientbootstrap.java:182)         @ org.elasticsearch.transport.netty.nettytransport.connecttochannels(nettytransport.java:702)         @ org.elasticsearch.transport.netty.nettytransport.connecttonode(nettytransport.java:647)         ... 8 more     caused by: java.net.socketexception: many open files         @ sun.nio.ch.net.socket0(native method)         @ sun.nio.ch.net.socket(net.java:423)         @ sun.nio.ch.net.socket(net.java:416)         @ sun.nio.ch.socketchannelimpl.<init>(socketchannelimpl.java:104)         @ sun.nio.ch.selectorproviderimpl.opensocketchannel(selectorproviderimpl.java:60)         @ java.nio.channels.socketchannel.open(socketchannel.java:142)         @ org.elasticsearch.common.netty.channel.socket.nio.nioclientsocketchannel.newsocket(nioclientsocketchannel.java:41)         ... 15 more 

so logstash opening files upto threshold , after giving permission denied files after threshold , saying many files opened.

any idea?

you need check what's limit of file handle linux user. 1 place check is:

cat /etc/security/limits.conf 

where define hard , soft limit. way use ulimit command below:

ulimit -a | grep nofiles ##or ulimit -n 

Comments

Popular posts from this blog

c++ - QTextObjectInterface with Qml TextEdit (QQuickTextEdit) -

javascript - angular ng-required radio button not toggling required off in firefox 33, OK in chrome -

xcode - Swift Playground - Files are not readable -