asked on 6/11/2021

not able to start kibana 5.6.16

Hi Experts,

I am not able to start kibana. I am using ubuntu 18 version and I had installed kibana 5.6.16.
and create user kibana, changed ownership to kibana for the kibana folder(installation folder)
and tried to start kibana service

ubuntu@ip-10-21-36-40:~$ sudo service kibana status
● kibana.service - Kibana
   Loaded: loaded (/etc/systemd/system/kibana.service; enabled; vendor preset: enabled)
   Active: failed (Result: exit-code) since Fri 2021-06-11 04:44:13 UTC; 28min ago
  Process: 5134 ExecStart=/usr/share/kibana/bin/kibana -c /etc/kibana/kibana.yml (code=exited, status=1/FAILURE)
 Main PID: 5134 (code=exited, status=1/FAILURE)

Jun 11 04:44:13 ip-10-21-36-40 systemd[1]: kibana.service: Service hold-off time over, scheduling restart.
Jun 11 04:44:13 ip-10-21-36-40 systemd[1]: kibana.service: Scheduled restart job, restart counter is at 5.
Jun 11 04:44:13 ip-10-21-36-40 systemd[1]: Stopped Kibana.
Jun 11 04:44:13 ip-10-21-36-40 systemd[1]: kibana.service: Start request repeated too quickly.
Jun 11 04:44:13 ip-10-21-36-40 systemd[1]: kibana.service: Failed with result 'exit-code'.
Jun 11 04:44:13 ip-10-21-36-40 systemd[1]: Failed to start Kibana.

Open in new window

ubuntu@ip-10-21-36-40:~$ journalctl -fu kibana.service
Jun 11 04:44:12 ip-10-21-36-40 kibana[5134]:     at exports.default (/usr/share/kibana/src/cli/serve/read_yaml_config.js:10:23)
Jun 11 04:44:12 ip-10-21-36-40 kibana[5134]:     at readServerSettings (/usr/share/kibana/src/cli/serve/serve.js:48:51)
Jun 11 04:44:12 ip-10-21-36-40 systemd[1]: 
Jun 11 04:44:12 ip-10-21-36-40 systemd[1]: 
Jun 11 04:44:13 ip-10-21-36-40 systemd[1]: kibana.service: Service hold-off time over, scheduling restart.
Jun 11 04:44:13 ip-10-21-36-40 systemd[1]: kibana.service: Scheduled restart job, restart counter is at 5.
Jun 11 04:44:13 ip-10-21-36-40 systemd[1]: Stopped Kibana.
Jun 11 04:44:13 ip-10-21-36-40 systemd[1]: 
Jun 11 04:44:13 ip-10-21-36-40 systemd[1]: .
Jun 11 04:44:13 ip-10-21-36-40 systemd[1]: Failed to start Kibana.when I start kibana service i get the following errors

Open in new window

Please help me in resolving this issue

Programming DevOps Ubuntu * kibana * elasticsearch

Last Comment

coder

6/16/2021

ASKER CERTIFIED SOLUTION

David Favor

6/11/2021

THIS SOLUTION IS ONLY AVAILABLE TO MEMBERS.

View this solution by signing up for a free trial.

Members can start a 7-Day free trial and enjoy unlimited access to the platform.

See Pricing Options

Start Free Trial

coder

6/15/2021

ASKER

Hi David,
Apologies for the delayed response. I think It is throwing error on kibana source code, Could you please tell me how to get the logs. Please see below the kibana yml file settings

logging.dest:"/var/log/kibana.log"
server.port: 5601
server.host: "localhost"
server.basePath: "/kibana"
server.name: "ntdldev.librariesnt.net"
elasticsearch.url: "http://172.17.0.1:9200"

Open in new window

secondly I had changed the ownership of kibana.log to kibana
with the following command

sudo chown kibana:kibana kibana.log

and then restarted kibana with the following command

sudo service kibana stop
sudo service kibana start

Please see below the nginx settings

    #initially kibana was not password protected. now it works inside nginx firewall and password protected
    location /kibana {
        auth_basic "Kibana";
        auth_basic_user_file /etc/nginx/kibana_htpasswd;
        proxy_pass http://localhost:5601/ ;
        rewrite /kibana/(.*) /$1 break;
    }

Open in new window

still it is not starting and kibana.log is empty

the same settings work on the test machine. I don't know what I miss.

Please suggest what can done
Any help is highly appriciated.

coder

6/16/2021

ASKER

Hi David,
Thanks for your suggestion. I don't know how to check the logs. After your comment I had checked the log with the following command.

journalctl -u kibana.service -r

I got the following error

Jun 16 06:21:37 ip-10-21-36-40 kibana[12838]:     # Set the value of this setting  ...
Jun 16 06:21:37 ip-10-21-36-40 kibana[12838]: FATAL CLI ERROR YAMLException: can not read a block mapping entry; a multiline key may not be an implicit key at line 89, column 1:

Open in new window

I have test machine working fine, I compared with the test machine and tried to the same steps

I found the bug in the following line

logging.dest:"/var/log/kibana.log"

in this line there is no space after ":" the line should be like

logging.dest: "/var/log/kibana.log"

after changing this it is working fine.

Thanks for your suggestion.