Questions tagged [elasticsearch]
ElasticSearch is a JSON-based search and analytics engine, often associated with Logstash, which collects data, and Kibana, which visualizes the results. There are separate tags for these.
47
questions
0
votes
0answers
10 views
Elastic query: check for two specific alarms types if they are raised in 10 minute period
I have an index named "alarm". And it has below fields:
- raiseTime
- clearTime
- alarmSource
- alarmType
What I want to do is:
query for a specific alarmType: "Temperature High" first.
If ...
0
votes
0answers
11 views
Timestamp missing in Elasticsearch
I am quite new to Elasticsearch. I set up a new EFK cluster.
Goal: Centralize logs and visualize it in Kibana.
Problem: Timestamps are missing in Elasticsearch.
What am I missing?
Fluentd Client:
...
0
votes
1answer
88 views
what is GREEDYDATA in elasticsearch
reading the conf files of logstash i found in filter conf
grok {
match => { "message" => "Put\s*command\s*:\s+%{GREEDYDATA:command}" }
}
How does this filter work , i tried to ...
0
votes
1answer
20 views
Unable to remove the unwanted messages(especially Auditbeat) in my centos server
I need your help in solving the below mentioned Issue.
I have Installed Auditbeat-7.3.1 as a part of ELK setup in my centos server. Everything was working well, But i was facing problem while ...
0
votes
0answers
48 views
Elastic Stack 7.4.0 | Filebeat CEF Module | mapper_parsing_exception
Hy!
I'm trying to use Filebeat CEF module, but for every message i am affectionately received with this log
Oct 13 15:43:45 MyHostname filebeat[24149]:
2019-10-13T15:43:45.352-0300#011WARN#...
1
vote
1answer
65 views
rsyslog error in logstash
I have installed ELK and tried to configure rsyslog server with logstash but i am getting lot of \ while executing curl -XGET 'http://172.22.63.61:9200/logstash-*/_search?q=*&pretty'
Rsyslog ...
0
votes
0answers
8 views
Can we have set type field behaviour in elasticsearch..?
I am using ES 7.3v and i wanted to have key, value pairs where i want that my key values behave as set type and they don't allow duplicate values in it and also i wanted to set a restriction on the ...
0
votes
0answers
15 views
Plotinus - a searchable command palette
I've recently installed plotinus on my system by following the instructions at GitHub. Everythings seems to have gone just fine, and even the installation log is clean as a whistle. However, nothing ...
2
votes
2answers
352 views
Change filesystem without losing data
I've got 16 nodes of elasticsearch (RHEL 7) - 18TB each, every node has a ext4 filesystem. For better efficency I need to change to XFS filesystem.
Is there any tool / way which help me change ...
3
votes
0answers
193 views
Yum install: unexpected nothing to do while upgrading elasticsearch
I'm experimenting something estrange with yum in centos7, lets see If someone understands what's happening:
Usually, I upgrade packages using sudo yum install <package_name>-<version_info>...
0
votes
1answer
55 views
unable to connect with localhost (11.213.234.24) on port 9200 from vagrant
I am running vagrant from a virtual box with centos. Trying to connect my localhost on port 9200 from vagrant by using (curl -X GET 'http://11.213.234.24:9200'). Getting below error
curl: (7) couldn'...
0
votes
1answer
162 views
Elasticsearch fails to start with 'permissions read' error even though read permissions exist
I have a symlink at /etc/elasticsearch/analysis that points to a mounted drive at /elasticdata/fileshare/analysis on Ubuntu 16.04 LTS Azure VM. When I try and start elasticsearch I am getting the ...
0
votes
0answers
26 views
Elasticsearch process run under weird username
I have Elasticsearch 1.7.3 running successfully on CentOS7. However, I observed:
%ps -aux | grep elastic
**209** 10504 85.0 29.2 36122740 19283600 ? SLl 04:02 0:05
/usr/bin/java -Xms30g -...
0
votes
1answer
229 views
Advantage of elasticsearch over grep when trying to search keyword in logs files [closed]
I know elasticsearch is good for full text search but when it comes to analyze logs, say nginx logs what is the advantage of using it over grep (with tail, awk, etc.) ?
Quite of often I dig through ...
0
votes
1answer
27 views
How to operate on a directory with different owner from a script?
Few days ago i have installed elasticsearch,
For diagnosing some problems on my elasticsearch setup, i have checked the logs files located in /var/log/elasticsearch and tailed them but apparently the ...
3
votes
1answer
444 views
Why does a systemd unit file at `/usr/lib/systemd/system/` still works for Ubuntu?
I understand that systemd stores unit files at different locations for different versions of Linux. On RHEL, it's at /usr/lib/systemd/system/, whereas on Debian-based machines it's at /lib/systemd/...
0
votes
0answers
207 views
elasticsearch and transport tcp problem
I have 3 nodes fro cluster elasticsearch with this config and I have this error!
node-1:
cluster.name: graylog-production
node.name: elasticsearch1
node.master: true
node.data: true
node.ingest: ...
1
vote
2answers
4k views
Elasticsearch cannot open log file: Permission denied
The error
I installed Elasticsearch on CentOS using rpm and am encountering this error when I try to start it via systemctl start elasticsearch:
Feb 20 21:08:34 server.cberdata.org systemd[1]: ...
0
votes
1answer
89 views
How can I set the Java heap size for elasticsearch on Nixos?
It seems these should go in the ${configDir}/jvm.options"} (/var/lib/elasticsearch/config/jvm.options ?) looking at the package at https://github.com/NixOS/nixpkgs/blob/master/nixos/modules/services/...
0
votes
1answer
63 views
One port is listening with an * and the other is listening with 127.0.0.1 and only the first is accepting remote connections
Please see the attached picture below, and then I will explain:
So, I have Solr running which uses port 8983. And as you can see in the screen shot, it's listed as "TCP *:8983 (LISTEN)". And, it's ...
0
votes
1answer
416 views
Can I lock down access to a TCP port in Linux
I'm trying to secure a single-node Elasticsearch machine. Basically, I want to put Elasticsearch behind a reverse proxy (nginx) and make sure that the only way any user or process can communicate with ...
1
vote
1answer
1k views
How is JVM memory usage calculated?
I am tuning my Elasticsearch cluster, and see that the memory usage doesn't line up. Running "free" on my instance:
free
total used free shared buff/cache ...
0
votes
1answer
343 views
problem re-loading index from filebeat in elasticsearch
I am using the ELK stack (more ELG stack as I am using Grafana as the front end instead of kibana for personal reasons). I am using Filebeat to send the logs file to Logstash which are then stored in ...
3
votes
1answer
6k views
How to give RAM to the filesystem cache
I am tuning my linux machine running Elasticsearch. It says that I should give at least half the memory of the machine running elasticsearch to the filesystem cache. But I don't know how much of it is ...
-1
votes
2answers
7k views
How do i completely uninstall ELK?
I search on internet that we have to unistall each of the ELK part one by one like unistall stand-alone kibana, elastic search, and logstash. Is there any command which no need to unistall all of them ...
3
votes
2answers
180 views
Timeouts between an API and an elasticsearch server every 2 hours
We are experiencing a weird issue on our servers. (Debian 8.9) We have an API which is a PHP application. It requests an elasticsearch which instance is on a separate server.
Every 2 hours, we are ...
0
votes
1answer
3k views
How to start elasticsearch on a CentOS?
I have downloaded the latest elasticsearch version 5.5.1 on my Centos 7 server from https://www.elastic.co/downloads/elasticsearch. I have unzipped the file and store it in elasticsearch directory.
...
2
votes
1answer
3k views
“unable to load jna” error on Elasticsearch on Centos
What is the solution to this?
New install of elasticsearch 5.4.1 on Centos 6.8
[2017-06-15T13:54:19,140][WARN ][o.e.b.Natives ] unable to load JNA n
ative support library, native methods ...
3
votes
2answers
301 views
Can not run Elasticsearch on Linux Mint 18
I installed Elasticsearch on Linux Mint without any trouble.
Everything according this tutorial Easy install for elasticsearch on Ubuntu 14.04.
All installation steps went well.
However, when I want ...
0
votes
1answer
394 views
Kibana- Want to split vertical bars based on my log fields
I have an application log file consists of following log levels: INFO, WARN, ERROR, DEBUG. Following filter criteria works fine in logstash config file:
filter {
grok {
match => { "...
0
votes
1answer
195 views
Send Apache Catalina Logs to Logstash
Dependencies :
OS Version : CentOS 5.0
Server Environment : Production
Logstash Version : 5.0
Elasticsearch Version : 5.0
I have several app servers running on CentOS 5.0. All these are on-...
-1
votes
2answers
755 views
How can I create a menu item for terminal-applications starting in background mode
I want to start e.g. my ElasticSearch instance which is installed manually via one-click in the cinnamon menu.
What I can do is /opt/elasticsearch-1.6.2/bin/elasticsearch & and the application is ...
0
votes
1answer
162 views
logstash - take 2 - filter to send messages from IntelMQ/python/redis to ELK
Following up on the heels of this question, https://stackoverflow.com/questions/40768603/logstash-trying-to-make-sense-of-strings-passed-by-intelmq-in-elasticsearch I am trying to create a refine/...
1
vote
1answer
235 views
Tile/Greographic Map in Kibana not working
I am trying to create a geographical map of my data in Kibana 5.01, and it does not work. The fact is that I do not even have the geoip.field that is required in the menu.
I am sending data from ...
3
votes
2answers
3k views
Unable to start elasticsearch
Configuration :
Elasticsearch Version = 5.0.1
OS = Amazon Linux AMI release 2014.03
I am using AWS m3.large instance. I have two elasticsearch nodes. For my data node(node-2) , When I started ...
3
votes
2answers
5k views
How to raise max threads for elasticsearch?
I have a fresh installation of Ubuntu 16.04 and I installed elasticsearch 5 on it. Now when I try to start elasticsearch using
/etc/init.d/elasticsearch start
After a few seconds in the log file I ...
1
vote
1answer
1k views
send json via rsyslog to elasticsearch
in our company we need aggregate services statistics
for some reason we decide to use rsyslogd to send applications statistics (json format) to elasticsearch system directly (this tutorial).
but we ...
2
votes
2answers
262 views
Malicious processes open connections to China
I recently started migrating some of my company's servers to Google's compute engine. Among other things I set up a 2-node elasticsearch cluster.
Today I run top command on one of the nodes and I ...
3
votes
0answers
4k views
Able to ping my host but getting no route to host
I have a elasticsearch service running on MY_HOST_IP(10.x.x.xx) and port 9200. I am able to ping 10.x.x.xx from my VM, but when I try to connect elasticsearch it gives me :
no route to host ...
0
votes
1answer
379 views
Install ELK in centos
I install ELK on centos following below link.
https://www.digitalocean.com/community/tutorials/how-to-install-elasticsearch-1-7-logstash-1-5-and-kibana-4-1-elk-stack-on-centos-7
But the problem ...
0
votes
1answer
876 views
authenticating ldap users with searchguard for elasticsearch
I have an elastic-search setup with search-guard plug-in. My elastic-search web access is behind single sign on proxy , and i want to authenticated users coming through SSO according to their roles in ...
2
votes
1answer
1k views
Opposite behavior of keepalive (nginx reverse proxy on ElasticSearch)
I am setting up a nginx reverse proxy for ElasticSearch (with HTTP Basic Auth) as described in this article.
This is my nginx config file:
events {
worker_connections 1024;
}
http {
...
1
vote
1answer
787 views
Is it possible to monitor JVM usage of Elasticsearch via Munin?
I'd like to use Munin to monitor the status of the JVM used by Elasticsearch, which is run via Java (output of ps follows):
elastic+ 1083 1 3 09:29 ? 00:13:23 /usr/bin/java -Xms8g -Xmx8g ...
0
votes
1answer
263 views
Munin plugins for Elasticsearch v2.x
Are there any Munin plugins available for Elasticsearch v2.x?
I know that there are some for v1.x but these are not compatible with v2.x.
0
votes
1answer
494 views
How to enable kibana at startup
I just downloaded kibana-4.3 tar file , extract it and it works fine. But i want to enable the service at system startup and i got the error by using chkconfig command:
service kibana does not ...
2
votes
1answer
11k views
ElasticSearch ports in iptables
I have setup an elastic-search cluster with two data nodes, one master node and one client node with kibana. I was running it with iptables disabled on each node.
Now I need to enable iptables and I ...
0
votes
0answers
78 views
Elasticsearch error on Head command
When i try to execute this command againt Elasticsearch using sense
HEAD /megacorp/employee/1
It results in this error:
TypeError: dataOrjqXHR is undefined (http://myserver/bundles/sense.bundle.js:...
