# Elasticsearch **URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1286 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 1287 --- ## [Can I parse text in pdf document before sending it to elasticsearch using FSCrawler](https://discuss.elastic.co/t/can-i-parse-text-in-pdf-document-before-sending-it-to-elasticsearch-using-fscrawler/182564)
**Author:** [@Vishnu\_mk](https://discuss.elastic.co/u/Vishnu_mk)\ **Replies:** 17\ **Last updated:** [May 26, 2019, 11:54am UTC](https://discuss.elastic.co/t/can-i-parse-text-in-pdf-document-before-sending-it-to-elasticsearch-using-fscrawler/182564 "2019-05-26T11:54:23Z")
Please help. --- ## [How to configure indexes in logstash](https://discuss.elastic.co/t/how-to-configure-indexes-in-logstash/182792)
**Author:** [@Swaroop\_Chand](https://discuss.elastic.co/u/Swaroop_Chand)\ **Replies:** 1\ **Last updated:** [May 26, 2019, 10:09am UTC](https://discuss.elastic.co/t/how-to-configure-indexes-in-logstash/182792 "2019-05-26T10:09:21Z")
input { beats { port =\> 5044 } } filter { if \[type\] == "syslog" { grok { match =\> { "message" =\> "%{SYSLOGTIMESTAMP:syslog\_timestamp} %{SYSLOGHOST:syslog\_hostname} %{DATA:syslog\_program}(?:\[%{POSINT:syslog\_pid}\])… --- ## [Syncing large amount of data from mysql to elasticsearch](https://discuss.elastic.co/t/syncing-large-amount-of-data-from-mysql-to-elasticsearch/180505)
**Author:** [@Jose\_Tom](https://discuss.elastic.co/u/Jose_Tom)\ **Replies:** 9\ **Last updated:** [May 26, 2019, 9:53am UTC](https://discuss.elastic.co/t/syncing-large-amount-of-data-from-mysql-to-elasticsearch/180505 "2019-05-26T09:53:03Z")
Hi All, I am fairly new to elasticsearch. We have a large amount of data in multiple databases (mainly mysql). I need to move them to elasticsearch with either a parent child approach or nested approach. The requirement … --- ## [RestHighLevelClient slow performance](https://discuss.elastic.co/t/resthighlevelclient-slow-performance/182746)
**Author:** [@eugene\_p](https://discuss.elastic.co/u/eugene_p)\ **Replies:** 5\ **Last updated:** [May 26, 2019, 8:04am UTC](https://discuss.elastic.co/t/resthighlevelclient-slow-performance/182746 "2019-05-26T08:04:58Z")
Hi everyone. I noticed that requests executed through RestHighLevelClient slower 6 times than the same requests executed through curl or Postman. So I configure the RestHighLevelClient: @Bean fun restHighLevelClient()… --- ## [Configuring Elasticsearch 7 cluster](https://discuss.elastic.co/t/configuring-elasticsearch-7-cluster/182737)
**Author:** [@Hooman\_Bahreini](https://discuss.elastic.co/u/Hooman_Bahreini)\ **Replies:** 10\ **Last updated:** [May 26, 2019, 8:00am UTC](https://discuss.elastic.co/t/configuring-elasticsearch-7-cluster/182737 "2019-05-26T08:00:41Z")
I have three server and I have installed elasticsearch on all of them. In the elasticsearch.yml I have the following config: first server: 172.31.1.1 # /stc/elasticsearch.elasticsearch.yml cluster.name: es-cluster nod… --- ## [Frequently failed to start elasticsearch service](https://discuss.elastic.co/t/frequently-failed-to-start-elasticsearch-service/182730)
**Author:** [@vernal](https://discuss.elastic.co/u/vernal)\ **Replies:** 4\ **Last updated:** [May 26, 2019, 7:31am UTC](https://discuss.elastic.co/t/frequently-failed-to-start-elasticsearch-service/182730 "2019-05-26T07:31:47Z")
It was running well. Since one week ago, we kept getting this kind of error as shown below. What is the cause for this? ● elasticsearch.service - Elasticsearch Loaded: loaded (/usr/lib/systemd/system/elasticsearch.servi… --- ## [Failed to connect to ip-myip port 80: Connection refused](https://discuss.elastic.co/t/failed-to-connect-to-ip-myip-port-80-connection-refused/182780)
**Author:** [@Hooman\_Bahreini](https://discuss.elastic.co/u/Hooman_Bahreini)\ **Replies:** 7\ **Last updated:** [May 26, 2019, 5:41am UTC](https://discuss.elastic.co/t/failed-to-connect-to-ip-myip-port-80-connection-refused/182780 "2019-05-26T05:41:22Z")
I have installed elasticsearch 7 on Ubuntu 18. I have 3 nodes, all master eligible. This is my configuration: First server: 172.31.1.1 # /etc/elasticsearch/elasticsearch.yml cluster.name: es-cluster node.name: es-1 p… --- ## [Elasticsearch as Linked Server in MS SQL Server](https://discuss.elastic.co/t/elasticsearch-as-linked-server-in-ms-sql-server/182781)
**Author:** [@kabcampbell](https://discuss.elastic.co/u/kabcampbell)\ **Replies:** 0\ **Last updated:** [May 26, 2019, 3:18am UTC](https://discuss.elastic.co/t/elasticsearch-as-linked-server-in-ms-sql-server/182781 "2019-05-26T03:18:11Z")
Given that we now have Elasticsearch SQL, has anyone tried to set up Elasticsearch as a Linked Server in MS SQL Server? I figured it would be possible since there is an ODBC driver, but I haven't been able to successfull… --- ## [Order getting elements from source in query](https://discuss.elastic.co/t/order-getting-elements-from-source-in-query/182777)
**Author:** [@jbalaguero](https://discuss.elastic.co/u/jbalaguero)\ **Replies:** 1\ **Last updated:** [May 25, 2019, 11:49pm UTC](https://discuss.elastic.co/t/order-getting-elements-from-source-in-query/182777 "2019-05-25T23:49:55Z")
I'm executing a query with ".../\_search?\_source=cacheId,expirationTime" and also trying "/\_search?\_source=expirationTime,cacheId", and the response is always: ( ... ) "\_source": {"expirationTime":1558724355237,"cacheId… --- ## [230k aggregation trying to get an output](https://discuss.elastic.co/t/230k-aggregation-trying-to-get-an-output/181896)
**Author:** [@iukea](https://discuss.elastic.co/u/iukea)\ **Replies:** 2\ **Last updated:** [May 25, 2019, 7:11pm UTC](https://discuss.elastic.co/t/230k-aggregation-trying-to-get-an-output/181896 "2019-05-25T19:11:41Z")
Need some wisdom on aggregations. I have around 230k aggregated IPs I am trying to aggregate and get them to a JSON file. What would be the best way to do this in the ElasticSearch api? using the scroll api? or just … --- ## [How to create separate roles for Kibana?](https://discuss.elastic.co/t/how-to-create-separate-roles-for-kibana/182558)
**Author:** [@Barun\_Kumar](https://discuss.elastic.co/u/Barun_Kumar)\ **Replies:** 3\ **Last updated:** [May 25, 2019, 3:44pm UTC](https://discuss.elastic.co/t/how-to-create-separate-roles-for-kibana/182558 "2019-05-25T15:44:42Z")
I have different indexes of Elasticsearch and indexes are showing in Kibana too. Now I want to create different roles in Kibana to access different indexes by separate user. I am using basic license. Also I can't see th… --- ## [Use copy\_to for multiple fields, but the analyzer for each field is different from the analyzer for search\_analyzer](https://discuss.elastic.co/t/use-copy-to-for-multiple-fields-but-the-analyzer-for-each-field-is-different-from-the-analyzer-for-search-analyzer/182747)
**Author:** [@Zyuxing](https://discuss.elastic.co/u/Zyuxing)\ **Replies:** 1\ **Last updated:** [May 25, 2019, 2:55pm UTC](https://discuss.elastic.co/t/use-copy-to-for-multiple-fields-but-the-analyzer-for-each-field-is-different-from-the-analyzer-for-search-analyzer/182747 "2019-05-25T14:55:26Z")
Use copy\_to for multiple fields, but the analyzer for each field is different from the analyzer for search\_analyzer,Will they use the corresponding analyzer and search\_analyzer for each field --- ## [How to choose upstream\_response\_time from nginx for line chart in visualize?](https://discuss.elastic.co/t/how-to-choose-upstream-response-time-from-nginx-for-line-chart-in-visualize/182758)
**Author:** [@patsevanton](https://discuss.elastic.co/u/patsevanton)\ **Replies:** 0\ **Last updated:** [May 25, 2019, 2:17pm UTC](https://discuss.elastic.co/t/how-to-choose-upstream-response-time-from-nginx-for-line-chart-in-visualize/182758 "2019-05-25T14:17:49Z")
Hello ELK 6.6 Mapping - https://pastebin.com/svDn4xa0 There is an upstream\_response\_time field. The screenshot below Trying to visualize select upstream\_response\_time from nginx for line chart But it doesn't. H… --- ## [How to import ORACLE DB Data to Kibana (After Establishing the connection)](https://discuss.elastic.co/t/how-to-import-oracle-db-data-to-kibana-after-establishing-the-connection/182452)
**Author:** [@boyaronur](https://discuss.elastic.co/u/boyaronur)\ **Replies:** 7\ **Last updated:** [May 25, 2019, 12:16pm UTC](https://discuss.elastic.co/t/how-to-import-oracle-db-data-to-kibana-after-establishing-the-connection/182452 "2019-05-25T12:16:20Z")
Hello, I established a Oracle DB connection using Logstash. I am a complete beginner and I do not know what to do next. I created conf file where my configuration for Oracle DB connection is written. Localhost 9200, 9… --- ## [Problems when indexing csv files](https://discuss.elastic.co/t/problems-when-indexing-csv-files/182753)
**Author:** [@Ayumalex](https://discuss.elastic.co/u/Ayumalex)\ **Replies:** 2\ **Last updated:** [May 25, 2019, 10:45am UTC](https://discuss.elastic.co/t/problems-when-indexing-csv-files/182753 "2019-05-25T10:45:34Z")
Hello, I use ELK (for the first time) to process CSV files. However, I have a problem when I run logstash with my configuration file: input { file { path =\> "/home/user/network\_capt/csv/\*.csv" start\_position =\> "… --- ## [7.0.1: template with geo\_point + geoip processor in pipeline + bulk = crash](https://discuss.elastic.co/t/7-0-1-template-with-geo-point-geoip-processor-in-pipeline-bulk-crash/182039)
**Author:** [@dperetti](https://discuss.elastic.co/u/dperetti)\ **Replies:** 6\ **Last updated:** [May 25, 2019, 10:19am UTC](https://discuss.elastic.co/t/7-0-1-template-with-geo-point-geoip-processor-in-pipeline-bulk-crash/182039 "2019-05-25T10:19:05Z")
I'm encountering a similar issue as: I'm sending logs from kubernetes using fluent-bit to an ES pipeline with a geoip processor. PUT \_ingest/pipeline/geoip { "description": "Ingest nginx-ingress logs", "processors… --- ## [In flight circuit breaker explanation](https://discuss.elastic.co/t/in-flight-circuit-breaker-explanation/181970)
**Author:** [@ttdata](https://discuss.elastic.co/u/ttdata)\ **Replies:** 7\ **Last updated:** [May 25, 2019, 10:13am UTC](https://discuss.elastic.co/t/in-flight-circuit-breaker-explanation/181970 "2019-05-25T10:13:31Z")
Hello ! I have one question about the circuit breaker "in flight requests" What exactly it means ? For instance i share with you a sreenshot where the circuit break in flight requests increase and while this time i had… --- ## [Performance hit due to sort over date field](https://discuss.elastic.co/t/performance-hit-due-to-sort-over-date-field/182664)
**Author:** [@mats990](https://discuss.elastic.co/u/mats990)\ **Replies:** 4\ **Last updated:** [May 25, 2019, 9:52am UTC](https://discuss.elastic.co/t/performance-hit-due-to-sort-over-date-field/182664 "2019-05-25T09:52:39Z")
Hi, We are trying to optimize query that should fetch top 50 newest documents from a large data set. That data set has 60,000,000 documents (filtered) across 92 indices, 7377 shards and 48 nodes. At that time all nodes … --- ## [Search for a keyword in all fields of an index according to given conditions](https://discuss.elastic.co/t/search-for-a-keyword-in-all-fields-of-an-index-according-to-given-conditions/182749)
**Author:** [@sahilkumar](https://discuss.elastic.co/u/sahilkumar)\ **Replies:** 1\ **Last updated:** [May 25, 2019, 8:12am UTC](https://discuss.elastic.co/t/search-for-a-keyword-in-all-fields-of-an-index-according-to-given-conditions/182749 "2019-05-25T08:12:04Z")
I have a file containing keywords which I need to search for in the index. It is a csv file containing 3 headers - keyword,brandName,bucketName What I need to do is search for the keyword in all fields of the index if b… --- ## [Not able to index large csv files using java bulk api](https://discuss.elastic.co/t/not-able-to-index-large-csv-files-using-java-bulk-api/179328)
**Author:** [@sahilkumar](https://discuss.elastic.co/u/sahilkumar)\ **Replies:** 6\ **Last updated:** [May 25, 2019, 7:46am UTC](https://discuss.elastic.co/t/not-able-to-index-large-csv-files-using-java-bulk-api/179328 "2019-05-25T07:46:24Z")
I am using es 6.6.2 to index a csv file(150MB), that contains about a million documents, using my java application. I read the file using bufferreader and then using json builder I add the documents to bulkrequest. When … --- ## [Upgrade from 6.5.4 Trial To 7.1.0](https://discuss.elastic.co/t/upgrade-from-6-5-4-trial-to-7-1-0/182735)
**Author:** [@kmkarthick](https://discuss.elastic.co/u/kmkarthick)\ **Replies:** 1\ **Last updated:** [May 25, 2019, 7:36am UTC](https://discuss.elastic.co/t/upgrade-from-6-5-4-trial-to-7-1-0/182735 "2019-05-25T07:36:26Z")
I'm running 6.5.4 on Trial Licence expiring in a week. SSL enabled and Xpack installed. Can i upgrade to 7.1 directly or do i need to upgrade to 6.8 first? --- ## [Advice on design & query](https://discuss.elastic.co/t/advice-on-design-query/182743)
**Author:** [@Aco\_Strkalj](https://discuss.elastic.co/u/Aco_Strkalj)\ **Replies:** 0\ **Last updated:** [May 25, 2019, 5:54am UTC](https://discuss.elastic.co/t/advice-on-design-query/182743 "2019-05-25T05:54:20Z")
Hi everyone I just started exploring ES it seems like a great solution to my search needs. However I am stuck at figuring out how to apply it with my current database storage design. I have 2 tables, one called 'titles'… --- ## [Index lifetime policy -\> remove link between policy and index template](https://discuss.elastic.co/t/index-lifetime-policy-remove-link-between-policy-and-index-template/181527)
**Author:** [@asp](https://discuss.elastic.co/u/asp)\ **Replies:** 1\ **Last updated:** [May 24, 2019, 9:31pm UTC](https://discuss.elastic.co/t/index-lifetime-policy-remove-link-between-policy-and-index-template/181527 "2019-05-24T21:31:50Z")
Hi all, I was just playing a bit with index lifetime policy in 6.6.2. As I understand I create a policy and then I add the policy to an index template. I created it with kibana. I have following questions: I want t… --- ## [Doubt Related using multiple indexes or Join](https://discuss.elastic.co/t/doubt-related-using-multiple-indexes-or-join/182692)
**Author:** [@amit\_sachdeva](https://discuss.elastic.co/u/amit_sachdeva)\ **Replies:** 1\ **Last updated:** [May 24, 2019, 8:26pm UTC](https://discuss.elastic.co/t/doubt-related-using-multiple-indexes-or-join/182692 "2019-05-24T20:26:07Z")
I am creating two different indexes but both are related to each other like a foreign key. I want to search results in both indexes using some fields indexed in both indexes. First index is storing data of users and othe… --- ## [Nested, join multiple indexes](https://discuss.elastic.co/t/nested-join-multiple-indexes/182720)
**Author:** [@JH82](https://discuss.elastic.co/u/JH82)\ **Replies:** 1\ **Last updated:** [May 24, 2019, 8:20pm UTC](https://discuss.elastic.co/t/nested-join-multiple-indexes/182720 "2019-05-24T20:20:23Z")
Hello, I've some difficulties to understand how works "join alternative, nested, object type, ..." in ES. I've read some docs (like Nested field type | Elasticsearch Guide \[8.11\] | Elastic) but I can't see how a nested … --- ## [VM RAM / CPU Requirements](https://discuss.elastic.co/t/vm-ram-cpu-requirements/182714)
**Author:** [@JeremysBrain](https://discuss.elastic.co/u/JeremysBrain)\ **Replies:** 2\ **Last updated:** [May 24, 2019, 8:07pm UTC](https://discuss.elastic.co/t/vm-ram-cpu-requirements/182714 "2019-05-24T20:07:23Z")
I'm trying to create a basic ELK stack as a proof of concept for logging and monitoring our infrastructure. I'm planning on starting with simple Linux VM's in vSphere, but may move on to Elastic Cloud or some kind of co… --- ## [Develop an Elastic plugin for automatic index restore when you need them](https://discuss.elastic.co/t/develop-an-elastic-plugin-for-automatic-index-restore-when-you-need-them/182516)
**Author:** [@Victor\_Guimaraes](https://discuss.elastic.co/u/Victor_Guimaraes)\ **Replies:** 6\ **Last updated:** [May 24, 2019, 7:49pm UTC](https://discuss.elastic.co/t/develop-an-elastic-plugin-for-automatic-index-restore-when-you-need-them/182516 "2019-05-24T19:49:04Z")
Hello I'm using ElasticSearch 6.7.2 and I have a massive amount of documents organized on daily indexes. So, for financial reasons, I decided to snapshot the old indexes (with more than 9 months) in Google Cloud Storage… --- ## [Internal API to query against a shard](https://discuss.elastic.co/t/internal-api-to-query-against-a-shard/182303)
**Author:** [@cecoke](https://discuss.elastic.co/u/cecoke)\ **Replies:** 8\ **Last updated:** [May 24, 2019, 7:48pm UTC](https://discuss.elastic.co/t/internal-api-to-query-against-a-shard/182303 "2019-05-24T19:48:08Z")
Hi Elastic, I wonder if there is any internal API I can use to query against a local shard. My code might be a plugin with a query and the id of a local shard on the node. I want to execute the query on the specified sh… --- ## [\[solved\] - BulkIndexError - Compressor detection can only be called on some xcontent bytes or compressed xcontent bytes](https://discuss.elastic.co/t/solved-bulkindexerror-compressor-detection-can-only-be-called-on-some-xcontent-bytes-or-compressed-xcontent-bytes/181725)
**Author:** [@JH82](https://discuss.elastic.co/u/JH82)\ **Replies:** 2\ **Last updated:** [May 24, 2019, 7:15pm UTC](https://discuss.elastic.co/t/solved-bulkindexerror-compressor-detection-can-only-be-called-on-some-xcontent-bytes-or-compressed-xcontent-bytes/181725 "2019-05-24T19:15:05Z")
Hello ! I've problem with bulkinsert. I don't understand this error ('Unexpected error:', (\, BulkIndexError('7 document(s) failed to index.', \[{u'index': {u'status':… --- ## [Does ELK support Oracle SAAS applications](https://discuss.elastic.co/t/does-elk-support-oracle-saas-applications/182662)
**Author:** [@sanchitdba](https://discuss.elastic.co/u/sanchitdba)\ **Replies:** 0\ **Last updated:** [May 24, 2019, 1:35pm UTC](https://discuss.elastic.co/t/does-elk-support-oracle-saas-applications/182662 "2019-05-24T13:35:20Z")
Hi All, My one of the client want to monitor the Oracle SAAS application like SOACS and all. could you please tell me does ELK support Oracle SAAS application. If yes then Please share the link. Regards, San [Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1285) [Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1287)