I need guy who can install and configure elasticsearch

avagyanlevon · January 17, 2021, 5:53pm

I need guy who can install and configure elasticsearch. I have problem with elasticsearch with my website, it was stop works after restarting server, now I need expert who can install and configuration it. Sorry for my English.

Thanks

dadoonet · January 17, 2021, 6:43pm

Welcome!

Elastic can provide support but IMO the easiest/cheapest thing to do is to start a cluster on cloud.elastic.co. You will have a cluster running in few minutes.

14 days all free to test it.

avagyanlevon · January 17, 2021, 6:56pm

Thank you very much for your reply, Its ok for me but I don't know what I need to do, and I need a guy to install and configure all things for me, I will pay sure.

Thanks

dadoonet · January 18, 2021, 4:13am

Why not just starting a cluster on cloud.elastic.co?

elasticforme · January 18, 2021, 4:18am

Like david said. it is very easy to do.

First of all. tell us what you have and when you said it is not working? do you have any log, any error?
post here and expert here will help you start that up in no time.

avagyanlevon · January 18, 2021, 4:39am

I have a website www.stockerwill.com
Also I hvae installed elasticsearch on my hosting. All was work correct with my script before my server restarted. Then I try to remove elasticsearch and remove all index. Please check screenshot from my admin panel.
el1

Now when I try to test server it says error. Also please check the screenshot from my shell-client

Sorry again for my English. All things works good before my server was restarted.

Thanks

avagyanlevon · January 18, 2021, 11:57am

Hi, I was able to install elasticsearch and creat index, but when I switch on from my website all content is hide from site. Please check screenshots.

This is zip files from etc elasticsearch folder

If need anything else I will send.

Thanks

dadoonet · January 18, 2021, 12:02pm

Please don't post images of text as they are hard to read, may not display correctly for everyone, and are not searchable.

Instead, paste the text and format it with </> icon or pairs of triple backticks (```), and check the preview window to make sure it's properly formatted before posting it. This makes it more likely that your question will receive a useful answer.

It would be great if you could update your post to solve this.

avagyanlevon · January 18, 2021, 12:21pm

(Redirecting to /bin/systemctl status -l elasticsearch.service
● elasticsearch.service - Elasticsearch
Loaded: loaded (/usr/lib/systemd/system/elasticsearch.service; disabled; vendor preset: disabled)
Active: active (running) since Mon 2021-01-18 14:30:59 +03; 48min ago
Docs: http://www.elastic.co
Main PID: 11896 (java)
CGroup: /system.slice/elasticsearch.service
└─11896 /bin/java -Xms1g -Xmx1g -XX:+UseConcMarkSweepGC -XX:CMSInitiatingOccupancyFraction=75 -XX:+UseCMSInitiatingOccupancyOnly -Des.netwo
rkaddress.cache.ttl=60 -Des.networkaddress.cache.negative.ttl=10 -XX:+AlwaysPreTouch -Xss1m -Djava.awt.headless=true -Dfile.encoding=UTF-8 -Djna.nosys
=true -XX:-OmitStackTraceInFastThrow -Dio.netty.noUnsafe=true -Dio.netty.noKeySetOptimization=true -Dio.netty.recycler.maxCapacityPerThread=0 -Dlog4j.
shutdownHookEnabled=false -Dlog4j2.disable.jmx=true -Djava.io.tmpdir=/tmp/elasticsearch-6363547287932206120 -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDu
mpPath=/var/lib/elasticsearch -XX:ErrorFile=/var/log/elasticsearch/hs_err_pid%p.log -XX:+PrintGCDetails -XX:+PrintGCDateStamps -XX:+PrintTenuringDistr
ibution -XX:+PrintGCApplicationStoppedTime -Xloggc:/var/log/elasticsearch/gc.log -XX:+UseGCLogFileRotation -XX:NumberOfGCLogFiles=32 -XX:GCLogFileSize
=64m -Des.path.home=/usr/share/elasticsearch -Des.path.conf=/etc/elasticsearch -Des.distribution.flavor=oss -Des.distribution.type=rpm -cp /usr/share/
elasticsearch/lib/* org.elasticsearch.bootstrap.Elasticsearch -p /var/run/elasticsearch/elasticsearch.pid --quiet

Jan 18 14:30:59 cloud.stockerwill.com systemd[1]: Started Elasticsearch. )

avagyanlevon · January 18, 2021, 12:23pm

I think elasticsearch working on hosting, but when I switch on elasticsearch on website all my content unvisible.

Thanks

dadoonet · January 18, 2021, 12:55pm

Please format your code, logs or configuration files using </> icon as explained in this guide and not the citation button. It will make your post more readable.

Or use markdown style like:

```
CODE
```

This is the icon to use if you are not using markdown format:

There's a live preview panel for exactly this reasons.

Lots of people read these forums, and many of them will simply skip over a post that is difficult to read, because it's just too large an investment of their time to try and follow a wall of badly formatted text.
If your goal is to get an answer to your questions, it's in your interest to make it as easy to read and understand as possible.

It looks like Elasticsearch is running.

Please share the elasticsearch logs. Should be in /var/log/elasticsearch/

avagyanlevon · January 18, 2021, 12:57pm

Please check this zip file there are all log files

dadoonet · January 18, 2021, 4:23pm

Please next time, just copy/paste the content here instead of using a zip file. The log file is elasticsearch.log. It can take some time to download the file uncompress, etc vs just reading some logs over the phone directly. So better to paste logs as text instead.

Here are few things we can tell:

[2021-01-18T14:31:12,990][INFO ][o.e.h.n.Netty4HttpServerTransport] [CsrXKoM] publish_address {127.0.0.1:9200}, bound_addresses {127.0.0.1:9200}

This means that elasticsearch is running fine. But it will be available only from localhost. So if your application is running on the same host, that's ok. Otherwise you will need to change some settings.

[2021-01-18T14:31:03,776][INFO ][o.e.n.Node               ] [CsrXKoM] version[6.8.13], pid[11896], build[oss/rpm/be13c69/2020-10-16T09:09:46.555371Z], OS[Linux/3.10.0-1160.11.1.el7.x86_64/amd64], JVM[Red Hat, Inc./OpenJDK 64-Bit Server VM/1.8.0_275/25.275-b01]

Not sure which version is expected. Is your application compatible with 6.x or 7.x? If the later, I'd install the latest elasticsearch version instead.

[2021-01-18T14:43:05,040][DEBUG][o.e.a.s.TransportSearchAction] [CsrXKoM] [stockerwill][0], node[CsrXKoMuTcS1kLZjIkztkw], [P], s[STARTED], a[id=KOcvMGolQQ6ATf1E-vzsaQ]: Failed to execute [SearchRequest{searchType=QUERY_THEN_FETCH, indices=[stockerwill], indicesOptions=IndicesOptions[ignore_unavailable=false, allow_no_indices=true, expand_wildcards_open=true, expand_wildcards_closed=false, allow_aliases_to_multiple_indices=true, forbid_closed_indices=true, ignore_aliases=false, ignore_throttled=true], types=[_doc], routing='null', preference='null', requestCache=null, scroll=null, maxConcurrentShardRequests=5, batchedReduceSize=512, preFilterShardSize=128, allowPartialSearchResults=true, localClusterAlias=null, getOrCreateAbsoluteStartMillis=-1, source={"from":0,"size":48,"query":{"bool":{"filter":[{"term":{"published":{"value":1,"boost":1.0}}},{"terms":{"media_id":[1],"boost":1.0}}],"adjust_pure_negative":true,"boost":1.0}},"_source":false,"sort":[{"viewed":{"order":"desc"}}]}}] lastShard [true]
org.elasticsearch.transport.RemoteTransportException: [CsrXKoM][127.0.0.1:9300][indices:data/read/search[phase/query]]
Caused by: java.lang.IllegalArgumentException: Fielddata is disabled on text fields by default. Set fielddata=true on [viewed] in order to load fielddata in memory by uninverting the inverted index. Note that this can however use significant memory. Alternatively use a keyword field instead.
	at org.elasticsearch.index.mapper.TextFieldMapper$TextFieldType.fielddataBuilder(TextFieldMapper.java:779) ~[elasticsearch-6.8.13.jar:6.8.13]
	at org.elasticsearch.index.fielddata.IndexFieldDataService.getForField(IndexFieldDataService.java:116) ~[elasticsearch-6.8.13.jar:6.8.13]
	at org.elasticsearch.index.query.QueryShardContext.getForField(QueryShardContext.java:177) ~[elasticsearch-6.8.13.jar:6.8.13]
	at org.elasticsearch.search.sort.FieldSortBuilder.build(FieldSortBuilder.java:353) ~[elasticsearch-6.8.13.jar:6.8.13]
	at org.elasticsearch.search.sort.SortBuilder.buildSort(SortBuilder.java:153) ~[elasticsearch-6.8.13.jar:6.8.13]
	at org.elasticsearch.search.SearchService.parseSource(SearchService.java:818) ~[elasticsearch-6.8.13.jar:6.8.13]
	at org.elasticsearch.search.SearchService.createContext(SearchService.java:648) ~[elasticsearch-6.8.13.jar:6.8.13]
	at org.elasticsearch.search.SearchService.createAndPutContext(SearchService.java:599) ~[elasticsearch-6.8.13.jar:6.8.13]
	at org.elasticsearch.search.SearchService.executeQueryPhase(SearchService.java:387) ~[elasticsearch-6.8.13.jar:6.8.13]
	at org.elasticsearch.search.SearchService.access$100(SearchService.java:126) ~[elasticsearch-6.8.13.jar:6.8.13]
	at org.elasticsearch.search.SearchService$2.onResponse(SearchService.java:359) [elasticsearch-6.8.13.jar:6.8.13]
	at org.elasticsearch.search.SearchService$2.onResponse(SearchService.java:355) [elasticsearch-6.8.13.jar:6.8.13]
	at org.elasticsearch.search.SearchService$4.doRun(SearchService.java:1117) [elasticsearch-6.8.13.jar:6.8.13]
	at org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37) [elasticsearch-6.8.13.jar:6.8.13]
	at org.elasticsearch.common.util.concurrent.TimedRunnable.doRun(TimedRunnable.java:41) [elasticsearch-6.8.13.jar:6.8.13]
	at org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:778) [elasticsearch-6.8.13.jar:6.8.13]
	at org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37) [elasticsearch-6.8.13.jar:6.8.13]
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [?:1.8.0_275]
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [?:1.8.0_275]
	at java.lang.Thread.run(Thread.java:748) [?:1.8.0_275]

This is more important IMO.

The query seems wrong or it does not match the mapping. I removed the non important parts and here is actually the query which is failing:

{
   "query":{
      "bool":{
         "filter":[
            {
               "term":{
                  "published":{
                     "value":1
                  }
               }
            },
            {
               "terms":{
                  "media_id":[
                     1
                  ]
               }
            }
         ]
      }
   },
   "sort":[
      {
         "viewed":{
            "order":"desc"
         }
      }
   ]
}

The problem is here the sort part. You are trying to sort on a field named viewed but this field is not allowed to do sorting. because it's not a keyword field nor it has fielddata: true on the text field.

So, elasticsearch is running well.

You now need to understand why the mapping is incorrect.
My guess is that the software which creates the index does not use index templates.

May be you need to click first on "create index" button before trying to reindex anything.

So I'd

DELETE stockerwill

And the click on create index and only then click on "reindex publications".
My guess is that the create index button creates the index and the correct mapping.

avagyanlevon · January 18, 2021, 4:39pm

Thanks so much for your help, just a question in which file I need to check The query ?

Thanks

dadoonet · January 18, 2021, 5:19pm

There's no file for that. Your software emits the query to elasticsearch. Not elasticsearch itself. So this is a question to ask to the software you are using.

avagyanlevon · January 18, 2021, 6:23pm

   object(stdClass)#3330 (2) { ["error"]=> object(stdClass)#3328 (4) { ["root_cause"]=> array(1) { [0]=> object(stdClass)#3306 (2) { ["type"]=> string(24) "mapper_parsing_exception" ["reason"]=> string(910) "Root mapping definition has unsupported parameters: [featured : {type=integer}] [keywords : {normalizer=custom_sort_normalizer, type=keyword}] [data : {index=true, type=integer}] [rating : {index=true, type=float}] [description : {type=text}] [source : {type=text}] [title : {type=text}] [userid : {type=integer}] [colors : {type=keyword}] [duration : {type=integer}] [content_type : {type=keyword}] [viewed : {index=true, type=integer}] [media_id : {type=integer}] [exclusive : {type=integer}] [categories : {type=integer}] [free : {type=integer}] [editorial : {type=integer}] [orientation : {type=integer}] [frames : {type=text}] [author : {type=keyword}] [format : {type=text}] [holder : {type=text}] [rendering : {type=text}] [published : {type=integer}] [downloaded : {index=true, type=integer}] [rights_managed : {type=integer}] [adult : {type=integer}] [contacts : {type=integer}] [ratio : {type=text}]" } } ["type"]=> string(24) "mapper_parsing_exception" ["reason"]=> string(948) "Failed to parse mapping [properties]: Root mapping definition has unsupported parameters: [featured : {type=integer}] [keywords : {normalizer=custom_sort_normalizer, type=keyword}] [data : {index=true, type=integer}] [rating : {index=true, type=float}] [description : {type=text}] [source : {type=text}] [title : {type=text}] [userid : {type=integer}] [colors : {type=keyword}] [duration : {type=integer}] [content_type : {type=keyword}] [viewed : {index=true, type=integer}] [media_id : {type=integer}] [exclusive : {type=integer}] [categories : {type=integer}] [free : {type=integer}] [editorial : {type=integer}] [orientation : {type=integer}] [frames : {type=text}] [author : {type=keyword}] [format : {type=text}] [holder : {type=text}] [rendering : {type=text}] [published : {type=integer}] [downloaded : {index=true, type=integer}] [rights_managed : {type=integer}] [adult : {type=integer}] [contacts : {type=integer}] [ratio : {type=text}]" ["caused_by"]=> object(stdClass)#3283 (2) { ["type"]=> string(24) "mapper_parsing_exception" ["reason"]=> string(910) "Root mapping definition has unsupported parameters: [featured : {type=integer}] [keywords : {normalizer=custom_sort_normalizer, type=keyword}] [data : {index=true, type=integer}] [rating : {index=true, type=float}] [description : {type=text}] [source : {type=text}] [title : {type=text}] [userid : {type=integer}] [colors : {type=keyword}] [duration : {type=integer}] [content_type : {type=keyword}] [viewed : {index=true, type=integer}] [media_id : {type=integer}] [exclusive : {type=integer}] [categories : {type=integer}] [free : {type=integer}] [editorial : {type=integer}] [orientation : {type=integer}] [frames : {type=text}] [author : {type=keyword}] [format : {type=text}] [holder : {type=text}] [rendering : {type=text}] [published : {type=integer}] [downloaded : {index=true, type=integer}] [rights_managed : {type=integer}] [adult : {type=integer}] [contacts : {type=integer}] [ratio : {type=text}]" } } ["status"]=> int(400) }
Error. ElasticSearch Index was not created.

avagyanlevon · January 18, 2021, 6:23pm

Thanks, when I try to creat index from my admin panel this is appear

dadoonet · January 18, 2021, 9:22pm

Are you sure your project/application is compatible with this version of elasticsearch? What product is it?

avagyanlevon · January 20, 2021, 4:21pm

I have updated elasticsearch 7 version, when I changed the index name from stockerwill to pvs, my website content start working, but problem is that not all content going indexed, I see that only 38801 items was indexed. When I try to start cron manually I see that every time some content going indexed.

[root@cloud ~]# curl localhost:9200/_cat/indices
yellow open stockerwill zmweuII0TnKtVtiMVCRY-w 1 1 97867 3958 174.7mb 174.7mb
yellow open pvs RaiwVudjRbKeM7iMhBXXMQ 1 1 38801 3997 309.5mb 309.5mb
green open .kibana_1 giS6XWYNRj6z3UaHu8p8IA 1 0 2 0 9.1kb 9.1kb
yellow open test_index 7O4AcsG1TbCuHaUCVzCoig 5 1 0 0 1.2kb 1.2kb

Also I checked yml file and saw this, is it configured well, or I need to change anything there?

# ---------------------------------- Cluster -----------------------------------
#
# Use a descriptive name for your cluster:
#
#cluster.name: my-application
#
# ------------------------------------ Node ------------------------------------
#
# Use a descriptive name for the node:
#
#node.name: node-1
#
# Add custom attributes to the node:
#
#node.attr.rack: r1
#

Thanks

avagyanlevon · January 20, 2021, 4:24pm

Also please check this

[root@cloud ~]# GET /_cat/shards? v&h=n,index,shard,prirep,state,sto,sc,unassigned.reason,unassigned.details&s=sto,index                              
[1] 15803                                                                                                                                             
[2] 15804                                                                                                                                             
[root@cloud ~]# error code: 1010

Topic		Replies	Views
Not able to make elasticsearch work on our website Elasticsearch	7	1373	July 5, 2017
Cluster config Elasticsearch	1	155	August 29, 2023
Server configuration suggestions Elasticsearch	2	459	July 6, 2017
How to configure elasticserch on cloud? Elasticsearch	2	409	October 25, 2018
ElasticSearch Performance Elasticsearch	4	348	October 12, 2020

I need guy who can install and configure elasticsearch

Related topics