Upgrade from 6.4 to 7.2

han1 · July 2, 2019, 2:27pm

We have just upgraded our deployment from 6 to version 7.2
We have created 7 indices and in Kabana it show all of them having documents.

However, when we try to view the documents, only one of the indices shows the docs and the others return total of Zero. Even though in the index management tab the indices ALL have documents in them.

Please advise what we are overlooking

dadoonet · July 2, 2019, 3:36pm

What gives:

GET /_cat/indices?v

You did not install 6.8 and then used the upgrade assistant?

han1 · July 2, 2019, 4:01pm

Hi
No. We created a new deployment. everything Fresh and added new Indices

userguy · July 2, 2019, 4:14pm

can you paste output of GET /_cat/indices

han1 · July 2, 2019, 4:15pm

Sure. Here it is:

health status index                                     uuid                   pri rep docs.count docs.deleted store.size pri.store.size
green  open   building-name-and-number-group-ie-2018-q4 Gx-XwgXjQuGcI6tH37QCNw   1   1        164            0    163.3kb         81.6kb
green  open   address-ie-2018-q4                        95mb4-DvRVOX_q918af4UA   1   1      10000            0     18.8mb          9.4mb
green  open   thoroughfare-group-ie-2018-q4             J-ppzCNzQUOykEYi7J3EJQ   1   1        338           62    342.2kb        171.1kb
green  open   apm-7.2.0-onboarding-2019.07.02           AaH-e7rVTraW-Ix2FF4uTg   1   1          1            0     12.5kb          6.2kb
green  open   .security-7                               a8Nmbw8PRgSsIzUW_h65OQ   1   1         38            0    162.4kb         63.1kb
green  open   building-name-group-ie-2018-q4            hPf8p2F-SAuZtzgItku6Jw   1   1         81            0    121.3kb         60.6kb
green  open   .kibana_1                                 tx8QvopLQFmj918NUixguw   1   1          7            0     80.8kb         37.4kb
green  open   building-number-group-ie-2018-q4          i21rs4ElRyq8xsIv0BthGQ   1   1         59            0     60.6kb         30.3kb
green  open   secondary-thoroughfare-group-ie-2018-q4   0ce9CGkxQHu1DsP2ffnkuA   1   1         10            0     18.9kb          9.4kb
green  open   building-group-ie-2018-q4                 K20f_1IuS4-1GG0YZIdVDQ   1   1         68            4       96kb           48kb
green  open   .kibana_task_manager                      TZiEhVEFTui28xA8JsVnnA   1   1          2            0     50.1kb         12.7kb

userguy · July 2, 2019, 4:19pm

What does it show when you do GET /index_name/_search?pretty=true

han1 · July 2, 2019, 4:21pm

Command:
GET /building-name-and-number-group-ie/_search
{
"query": {
"match_all": {}
}
}

OUTPUT:

{
"took" : 1,
"timed_out" : false,
"_shards" : {
"total" : 1,
"successful" : 1,
"skipped" : 0,
"failed" : 0
},
"hits" : {
"total" : {
"value" : 0,
"relation" : "eq"
},
"max_score" : null,
"hits" :
}
}

han1 · July 2, 2019, 4:22pm

Also the same if you use full index name instead of alias:
building-name-and-number-group-ie-2018-q4

userguy · July 2, 2019, 4:23pm

what does the logs say wen you do query also can you share , /_cluster/health?pretty=1 and /_cat/shards

han1 · July 2, 2019, 4:24pm

Sorry. Don't know how to view the logs. But should it be this difficult when Elasticsearch says there are say 200 docs but nothing for a match all query?

userguy · July 2, 2019, 4:26pm

You can view logs on server under /var/log/elasticsearch/Clustername.log

Also We need to check what is happening in background .

han1 · July 2, 2019, 4:26pm

Found the logs. Says nothing to indicate any errors!

userguy · July 2, 2019, 4:27pm

can you post this

han1 · July 2, 2019, 4:28pm

Sure. Here it is:

{
  "cluster_name" : "fc8b85de62274f64af5355e0785c2a8c",
  "status" : "green",
  "timed_out" : false,
  "number_of_nodes" : 3,
  "number_of_data_nodes" : 2,
  "active_primary_shards" : 11,
  "active_shards" : 22,
  "relocating_shards" : 0,
  "initializing_shards" : 0,
  "unassigned_shards" : 0,
  "delayed_unassigned_shards" : 0,
  "number_of_pending_tasks" : 0,
  "number_of_in_flight_fetch" : 0,
  "task_max_waiting_in_queue_millis" : 0,
  "active_shards_percent_as_number" : 100.0
}

han1 · July 2, 2019, 4:33pm

And the shards:

thoroughfare-group-ie-2018-q4             0 p STARTED   338 171.1kb 172.27.135.207 instance-0000000001
thoroughfare-group-ie-2018-q4             0 r STARTED   338 171.1kb 172.27.60.248  instance-0000000000
.kibana_1                                 0 p STARTED     7  37.4kb 172.27.135.207 instance-0000000001
.kibana_1                                 0 r STARTED     7  43.3kb 172.27.60.248  instance-0000000000
address-ie-2018-q4                        0 p STARTED 10000   9.4mb 172.27.135.207 instance-0000000001
address-ie-2018-q4                        0 r STARTED 10000   9.4mb 172.27.60.248  instance-0000000000
building-number-group-ie-2018-q4          0 p STARTED    59  30.3kb 172.27.135.207 instance-0000000001
building-number-group-ie-2018-q4          0 r STARTED    59  30.3kb 172.27.60.248  instance-0000000000
building-name-and-number-group-ie-2018-q4 0 p STARTED   164  81.6kb 172.27.135.207 instance-0000000001
building-name-and-number-group-ie-2018-q4 0 r STARTED   164  81.6kb 172.27.60.248  instance-0000000000
apm-7.2.0-onboarding-2019.07.02           0 p STARTED     1   6.2kb 172.27.135.207 instance-0000000001
apm-7.2.0-onboarding-2019.07.02           0 r STARTED     1   6.3kb 172.27.60.248  instance-0000000000
.security-7                               0 r STARTED    38  99.2kb 172.27.135.207 instance-0000000001
.security-7                               0 p STARTED    38  63.1kb 172.27.60.248  instance-0000000000
building-name-group-ie-2018-q4            0 p STARTED    81  60.6kb 172.27.135.207 instance-0000000001
building-name-group-ie-2018-q4            0 r STARTED    81  60.6kb 172.27.60.248  instance-0000000000
.kibana_task_manager                      0 p STARTED     2  12.7kb 172.27.135.207 instance-0000000001
.kibana_task_manager                      0 r STARTED     2  37.4kb 172.27.60.248  instance-0000000000
secondary-thoroughfare-group-ie-2018-q4   0 p STARTED    10   9.4kb 172.27.135.207 instance-0000000001
secondary-thoroughfare-group-ie-2018-q4   0 r STARTED    10   9.4kb 172.27.60.248  instance-0000000000
building-group-ie-2018-q4                 0 p STARTED    68    48kb 172.27.135.207 instance-0000000001
building-group-ie-2018-q4                 0 r STARTED    68    48kb 172.27.60.248  instance-0000000000

dadoonet · July 2, 2019, 5:06pm

Please format your code, logs or configuration files using </> icon as explained in this guide and not the citation button. It will make your post more readable.

Or use markdown style like:

```
CODE
```

This is the icon to use if you are not using markdown format:

There's a live preview panel for exactly this reasons.

Lots of people read these forums, and many of them will simply skip over a post that is difficult to read, because it's just too large an investment of their time to try and follow a wall of badly formatted text.
If your goal is to get an answer to your questions, it's in your interest to make it as easy to read and understand as possible.

What is the output of:

GET /_cat/aliases?v

han1 · July 2, 2019, 5:14pm

    alias                             index                                     filter routing.index routing.search
building-group-ie                 building-group-ie-2018-q4                 -      -             -
thoroughfare-group-ie             thoroughfare-group-ie-2018-q4             -      -             -
secondary-thoroughfare-group-ie   secondary-thoroughfare-group-ie-2018-q4   -      -             -
building-name-group-ie            building-name-group-ie-2018-q4            -      -             -
.security                         .security-7                               -      -             -
building-number-group-ie          building-number-group-ie-2018-q4          -      -             -
address-ie                        address-ie-2018-q4                        -      -             -
building-name-and-number-group-ie building-name-and-number-group-ie-2018-q4 -      -             -
.kibana                           .kibana_1                                 -      -             -

han1 · July 2, 2019, 5:51pm

Did this give you any useful insight?

dadoonet · July 2, 2019, 7:30pm

What is the output of:

GET /building-name-and-number-group-ie-2018-q4/_search?size=0

What tool do you use to run this query?

han1 · July 2, 2019, 8:13pm

{
  "took" : 0,
  "timed_out" : false,
  "_shards" : {
    "total" : 1,
    "successful" : 1,
    "skipped" : 0,
    "failed" : 0
  },
  "hits" : {
    "total" : {
      "value" : 0,
      "relation" : "eq"
    },
    "max_score" : null,
    "hits" : [ ]
  }
}

I use the dev tools in Kibana

Topic		Replies	Views
"GET _cat/indices" does not output all the indices Elasticsearch	3	2501	January 13, 2022
GET /_cat/indices not showing all indices after upgrade to 7.3 Elasticsearch	1	21	September 6, 2024
Number of documents in a Kibana search does not match Elasticsearch Kibana	5	21	September 3, 2024
_cat/indices docs.count does not match indice _count - why? Elasticsearch	2	4116	July 5, 2017
Unable to get all indices in the data folder that have been reindexed from 5.6 to 6.8 however I can see indices when I use query _cat /indices Elasticsearch	9	361	March 3, 2022

Upgrade from 6.4 to 7.2

Related Topics