Index with 5 shards, each shard has reached 50gb

[dawood_abdullah]

Hi,

All my shards have reached 50gb, below are the details

data_v1 2 r STARTED 167362666 50.1gb 10.0.1.37 node-3
data_v1 2 r STARTED 167362666 50.7gb 10.0.0.176 node-2
data_v1 2 p STARTED 167362666 50.6gb 10.0.0.253 node-1
data_v1 1 r STARTED 153217005 45.4gb 10.0.1.37 node-3
data_v1 1 p STARTED 153217005 47.1gb 10.0.0.176 node-2
data_v1 1 r STARTED 153217005 47.2gb 10.0.0.253 node-1
data_v1 3 r STARTED 170138273 53.8gb 10.0.1.37 node-3
data_v1 3 r STARTED 170138273 54gb 10.0.0.176 node-2
data_v1 3 p STARTED 170138273 54gb 10.0.0.253 node-1
data_v1 4 r STARTED 169475783 50.4gb 10.0.1.37 node-3
data_v1 4 r STARTED 169475783 50.9gb 10.0.0.176 node-2
data_v1 4 p STARTED 169475783 50.8gb 10.0.0.253 node-1
data_v1 0 r STARTED 179150715 52gb 10.0.1.37 node-3
data_v1 0 r STARTED 179150823 52.6gb 10.0.0.176 node-2
data_v1 0 p STARTED 179150693 52.7gb 10.0.0.253 node-1

I am planning to add another index "data_v2", what would be best strategy, if I have to do following operations:

1. Index in new index "data_v2"
2. Search across both the indexes "data_v1" and "data_v2"
3. Update / Delete across both the indexes "data_v1" and "data_v2"

Please suggest what will be right strategy if I have to achieve above usecases.

Thanks.

[Christian_Dahlqvist]

You can easily search across multiple indices but in order to update or delete you may st first identify which index the document resides in. You might be better off staying with a single index but increase the number of shards through reindexing or the split index api.

[dawood_abdullah]

Thanks Christian for the response, but how many shards is recommended for an Index, if say every Six - Eight months each of my Shard reaches 50gb.