# getting UnavailableShardsException on PUT, and NoShardAvailableActionException on Get
**URL:** https://discuss.elastic.co/t/getting-unavailableshardsexception-on-put-and-noshardavailableactionexception-on-get/8675
**Category:** Elasticsearch
**Created:** [August 8, 2012, 2:51pm UTC](https://discuss.elastic.co/t/getting-unavailableshardsexception-on-put-and-noshardavailableactionexception-on-get/8675 "2012-08-08T14:51:40Z")
**Posts on this page:** 8
**Page:** 1
### Author:  [@ryaker](https://discuss.elastic.co/u/ryaker)
#### Post date: [August 8, 2012, 2:51pm UTC](https://discuss.elastic.co/t/getting-unavailableshardsexception-on-put-and-noshardavailableactionexception-on-get/8675/1 "2012-08-08T14:51:40Z")
Yesterday evening our EC2 instance running ElasticSearch became
unreachable. Ping, SSh and elasticsearch were all unreachable even after
multiple reboots.
The solution
- spawn up a new EC2 instance
- use chef to provision it as an elasticsearch server (same
elasticsearch.yml).
- Point our task server which we use to build the indexes, and build our
Food, SavedMeal, Recipe, and UserSet(Groups) indexes
- Point our two web servers which search the index, and add new
documents at the new server
- Open the site back up
The first problem I ran into, and seem to have solved (although not sure
how great solution is) was too many open files.
I am running the start-stop-daemon via sudo which is using the limits.conf
info now and has raised limit from 1024.
Search is now snappy and consistent.
However now not able to add documents to the index.
I'm getting
UnavailableShardsException[[default][4] [2] shardIt, [0] active : Timeout
waiting for [1m], request: index {[default][Food][206621],
source[{"id":206621,"name":"French Vanilla Formula 1
(US)","description":"","slug":"french-vanilla-formula-1-us","media\_id":null,"user\_id":19645,"serving\_size":"2
scoops","gram\_weight":null,"calories":null,"calories\_from\_fat":10,"total\_fat":1,"saturated\_fat":null,"polyunsaturated\_fat":null,"monounsaturated\_fat":null,"cholesterol":null,"sodium":140,"potassium":210,"total\_carbohydrate":13,"dietary\_fiber":3,"sugars":9,"protein":9,"vitamin\_a":25,"vitamin\_c":25,"calcium":8,"iron":15,"vitamin\_d":25,"vitamin\_e":25,"vitamin\_k":0,"thiamin":25,"riboflavin":25,"niacin":25,"vitamin\_b6":25,"folic\_acid":25,"vitamin\_b12":25,"pantothenic\_acid":25,"phosphorus":15,"magnesium":10,"zinc":25,"selenium":15,"copper":25,"manganese":null,"kcal":90,"kj":null,"alcohol":null,"caffeine":null,"rank":null,"counter":null,"expert\_rank":null,"pantry\_counter":null,"brand":"Herbalife","overall\_rank":null,"verified":false,"source":"iChange","culture":"en\_US","indexable":1}]}]
And if I try and go directly to an indexed item that is returning properly
from the search I get
{"error": "NoShardAvailableActionException[[default][0] No shard available
for [Food#16447]]","status": 500}
This is my elasticsearch.yml
_cluster: name: ichange\_cluster index: store: type: fs cloud: aws:
access\_key: AKIAJ2XMXZ6C4EUYP36Q secret\_key:
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 network: host: 0.0.0.0 gateway:
type: local recover\_after\_nodes: 1 recover\_after\_time: 5m expected\_nodes: 1
path: logs: /var/log/elasticsearch data: /var/lib/elasticsearch work:
/tmp/elasticsearch_
---
### Author:  [@ryaker](https://discuss.elastic.co/u/ryaker)
#### Post date: [August 8, 2012, 3:22pm UTC](https://discuss.elastic.co/t/getting-unavailableshardsexception-on-put-and-noshardavailableactionexception-on-get/8675/2 "2012-08-08T15:22:44Z")
> When I try a query
[http://ec2-23-23-23-246.compute-1.amazonaws.com:9200/\_search?pretty=true'%20-d%20'{"query":{"term":{"name":"apple"}](http://ec2-23-23-23-246.compute-1.amazonaws.com:9200/_search?pretty=true'%20-d%20'%7B%22query%22:%7B%22term%22:%7B%22name%22:%22apple%22%7D)}}'
I get
"\_shards": {"total": 30,"successful": 25,"failed": 5,"failures": [{"index":
"default","shard": 0,"reason": "No active shards"},{"index": "default","
shard": 1,"reason": "No active shards"},{"index": "default","shard": 2,"
reason": "No active shards"},{"index": "default","shard": 3,"reason": "No
active shards"},{"index": "default","shard": 4,"reason": "No active shards"}
]
},
---
### Author:  [@ryaker](https://discuss.elastic.co/u/ryaker)
#### Post date: [August 8, 2012, 3:52pm UTC](https://discuss.elastic.co/t/getting-unavailableshardsexception-on-put-and-noshardavailableactionexception-on-get/8675/3 "2012-08-08T15:52:31Z")
FYI: Not sure how to tell what version of Elasticsearch I'm running.
But all the issues I am seeing that also have failures "reason": "No active
shards" are all in the last month.
This server was setup via chef last night.
On Wednesday, August 8, 2012 7:51:40 AM UTC-7, Ryaker wrote:
> Yesterday evening our EC2 instance running Elasticsearch became
> unreachable. Ping, SSh and elasticsearch were all unreachable even after
> multiple reboots.
> The solution
>
> - spawn up a new EC2 instance
> - use chef to provision it as an elasticsearch server (same
> elasticsearch.yml).
> - Point our task server which we use to build the indexes, and build
> our Food, SavedMeal, Recipe, and UserSet(Groups) indexes
> - Point our two web servers which search the index, and add new
> documents at the new server
> - Open the site back up
>
> The first problem I ran into, and seem to have solved (although not sure
> how great solution is) was too many open files.
> I am running the start-stop-daemon via sudo which is using the limits.conf
> info now and has raised limit from 1024.
>
> Search is now snappy and consistent.
>
> However now not able to add documents to the index.
>
> I'm getting
> UnavailableShardsException[[default][4] [2] shardIt, [0] active : Timeout
> waiting for [1m], request: index {[default][Food][206621],
> source[{"id":206621,"name":"French Vanilla Formula 1
> (US)","description":"","slug":"french-vanilla-formula-1-us","media\_id":null,"user\_id":19645,"serving\_size":"2
> scoops","gram\_weight":null,"calories":null,"calories\_from\_fat":10,"total\_fat":1,"saturated\_fat":null,"polyunsaturated\_fat":null,"monounsaturated\_fat":null,"cholesterol":null,"sodium":140,"potassium":210,"total\_carbohydrate":13,"dietary\_fiber":3,"sugars":9,"protein":9,"vitamin\_a":25,"vitamin\_c":25,"calcium":8,"iron":15,"vitamin\_d":25,"vitamin\_e":25,"vitamin\_k":0,"thiamin":25,"riboflavin":25,"niacin":25,"vitamin\_b6":25,"folic\_acid":25,"vitamin\_b12":25,"pantothenic\_acid":25,"phosphorus":15,"magnesium":10,"zinc":25,"selenium":15,"copper":25,"manganese":null,"kcal":90,"kj":null,"alcohol":null,"caffeine":null,"rank":null,"counter":null,"expert\_rank":null,"pantry\_counter":null,"brand":"Herbalife","overall\_rank":null,"verified":false,"source":"iChange","culture":"en\_US","indexable":1}]}]
>
> And if I try and go directly to an indexed item that is returning properly
> from the search I get
>
> {"error": "NoShardAvailableActionException[[default][0] No shard
> available for [Food#16447]]","status": 500}
>
> This is my elasticsearch.yml
>
> _cluster: name: ichange\_cluster index: store: type: fs cloud: aws:
> access\_key: AKIAJ2XMXZ6C4EUYP36Q secret\_key:
> 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 network: host: 0.0.0.0 gateway:
> type: local recover\_after\_nodes: 1 recover\_after\_time: 5m expected\_nodes: 1
> path: logs: /var/log/elasticsearch data: /var/lib/elasticsearch work:
> /tmp/elasticsearch_
---
### Author:  [@olof](https://discuss.elastic.co/u/olof)
#### Post date: [August 8, 2012, 4:13pm UTC](https://discuss.elastic.co/t/getting-unavailableshardsexception-on-put-and-noshardavailableactionexception-on-get/8675/4 "2012-08-08T16:13:53Z")
Just in case you didn't consider it, we can connect to your ES instance on
that url. Although I doubt anyone here has malicious intent, you might want
to remove the link if there is anything sensitive in the index.
I connected with elasticsearch-head (that and bigdesk are good monitoring
tools btw) and it seems the index "default" is somehow known by the
cluster, but all the data is missing. There is no status to fetch from it,
but there is metadata (enough to say that there are 5 shards and replica
count 1). Is it present in the filesystem? It should be in the ES data dir
somewhere (data/[clustername]/nodes/0/indices/[indexname] for me in 0.19.4).
You are running 0.16.2 according to the cluster info.
Have you tried restarting ES again? For me, that has sometimes helped to
make it pick up shards.
Den onsdagen den 8:e augusti 2012 kl. 17:52:31 UTC+2 skrev Ryaker:
> FYI: Not sure how to tell what version of Elasticsearch I'm running.
>
> But all the issues I am seeing that also have failures "reason": "No
> active shards" are all in the last month.
>
> This server was setup via chef last night.
>
> On Wednesday, August 8, 2012 7:51:40 AM UTC-7, Ryaker wrote:
>
> > Yesterday evening our EC2 instance running Elasticsearch became
> > unreachable. Ping, SSh and elasticsearch were all unreachable even after
> > multiple reboots.
> > The solution
> >
> > - spawn up a new EC2 instance
> > - use chef to provision it as an elasticsearch server (same
> > elasticsearch.yml).
> > - Point our task server which we use to build the indexes, and build
> > our Food, SavedMeal, Recipe, and UserSet(Groups) indexes
> > - Point our two web servers which search the index, and add new
> > documents at the new server
> > - Open the site back up
> >
> > The first problem I ran into, and seem to have solved (although not sure
> > how great solution is) was too many open files.
> > I am running the start-stop-daemon via sudo which is using the
> > limits.conf info now and has raised limit from 1024.
> >
> > Search is now snappy and consistent.
> >
> > However now not able to add documents to the index.
> >
> > I'm getting
> > UnavailableShardsException[[default][4] [2] shardIt, [0] active : Timeout
> > waiting for [1m], request: index {[default][Food][206621],
> > source[{"id":206621,"name":"French Vanilla Formula 1
> > (US)","description":"","slug":"french-vanilla-formula-1-us","media\_id":null,"user\_id":19645,"serving\_size":"2
> > scoops","gram\_weight":null,"calories":null,"calories\_from\_fat":10,"total\_fat":1,"saturated\_fat":null,"polyunsaturated\_fat":null,"monounsaturated\_fat":null,"cholesterol":null,"sodium":140,"potassium":210,"total\_carbohydrate":13,"dietary\_fiber":3,"sugars":9,"protein":9,"vitamin\_a":25,"vitamin\_c":25,"calcium":8,"iron":15,"vitamin\_d":25,"vitamin\_e":25,"vitamin\_k":0,"thiamin":25,"riboflavin":25,"niacin":25,"vitamin\_b6":25,"folic\_acid":25,"vitamin\_b12":25,"pantothenic\_acid":25,"phosphorus":15,"magnesium":10,"zinc":25,"selenium":15,"copper":25,"manganese":null,"kcal":90,"kj":null,"alcohol":null,"caffeine":null,"rank":null,"counter":null,"expert\_rank":null,"pantry\_counter":null,"brand":"Herbalife","overall\_rank":null,"verified":false,"source":"iChange","culture":"en\_US","indexable":1}]}]
> >
> > And if I try and go directly to an indexed item that is returning
> > properly from the search I get
> >
> > {"error": "NoShardAvailableActionException[[default][0] No shard
> > available for [Food#16447]]","status": 500}
> >
> > This is my elasticsearch.yml
> >
> > _cluster: name: ichange\_cluster index: store: type: fs cloud: aws:
> > access\_key: AKIAJ2XMXZ6C4EUYP36Q secret\_key:
> > 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 network: host: 0.0.0.0 gateway:
> > type: local recover\_after\_nodes: 1 recover\_after\_time: 5m expected\_nodes: 1
> > path: logs: /var/log/elasticsearch data: /var/lib/elasticsearch work:
> > /tmp/elasticsearch_
---
### Author:  [@ryaker](https://discuss.elastic.co/u/ryaker)
#### Post date: [August 8, 2012, 4:24pm UTC](https://discuss.elastic.co/t/getting-unavailableshardsexception-on-put-and-noshardavailableactionexception-on-get/8675/5 "2012-08-08T16:24:05Z")
Nothing sensitive but I deleted the post with the link.
What should the data look like.
in data/[clustername]/nodes/0/indices/food
I see four folders 0-4 in each of thos is an index folder and a translog
folder
in
data/[clustername]/nodes/0/indices/food/0/index I see
0/indices/food/0/index:
total 7560
-rw-r--r-- 1 root root 14 2012-07-19 18:42 \_55\_1.del
-rw-r--r-- 1 root root 890461 2012-07-19 01:10 \_55.fdt
-rw-r--r-- 1 root root 7364 2012-07-19 01:10 \_55.fdx
-rw-r--r-- 1 root root 92 2012-07-19 01:10 \_55.fnm
-rw-r--r-- 1 root root 48615 2012-07-19 01:10 \_55.frq
-rw-r--r-- 1 root root 5524 2012-07-19 01:10 \_55.nrm
-rw-r--r-- 1 root root 66703 2012-07-19 01:10 \_55.prx
-rw-r--r-- 1 root root 876 2012-07-19 01:10 \_55.tii
-rw-r--r-- 1 root root 61733 2012-07-19 01:10 \_55.tis
-rw-r--r-- 1 root root 997 2012-08-07 20:31 \_6i.fdt
-rw-r--r-- 1 root root 12 2012-08-07 20:31 \_6i.fdx
-rw-r--r-- 1 root root 92 2012-08-07 20:31 \_6i.fnm
-rw-r--r-- 1 root root 40 2012-08-07 20:31 \_6i.frq
-rw-r--r-- 1 root root 10 2012-08-07 20:31 \_6i.nrm
-rw-r--r-- 1 root root 79 2012-08-07 20:31 \_6i.prx
-rw-r--r-- 1 root root 35 2012-08-07 20:31 \_6i.tii
-rw-r--r-- 1 root root 321 2012-08-07 20:31 \_6i.tis
-rw-r--r-- 1 root root 9 2012-08-08 10:12 \_6j\_1.del
-rw-r--r-- 1 root root 2048 2012-08-08 09:59 \_6j.fdt
-rw-r--r-- 1 root root 20 2012-08-08 09:59 \_6j.fdx
-rw-r--r-- 1 root root 103 2012-08-08 09:59 \_6j.fnm
-rw-r--r-- 1 root root 46 2012-08-08 09:59 \_6j.frq
-rw-r--r-- 1 root root 18 2012-08-08 09:59 \_6j.nrm
-rw-r--r-- 1 root root 64 2012-08-08 09:59 \_6j.prx
-rw-r--r-- 1 root root 35 2012-08-08 09:59 \_6j.tii
-rw-r--r-- 1 root root 242 2012-08-08 09:59 \_6j.tis
-rw-r--r-- 1 root root 14 2012-06-20 20:10 \_a\_1.del
-rw-r--r-- 1 root root 2988602 2012-06-20 18:40 \_a.fdt
-rw-r--r-- 1 root root 22300 2012-06-20 18:40 \_a.fdx
-rw-r--r-- 1 root root 92 2012-06-20 18:40 \_a.fnm
-rw-r--r-- 1 root root 220586 2012-06-20 18:40 \_a.frq
-rw-r--r-- 1 root root 16726 2012-06-20 18:40 \_a.nrm
-rw-r--r-- 1 root root 220337 2012-06-20 18:40 \_a.prx
-rw-r--r-- 1 root root 4066 2012-06-20 18:40 \_a.tii
-rw-r--r-- 1 root root 303152 2012-06-20 18:40 \_a.tis
-rw-r--r-- 1 root root 651 2012-08-08 10:12 \_checksums-1344420773785
-rw-r--r-- 1 root root 2283797 2012-06-20 18:40 \_l.fdt
-rw-r--r-- 1 root root 18860 2012-06-20 18:40 \_l.fdx
-rw-r--r-- 1 root root 92 2012-06-20 18:40 \_l.fnm
-rw-r--r-- 1 root root 128741 2012-06-20 18:40 \_l.frq
-rw-r--r-- 1 root root 14146 2012-06-20 18:40 \_l.nrm
-rw-r--r-- 1 root root 171440 2012-06-20 18:40 \_l.prx
-rw-r--r-- 1 root root 1615 2012-06-20 18:40 \_l.tii
-rw-r--r-- 1 root root 119432 2012-06-20 18:40 \_l.tis
-rw-r--r-- 1 root root 1180 2012-08-08 10:12 segments\_4c
-rw-r--r-- 1 root root 20 2012-08-08 10:12 segments.gen
-rw-r--r-- 1 root root 0 2012-08-08 10:43 write.lock
I've restarted the server multiple times.
I assume that 0.16.2 is older then 0.19.4 any idea how I'd upgrade
On Wednesday, August 8, 2012 9:13:53 AM UTC-7, olof wrote:
> Just in case you didn't consider it, we can connect to your ES instance on
> that url. Although I doubt anyone here has malicious intent, you might want
> to remove the link if there is anything sensitive in the index.
>
> I connected with elasticsearch-head (that and bigdesk are good monitoring
> tools btw) and it seems the index "default" is somehow known by the
> cluster, but all the data is missing. There is no status to fetch from it,
> but there is metadata (enough to say that there are 5 shards and replica
> count 1). Is it present in the filesystem? It should be in the ES data dir
> somewhere (data/[clustername]/nodes/0/indices/[indexname] for me in 0.19.4).
> You are running 0.16.2 according to the cluster info.
>
> Have you tried restarting ES again? For me, that has sometimes helped to
> make it pick up shards.
>
> Den onsdagen den 8:e augusti 2012 kl. 17:52:31 UTC+2 skrev Ryaker:
>
> > FYI: Not sure how to tell what version of Elasticsearch I'm running.
> >
> > But all the issues I am seeing that also have failures "reason": "No
> > active shards" are all in the last month.
> >
> > This server was setup via chef last night.
> >
> > On Wednesday, August 8, 2012 7:51:40 AM UTC-7, Ryaker wrote:
> >
> > > Yesterday evening our EC2 instance running Elasticsearch became
> > > unreachable. Ping, SSh and elasticsearch were all unreachable even after
> > > multiple reboots.
> > > The solution
> > >
> > > - spawn up a new EC2 instance
> > > - use chef to provision it as an elasticsearch server (same
> > > elasticsearch.yml).
> > > - Point our task server which we use to build the indexes, and build
> > > our Food, SavedMeal, Recipe, and UserSet(Groups) indexes
> > > - Point our two web servers which search the index, and add new
> > > documents at the new server
> > > - Open the site back up
> > >
> > > The first problem I ran into, and seem to have solved (although not sure
> > > how great solution is) was too many open files.
> > > I am running the start-stop-daemon via sudo which is using the
> > > limits.conf info now and has raised limit from 1024.
> > >
> > > Search is now snappy and consistent.
> > >
> > > However now not able to add documents to the index.
> > >
> > > I'm getting
> > > UnavailableShardsException[[default][4] [2] shardIt, [0] active :
> > > Timeout waiting for [1m], request: index {[default][Food][206621],
> > > source[{"id":206621,"name":"French Vanilla Formula 1
> > > (US)","description":"","slug":"french-vanilla-formula-1-us","media\_id":null,"user\_id":19645,"serving\_size":"2
> > > scoops","gram\_weight":null,"calories":null,"calories\_from\_fat":10,"total\_fat":1,"saturated\_fat":null,"polyunsaturated\_fat":null,"monounsaturated\_fat":null,"cholesterol":null,"sodium":140,"potassium":210,"total\_carbohydrate":13,"dietary\_fiber":3,"sugars":9,"protein":9,"vitamin\_a":25,"vitamin\_c":25,"calcium":8,"iron":15,"vitamin\_d":25,"vitamin\_e":25,"vitamin\_k":0,"thiamin":25,"riboflavin":25,"niacin":25,"vitamin\_b6":25,"folic\_acid":25,"vitamin\_b12":25,"pantothenic\_acid":25,"phosphorus":15,"magnesium":10,"zinc":25,"selenium":15,"copper":25,"manganese":null,"kcal":90,"kj":null,"alcohol":null,"caffeine":null,"rank":null,"counter":null,"expert\_rank":null,"pantry\_counter":null,"brand":"Herbalife","overall\_rank":null,"verified":false,"source":"iChange","culture":"en\_US","indexable":1}]}]
> > >
> > > And if I try and go directly to an indexed item that is returning
> > > properly from the search I get
> > >
> > > {"error": "NoShardAvailableActionException[[default][0] No shard
> > > available for [Food#16447]]","status": 500}
> > >
> > > This is my elasticsearch.yml
> > >
> > > _cluster: name: ichange\_cluster index: store: type: fs cloud: aws:
> > > access\_key: AKIAJ2XMXZ6C4EUYP36Q secret\_key:
> > > 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 network: host: 0.0.0.0 gateway:
> > > type: local recover\_after\_nodes: 1 recover\_after\_time: 5m expected\_nodes: 1
> > > path: logs: /var/log/elasticsearch data: /var/lib/elasticsearch work:
> > > /tmp/elasticsearch_
---
### Author:  [@ryaker](https://discuss.elastic.co/u/ryaker)
#### Post date: [August 8, 2012, 4:49pm UTC](https://discuss.elastic.co/t/getting-unavailableshardsexception-on-put-and-noshardavailableactionexception-on-get/8675/6 "2012-08-08T16:49:03Z")
How were you able to tell the version number of Elasticsearch?
On Wednesday, August 8, 2012 9:13:53 AM UTC-7, olof wrote:
> Just in case you didn't consider it, we can connect to your ES instance on
> that url. Although I doubt anyone here has malicious intent, you might want
> to remove the link if there is anything sensitive in the index.
>
> I connected with elasticsearch-head (that and bigdesk are good monitoring
> tools btw) and it seems the index "default" is somehow known by the
> cluster, but all the data is missing. There is no status to fetch from it,
> but there is metadata (enough to say that there are 5 shards and replica
> count 1). Is it present in the filesystem? It should be in the ES data dir
> somewhere (data/[clustername]/nodes/0/indices/[indexname] for me in 0.19.4).
> You are running 0.16.2 according to the cluster info.
>
> Have you tried restarting ES again? For me, that has sometimes helped to
> make it pick up shards.
>
> Den onsdagen den 8:e augusti 2012 kl. 17:52:31 UTC+2 skrev Ryaker:
>
> > FYI: Not sure how to tell what version of Elasticsearch I'm running.
> >
> > But all the issues I am seeing that also have failures "reason": "No
> > active shards" are all in the last month.
> >
> > This server was setup via chef last night.
> >
> > On Wednesday, August 8, 2012 7:51:40 AM UTC-7, Ryaker wrote:
> >
> > > Yesterday evening our EC2 instance running Elasticsearch became
> > > unreachable. Ping, SSh and elasticsearch were all unreachable even after
> > > multiple reboots.
> > > The solution
> > >
> > > - spawn up a new EC2 instance
> > > - use chef to provision it as an elasticsearch server (same
> > > elasticsearch.yml).
> > > - Point our task server which we use to build the indexes, and build
> > > our Food, SavedMeal, Recipe, and UserSet(Groups) indexes
> > > - Point our two web servers which search the index, and add new
> > > documents at the new server
> > > - Open the site back up
> > >
> > > The first problem I ran into, and seem to have solved (although not sure
> > > how great solution is) was too many open files.
> > > I am running the start-stop-daemon via sudo which is using the
> > > limits.conf info now and has raised limit from 1024.
> > >
> > > Search is now snappy and consistent.
> > >
> > > However now not able to add documents to the index.
> > >
> > > I'm getting
> > > UnavailableShardsException[[default][4] [2] shardIt, [0] active :
> > > Timeout waiting for [1m], request: index {[default][Food][206621],
> > > source[{"id":206621,"name":"French Vanilla Formula 1
> > > (US)","description":"","slug":"french-vanilla-formula-1-us","media\_id":null,"user\_id":19645,"serving\_size":"2
> > > scoops","gram\_weight":null,"calories":null,"calories\_from\_fat":10,"total\_fat":1,"saturated\_fat":null,"polyunsaturated\_fat":null,"monounsaturated\_fat":null,"cholesterol":null,"sodium":140,"potassium":210,"total\_carbohydrate":13,"dietary\_fiber":3,"sugars":9,"protein":9,"vitamin\_a":25,"vitamin\_c":25,"calcium":8,"iron":15,"vitamin\_d":25,"vitamin\_e":25,"vitamin\_k":0,"thiamin":25,"riboflavin":25,"niacin":25,"vitamin\_b6":25,"folic\_acid":25,"vitamin\_b12":25,"pantothenic\_acid":25,"phosphorus":15,"magnesium":10,"zinc":25,"selenium":15,"copper":25,"manganese":null,"kcal":90,"kj":null,"alcohol":null,"caffeine":null,"rank":null,"counter":null,"expert\_rank":null,"pantry\_counter":null,"brand":"Herbalife","overall\_rank":null,"verified":false,"source":"iChange","culture":"en\_US","indexable":1}]}]
> > >
> > > And if I try and go directly to an indexed item that is returning
> > > properly from the search I get
> > >
> > > {"error": "NoShardAvailableActionException[[default][0] No shard
> > > available for [Food#16447]]","status": 500}
> > >
> > > This is my elasticsearch.yml
> > >
> > > _cluster: name: ichange\_cluster index: store: type: fs cloud: aws:
> > > access\_key: AKIAJ2XMXZ6C4EUYP36Q secret\_key:
> > > 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 network: host: 0.0.0.0 gateway:
> > > type: local recover\_after\_nodes: 1 recover\_after\_time: 5m expected\_nodes: 1
> > > path: logs: /var/log/elasticsearch data: /var/lib/elasticsearch work:
> > > /tmp/elasticsearch_
On Wednesday, August 8, 2012 9:13:53 AM UTC-7, olof wrote:
> Just in case you didn't consider it, we can connect to your ES instance on
> that url. Although I doubt anyone here has malicious intent, you might want
> to remove the link if there is anything sensitive in the index.
>
> I connected with elasticsearch-head (that and bigdesk are good monitoring
> tools btw) and it seems the index "default" is somehow known by the
> cluster, but all the data is missing. There is no status to fetch from it,
> but there is metadata (enough to say that there are 5 shards and replica
> count 1). Is it present in the filesystem? It should be in the ES data dir
> somewhere (data/[clustername]/nodes/0/indices/[indexname] for me in 0.19.4).
> You are running 0.16.2 according to the cluster info.
>
> Have you tried restarting ES again? For me, that has sometimes helped to
> make it pick up shards.
>
> Den onsdagen den 8:e augusti 2012 kl. 17:52:31 UTC+2 skrev Ryaker:
>
> > FYI: Not sure how to tell what version of Elasticsearch I'm running.
> >
> > But all the issues I am seeing that also have failures "reason": "No
> > active shards" are all in the last month.
> >
> > This server was setup via chef last night.
> >
> > On Wednesday, August 8, 2012 7:51:40 AM UTC-7, Ryaker wrote:
> >
> > > Yesterday evening our EC2 instance running Elasticsearch became
> > > unreachable. Ping, SSh and elasticsearch were all unreachable even after
> > > multiple reboots.
> > > The solution
> > >
> > > - spawn up a new EC2 instance
> > > - use chef to provision it as an elasticsearch server (same
> > > elasticsearch.yml).
> > > - Point our task server which we use to build the indexes, and build
> > > our Food, SavedMeal, Recipe, and UserSet(Groups) indexes
> > > - Point our two web servers which search the index, and add new
> > > documents at the new server
> > > - Open the site back up
> > >
> > > The first problem I ran into, and seem to have solved (although not sure
> > > how great solution is) was too many open files.
> > > I am running the start-stop-daemon via sudo which is using the
> > > limits.conf info now and has raised limit from 1024.
> > >
> > > Search is now snappy and consistent.
> > >
> > > However now not able to add documents to the index.
> > >
> > > I'm getting
> > > UnavailableShardsException[[default][4] [2] shardIt, [0] active :
> > > Timeout waiting for [1m], request: index {[default][Food][206621],
> > > source[{"id":206621,"name":"French Vanilla Formula 1
> > > (US)","description":"","slug":"french-vanilla-formula-1-us","media\_id":null,"user\_id":19645,"serving\_size":"2
> > > scoops","gram\_weight":null,"calories":null,"calories\_from\_fat":10,"total\_fat":1,"saturated\_fat":null,"polyunsaturated\_fat":null,"monounsaturated\_fat":null,"cholesterol":null,"sodium":140,"potassium":210,"total\_carbohydrate":13,"dietary\_fiber":3,"sugars":9,"protein":9,"vitamin\_a":25,"vitamin\_c":25,"calcium":8,"iron":15,"vitamin\_d":25,"vitamin\_e":25,"vitamin\_k":0,"thiamin":25,"riboflavin":25,"niacin":25,"vitamin\_b6":25,"folic\_acid":25,"vitamin\_b12":25,"pantothenic\_acid":25,"phosphorus":15,"magnesium":10,"zinc":25,"selenium":15,"copper":25,"manganese":null,"kcal":90,"kj":null,"alcohol":null,"caffeine":null,"rank":null,"counter":null,"expert\_rank":null,"pantry\_counter":null,"brand":"Herbalife","overall\_rank":null,"verified":false,"source":"iChange","culture":"en\_US","indexable":1}]}]
> > >
> > > And if I try and go directly to an indexed item that is returning
> > > properly from the search I get
> > >
> > > {"error": "NoShardAvailableActionException[[default][0] No shard
> > > available for [Food#16447]]","status": 500}
> > >
> > > This is my elasticsearch.yml
> > >
> > > _cluster: name: ichange\_cluster index: store: type: fs cloud: aws:
> > > access\_key: AKIAJ2XMXZ6C4EUYP36Q secret\_key:
> > > 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 network: host: 0.0.0.0 gateway:
> > > type: local recover\_after\_nodes: 1 recover\_after\_time: 5m expected\_nodes: 1
> > > path: logs: /var/log/elasticsearch data: /var/lib/elasticsearch work:
> > > /tmp/elasticsearch_
---
### Author:  [@ryaker](https://discuss.elastic.co/u/ryaker)
#### Post date: [August 8, 2012, 4:57pm UTC](https://discuss.elastic.co/t/getting-unavailableshardsexception-on-put-and-noshardavailableactionexception-on-get/8675/7 "2012-08-08T16:57:31Z")
/\_cluster/health?pretty=true
> {"cluster\_name": "ichange\_cluster","status": "red","timed\_out": false,"
>
> > > > number\_of\_nodes": 1,"number\_of\_data\_nodes": 1,"active\_primary\_shards":
> > > > 25,"active\_shards": 25,"relocating\_shards": 0,"initializing\_shards": 0,
> > > > "unassigned\_shards": 35}
---
### Author:  [@system](https://discuss.elastic.co/u/system)
#### Post date: [July 6, 2017, 3:17am UTC](https://discuss.elastic.co/t/getting-unavailableshardsexception-on-put-and-noshardavailableactionexception-on-get/8675/8 "2017-07-06T03:17:05Z")