ElasticSearch throwing “OutOfMemoryError[unable to create new native thread]”

Hello!

I'm new to Elasticsearch and I've been seeing various posts saying that the number of threads is responsible for this error. I've compared output from my dev server and production (production is the problem) and get different outputs. The command I ran was: curl -XGET 'localhost:9200/_nodes/thread_pool?pretty'

This returns (production):
{
"cluster_name" : "elasticsearch",
"nodes" : {
"eBNwhHo1RuGOui1XFus8vA" : {
"name" : "Terminus",
"transport_address" : "inet[/216.243.23.200:9300]",
"host" : "crm1-sea401.spectrumnet.us",
"ip" : "216.243.23.200",
"version" : "1.3.1",
"build" : "2de6dc5",
"http_address" : "inet[/216.243.23.200:9200]",
"thread_pool" : {
"percolate" : {
"type" : "fixed",
"min" : 8,
"max" : 8,
"queue_size" : "1k"
},
"snapshot_data" : {
"type" : "scaling",
"min" : 1,
"max" : 5,
"keep_alive" : "5m",
"queue_size" : -1
},
"bench" : {
"type" : "scaling",
"min" : 1,
"max" : 4,
"keep_alive" : "5m",
"queue_size" : -1
},
"index" : {
"type" : "fixed",
"min" : 8,
"max" : 8,
"queue_size" : "200"
},
"refresh" : {
"type" : "scaling",
"min" : 1,
"max" : 4,
"keep_alive" : "5m",
"queue_size" : -1
},
"suggest" : {
"type" : "fixed",
"min" : 8,
"max" : 8,
"queue_size" : "1k"
},
"generic" : {
"type" : "cached",
"keep_alive" : "30s",
"queue_size" : -1
},
"warmer" : {
"type" : "scaling",
"min" : 1,
"max" : 4,
"keep_alive" : "5m",
"queue_size" : -1
},
"search" : {
"type" : "fixed",
"min" : 24,
"max" : 24,
"queue_size" : "1k"
},
"flush" : {
"type" : "scaling",
"min" : 1,
"max" : 4,
"keep_alive" : "5m",
"queue_size" : -1
},
"optimize" : {
"type" : "fixed",
"min" : 1,
"max" : 1,
"queue_size" : -1
},
"management" : {
"type" : "scaling",
"min" : 1,
"max" : 5,
"keep_alive" : "5m",
"queue_size" : -1
},
"get" : {
"type" : "fixed",
"min" : 8,
"max" : 8,
"queue_size" : "1k"
},
"merge" : {
"type" : "scaling",
"min" : 1,
"max" : 4,
"keep_alive" : "5m",
"queue_size" : -1
},
"bulk" : {
"type" : "fixed",
"min" : 8,
"max" : 8,
"queue_size" : "50"
},
"snapshot" : {
"type" : "scaling",
"min" : 1,
"max" : 4,
"keep_alive" : "5m",
"queue_size" : -1
}
}
}
}
}

The call: wget localhos:9200 returns

Resolving localhost... ::1, 127.0.0.1
Connecting to localhost|::1|:9200... connected.
HTTP request sent, awaiting response... 500 Internal Server Error
2016-01-28 09:33:28 ERROR 500: Internal Server Error.

Any ideas what's going on?

What do your ES logs show, there should be something at the same time.