Hi Mark Walkom,
Thanks for your quick response...
Sorry , I am not sure how to post from gist/pastebin/etc. Below are your
requested details
Operating system : Linux
ES version : Elasticsearch-0.90.7
JAVA Version :JDK 1.7
Data : we didn't have any parent child relations. Just we are loading with
auto generated primary key.(29,666,482 documents= 21.9 GB).
Data Loading : we are loading data into elastic by writing 20 threads.
Client creation :
Settings settings = ImmutableSettings.settingsBuilder().put("cluster.name",
"UCS_DEV_ES_CLUSTER").build();
elasticClient = new TransportClient(settings).addTransportAddress(new
InetSocketTransportAddress("server1", 9300))
.addTransportAddress(new InetSocketTransportAddress("server2", 9300));
Below are the server details
we have 4 nodes.
Each node contains
CPU: 4 , RAM: 16G , Storage: 122G
ES_HEAP_SIZE 8 G
Please find enclosed elasticsearch.yml file which we are using.
Thanks,
Srikanth.
On Wed, Dec 18, 2013 at 5:02 PM, Mark Walkom markw@campaignmonitor.comwrote:
It will help if you post (via a gist/pastebin/etc) what you have now.
Also what sort of data is it, how are you loading it, what versions of
things are you running on (OS, java, ES, etc etc)
Regards,
Mark Walkom
Infrastructure Engineer
Campaign Monitor
email: markw@campaignmonitor.com
web: www.campaignmonitor.com
On 19 December 2013 11:53, srikanth ramineni ri.srikanth@gmail.comwrote:
Hi Team,
We have below server configurations. We are trying to load more than 500
million data into elastic. When data reaches 40 millions, shards are going
down and data is deleting . Can you please help us with best configuration
for above requirement.
Below are the server details
we have 4 nodes.
Each node contains
CPU: 4 , RAM: 16G , Storage: 122G
ES_HEAP_SIZE 8 G
Thanks,
Srikanth.
--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/436a22c0-7aca-4502-b229-db91c0ebce01%40googlegroups.com
.
For more options, visit https://groups.google.com/groups/opt_out.
--
You received this message because you are subscribed to a topic in the
Google Groups "elasticsearch" group.
To unsubscribe from this topic, visit
https://groups.google.com/d/topic/elasticsearch/QRGwAlqL-qY/unsubscribe.
To unsubscribe from this group and all its topics, send an email to
elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/CAEM624YPB%3DkkJ3eOFRRc%2Bw%2BqG3junYQWpiD3EzPp677BLTbwvQ%40mail.gmail.com
.
For more options, visit https://groups.google.com/groups/opt_out.
--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CAGuNUAV5A_Vj9k285nAW_xW7UdnVr5K5n1DBndBLo%3D9KiQ8BaQ%40mail.gmail.com.
For more options, visit https://groups.google.com/groups/opt_out.