Elasticsearch development environment - system requirements

Hi All,
I am new to elasticsearch. Kindly let me know the system
requirements for elasticsearch in development environment.What is the best
way to import data into elasticsearch using csv .

    I have been trying for bulk import using csv into elasticsearch for 

100 records using two ways :
logstash
CSV - River.

My system configuration is : 32 bit operating system with 2.00 GB RAM with
default elasticsearch configuration.

With this system i am able to import only 10 records . The elasticsearch
log is showing message that "Next run in 1 hr ". What does that mean ?

Please help me !!!

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/0b9f9d2d-9c2a-4f08-9b65-1a78da4a5359%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

How do you know that you have imported only 10 records?

David

Le 2 févr. 2015 à 07:05, Shwetha Raghavendra shwetha.raghavendra@pearson.com a écrit :

Hi All,
I am new to elasticsearch. Kindly let me know the system requirements for elasticsearch in development environment.What is the best way to import data into elasticsearch using csv .

    I have been trying for bulk import using csv into elasticsearch for 100 records using two ways :

logstash
CSV - River.

My system configuration is : 32 bit operating system with 2.00 GB RAM with default elasticsearch configuration.

With this system i am able to import only 10 records . The elasticsearch log is showing message that "Next run in 1 hr ". What does that mean ?

Please help me !!!

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/0b9f9d2d-9c2a-4f08-9b65-1a78da4a5359%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/9A1C2A43-AFE8-4B2F-80EF-007611ECBF88%40pilato.fr.
For more options, visit https://groups.google.com/d/optout.

Hi,
After importing , i am checking through kibana tool .

Logstash configuration is :

input {
stdin {
type => "stdin-type"
}

file {
path => ["C:/ELK/data/teacher_det.csv"]
start_position => "beginning"
}
}

filter {
csv {
columns => ["tid","tname"]
separator => ","
}
}

output {
elasticsearch {
host => "localhost"
protocol => "http"
embedded => true
index => "teacher_det_indx"
index_type => "teacher_det_type"
document_id => "%{tid}"
}
}

CSV - River configuration :

PUT /_river/schoolData/_meta
{

"type" : "csv",

"csv_file" : {

    "folder" : "C:/ELK/data/tmp",

    "first_line_is_header":"true"

},

"index" : {

    "index" : "sch_indx",

    "type" : "sch_type",

    "bulk_size" : 100,

    "bulk_threshold" : 10

}

}

Regards,
Shwetha

On Monday, 2 February 2015 11:58:45 UTC+5:30, David Pilato wrote:

How do you know that you have imported only 10 records?

David

Le 2 févr. 2015 à 07:05, Shwetha Raghavendra <shwetha.r...@pearson.com
<javascript:>> a écrit :

Hi All,
I am new to elasticsearch. Kindly let me know the system
requirements for elasticsearch in development environment.What is the best
way to import data into elasticsearch using csv .

    I have been trying for bulk import using csv into elasticsearch 

for 100 records using two ways :
logstash
CSV - River.

My system configuration is : 32 bit operating system with 2.00 GB RAM with
default elasticsearch configuration.

With this system i am able to import only 10 records . The elasticsearch
log is showing message that "Next run in 1 hr ". What does that mean ?

Please help me !!!

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearc...@googlegroups.com <javascript:>.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/0b9f9d2d-9c2a-4f08-9b65-1a78da4a5359%40googlegroups.com
https://groups.google.com/d/msgid/elasticsearch/0b9f9d2d-9c2a-4f08-9b65-1a78da4a5359%40googlegroups.com?utm_medium=email&utm_source=footer
.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/ae66bad8-37b7-495e-8b9b-f9449ff6668d%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Could you run a query outside Kibana? For example:

GET /_search?size=0

David

Le 2 févr. 2015 à 07:49, Shwetha Raghavendra shwetha.raghavendra@pearson.com a écrit :

Hi,
After importing , i am checking through kibana tool .

Logstash configuration is :

input {
stdin {
type => "stdin-type"
}

file {
path => ["C:/ELK/data/teacher_det.csv"]
start_position => "beginning"
}
}

filter {
csv {
columns => ["tid","tname"]
separator => ","
}
}

output {
elasticsearch {
host => "localhost"
protocol => "http"
embedded => true
index => "teacher_det_indx"
index_type => "teacher_det_type"
document_id => "%{tid}"
}
}

CSV - River configuration :

PUT /_river/schoolData/_meta
{

"type" : "csv",

"csv_file" : {

    "folder" : "C:/ELK/data/tmp",

    "first_line_is_header":"true"

},

"index" : {

    "index" : "sch_indx",

    "type" : "sch_type",

    "bulk_size" : 100,

    "bulk_threshold" : 10

}

}

Regards,
Shwetha

On Monday, 2 February 2015 11:58:45 UTC+5:30, David Pilato wrote:
How do you know that you have imported only 10 records?

David

Le 2 févr. 2015 à 07:05, Shwetha Raghavendra shwetha.r...@pearson.com a écrit :

Hi All,
I am new to elasticsearch. Kindly let me know the system requirements for elasticsearch in development environment.What is the best way to import data into elasticsearch using csv .

    I have been trying for bulk import using csv into elasticsearch for 100 records using two ways :

logstash
CSV - River.

My system configuration is : 32 bit operating system with 2.00 GB RAM with default elasticsearch configuration.

With this system i am able to import only 10 records . The elasticsearch log is showing message that "Next run in 1 hr ". What does that mean ?

Please help me !!!

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearc...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/0b9f9d2d-9c2a-4f08-9b65-1a78da4a5359%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/ae66bad8-37b7-495e-8b9b-f9449ff6668d%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/AADD24C7-DB5E-4C8C-9341-D02613DA35B7%40pilato.fr.
For more options, visit https://groups.google.com/d/optout.

May be also you have the same tid 10 times?

David

Le 2 févr. 2015 à 07:49, Shwetha Raghavendra shwetha.raghavendra@pearson.com a écrit :

Hi,
After importing , i am checking through kibana tool .

Logstash configuration is :

input {
stdin {
type => "stdin-type"
}

file {
path => ["C:/ELK/data/teacher_det.csv"]
start_position => "beginning"
}
}

filter {
csv {
columns => ["tid","tname"]
separator => ","
}
}

output {
elasticsearch {
host => "localhost"
protocol => "http"
embedded => true
index => "teacher_det_indx"
index_type => "teacher_det_type"
document_id => "%{tid}"
}
}

CSV - River configuration :

PUT /_river/schoolData/_meta
{

"type" : "csv",

"csv_file" : {

    "folder" : "C:/ELK/data/tmp",

    "first_line_is_header":"true"

},

"index" : {

    "index" : "sch_indx",

    "type" : "sch_type",

    "bulk_size" : 100,

    "bulk_threshold" : 10

}

}

Regards,
Shwetha

On Monday, 2 February 2015 11:58:45 UTC+5:30, David Pilato wrote:
How do you know that you have imported only 10 records?

David

Le 2 févr. 2015 à 07:05, Shwetha Raghavendra shwetha.r...@pearson.com a écrit :

Hi All,
I am new to elasticsearch. Kindly let me know the system requirements for elasticsearch in development environment.What is the best way to import data into elasticsearch using csv .

    I have been trying for bulk import using csv into elasticsearch for 100 records using two ways :

logstash
CSV - River.

My system configuration is : 32 bit operating system with 2.00 GB RAM with default elasticsearch configuration.

With this system i am able to import only 10 records . The elasticsearch log is showing message that "Next run in 1 hr ". What does that mean ?

Please help me !!!

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearc...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/0b9f9d2d-9c2a-4f08-9b65-1a78da4a5359%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/ae66bad8-37b7-495e-8b9b-f9449ff6668d%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/962500F8-6AE8-4A5C-AC41-31C80C823341%40pilato.fr.
For more options, visit https://groups.google.com/d/optout.