Elastic search and hadoop

Elastic Stack Elasticsearch
1

Hi all

I am new to elasictc search. got some problem here setting up elasictic
search. i got a hadoop running up now . one master and one slave . but
after i download elastic search and try to run /bin/elasticsearch -f. it
hangs there at some command line .. can i know what i need to change in the
config folder ? as i don't really understand the steps on the elastic
search website. can anyone got any better website for me to try it and
refer..

Thanks
Regards

--

2

Welcome.

1st, try to run ES in standalone (without Hadoop): download, unzip, launch bin/elasticsearch -f (from UNIX), bin/elasticsearch.bat from windows
2nd, in another shell, try curl localhost:9200
If you use windows, open this URL from a browser.

If it doesn't work, check that you have a Java (6 or 7) somewhere and that JAVA_HOME is defined.

If it still does not work, report here any error you can see in logs.

BTW, read this: http://www.elasticsearch.org/guide/reference/setup/installation.html

HTH

--
David :wink:
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs

Le 27 déc. 2012 à 06:15, jundatan85@gmail.com a écrit :

Hi all

I am new to elasictc search. got some problem here setting up elasictic search. i got a hadoop running up now . one master and one slave . but after i download elastic search and try to run /bin/elasticsearch -f. it hangs there at some command line .. can i know what i need to change in the config folder ? as i don't really understand the steps on the elastic search website. can anyone got any better website for me to try it and refer..

Thanks
Regards

--

3

Thanks for the reply David, i have tried it out before and it still not
working. the terminal will be still hang

elasticsearch-0.20.1# bin/elasticsearch -f
[2012-12-27 17:21:55,023][INFO ][node ] [Boomslang]
{0.20.1}[2187]: initializing ...
[2012-12-27 17:21:55,034][INFO ][plugins ] [Boomslang]
loaded , sites
[2012-12-27 17:21:58,484][INFO ][node ] [Boomslang]
{0.20.1}[2187]: initialized
[2012-12-27 17:21:58,484][INFO ][node ] [Boomslang]
{0.20.1}[2187]: starting ...
[2012-12-27 17:21:58,674][INFO ][transport ] [Boomslang]
bound_address {inet[XXX.XX.XXX.XXX:9300]}, publish_address
{inet[/XXX.XXX.XXX.XXX:9300]}
[2012-12-27 17:22:01,922][INFO ][cluster.service ] [Boomslang]
new_master
[Boomslang][DuJAy1WLSdij0PNFPLt_0g][inet[/XXX.XXX.XXX.XXX:9300]], reason:
zen-disco-join (elected_as_master)
[2012-12-27 17:22:01,971][INFO ][discovery ] [Boomslang]
elasticsearch/DuJAy1WLSdij0PNFPLt_0g
[2012-12-27 17:22:02,010][INFO ][http ] [Boomslang]
bound_address {inet[/XXX.XXX.XXX.XXX:9200]}, publish_address
{inet[/XXX.XXX.XXX.XXX:9200]}
[2012-12-27 17:22:02,010][INFO ][node ] [Boomslang]
{0.20.1}[2187]: started
[2012-12-27 17:22:02,081][INFO ][gateway ] [Boomslang]
recovered [0] indices into cluster_state

I have read th website u have send me but i did not see anything regarding
such error .

Thanks

On Thu, Dec 27, 2012 at 12:36 PM, David Pilato david@pilato.fr wrote:

Welcome.

1st, try to run ES in standalone (without Hadoop): download, unzip, launch
bin/elasticsearch -f (from UNIX), bin/elasticsearch.bat from windows
2nd, in another shell, try curl localhost:9200
If you use windows, open this URL from a browser.

If it doesn't work, check that you have a Java (6 or 7) somewhere and that
JAVA_HOME is defined.

If it still does not work, report here any error you can see in logs.

BTW, read this:
Elasticsearch Platform — Find real-time answers at scale | Elastic

HTH

--
David :wink:
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs

Le 27 déc. 2012 à 06:15, jundatan85@gmail.com a écrit :

Hi all

I am new to elasictc search. got some problem here setting up elasictic
search. i got a hadoop running up now . one master and one slave . but
after i download Elasticsearch and try to run /bin/elasticsearch -f. it
hangs there at some command line .. can i know what i need to change in the
config folder ? as i don't really understand the steps on the elastic
search website. can anyone got any better website for me to try it and
refer..

Thanks
Regards

--

--

--

4

Looks like everything is working here.
What do you expect to see?

Did you open localhost:9200 in your browser?

--
David :wink:
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs

Le 27 déc. 2012 à 06:51, Tan Chween Tah jundatan85@gmail.com a écrit :

Thanks for the reply David, i have tried it out before and it still not working. the terminal will be still hang

elasticsearch-0.20.1# bin/elasticsearch -f
[2012-12-27 17:21:55,023][INFO ][node ] [Boomslang] {0.20.1}[2187]: initializing ...
[2012-12-27 17:21:55,034][INFO ][plugins ] [Boomslang] loaded , sites
[2012-12-27 17:21:58,484][INFO ][node ] [Boomslang] {0.20.1}[2187]: initialized
[2012-12-27 17:21:58,484][INFO ][node ] [Boomslang] {0.20.1}[2187]: starting ...
[2012-12-27 17:21:58,674][INFO ][transport ] [Boomslang] bound_address {inet[XXX.XX.XXX.XXX:9300]}, publish_address {inet[/XXX.XXX.XXX.XXX:9300]}
[2012-12-27 17:22:01,922][INFO ][cluster.service ] [Boomslang] new_master [Boomslang][DuJAy1WLSdij0PNFPLt_0g][inet[/XXX.XXX.XXX.XXX:9300]], reason: zen-disco-join (elected_as_master)
[2012-12-27 17:22:01,971][INFO ][discovery ] [Boomslang] elasticsearch/DuJAy1WLSdij0PNFPLt_0g
[2012-12-27 17:22:02,010][INFO ][http ] [Boomslang] bound_address {inet[/XXX.XXX.XXX.XXX:9200]}, publish_address {inet[/XXX.XXX.XXX.XXX:9200]}
[2012-12-27 17:22:02,010][INFO ][node ] [Boomslang] {0.20.1}[2187]: started
[2012-12-27 17:22:02,081][INFO ][gateway ] [Boomslang] recovered [0] indices into cluster_state

I have read th website u have send me but i did not see anything regarding such error .

Thanks

On Thu, Dec 27, 2012 at 12:36 PM, David Pilato david@pilato.fr wrote:

Welcome.

1st, try to run ES in standalone (without Hadoop): download, unzip, launch bin/elasticsearch -f (from UNIX), bin/elasticsearch.bat from windows
2nd, in another shell, try curl localhost:9200
If you use windows, open this URL from a browser.

If it doesn't work, check that you have a Java (6 or 7) somewhere and that JAVA_HOME is defined.

If it still does not work, report here any error you can see in logs.

BTW, read this: Elasticsearch Platform — Find real-time answers at scale | Elastic

HTH

--
David :wink:
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs

Le 27 déc. 2012 à 06:15, jundatan85@gmail.com a écrit :

Hi all

I am new to elasictc search. got some problem here setting up elasictic search. i got a hadoop running up now . one master and one slave . but after i download Elasticsearch and try to run /bin/elasticsearch -f. it hangs there at some command line .. can i know what i need to change in the config folder ? as i don't really understand the steps on the Elasticsearch website. can anyone got any better website for me to try it and refer..

Thanks
Regards

--

--

--

5

Thanks david

What i am trying to do is like having big data of text or json file and put
distribute it in different computer using hadoop and using Elasticsearch
to query the words so it will return the result faster .

You said it is working fine. so is there a example on how to insert a text
file or json file into the Elasticsearch and i am able to query the words
out. for eg. Test.txt contain words inside. and i want to search the words
like "happy" inside that test.txt file .. is it possible for elasitc search
to do that ?

nope i did not try just now. but now I have try opening localhost:9200 in
my browser but it throw me an error "problem loading page".

any advice ?

thanks

On Thu, Dec 27, 2012 at 2:54 PM, David Pilato david@pilato.fr wrote:

Looks like everything is working here.
What do you expect to see?

Did you open localhost:9200 in your browser?

--
David :wink:
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs

Le 27 déc. 2012 à 06:51, Tan Chween Tah jundatan85@gmail.com a écrit :

Thanks for the reply David, i have tried it out before and it still not
working. the terminal will be still hang

elasticsearch-0.20.1# bin/elasticsearch -f
[2012-12-27 17:21:55,023][INFO ][node ] [Boomslang]
{0.20.1}[2187]: initializing ...
[2012-12-27 17:21:55,034][INFO ][plugins ] [Boomslang]
loaded , sites
[2012-12-27 17:21:58,484][INFO ][node ] [Boomslang]
{0.20.1}[2187]: initialized
[2012-12-27 17:21:58,484][INFO ][node ] [Boomslang]
{0.20.1}[2187]: starting ...
[2012-12-27 17:21:58,674][INFO ][transport ] [Boomslang]
bound_address {inet[XXX.XX.XXX.XXX:9300]}, publish_address
{inet[/XXX.XXX.XXX.XXX:9300]}
[2012-12-27 17:22:01,922][INFO ][cluster.service ] [Boomslang]
new_master
[Boomslang][DuJAy1WLSdij0PNFPLt_0g][inet[/XXX.XXX.XXX.XXX:9300]], reason:
zen-disco-join (elected_as_master)
[2012-12-27 17:22:01,971][INFO ][discovery ] [Boomslang]
elasticsearch/DuJAy1WLSdij0PNFPLt_0g
[2012-12-27 17:22:02,010][INFO ][http ] [Boomslang]
bound_address {inet[/XXX.XXX.XXX.XXX:9200]}, publish_address
{inet[/XXX.XXX.XXX.XXX:9200]}
[2012-12-27 17:22:02,010][INFO ][node ] [Boomslang]
{0.20.1}[2187]: started
[2012-12-27 17:22:02,081][INFO ][gateway ] [Boomslang]
recovered [0] indices into cluster_state

I have read th website u have send me but i did not see anything regarding
such error .

Thanks

On Thu, Dec 27, 2012 at 12:36 PM, David Pilato david@pilato.fr wrote:

Welcome.

1st, try to run ES in standalone (without Hadoop): download, unzip,
launch bin/elasticsearch -f (from UNIX), bin/elasticsearch.bat from windows
2nd, in another shell, try curl localhost:9200
If you use windows, open this URL from a browser.

If it doesn't work, check that you have a Java (6 or 7) somewhere and
that JAVA_HOME is defined.

If it still does not work, report here any error you can see in logs.

BTW, read this:
Elasticsearch Platform — Find real-time answers at scale | Elastic

HTH

--
David :wink:
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs

Le 27 déc. 2012 à 06:15, jundatan85@gmail.com a écrit :

Hi all

I am new to elasictc search. got some problem here setting up elasictic
search. i got a hadoop running up now . one master and one slave . but
after i download Elasticsearch and try to run /bin/elasticsearch -f. it
hangs there at some command line .. can i know what i need to change in the
config folder ? as i don't really understand the steps on the elastic
search website. can anyone got any better website for me to try it and
refer..

Thanks
Regards

--

--

--

--

--

6

Ok. First, you have to make sure that your ES instance is working fine.
You should be able to do a curl localhost:9200 and see a JSON. If not, don't go
to the next steps and fix your problem! (BTW, tell me if you run under linux or
windows).

What you want to achieve is to index files. It's not one of the basic feature of
ES but it's available as a plugin (

https://github.com/elasticsearch/elasticsearch-mapper-attachments ). You have
a full script here to try it: Test of attachments plugin · GitHub
https://gist.github.com/3907010

But, it's without Hadoop. That gives me an idea for my scrutmydocs
http://www.scrutmydocs.org/ project. I should add in the FSRiver (File System
River) (or create a new one) the possibility of fetching content from hdfs...

Does it help?

Le 27 décembre 2012 à 09:38, Tan Chween Tah jundatan85@gmail.com a écrit :

Thanks david

What i am trying to do is like having big data of text or json file and put
distribute it in different computer using hadoop and using Elasticsearch to
query the words so it will return the result faster .

You said it is working fine. so is there a example on how to insert a text
file or json file into the Elasticsearch and i am able to query the words
out. for eg. Test.txt contain words inside. and i want to search the words
like "happy" inside that test.txt file .. is it possible for elasitc search to
do that ?

nope i did not try just now. but now I have try opening localhost:9200 in my
browser but it throw me an error "problem loading page".

any advice ?

thanks

On Thu, Dec 27, 2012 at 2:54 PM, David Pilato <david@pilato.fr
mailto:david@pilato.fr > wrote:

Looks like everything is working here.
What do you expect to see?

Did you open localhost:9200 in your browser?

--
David :wink:
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs

Le 27 déc. 2012 à 06:51, Tan Chween Tah < jundatan85@gmail.com
mailto:jundatan85@gmail.com > a écrit :
Thanks for the reply David, i have tried it out before and it still not
working. the terminal will be still hang

elasticsearch-0.20.1# bin/elasticsearch -f
[2012-12-27 17:21:55,023][INFO ][node ] [Boomslang]
{0.20.1}[2187]: initializing ...
[2012-12-27 17:21:55,034][INFO ][plugins ] [Boomslang]
loaded , sites
[2012-12-27 17:21:58,484][INFO ][node ] [Boomslang]
{0.20.1}[2187]: initialized
[2012-12-27 17:21:58,484][INFO ][node ] [Boomslang]
{0.20.1}[2187]: starting ...
[2012-12-27 17:21:58,674][INFO ][transport ] [Boomslang]
bound_address {inet[XXX.XX.XXX.XXX:9300]}, publish_address
{inet[/XXX.XXX.XXX.XXX:9300]}
[2012-12-27 17:22:01,922][INFO ][cluster.service ] [Boomslang]
new_master [Boomslang][DuJAy1WLSdij0PNFPLt_0g][inet[/XXX.XXX.XXX.XXX:9300]],
reason: zen-disco-join (elected_as_master)
[2012-12-27 17:22:01,971][INFO ][discovery ] [Boomslang]
elasticsearch/DuJAy1WLSdij0PNFPLt_0g
[2012-12-27 17:22:02,010][INFO ][http ] [Boomslang]
bound_address {inet[/XXX.XXX.XXX.XXX:9200]}, publish_address
{inet[/XXX.XXX.XXX.XXX:9200]}
[2012-12-27 17:22:02,010][INFO ][node ] [Boomslang]
{0.20.1}[2187]: started
[2012-12-27 17:22:02,081][INFO ][gateway ] [Boomslang]
recovered [0] indices into cluster_state

I have read th website u have send me but i did not see anything
regarding such error .

Thanks

On Thu, Dec 27, 2012 at 12:36 PM, David Pilato <david@pilato.fr
mailto:david@pilato.fr > wrote:
> > > Welcome.

 1st, try to run ES in standalone (without Hadoop): download, unzip,

launch bin/elasticsearch -f (from UNIX), bin/elasticsearch.bat from
windows
2nd, in another shell, try curl localhost:9200
If you use windows, open this URL from a browser.

 If it doesn't work, check that you have a Java (6 or 7) somewhere and

that JAVA_HOME is defined.

 If it still does not work, report here any error you can see in logs.

 BTW, read this:

Elasticsearch Platform — Find real-time answers at scale | Elastic
http://www.elasticsearch.org/guide/reference/setup/installation.html

 HTH

 --
 David ;-)
 Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs


 Le 27 déc. 2012 à 06:15, jundatan85@gmail.com

mailto:jundatan85@gmail.com a écrit :
Hi all

 I am new to elasictc search. got some problem here setting up

elasictic search. i got a hadoop running up now . one master and one
slave . but after i download Elasticsearch and try to run
/bin/elasticsearch -f. it hangs there at some command line .. can i know
what i need to change in the config folder ? as i don't really understand
the steps on the Elasticsearch website. can anyone got any better website
for me to try it and refer..

 Thanks
 Regards



 --





 --

--

--

--

--
David Pilato
http://www.scrutmydocs.org/
http://dev.david.pilato.fr/
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs

--

7

Please keep the thread in the mailing list scope. Not outside (don't send direct
mails).

OK. Here are the steps you have to follow:
1/ stop all running shells and open a new one
Just check if you have an elasticsearch running in the background ( ps -ef |
grep elasticsearch ) and kill the process if you find one.
2/ on a fresh clean elasticsearch dir (you should not find data, logs dir),
start bin/elasticsearch -f
3/ open a new shell and type curl http://localhost:9200

What happens?

Le 27 décembre 2012 à 10:48, jundatan85@gmail.com a écrit :

ok thanks. i will take a look later.

i am using ubuntu linux and using a root account

let solve the problem that my ES instance is not working. when i type in
locahost:9200 it said "unable to connect tp server at localhost:9200"

On Thursday, December 27, 2012 5:30:44 PM UTC+8, David Pilato wrote:

Ok. First, you have to make sure that your ES instance is working
fine.
You should be able to do a curl localhost:9200 and see a JSON. If not,
don't go to the next steps and fix your problem! (BTW, tell me if you run
under linux or windows).

What you want to achieve is to index files. It's not one of the basic
feature of ES but it's available as a plugin (
GitHub - elastic/elasticsearch-mapper-attachments: Mapper Attachments Type plugin for Elasticsearch). You have
a full script here to try it:
https://github.com/elasticsearch/elasticsearch-mapper-attachments
Test of attachments plugin · GitHub https://gist.github.com/3907010

But, it's without Hadoop. That gives me an idea for my
https://gist.github.com/3907010 scrutmydocs http://www.scrutmydocs.org/
project. I should add in the FSRiver (File System River) (or create a new
one) the possibility of fetching content from hdfs...

Does it help?

Le 27 décembre 2012 à 09:38, Tan Chween Tah < junda...@gmail.com> a écrit
:

> > > Thanks david

What i am trying to do is like having big data of text or json file

and put distribute it in different computer using hadoop and using elastic
search to query the words so it will return the result faster .

You said it is working fine. so is there a example on how to insert a

text file or json file into the Elasticsearch and i am able to query the
words out. for eg. Test.txt contain words inside. and i want to search the
words like "happy" inside that test.txt file .. is it possible for elasitc
search to do that ?

nope i did not try just now. but now I have try opening localhost:9200

in my browser but it throw me an error "problem loading page".

any advice ?

thanks




On Thu, Dec 27, 2012 at 2:54 PM, David Pilato <da...@pilato.fr> wrote:
  > > > >       Looks like everything is working here.

  What do you expect to see?

  Did you open localhost:9200 in your browser?


  --
  David ;-)
  Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs


  Le 27 déc. 2012 à 06:51, Tan Chween Tah < junda...@gmail.com> a

écrit :
Thanks for the reply David, i have tried it out before and it
still not working. the terminal will be still hang

  elasticsearch-0.20.1# bin/elasticsearch -f
  [2012-12-27 17:21:55,023][INFO ][node                     ]

[Boomslang] {0.20.1}[2187]: initializing ...
[2012-12-27 17:21:55,034][INFO ][plugins ]
[Boomslang] loaded , sites
[2012-12-27 17:21:58,484][INFO ][node ]
[Boomslang] {0.20.1}[2187]: initialized
[2012-12-27 17:21:58,484][INFO ][node ]
[Boomslang] {0.20.1}[2187]: starting ...
[2012-12-27 17:21:58,674][INFO ][transport ]
[Boomslang] bound_address {inet[XXX.XX.XXX.XXX:9300]}, publish_address
{inet[/XXX.XXX.XXX.XXX:9300]}
[2012-12-27 17:22:01,922][INFO ][cluster.service ]
[Boomslang] new_master
[Boomslang][DuJAy1WLSdij0PNFPLt_0g][inet[/XXX.XXX.XXX.XXX:9300]],
reason: zen-disco-join (elected_as_master)
[2012-12-27 17:22:01,971][INFO ][discovery ]
[Boomslang] elasticsearch/DuJAy1WLSdij0PNFPLt_0g
[2012-12-27 17:22:02,010][INFO ][http ]
[Boomslang] bound_address {inet[/XXX.XXX.XXX.XXX:9200]}, publish_address
{inet[/XXX.XXX.XXX.XXX:9200]}
[2012-12-27 17:22:02,010][INFO ][node ]
[Boomslang] {0.20.1}[2187]: started
[2012-12-27 17:22:02,081][INFO ][gateway ]
[Boomslang] recovered [0] indices into cluster_state

  I have read th website u have send me but i did not see anything

regarding such error .

  Thanks

  On Thu, Dec 27, 2012 at 12:36 PM, David Pilato <da...@pilato.fr>

wrote:
> > > > > Welcome.

    1st, try to run ES in standalone (without Hadoop): download,

unzip, launch bin/elasticsearch -f (from UNIX), bin/elasticsearch.bat
from windows
2nd, in another shell, try curl localhost:9200
If you use windows, open this URL from a browser.

    If it doesn't work, check that you have a Java (6 or 7)

somewhere and that JAVA_HOME is defined.

    If it still does not work, report here any error you can see

in logs.

    BTW, read this:

Elasticsearch Platform — Find real-time answers at scale | Elastic
http://www.elasticsearch.org/guide/reference/setup/installation.html

    HTH

    --
    David ;-)
    Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs


    Le 27 déc. 2012 à 06:15,

http://www.elasticsearch.org/guide/reference/setup/installation.html
junda...@gmail.com a écrit :
Hi all

    I am new to elasictc search. got some problem here setting up

elasictic search. i got a hadoop running up now . one master and one
slave . but after i download Elasticsearch and try to run
/bin/elasticsearch -f. it hangs there at some command line .. can i
know what i need to change in the config folder ? as i don't really
understand the steps on the Elasticsearch website. can anyone got any
better website for me to try it and refer..

    Thanks
    Regards



    --





    --


  > > > > 

  --





  --






  --


> > > 

--
David Pilato
http://www.scrutmydocs.org/ <http://www.scrutmydocs.org/>
http://dev.david.pilato.fr/ <http://dev.david.pilato.fr/>
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs

--
David Pilato
http://www.scrutmydocs.org/
http://dev.david.pilato.fr/
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs

--

8

ok thanks i will take a look later.

i am using ubuntu linux root account now.

let solve the es problem first. cos i can't view the json file u mention
when i enter localhost:9200 on my browser.
I think my es instance is not working. can i know is there any
configuration i need to set. as i have edit the elasticsearch.yml. cluster
name and network_blind_host. what other thing i need to set in order to
view the localhost:9200.

On Thursday, December 27, 2012 5:30:44 PM UTC+8, David Pilato wrote:

Ok. First, you have to make sure that your ES instance is working fine.
You should be able to do a curl localhost:9200 and see a JSON. If not,
don't go to the next steps and fix your problem! (BTW, tell me if you run
under linux or windows).

What you want to achieve is to index files. It's not one of the basic
feature of ES but it's available as a plugin (
GitHub - elastic/elasticsearch-mapper-attachments: Mapper Attachments Type plugin for Elasticsearch). You
have a full script here to try it: Test of attachments plugin · GitHub

But, it's without Hadoop. That gives me an idea for my scrutmydocshttp://www.scrutmydocs.org/ project.
I should add in the FSRiver (File System River) (or create a new one) the
possibility of fetching content from hdfs...

Does it help?

Le 27 décembre 2012 à 09:38, Tan Chween Tah <junda...@gmail.com<javascript:>>
a écrit :

Thanks david

What i am trying to do is like having big data of text or json file and
put distribute it in different computer using hadoop and using elastic
search to query the words so it will return the result faster .

You said it is working fine. so is there a example on how to insert a text
file or json file into the Elasticsearch and i am able to query the words
out. for eg. Test.txt contain words inside. and i want to search the words
like "happy" inside that test.txt file .. is it possible for elasitc search
to do that ?

nope i did not try just now. but now I have try opening localhost:9200 in
my browser but it throw me an error "problem loading page".

any advice ?

thanks

On Thu, Dec 27, 2012 at 2:54 PM, David Pilato <da...@pilato.fr<javascript:>

wrote:

Looks like everything is working here.
What do you expect to see?

Did you open localhost:9200 in your browser?

--
David :wink:
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs

Le 27 déc. 2012 à 06:51, Tan Chween Tah < junda...@gmail.com <javascript:>>
a écrit :
Thanks for the reply David, i have tried it out before and it still not
working. the terminal will be still hang

elasticsearch-0.20.1# bin/elasticsearch -f
[2012-12-27 17:21:55,023][INFO ][node ] [Boomslang]
{0.20.1}[2187]: initializing ...
[2012-12-27 17:21:55,034][INFO ][plugins ] [Boomslang]
loaded , sites
[2012-12-27 17:21:58,484][INFO ][node ] [Boomslang]
{0.20.1}[2187]: initialized
[2012-12-27 17:21:58,484][INFO ][node ] [Boomslang]
{0.20.1}[2187]: starting ...
[2012-12-27 17:21:58,674][INFO ][transport ] [Boomslang]
bound_address {inet[XXX.XX.XXX.XXX:9300]}, publish_address
{inet[/XXX.XXX.XXX.XXX:9300]}
[2012-12-27 17:22:01,922][INFO ][cluster.service ] [Boomslang]
new_master
[Boomslang][DuJAy1WLSdij0PNFPLt_0g][inet[/XXX.XXX.XXX.XXX:9300]], reason:
zen-disco-join (elected_as_master)
[2012-12-27 17:22:01,971][INFO ][discovery ] [Boomslang]
elasticsearch/DuJAy1WLSdij0PNFPLt_0g
[2012-12-27 17:22:02,010][INFO ][http ] [Boomslang]
bound_address {inet[/XXX.XXX.XXX.XXX:9200]}, publish_address
{inet[/XXX.XXX.XXX.XXX:9200]}
[2012-12-27 17:22:02,010][INFO ][node ] [Boomslang]
{0.20.1}[2187]: started
[2012-12-27 17:22:02,081][INFO ][gateway ] [Boomslang]
recovered [0] indices into cluster_state

I have read th website u have send me but i did not see anything regarding
such error .

Thanks

On Thu, Dec 27, 2012 at 12:36 PM, David Pilato <da...@pilato.fr<javascript:>

wrote:

Welcome.

1st, try to run ES in standalone (without Hadoop): download, unzip,
launch bin/elasticsearch -f (from UNIX), bin/elasticsearch.bat from windows
2nd, in another shell, try curl localhost:9200
If you use windows, open this URL from a browser.

If it doesn't work, check that you have a Java (6 or 7) somewhere and
that JAVA_HOME is defined.

If it still does not work, report here any error you can see in logs.

BTW, read this:
Elasticsearch Platform — Find real-time answers at scale | Elastic

HTH

--
David :wink:
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs

Le 27 déc. 2012 à 06:15, junda...@gmail.com <javascript:> a écrit :
Hi all

I am new to elasictc search. got some problem here setting up elasictic
search. i got a hadoop running up now . one master and one slave . but
after i download Elasticsearch and try to run /bin/elasticsearch -f. it
hangs there at some command line .. can i know what i need to change in the
config folder ? as i don't really understand the steps on the elastic
search website. can anyone got any better website for me to try it and
refer..

Thanks
Regards

--

--

--

--

--

--
David Pilato
http://www.scrutmydocs.org/
http://dev.david.pilato.fr/
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs

--

9

ok it works now .. i can see the localhost:9200 which will return me

{
"ok" : true,
"status" : 200,
"name" : "Strong Guy",
"version" : {
"number" : "0.20.1",
"snapshot_build" : false
},
"tagline" : "You Know, for Search"
}

this mean that it is working fine and running. i will take a look
again for the things i mention before.
Thanks for your helps David .
any advice on what is my next step after i get this ES running.

On Thu, Dec 27, 2012 at 4:59 PM, David Pilato david@pilato.fr wrote:

**
Please keep the thread in the mailing list scope. Not outside (don't send
direct mails).

OK. Here are the steps you have to follow:
1/ stop all running shells and open a new one
Just check if you have an elasticsearch running in the background ( ps
-ef | grep elasticsearch ) and kill the process if you find one.
2/ on a fresh clean elasticsearch dir (you should not find data, logs
dir), start bin/elasticsearch -f
3/ open a new shell and type curl http://localhost:9200

What happens?

Le 27 décembre 2012 à 10:48, jundatan85@gmail.com a écrit :

ok thanks. i will take a look later.

i am using ubuntu linux and using a root account

let solve the problem that my ES instance is not working. when i type in
locahost:9200 it said "unable to connect tp server at localhost:9200"

On Thursday, December 27, 2012 5:30:44 PM UTC+8, David Pilato wrote:

Ok. First, you have to make sure that your ES instance is working fine.
You should be able to do a curl localhost:9200 and see a JSON. If not,
don't go to the next steps and fix your problem! (BTW, tell me if you run
under linux or windows).

What you want to achieve is to index files. It's not one of the basic
feature of ES but it's available as a plugin ( GitHub - elastic/elasticsearch-mapper-attachments: Mapper Attachments Type plugin for Elasticsearch).
You have a full script here to try it:
https://github.com/elasticsearch/elasticsearch-mapper-attachments Test of attachments plugin · GitHub

But, it's without Hadoop. That gives me an idea for my
https://gist.github.com/3907010 scrutmydocshttp://www.scrutmydocs.org/ project.
I should add in the FSRiver (File System River) (or create a new one) the
possibility of fetching content from hdfs...

Does it help?

Le 27 décembre 2012 à 09:38, Tan Chween Tah < junda...@gmail.com> a
écrit :

Thanks david

What i am trying to do is like having big data of text or json file and
put distribute it in different computer using hadoop and using elastic
search to query the words so it will return the result faster .

You said it is working fine. so is there a example on how to insert a text
file or json file into the Elasticsearch and i am able to query the words
out. for eg. Test.txt contain words inside. and i want to search the words
like "happy" inside that test.txt file .. is it possible for elasitc search
to do that ?

nope i did not try just now. but now I have try opening localhost:9200 in
my browser but it throw me an error "problem loading page".

any advice ?

thanks

On Thu, Dec 27, 2012 at 2:54 PM, David Pilato da...@pilato.fr wrote:

Looks like everything is working here.
What do you expect to see?

Did you open localhost:9200 in your browser?

--
David :wink:
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs

Le 27 déc. 2012 à 06:51, Tan Chween Tah < junda...@gmail.com> a écrit :
Thanks for the reply David, i have tried it out before and it still not
working. the terminal will be still hang

elasticsearch-0.20.1# bin/elasticsearch -f
[2012-12-27 17:21:55,023][INFO ][node ] [Boomslang]
{0.20.1}[2187]: initializing ...
[2012-12-27 17:21:55,034][INFO ][plugins ] [Boomslang]
loaded , sites
[2012-12-27 17:21:58,484][INFO ][node ] [Boomslang]
{0.20.1}[2187]: initialized
[2012-12-27 17:21:58,484][INFO ][node ] [Boomslang]
{0.20.1}[2187]: starting ...
[2012-12-27 17:21:58,674][INFO ][transport ] [Boomslang]
bound_address {inet[XXX.XX.XXX.XXX:9300]}, publish_address
{inet[/XXX.XXX.XXX.XXX:9300]}
[2012-12-27 17:22:01,922][INFO ][cluster.service ] [Boomslang]
new_master
[Boomslang][DuJAy1WLSdij0PNFPLt_0g][inet[/XXX.XXX.XXX.XXX:9300]], reason:
zen-disco-join (elected_as_master)
[2012-12-27 17:22:01,971][INFO ][discovery ] [Boomslang]
elasticsearch/DuJAy1WLSdij0PNFPLt_0g
[2012-12-27 17:22:02,010][INFO ][http ] [Boomslang]
bound_address {inet[/XXX.XXX.XXX.XXX:9200]}, publish_address
{inet[/XXX.XXX.XXX.XXX:9200]}
[2012-12-27 17:22:02,010][INFO ][node ] [Boomslang]
{0.20.1}[2187]: started
[2012-12-27 17:22:02,081][INFO ][gateway ] [Boomslang]
recovered [0] indices into cluster_state

I have read th website u have send me but i did not see anything regarding
such error .

Thanks

On Thu, Dec 27, 2012 at 12:36 PM, David Pilato da...@pilato.fr wrote:

Welcome.

1st, try to run ES in standalone (without Hadoop): download, unzip,
launch bin/elasticsearch -f (from UNIX), bin/elasticsearch.bat from windows
2nd, in another shell, try curl localhost:9200
If you use windows, open this URL from a browser.

If it doesn't work, check that you have a Java (6 or 7) somewhere and
that JAVA_HOME is defined.

If it still does not work, report here any error you can see in logs.

BTW, read this: Elasticsearch Platform — Find real-time answers at scale | Elastic

HTH

--
David :wink:
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs

Le 27 déc. 2012 à 06:15,
http://www.elasticsearch.org/guide/reference/setup/installation.html
junda...@gmail.com a écrit :
Hi all

I am new to elasictc search. got some problem here setting up elasictic
search. i got a hadoop running up now . one master and one slave . but
after i download Elasticsearch and try to run /bin/elasticsearch -f. it
hangs there at some command line .. can i know what i need to change in the
config folder ? as i don't really understand the steps on the elastic
search website. can anyone got any better website for me to try it and
refer..

Thanks
Regards

--

--

--

--

--

--
David Pilato
http://www.scrutmydocs.org/
http://dev.david.pilato.fr/
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs

--
David Pilato
http://www.scrutmydocs.org/
http://dev.david.pilato.fr/
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs

--

--

10

Cool.
Try to play with attachments now: Follow this script
https://gist.github.com/3907010 .

Le 27 décembre 2012 à 11:25, Tan Chween Tah jundatan85@gmail.com a écrit :

ok it works now .. i can see the localhost:9200 which will return me

{
"ok" : true,
"status" : 200,
"name" : "Strong Guy",
"version" : {
"number" : "0.20.1",
"snapshot_build" : false
},
"tagline" : "You Know, for Search"
}

this mean that it is working fine and running. i will take a look again for
the things i mention before.
Thanks for your helps David .
any advice on what is my next step after i get this ES running.

On Thu, Dec 27, 2012 at 4:59 PM, David Pilato <david@pilato.fr
mailto:david@pilato.fr > wrote:

Please keep the thread in the mailing list scope. Not outside (don't
send direct mails).

OK. Here are the steps you have to follow:
1/ stop all running shells and open a new one
Just check if you have an elasticsearch running in the background ( ps
-ef | grep elasticsearch ) and kill the process if you find one.
2/ on a fresh clean elasticsearch dir (you should not find data, logs
dir), start bin/elasticsearch -f
3/ open a new shell and type curl http://localhost:9200
http://localhost:9200

What happens?

Le 27 décembre 2012 à 10:48, jundatan85@gmail.com
mailto:jundatan85@gmail.com a écrit :

> > > ok thanks. i will take a look later.

i am using ubuntu linux and using a root account

 let solve the problem that my ES instance is not working. when i type

in locahost:9200 it said "unable to connect tp server at localhost:9200"

On Thursday, December 27, 2012 5:30:44 PM UTC+8, David Pilato wrote:
  > > > >       Ok. First, you have to make sure that your ES instance
  > > > > is working fine.

  You should be able to do a curl localhost:9200 and see a JSON. If

not, don't go to the next steps and fix your problem! (BTW, tell me if
you run under linux or windows).

  What you want to achieve is to index files. It's not one of the

basic feature of ES but it's available as a plugin (
GitHub - elastic/elasticsearch-mapper-attachments: Mapper Attachments Type plugin for Elasticsearch). You
have a full script here to try it:
https://github.com/elasticsearch/elasticsearch-mapper-attachments
Test of attachments plugin · GitHub https://gist.github.com/3907010

  But, it's without Hadoop. That gives me an idea for my

https://gist.github.com/3907010 scrutmydocs
http://www.scrutmydocs.org/ project. I should add in the FSRiver
(File System River) (or create a new one) the possibility of fetching
content from hdfs...

  Does it help?

  Le 27 décembre 2012 à 09:38, Tan Chween Tah < junda...@gmail.com>

a écrit :

   > > > > >        Thanks david

   What i am trying to do is like having big data of text or json

file and put distribute it in different computer using hadoop and
using Elasticsearch to query the words so it will return the result
faster .

   You said it is working fine. so is there a example on how to

insert a text file or json file into the Elasticsearch and i am able
to query the words out. for eg. Test.txt contain words inside. and i
want to search the words like "happy" inside that test.txt file .. is
it possible for elasitc search to do that ?

   nope i did not try just now. but now I have try opening

localhost:9200 in my browser but it throw me an error "problem loading
page".

   any advice ?

   thanks



   On Thu, Dec 27, 2012 at 2:54 PM, David Pilato <da...@pilato.fr>

wrote:
> > > > > > Looks like everything is working here.

     What do you expect to see?

     Did you open localhost:9200 in your browser?


     --
     David ;-)
     Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs


     Le 27 déc. 2012 à 06:51, Tan Chween Tah <

junda...@gmail.com> a écrit :
Thanks for the reply David, i have tried it out before and
it still not working. the terminal will be still hang

     elasticsearch-0.20.1# bin/elasticsearch -f
     [2012-12-27 17:21:55,023][INFO ][node                     ]

[Boomslang] {0.20.1}[2187]: initializing ...
[2012-12-27 17:21:55,034][INFO ][plugins ]
[Boomslang] loaded , sites
[2012-12-27 17:21:58,484][INFO ][node ]
[Boomslang] {0.20.1}[2187]: initialized
[2012-12-27 17:21:58,484][INFO ][node ]
[Boomslang] {0.20.1}[2187]: starting ...
[2012-12-27 17:21:58,674][INFO ][transport ]
[Boomslang] bound_address {inet[XXX.XX.XXX.XXX:9300]},
publish_address {inet[/XXX.XXX.XXX.XXX:9300]}
[2012-12-27 17:22:01,922][INFO ][cluster.service ]
[Boomslang] new_master
[Boomslang][DuJAy1WLSdij0PNFPLt_0g][inet[/XXX.XXX.XXX.XXX:9300]],
reason: zen-disco-join (elected_as_master)
[2012-12-27 17:22:01,971][INFO ][discovery ]
[Boomslang] elasticsearch/DuJAy1WLSdij0PNFPLt_0g
[2012-12-27 17:22:02,010][INFO ][http ]
[Boomslang] bound_address {inet[/XXX.XXX.XXX.XXX:9200]},
publish_address {inet[/XXX.XXX.XXX.XXX:9200]}
[2012-12-27 17:22:02,010][INFO ][node ]
[Boomslang] {0.20.1}[2187]: started
[2012-12-27 17:22:02,081][INFO ][gateway ]
[Boomslang] recovered [0] indices into cluster_state

     I have read th website u have send me but i did not see

anything regarding such error .

     Thanks
     On Thu, Dec 27, 2012 at 12:36 PM, David Pilato

da...@pilato.fr wrote:
> > > > > > > Welcome.

       1st, try to run ES in standalone (without Hadoop):

download, unzip, launch bin/elasticsearch -f (from UNIX),
bin/elasticsearch.bat from windows
2nd, in another shell, try curl localhost:9200
If you use windows, open this URL from a browser.

       If it doesn't work, check that you have a Java (6 or 7)

somewhere and that JAVA_HOME is defined.

       If it still does not work, report here any error you

can see in logs.

       BTW, read this:

Elasticsearch Platform — Find real-time answers at scale | Elastic
http://www.elasticsearch.org/guide/reference/setup/installation.html

       HTH

       --
       David ;-)
       Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs


       Le 27 déc. 2012 à 06:15,

http://www.elasticsearch.org/guide/reference/setup/installation.html
junda...@gmail.com a écrit :
Hi all

       I am new to elasictc search. got some problem here

setting up elasictic search. i got a hadoop running up now . one
master and one slave . but after i download Elasticsearch and try
to run /bin/elasticsearch -f. it hangs there at some command line
.. can i know what i need to change in the config folder ? as i
don't really understand the steps on the Elasticsearch website.
can anyone got any better website for me to try it and refer..

       Thanks
       Regards



       --





       --


     > > > > > > 

     --





     --






     --


   > > > > > 

   --
   David Pilato
   http://www.scrutmydocs.org/ <http://www.scrutmydocs.org/>
   http://dev.david.pilato.fr/ <http://dev.david.pilato.fr/>
   Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs

  > > > >     > > >

--
David Pilato
http://www.scrutmydocs.org/ http://www.scrutmydocs.org/
http://dev.david.pilato.fr/ http://dev.david.pilato.fr/
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs

--

--

--
David Pilato
http://www.scrutmydocs.org/
http://dev.david.pilato.fr/
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs

--

11

hi thanks but the attachment don't seem to be working too .

On Thu, Dec 27, 2012 at 5:31 PM, David Pilato david@pilato.fr wrote:

**
Cool.
Try to play with attachments now: Follow this scripthttps://gist.github.com/3907010.

Le 27 décembre 2012 à 11:25, Tan Chween Tah jundatan85@gmail.com a
écrit :

ok it works now .. i can see the localhost:9200 which will return me

{
"ok" : true,
"status" : 200,
"name" : "Strong Guy",
"version" : {
"number" : "0.20.1",
"snapshot_build" : false
},
"tagline" : "You Know, for Search"
}

this mean that it is working fine and running. i will take a look again for the things i mention before.
Thanks for your helps David .
any advice on what is my next step after i get this ES running.

On Thu, Dec 27, 2012 at 4:59 PM, David Pilato david@pilato.fr wrote:

Please keep the thread in the mailing list scope. Not outside (don't
send direct mails).

OK. Here are the steps you have to follow:
1/ stop all running shells and open a new one
Just check if you have an elasticsearch running in the background ( ps
-ef | grep elasticsearch ) and kill the process if you find one.
2/ on a fresh clean elasticsearch dir (you should not find data, logs
dir), start bin/elasticsearch -f
3/ open a new shell and type curl http://localhost:9200

What happens?

Le 27 décembre 2012 à 10:48, jundatan85@gmail.com a écrit :

ok thanks. i will take a look later.

i am using ubuntu linux and using a root account

let solve the problem that my ES instance is not working. when i type in
locahost:9200 it said "unable to connect tp server at localhost:9200"

On Thursday, December 27, 2012 5:30:44 PM UTC+8, David Pilato wrote:

Ok. First, you have to make sure that your ES instance is working fine.
You should be able to do a curl localhost:9200 and see a JSON. If not,
don't go to the next steps and fix your problem! (BTW, tell me if you run
under linux or windows).

What you want to achieve is to index files. It's not one of the basic
feature of ES but it's available as a plugin ( GitHub - elastic/elasticsearch-mapper-attachments: Mapper Attachments Type plugin for Elasticsearch).
You have a full script here to try it:
https://github.com/elasticsearch/elasticsearch-mapper-attachments Test of attachments plugin · GitHub

But, it's without Hadoop. That gives me an idea for my
https://gist.github.com/3907010 scrutmydocshttp://www.scrutmydocs.org/ project.
I should add in the FSRiver (File System River) (or create a new one) the
possibility of fetching content from hdfs...

Does it help?

Le 27 décembre 2012 à 09:38, Tan Chween Tah < junda...@gmail.com> a
écrit :

Thanks david

What i am trying to do is like having big data of text or json file and
put distribute it in different computer using hadoop and using elastic
search to query the words so it will return the result faster .

You said it is working fine. so is there a example on how to insert a text
file or json file into the Elasticsearch and i am able to query the words
out. for eg. Test.txt contain words inside. and i want to search the words
like "happy" inside that test.txt file .. is it possible for elasitc search
to do that ?

nope i did not try just now. but now I have try opening localhost:9200 in
my browser but it throw me an error "problem loading page".

any advice ?

thanks

On Thu, Dec 27, 2012 at 2:54 PM, David Pilato da...@pilato.fr wrote:

Looks like everything is working here.
What do you expect to see?

Did you open localhost:9200 in your browser?

--
David :wink:
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs

Le 27 déc. 2012 à 06:51, Tan Chween Tah < junda...@gmail.com> a écrit :
Thanks for the reply David, i have tried it out before and it still not
working. the terminal will be still hang

elasticsearch-0.20.1# bin/elasticsearch -f
[2012-12-27 17:21:55,023][INFO ][node ] [Boomslang]
{0.20.1}[2187]: initializing ...
[2012-12-27 17:21:55,034][INFO ][plugins ] [Boomslang]
loaded , sites
[2012-12-27 17:21:58,484][INFO ][node ] [Boomslang]
{0.20.1}[2187]: initialized
[2012-12-27 17:21:58,484][INFO ][node ] [Boomslang]
{0.20.1}[2187]: starting ...
[2012-12-27 17:21:58,674][INFO ][transport ] [Boomslang]
bound_address {inet[XXX.XX.XXX.XXX:9300]}, publish_address
{inet[/XXX.XXX.XXX.XXX:9300]}
[2012-12-27 17:22:01,922][INFO ][cluster.service ] [Boomslang]
new_master
[Boomslang][DuJAy1WLSdij0PNFPLt_0g][inet[/XXX.XXX.XXX.XXX:9300]], reason:
zen-disco-join (elected_as_master)
[2012-12-27 17:22:01,971][INFO ][discovery ] [Boomslang]
elasticsearch/DuJAy1WLSdij0PNFPLt_0g
[2012-12-27 17:22:02,010][INFO ][http ] [Boomslang]
bound_address {inet[/XXX.XXX.XXX.XXX:9200]}, publish_address
{inet[/XXX.XXX.XXX.XXX:9200]}
[2012-12-27 17:22:02,010][INFO ][node ] [Boomslang]
{0.20.1}[2187]: started
[2012-12-27 17:22:02,081][INFO ][gateway ] [Boomslang]
recovered [0] indices into cluster_state

I have read th website u have send me but i did not see anything regarding
such error .

Thanks
On Thu, Dec 27, 2012 at 12:36 PM, David Pilato da...@pilato.fr wrote:

Welcome.

1st, try to run ES in standalone (without Hadoop): download, unzip,
launch bin/elasticsearch -f (from UNIX), bin/elasticsearch.bat from windows
2nd, in another shell, try curl localhost:9200
If you use windows, open this URL from a browser.

If it doesn't work, check that you have a Java (6 or 7) somewhere and
that JAVA_HOME is defined.

If it still does not work, report here any error you can see in logs.

BTW, read this: Elasticsearch Platform — Find real-time answers at scale | Elastic

HTH

--
David :wink:
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs

Le 27 déc. 2012 à 06:15,
http://www.elasticsearch.org/guide/reference/setup/installation.html
junda...@gmail.com a écrit :
Hi all

I am new to elasictc search. got some problem here setting up elasictic
search. i got a hadoop running up now . one master and one slave . but
after i download Elasticsearch and try to run /bin/elasticsearch -f. it
hangs there at some command line .. can i know what i need to change in the
config folder ? as i don't really understand the steps on the elastic
search website. can anyone got any better website for me to try it and
refer..

Thanks
Regards

--

--

--

--

--

--
David Pilato
http://www.scrutmydocs.org/
http://dev.david.pilato.fr/
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs

--
David Pilato
http://www.scrutmydocs.org/
http://dev.david.pilato.fr/
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs

--

--

--
David Pilato
http://www.scrutmydocs.org/
http://dev.david.pilato.fr/
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs

--

--

12

If you need help, you have to give some details as "doesn't seem to work" is not enough to find your problem.

So, what did you do?
What can you see? Is there any errors in logs?

--
David :wink:
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs

Le 28 déc. 2012 à 06:11, Tan Chween Tah jundatan85@gmail.com a écrit :

hi thanks but the attachment don't seem to be working too .

On Thu, Dec 27, 2012 at 5:31 PM, David Pilato david@pilato.fr wrote:

Cool.
Try to play with attachments now: Follow this script.

Le 27 décembre 2012 à 11:25, Tan Chween Tah jundatan85@gmail.com a écrit :

ok it works now .. i can see the localhost:9200 which will return me

{
"ok" : true,
"status" : 200,
"name" : "Strong Guy",
"version" : {
"number" : "0.20.1",
"snapshot_build" : false
},
"tagline" : "You Know, for Search"
}

this mean that it is working fine and running. i will take a look again for the things i mention before.
Thanks for your helps David .
any advice on what is my next step after i get this ES running.

On Thu, Dec 27, 2012 at 4:59 PM, David Pilato david@pilato.fr wrote:
Please keep the thread in the mailing list scope. Not outside (don't send direct mails).

OK. Here are the steps you have to follow:
1/ stop all running shells and open a new one
Just check if you have an elasticsearch running in the background ( ps -ef | grep elasticsearch ) and kill the process if you find one.
2/ on a fresh clean elasticsearch dir (you should not find data, logs dir), start bin/elasticsearch -f
3/ open a new shell and type curl http://localhost:9200

What happens?

Le 27 décembre 2012 à 10:48, jundatan85@gmail.com a écrit :

ok thanks. i will take a look later.

i am using ubuntu linux and using a root account

let solve the problem that my ES instance is not working. when i type in locahost:9200 it said "unable to connect tp server at localhost:9200"

On Thursday, December 27, 2012 5:30:44 PM UTC+8, David Pilato wrote:
Ok. First, you have to make sure that your ES instance is working fine.
You should be able to do a curl localhost:9200 and see a JSON. If not, don't go to the next steps and fix your problem! (BTW, tell me if you run under linux or windows).

What you want to achieve is to index files. It's not one of the basic feature of ES but it's available as a plugin ( GitHub - elastic/elasticsearch-mapper-attachments: Mapper Attachments Type plugin for Elasticsearch). You have a full script here to try it: Test of attachments plugin · GitHub

But, it's without Hadoop. That gives me an idea for my scrutmydocs project. I should add in the FSRiver (File System River) (or create a new one) the possibility of fetching content from hdfs...

Does it help?

Le 27 décembre 2012 à 09:38, Tan Chween Tah < junda...@gmail.com> a écrit :

Thanks david

What i am trying to do is like having big data of text or json file and put distribute it in different computer using hadoop and using Elasticsearch to query the words so it will return the result faster .

You said it is working fine. so is there a example on how to insert a text file or json file into the Elasticsearch and i am able to query the words out. for eg. Test.txt contain words inside. and i want to search the words like "happy" inside that test.txt file .. is it possible for elasitc search to do that ?

nope i did not try just now. but now I have try opening localhost:9200 in my browser but it throw me an error "problem loading page".

any advice ?

thanks

On Thu, Dec 27, 2012 at 2:54 PM, David Pilato da...@pilato.fr wrote:
Looks like everything is working here.
What do you expect to see?

Did you open localhost:9200 in your browser?

--
David :wink:
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs

Le 27 déc. 2012 à 06:51, Tan Chween Tah < junda...@gmail.com> a écrit :
Thanks for the reply David, i have tried it out before and it still not working. the terminal will be still hang

elasticsearch-0.20.1# bin/elasticsearch -f
[2012-12-27 17:21:55,023][INFO ][node ] [Boomslang] {0.20.1}[2187]: initializing ...
[2012-12-27 17:21:55,034][INFO ][plugins ] [Boomslang] loaded , sites
[2012-12-27 17:21:58,484][INFO ][node ] [Boomslang] {0.20.1}[2187]: initialized
[2012-12-27 17:21:58,484][INFO ][node ] [Boomslang] {0.20.1}[2187]: starting ...
[2012-12-27 17:21:58,674][INFO ][transport ] [Boomslang] bound_address {inet[XXX.XX.XXX.XXX:9300]}, publish_address {inet[/XXX.XXX.XXX.XXX:9300]}
[2012-12-27 17:22:01,922][INFO ][cluster.service ] [Boomslang] new_master [Boomslang][DuJAy1WLSdij0PNFPLt_0g][inet[/XXX.XXX.XXX.XXX:9300]], reason: zen-disco-join (elected_as_master)
[2012-12-27 17:22:01,971][INFO ][discovery ] [Boomslang] elasticsearch/DuJAy1WLSdij0PNFPLt_0g
[2012-12-27 17:22:02,010][INFO ][http ] [Boomslang] bound_address {inet[/XXX.XXX.XXX.XXX:9200]}, publish_address {inet[/XXX.XXX.XXX.XXX:9200]}
[2012-12-27 17:22:02,010][INFO ][node ] [Boomslang] {0.20.1}[2187]: started
[2012-12-27 17:22:02,081][INFO ][gateway ] [Boomslang] recovered [0] indices into cluster_state

I have read th website u have send me but i did not see anything regarding such error .

Thanks
On Thu, Dec 27, 2012 at 12:36 PM, David Pilato da...@pilato.fr wrote:
Welcome.

1st, try to run ES in standalone (without Hadoop): download, unzip, launch bin/elasticsearch -f (from UNIX), bin/elasticsearch.bat from windows
2nd, in another shell, try curl localhost:9200
If you use windows, open this URL from a browser.

If it doesn't work, check that you have a Java (6 or 7) somewhere and that JAVA_HOME is defined.

If it still does not work, report here any error you can see in logs.

BTW, read this: Elasticsearch Platform — Find real-time answers at scale | Elastic

HTH

--
David :wink:
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs

Le 27 déc. 2012 à 06:15, junda...@gmail.com a écrit :
Hi all

I am new to elasictc search. got some problem here setting up elasictic search. i got a hadoop running up now . one master and one slave . but after i download Elasticsearch and try to run /bin/elasticsearch -f. it hangs there at some command line .. can i know what i need to change in the config folder ? as i don't really understand the steps on the Elasticsearch website. can anyone got any better website for me to try it and refer..

Thanks
Regards

--

--

--

--

--

--
David Pilato
http://www.scrutmydocs.org/
http://dev.david.pilato.fr/
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs

--
David Pilato
http://www.scrutmydocs.org/
http://dev.david.pilato.fr/
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs

--

--

--
David Pilato
http://www.scrutmydocs.org/
http://dev.david.pilato.fr/
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs

--

--

13

i create the file.sh file and place the code
#!/bin/sh

http://cloud.github.com/downloads/elasticsearch/elasticsearch/elasticsearch-0.19.10.zip

#unzip elasticsearch-0.19.10.zip

#elasticsearch-0.19.10/bin/plugin -install
elasticsearch/elasticsearch-mapper-attachments/1.6.0

../../usr/local/elasticsearch-0.20.1/bin/elasticsearch

sleep 10

host=localhost:9200

curl -X DELETE "${host}/test"

curl -X PUT "${host}/test" -d '{

"settings" : { "index" : { "number_of_shards" : 1, "number_of_replicas" : 0
}}

}'

curl -X GET
"${host}/_cluster/health?wait_for_status=green&pretty=1&timeout=5s"

curl -X PUT "${host}/test/attachment/_mapping" -d '{

"attachment" : {

"properties" : {

"file" : {

"type" : "attachment",

"fields" : {

"title" : { "store" : "yes" },

"file" : { "term_vector":"with_positions_offsets", "store":"yes" }

}

}

}

}

}'

curl -C - -O

coded=cat fn6742.pdf | perl -MMIME::Base64 -ne 'print encode_base64($_)'

json="{"file":"${coded}"}"

echo "$json" > json.file

curl -X POST "${host}/test/attachment/" -d @json.file

echo

curl -XPOST "${host}/_refresh"

curl "${host}/_search?pretty=true" -d '{

"fields" : ["title"],

"query" : {

"query_string" : {

"query" : "amplifier"

}

},

"highlight" : {

"fields" : {

"file" : {}

}

}

}'
i run the file.sh from my terminal. it will said
./file.sh: 31: ./file.sh: curl: not found
./file.sh: 39: ./file.sh: curl: not found
./file.sh: 43: ./file.sh: curl: not found
./file.sh: 71: ./file.sh: curl: not found
cat: fn6742.pdf: No such file or directory
./file.sh: 81: ./file.sh: curl: not found

./file.sh: 87: ./file.sh: curl: not found
./file.sh: 91: ./file.sh: curl: not found

On Fri, Dec 28, 2012 at 12:11 PM, Tan Chween Tah jundatan85@gmail.comwrote:

hi thanks but the attachment don't seem to be working too .

On Thu, Dec 27, 2012 at 5:31 PM, David Pilato david@pilato.fr wrote:

**
Cool.
Try to play with attachments now: Follow this scripthttps://gist.github.com/3907010.

Le 27 décembre 2012 à 11:25, Tan Chween Tah jundatan85@gmail.com a
écrit :

ok it works now .. i can see the localhost:9200 which will return me

{
"ok" : true,
"status" : 200,
"name" : "Strong Guy",
"version" : {
"number" : "0.20.1",
"snapshot_build" : false
},
"tagline" : "You Know, for Search"
}

this mean that it is working fine and running. i will take a look again for the things i mention before.
Thanks for your helps David .
any advice on what is my next step after i get this ES running.

On Thu, Dec 27, 2012 at 4:59 PM, David Pilato david@pilato.fr wrote:

Please keep the thread in the mailing list scope. Not outside (don't
send direct mails).

OK. Here are the steps you have to follow:
1/ stop all running shells and open a new one
Just check if you have an elasticsearch running in the background ( ps
-ef | grep elasticsearch ) and kill the process if you find one.
2/ on a fresh clean elasticsearch dir (you should not find data, logs
dir), start bin/elasticsearch -f
3/ open a new shell and type curl http://localhost:9200

What happens?

Le 27 décembre 2012 à 10:48, jundatan85@gmail.com a écrit :

ok thanks. i will take a look later.

i am using ubuntu linux and using a root account

let solve the problem that my ES instance is not working. when i type
in locahost:9200 it said "unable to connect tp server at localhost:9200"

On Thursday, December 27, 2012 5:30:44 PM UTC+8, David Pilato wrote:

Ok. First, you have to make sure that your ES instance is working
fine.
You should be able to do a curl localhost:9200 and see a JSON. If not,
don't go to the next steps and fix your problem! (BTW, tell me if you run
under linux or windows).

What you want to achieve is to index files. It's not one of the basic
feature of ES but it's available as a plugin ( GitHub - elastic/elasticsearch-mapper-attachments: Mapper Attachments Type plugin for Elasticsearch).
You have a full script here to try it:
https://github.com/elasticsearch/elasticsearch-mapper-attachments Test of attachments plugin · GitHub

But, it's without Hadoop. That gives me an idea for my
https://gist.github.com/3907010 scrutmydocshttp://www.scrutmydocs.org/ project.
I should add in the FSRiver (File System River) (or create a new one) the
possibility of fetching content from hdfs...

Does it help?

Le 27 décembre 2012 à 09:38, Tan Chween Tah < junda...@gmail.com> a
écrit :

Thanks david

What i am trying to do is like having big data of text or json file and
put distribute it in different computer using hadoop and using elastic
search to query the words so it will return the result faster .

You said it is working fine. so is there a example on how to insert a
text file or json file into the Elasticsearch and i am able to query the
words out. for eg. Test.txt contain words inside. and i want to search the
words like "happy" inside that test.txt file .. is it possible for elasitc
search to do that ?

nope i did not try just now. but now I have try opening localhost:9200 in
my browser but it throw me an error "problem loading page".

any advice ?

thanks

On Thu, Dec 27, 2012 at 2:54 PM, David Pilato da...@pilato.fr wrote:

Looks like everything is working here.
What do you expect to see?

Did you open localhost:9200 in your browser?

--
David :wink:
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs

Le 27 déc. 2012 à 06:51, Tan Chween Tah < junda...@gmail.com> a écrit :
Thanks for the reply David, i have tried it out before and it still
not working. the terminal will be still hang

elasticsearch-0.20.1# bin/elasticsearch -f
[2012-12-27 17:21:55,023][INFO ][node ] [Boomslang]
{0.20.1}[2187]: initializing ...
[2012-12-27 17:21:55,034][INFO ][plugins ] [Boomslang]
loaded , sites
[2012-12-27 17:21:58,484][INFO ][node ] [Boomslang]
{0.20.1}[2187]: initialized
[2012-12-27 17:21:58,484][INFO ][node ] [Boomslang]
{0.20.1}[2187]: starting ...
[2012-12-27 17:21:58,674][INFO ][transport ] [Boomslang]
bound_address {inet[XXX.XX.XXX.XXX:9300]}, publish_address
{inet[/XXX.XXX.XXX.XXX:9300]}
[2012-12-27 17:22:01,922][INFO ][cluster.service ] [Boomslang]
new_master
[Boomslang][DuJAy1WLSdij0PNFPLt_0g][inet[/XXX.XXX.XXX.XXX:9300]], reason:
zen-disco-join (elected_as_master)
[2012-12-27 17:22:01,971][INFO ][discovery ] [Boomslang]
elasticsearch/DuJAy1WLSdij0PNFPLt_0g
[2012-12-27 17:22:02,010][INFO ][http ] [Boomslang]
bound_address {inet[/XXX.XXX.XXX.XXX:9200]}, publish_address
{inet[/XXX.XXX.XXX.XXX:9200]}
[2012-12-27 17:22:02,010][INFO ][node ] [Boomslang]
{0.20.1}[2187]: started
[2012-12-27 17:22:02,081][INFO ][gateway ] [Boomslang]
recovered [0] indices into cluster_state

I have read th website u have send me but i did not see anything
regarding such error .

Thanks
On Thu, Dec 27, 2012 at 12:36 PM, David Pilato da...@pilato.frwrote:

Welcome.

1st, try to run ES in standalone (without Hadoop): download, unzip,
launch bin/elasticsearch -f (from UNIX), bin/elasticsearch.bat from windows
2nd, in another shell, try curl localhost:9200
If you use windows, open this URL from a browser.

If it doesn't work, check that you have a Java (6 or 7) somewhere and
that JAVA_HOME is defined.

If it still does not work, report here any error you can see in logs.

BTW, read this: Elasticsearch Platform — Find real-time answers at scale | Elastic

HTH

--
David :wink:
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs

Le 27 déc. 2012 à 06:15,
http://www.elasticsearch.org/guide/reference/setup/installation.html
junda...@gmail.com a écrit :
Hi all

I am new to elasictc search. got some problem here setting up elasictic
search. i got a hadoop running up now . one master and one slave . but
after i download Elasticsearch and try to run /bin/elasticsearch -f. it
hangs there at some command line .. can i know what i need to change in the
config folder ? as i don't really understand the steps on the elastic
search website. can anyone got any better website for me to try it and
refer..

Thanks
Regards

--

--

--

--

--

--
David Pilato
http://www.scrutmydocs.org/
http://dev.david.pilato.fr/
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs

--
David Pilato
http://www.scrutmydocs.org/
http://dev.david.pilato.fr/
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs

--

--

--
David Pilato
http://www.scrutmydocs.org/
http://dev.david.pilato.fr/
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs

--

--

14

So you don't have curl on your system.
Install it or add it in your Path...

--
David :wink:
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs

Le 28 déc. 2012 à 08:19, Tan Chween Tah jundatan85@gmail.com a écrit :

i create the file.sh file and place the code
#!/bin/sh

#http://cloud.github.com/downloads/elasticsearch/elasticsearch/elasticsearch-0.19.10.zip

#unzip elasticsearch-0.19.10.zip

#elasticsearch-0.19.10/bin/plugin -install elasticsearch/elasticsearch-mapper-attachments/1.6.0

../../usr/local/elasticsearch-0.20.1/bin/elasticsearch

sleep 10

host=localhost:9200

curl -X DELETE "${host}/test"

curl -X PUT "${host}/test" -d '{

"settings" : { "index" : { "number_of_shards" : 1, "number_of_replicas" : 0 }}

}'

curl -X GET "${host}/_cluster/health?wait_for_status=green&pretty=1&timeout=5s"

curl -X PUT "${host}/test/attachment/_mapping" -d '{

"attachment" : {

"properties" : {

"file" : {

"type" : "attachment",

"fields" : {

"title" : { "store" : "yes" },

"file" : { "term_vector":"with_positions_offsets", "store":"yes" }

}

}

}

}

}'

curl -C - -O Renesas Electronics Corporation

coded=cat fn6742.pdf | perl -MMIME::Base64 -ne 'print encode_base64($_)'

json="{"file":"${coded}"}"

echo "$json" > json.file

curl -X POST "${host}/test/attachment/" -d @json.file

echo

curl -XPOST "${host}/_refresh"

curl "${host}/_search?pretty=true" -d '{

"fields" : ["title"],

"query" : {

"query_string" : {

"query" : "amplifier"

}

},

"highlight" : {

"fields" : {

"file" : {}

}

}

}'
i run the file.sh from my terminal. it will said
./file.sh: 31: ./file.sh: curl: not found
./file.sh: 39: ./file.sh: curl: not found
./file.sh: 43: ./file.sh: curl: not found
./file.sh: 71: ./file.sh: curl: not found
cat: fn6742.pdf: No such file or directory
./file.sh: 81: ./file.sh: curl: not found

./file.sh: 87: ./file.sh: curl: not found
./file.sh: 91: ./file.sh: curl: not found

On Fri, Dec 28, 2012 at 12:11 PM, Tan Chween Tah jundatan85@gmail.com wrote:

hi thanks but the attachment don't seem to be working too .

On Thu, Dec 27, 2012 at 5:31 PM, David Pilato david@pilato.fr wrote:

Cool.
Try to play with attachments now: Follow this script.

Le 27 décembre 2012 à 11:25, Tan Chween Tah jundatan85@gmail.com a écrit :

ok it works now .. i can see the localhost:9200 which will return me

{
"ok" : true,
"status" : 200,
"name" : "Strong Guy",
"version" : {
"number" : "0.20.1",
"snapshot_build" : false
},
"tagline" : "You Know, for Search"
}

this mean that it is working fine and running. i will take a look again for the things i mention before.
Thanks for your helps David .
any advice on what is my next step after i get this ES running.

On Thu, Dec 27, 2012 at 4:59 PM, David Pilato david@pilato.fr wrote:
Please keep the thread in the mailing list scope. Not outside (don't send direct mails).

OK. Here are the steps you have to follow:
1/ stop all running shells and open a new one
Just check if you have an elasticsearch running in the background ( ps -ef | grep elasticsearch ) and kill the process if you find one.
2/ on a fresh clean elasticsearch dir (you should not find data, logs dir), start bin/elasticsearch -f
3/ open a new shell and type curl http://localhost:9200

What happens?

Le 27 décembre 2012 à 10:48, jundatan85@gmail.com a écrit :

ok thanks. i will take a look later.

i am using ubuntu linux and using a root account

let solve the problem that my ES instance is not working. when i type in locahost:9200 it said "unable to connect tp server at localhost:9200"

On Thursday, December 27, 2012 5:30:44 PM UTC+8, David Pilato wrote:
Ok. First, you have to make sure that your ES instance is working fine.
You should be able to do a curl localhost:9200 and see a JSON. If not, don't go to the next steps and fix your problem! (BTW, tell me if you run under linux or windows).

What you want to achieve is to index files. It's not one of the basic feature of ES but it's available as a plugin ( GitHub - elastic/elasticsearch-mapper-attachments: Mapper Attachments Type plugin for Elasticsearch). You have a full script here to try it: Test of attachments plugin · GitHub

But, it's without Hadoop. That gives me an idea for my scrutmydocs project. I should add in the FSRiver (File System River) (or create a new one) the possibility of fetching content from hdfs...

Does it help?

Le 27 décembre 2012 à 09:38, Tan Chween Tah < junda...@gmail.com> a écrit :

Thanks david

What i am trying to do is like having big data of text or json file and put distribute it in different computer using hadoop and using Elasticsearch to query the words so it will return the result faster .

You said it is working fine. so is there a example on how to insert a text file or json file into the Elasticsearch and i am able to query the words out. for eg. Test.txt contain words inside. and i want to search the words like "happy" inside that test.txt file .. is it possible for elasitc search to do that ?

nope i did not try just now. but now I have try opening localhost:9200 in my browser but it throw me an error "problem loading page".

any advice ?

thanks

On Thu, Dec 27, 2012 at 2:54 PM, David Pilato da...@pilato.fr wrote:
Looks like everything is working here.
What do you expect to see?

Did you open localhost:9200 in your browser?

--
David :wink:
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs

Le 27 déc. 2012 à 06:51, Tan Chween Tah < junda...@gmail.com> a écrit :
Thanks for the reply David, i have tried it out before and it still not working. the terminal will be still hang

elasticsearch-0.20.1# bin/elasticsearch -f
[2012-12-27 17:21:55,023][INFO ][node ] [Boomslang] {0.20.1}[2187]: initializing ...
[2012-12-27 17:21:55,034][INFO ][plugins ] [Boomslang] loaded , sites
[2012-12-27 17:21:58,484][INFO ][node ] [Boomslang] {0.20.1}[2187]: initialized
[2012-12-27 17:21:58,484][INFO ][node ] [Boomslang] {0.20.1}[2187]: starting ...
[2012-12-27 17:21:58,674][INFO ][transport ] [Boomslang] bound_address {inet[XXX.XX.XXX.XXX:9300]}, publish_address {inet[/XXX.XXX.XXX.XXX:9300]}
[2012-12-27 17:22:01,922][INFO ][cluster.service ] [Boomslang] new_master [Boomslang][DuJAy1WLSdij0PNFPLt_0g][inet[/XXX.XXX.XXX.XXX:9300]], reason: zen-disco-join (elected_as_master)
[2012-12-27 17:22:01,971][INFO ][discovery ] [Boomslang] elasticsearch/DuJAy1WLSdij0PNFPLt_0g
[2012-12-27 17:22:02,010][INFO ][http ] [Boomslang] bound_address {inet[/XXX.XXX.XXX.XXX:9200]}, publish_address {inet[/XXX.XXX.XXX.XXX:9200]}
[2012-12-27 17:22:02,010][INFO ][node ] [Boomslang] {0.20.1}[2187]: started
[2012-12-27 17:22:02,081][INFO ][gateway ] [Boomslang] recovered [0] indices into cluster_state

I have read th website u have send me but i did not see anything regarding such error .

Thanks
On Thu, Dec 27, 2012 at 12:36 PM, David Pilato da...@pilato.fr wrote:
Welcome.

1st, try to run ES in standalone (without Hadoop): download, unzip, launch bin/elasticsearch -f (from UNIX), bin/elasticsearch.bat from windows
2nd, in another shell, try curl localhost:9200
If you use windows, open this URL from a browser.

If it doesn't work, check that you have a Java (6 or 7) somewhere and that JAVA_HOME is defined.

If it still does not work, report here any error you can see in logs.

BTW, read this: Elasticsearch Platform — Find real-time answers at scale | Elastic

HTH

--
David :wink:
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs

Le 27 déc. 2012 à 06:15, junda...@gmail.com a écrit :
Hi all

I am new to elasictc search. got some problem here setting up elasictic search. i got a hadoop running up now . one master and one slave . but after i download Elasticsearch and try to run /bin/elasticsearch -f. it hangs there at some command line .. can i know what i need to change in the config folder ? as i don't really understand the steps on the Elasticsearch website. can anyone got any better website for me to try it and refer..

Thanks
Regards

--

--

--

--

--

--
David Pilato
http://www.scrutmydocs.org/
http://dev.david.pilato.fr/
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs

--
David Pilato
http://www.scrutmydocs.org/
http://dev.david.pilato.fr/
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs

--

--

--
David Pilato
http://www.scrutmydocs.org/
http://dev.david.pilato.fr/
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs

--

--

15

so u mean curl does not come with eleasticsearch-0.20.1 version?

On Fri, Dec 28, 2012 at 2:36 PM, David Pilato david@pilato.fr wrote:

So you don't have curl on your system.
Install it or add it in your Path...

--
David :wink:
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs

Le 28 déc. 2012 à 08:19, Tan Chween Tah jundatan85@gmail.com a écrit :

i create the file.sh file and place the code
#!/bin/sh

http://cloud.github.com/downloads/elasticsearch/elasticsearch/elasticsearch-0.19.10.zip

#unzip elasticsearch-0.19.10.zip

#elasticsearch-0.19.10/bin/plugin -install
elasticsearch/elasticsearch-mapper-attachments/1.6.0

../../usr/local/elasticsearch-0.20.1/bin/elasticsearch

sleep 10

host=localhost:9200

curl -X DELETE "${host}/test"

curl -X PUT "${host}/test" -d '{

"settings" : { "index" : { "number_of_shards" : 1, "number_of_replicas" :
0 }}

}'

curl -X GET
"${host}/_cluster/health?wait_for_status=green&pretty=1&timeout=5s"

curl -X PUT "${host}/test/attachment/_mapping" -d '{

"attachment" : {

"properties" : {

"file" : {

"type" : "attachment",

"fields" : {

"title" : { "store" : "yes" },

"file" : { "term_vector":"with_positions_offsets", "store":"yes" }

}

}

}

}

}'

curl -C - -O
Renesas Electronics Corporation

coded=cat fn6742.pdf | perl -MMIME::Base64 -ne 'print encode_base64($_)'

json="{"file":"${coded}"}"

echo "$json" > json.file

curl -X POST "${host}/test/attachment/" -d @json.file

echo

curl -XPOST "${host}/_refresh"

curl "${host}/_search?pretty=true" -d '{

"fields" : ["title"],

"query" : {

"query_string" : {

"query" : "amplifier"

}

},

"highlight" : {

"fields" : {

"file" : {}

}

}

}'
i run the file.sh from my terminal. it will said
./file.sh: 31: ./file.sh: curl: not found
./file.sh: 39: ./file.sh: curl: not found
./file.sh: 43: ./file.sh: curl: not found
./file.sh: 71: ./file.sh: curl: not found
cat: fn6742.pdf: No such file or directory
./file.sh: 81: ./file.sh: curl: not found

./file.sh: 87: ./file.sh: curl: not found
./file.sh: 91: ./file.sh: curl: not found

On Fri, Dec 28, 2012 at 12:11 PM, Tan Chween Tah jundatan85@gmail.comwrote:

hi thanks but the attachment don't seem to be working too .

On Thu, Dec 27, 2012 at 5:31 PM, David Pilato david@pilato.fr wrote:

**
Cool.
Try to play with attachments now: Follow this scripthttps://gist.github.com/3907010.

Le 27 décembre 2012 à 11:25, Tan Chween Tah jundatan85@gmail.com a
écrit :

ok it works now .. i can see the localhost:9200 which will return me

{
"ok" : true,
"status" : 200,
"name" : "Strong Guy",
"version" : {
"number" : "0.20.1",
"snapshot_build" : false
},
"tagline" : "You Know, for Search"
}

this mean that it is working fine and running. i will take a look again for the things i mention before.
Thanks for your helps David .
any advice on what is my next step after i get this ES running.

On Thu, Dec 27, 2012 at 4:59 PM, David Pilato david@pilato.fr wrote:

Please keep the thread in the mailing list scope. Not outside (don't
send direct mails).

OK. Here are the steps you have to follow:
1/ stop all running shells and open a new one
Just check if you have an elasticsearch running in the background ( ps
-ef | grep elasticsearch ) and kill the process if you find one.
2/ on a fresh clean elasticsearch dir (you should not find data, logs
dir), start bin/elasticsearch -f
3/ open a new shell and type curl http://localhost:9200

What happens?

Le 27 décembre 2012 à 10:48, jundatan85@gmail.com a écrit :

ok thanks. i will take a look later.

i am using ubuntu linux and using a root account

let solve the problem that my ES instance is not working. when i type
in locahost:9200 it said "unable to connect tp server at localhost:9200"

On Thursday, December 27, 2012 5:30:44 PM UTC+8, David Pilato wrote:

Ok. First, you have to make sure that your ES instance is working
fine.
You should be able to do a curl localhost:9200 and see a JSON. If not,
don't go to the next steps and fix your problem! (BTW, tell me if you run
under linux or windows).

What you want to achieve is to index files. It's not one of the basic
feature of ES but it's available as a plugin ( GitHub - elastic/elasticsearch-mapper-attachments: Mapper Attachments Type plugin for Elasticsearch).
You have a full script here to try it:
https://github.com/elasticsearch/elasticsearch-mapper-attachments Test of attachments plugin · GitHub

But, it's without Hadoop. That gives me an idea for my
https://gist.github.com/3907010 scrutmydocshttp://www.scrutmydocs.org/ project.
I should add in the FSRiver (File System River) (or create a new one) the
possibility of fetching content from hdfs...

Does it help?

Le 27 décembre 2012 à 09:38, Tan Chween Tah < junda...@gmail.com> a
écrit :

Thanks david

What i am trying to do is like having big data of text or json file and
put distribute it in different computer using hadoop and using elastic
search to query the words so it will return the result faster .

You said it is working fine. so is there a example on how to insert a
text file or json file into the Elasticsearch and i am able to query the
words out. for eg. Test.txt contain words inside. and i want to search the
words like "happy" inside that test.txt file .. is it possible for elasitc
search to do that ?

nope i did not try just now. but now I have try opening localhost:9200
in my browser but it throw me an error "problem loading page".

any advice ?

thanks

On Thu, Dec 27, 2012 at 2:54 PM, David Pilato da...@pilato.frwrote:

Looks like everything is working here.
What do you expect to see?

Did you open localhost:9200 in your browser?

--
David :wink:
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs

Le 27 déc. 2012 à 06:51, Tan Chween Tah < junda...@gmail.com> a écrit :
Thanks for the reply David, i have tried it out before and it still
not working. the terminal will be still hang

elasticsearch-0.20.1# bin/elasticsearch -f
[2012-12-27 17:21:55,023][INFO ][node ] [Boomslang]
{0.20.1}[2187]: initializing ...
[2012-12-27 17:21:55,034][INFO ][plugins ] [Boomslang]
loaded , sites
[2012-12-27 17:21:58,484][INFO ][node ] [Boomslang]
{0.20.1}[2187]: initialized
[2012-12-27 17:21:58,484][INFO ][node ] [Boomslang]
{0.20.1}[2187]: starting ...
[2012-12-27 17:21:58,674][INFO ][transport ] [Boomslang]
bound_address {inet[XXX.XX.XXX.XXX:9300]}, publish_address
{inet[/XXX.XXX.XXX.XXX:9300]}
[2012-12-27 17:22:01,922][INFO ][cluster.service ] [Boomslang]
new_master
[Boomslang][DuJAy1WLSdij0PNFPLt_0g][inet[/XXX.XXX.XXX.XXX:9300]], reason:
zen-disco-join (elected_as_master)
[2012-12-27 17:22:01,971][INFO ][discovery ] [Boomslang]
elasticsearch/DuJAy1WLSdij0PNFPLt_0g
[2012-12-27 17:22:02,010][INFO ][http ] [Boomslang]
bound_address {inet[/XXX.XXX.XXX.XXX:9200]}, publish_address
{inet[/XXX.XXX.XXX.XXX:9200]}
[2012-12-27 17:22:02,010][INFO ][node ] [Boomslang]
{0.20.1}[2187]: started
[2012-12-27 17:22:02,081][INFO ][gateway ] [Boomslang]
recovered [0] indices into cluster_state

I have read th website u have send me but i did not see anything
regarding such error .

Thanks
On Thu, Dec 27, 2012 at 12:36 PM, David Pilato da...@pilato.frwrote:

Welcome.

1st, try to run ES in standalone (without Hadoop): download, unzip,
launch bin/elasticsearch -f (from UNIX), bin/elasticsearch.bat from windows
2nd, in another shell, try curl localhost:9200
If you use windows, open this URL from a browser.

If it doesn't work, check that you have a Java (6 or 7) somewhere and
that JAVA_HOME is defined.

If it still does not work, report here any error you can see in logs.

BTW, read this: Elasticsearch Platform — Find real-time answers at scale | Elastic

HTH

--
David :wink:
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs

Le 27 déc. 2012 à 06:15,
http://www.elasticsearch.org/guide/reference/setup/installation.html
junda...@gmail.com a écrit :
Hi all

I am new to elasictc search. got some problem here setting up
elasictic search. i got a hadoop running up now . one master and one slave
. but after i download Elasticsearch and try to run /bin/elasticsearch -f.
it hangs there at some command line .. can i know what i need to change in
the config folder ? as i don't really understand the steps on the elastic
search website. can anyone got any better website for me to try it and
refer..

Thanks
Regards

--

--

--

--

--

--
David Pilato
http://www.scrutmydocs.org/
http://dev.david.pilato.fr/
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs

--
David Pilato
http://www.scrutmydocs.org/
http://dev.david.pilato.fr/
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs

--

--

--
David Pilato
http://www.scrutmydocs.org/
http://dev.david.pilato.fr/
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs

--

--

--

--

16

i search online for curl it is for php-curl do i need to install that ?

On Fri, Dec 28, 2012 at 2:41 PM, Tan Chween Tah jundatan85@gmail.comwrote:

so u mean curl does not come with eleasticsearch-0.20.1 version?

On Fri, Dec 28, 2012 at 2:36 PM, David Pilato david@pilato.fr wrote:

So you don't have curl on your system.
Install it or add it in your Path...

--
David :wink:
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs

Le 28 déc. 2012 à 08:19, Tan Chween Tah jundatan85@gmail.com a écrit :

i create the file.sh file and place the code
#!/bin/sh

http://cloud.github.com/downloads/elasticsearch/elasticsearch/elasticsearch-0.19.10.zip

#unzip elasticsearch-0.19.10.zip

#elasticsearch-0.19.10/bin/plugin -install
elasticsearch/elasticsearch-mapper-attachments/1.6.0

../../usr/local/elasticsearch-0.20.1/bin/elasticsearch

sleep 10

host=localhost:9200

curl -X DELETE "${host}/test"

curl -X PUT "${host}/test" -d '{

"settings" : { "index" : { "number_of_shards" : 1, "number_of_replicas" :
0 }}

}'

curl -X GET
"${host}/_cluster/health?wait_for_status=green&pretty=1&timeout=5s"

curl -X PUT "${host}/test/attachment/_mapping" -d '{

"attachment" : {

"properties" : {

"file" : {

"type" : "attachment",

"fields" : {

"title" : { "store" : "yes" },

"file" : { "term_vector":"with_positions_offsets", "store":"yes" }

}

}

}

}

}'

curl -C - -O
Renesas Electronics Corporation

coded=cat fn6742.pdf | perl -MMIME::Base64 -ne 'print encode_base64($_)'

json="{"file":"${coded}"}"

echo "$json" > json.file

curl -X POST "${host}/test/attachment/" -d @json.file

echo

curl -XPOST "${host}/_refresh"

curl "${host}/_search?pretty=true" -d '{

"fields" : ["title"],

"query" : {

"query_string" : {

"query" : "amplifier"

}

},

"highlight" : {

"fields" : {

"file" : {}

}

}

}'
i run the file.sh from my terminal. it will said
./file.sh: 31: ./file.sh: curl: not found
./file.sh: 39: ./file.sh: curl: not found
./file.sh: 43: ./file.sh: curl: not found
./file.sh: 71: ./file.sh: curl: not found
cat: fn6742.pdf: No such file or directory
./file.sh: 81: ./file.sh: curl: not found

./file.sh: 87: ./file.sh: curl: not found
./file.sh: 91: ./file.sh: curl: not found

On Fri, Dec 28, 2012 at 12:11 PM, Tan Chween Tah jundatan85@gmail.comwrote:

hi thanks but the attachment don't seem to be working too .

On Thu, Dec 27, 2012 at 5:31 PM, David Pilato david@pilato.fr wrote:

**
Cool.
Try to play with attachments now: Follow this scripthttps://gist.github.com/3907010.

Le 27 décembre 2012 à 11:25, Tan Chween Tah jundatan85@gmail.com a
écrit :

ok it works now .. i can see the localhost:9200 which will return me

{
"ok" : true,
"status" : 200,
"name" : "Strong Guy",
"version" : {
"number" : "0.20.1",
"snapshot_build" : false
},
"tagline" : "You Know, for Search"
}

this mean that it is working fine and running. i will take a look again for the things i mention before.
Thanks for your helps David .
any advice on what is my next step after i get this ES running.

On Thu, Dec 27, 2012 at 4:59 PM, David Pilato david@pilato.frwrote:

Please keep the thread in the mailing list scope. Not outside (don't
send direct mails).

OK. Here are the steps you have to follow:
1/ stop all running shells and open a new one
Just check if you have an elasticsearch running in the background ( ps
-ef | grep elasticsearch ) and kill the process if you find one.
2/ on a fresh clean elasticsearch dir (you should not find data, logs
dir), start bin/elasticsearch -f
3/ open a new shell and type curl http://localhost:9200

What happens?

Le 27 décembre 2012 à 10:48, jundatan85@gmail.com a écrit :

ok thanks. i will take a look later.

i am using ubuntu linux and using a root account

let solve the problem that my ES instance is not working. when i type
in locahost:9200 it said "unable to connect tp server at localhost:9200"

On Thursday, December 27, 2012 5:30:44 PM UTC+8, David Pilato wrote:

Ok. First, you have to make sure that your ES instance is working
fine.
You should be able to do a curl localhost:9200 and see a JSON. If not,
don't go to the next steps and fix your problem! (BTW, tell me if you run
under linux or windows).

What you want to achieve is to index files. It's not one of the basic
feature of ES but it's available as a plugin ( GitHub - elastic/elasticsearch-mapper-attachments: Mapper Attachments Type plugin for Elasticsearch).
You have a full script here to try it:
https://github.com/elasticsearch/elasticsearch-mapper-attachments Test of attachments plugin · GitHub

But, it's without Hadoop. That gives me an idea for my
https://gist.github.com/3907010 scrutmydocshttp://www.scrutmydocs.org/ project.
I should add in the FSRiver (File System River) (or create a new one) the
possibility of fetching content from hdfs...

Does it help?

Le 27 décembre 2012 à 09:38, Tan Chween Tah < junda...@gmail.com> a
écrit :

Thanks david

What i am trying to do is like having big data of text or json file and
put distribute it in different computer using hadoop and using elastic
search to query the words so it will return the result faster .

You said it is working fine. so is there a example on how to insert a
text file or json file into the Elasticsearch and i am able to query the
words out. for eg. Test.txt contain words inside. and i want to search the
words like "happy" inside that test.txt file .. is it possible for elasitc
search to do that ?

nope i did not try just now. but now I have try opening localhost:9200
in my browser but it throw me an error "problem loading page".

any advice ?

thanks

On Thu, Dec 27, 2012 at 2:54 PM, David Pilato da...@pilato.frwrote:

Looks like everything is working here.
What do you expect to see?

Did you open localhost:9200 in your browser?

--
David :wink:
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs

Le 27 déc. 2012 à 06:51, Tan Chween Tah < junda...@gmail.com> a
écrit :
Thanks for the reply David, i have tried it out before and it still
not working. the terminal will be still hang

elasticsearch-0.20.1# bin/elasticsearch -f
[2012-12-27 17:21:55,023][INFO ][node ] [Boomslang]
{0.20.1}[2187]: initializing ...
[2012-12-27 17:21:55,034][INFO ][plugins ] [Boomslang]
loaded , sites
[2012-12-27 17:21:58,484][INFO ][node ] [Boomslang]
{0.20.1}[2187]: initialized
[2012-12-27 17:21:58,484][INFO ][node ] [Boomslang]
{0.20.1}[2187]: starting ...
[2012-12-27 17:21:58,674][INFO ][transport ] [Boomslang]
bound_address {inet[XXX.XX.XXX.XXX:9300]}, publish_address
{inet[/XXX.XXX.XXX.XXX:9300]}
[2012-12-27 17:22:01,922][INFO ][cluster.service ] [Boomslang]
new_master
[Boomslang][DuJAy1WLSdij0PNFPLt_0g][inet[/XXX.XXX.XXX.XXX:9300]], reason:
zen-disco-join (elected_as_master)
[2012-12-27 17:22:01,971][INFO ][discovery ] [Boomslang]
elasticsearch/DuJAy1WLSdij0PNFPLt_0g
[2012-12-27 17:22:02,010][INFO ][http ] [Boomslang]
bound_address {inet[/XXX.XXX.XXX.XXX:9200]}, publish_address
{inet[/XXX.XXX.XXX.XXX:9200]}
[2012-12-27 17:22:02,010][INFO ][node ] [Boomslang]
{0.20.1}[2187]: started
[2012-12-27 17:22:02,081][INFO ][gateway ] [Boomslang]
recovered [0] indices into cluster_state

I have read th website u have send me but i did not see anything
regarding such error .

Thanks
On Thu, Dec 27, 2012 at 12:36 PM, David Pilato da...@pilato.frwrote:

Welcome.

1st, try to run ES in standalone (without Hadoop): download, unzip,
launch bin/elasticsearch -f (from UNIX), bin/elasticsearch.bat from windows
2nd, in another shell, try curl localhost:9200
If you use windows, open this URL from a browser.

If it doesn't work, check that you have a Java (6 or 7) somewhere and
that JAVA_HOME is defined.

If it still does not work, report here any error you can see in logs.

BTW, read this: Elasticsearch Platform — Find real-time answers at scale | Elastic

HTH

--
David :wink:
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs

Le 27 déc. 2012 à 06:15,
http://www.elasticsearch.org/guide/reference/setup/installation.html
junda...@gmail.com a écrit :
Hi all

I am new to elasictc search. got some problem here setting up
elasictic search. i got a hadoop running up now . one master and one slave
. but after i download Elasticsearch and try to run /bin/elasticsearch -f.
it hangs there at some command line .. can i know what i need to change in
the config folder ? as i don't really understand the steps on the elastic
search website. can anyone got any better website for me to try it and
refer..

Thanks
Regards

--

--

--

--

--

--
David Pilato
http://www.scrutmydocs.org/
http://dev.david.pilato.fr/
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs

--
David Pilato
http://www.scrutmydocs.org/
http://dev.david.pilato.fr/
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs

--

--

--
David Pilato
http://www.scrutmydocs.org/
http://dev.david.pilato.fr/
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs

--

--

--

--

17

curl is a command-line utility. You should use your operating system's
package manager (yum/apt-get) to install it. Do not install php-curl.

Please use gist (https://gist.github.com/) when posting large amounts of
code. Easier for everyone to read.

--
Ivan

On Thu, Dec 27, 2012 at 11:54 PM, Tan Chween Tah jundatan85@gmail.comwrote:

i search online for curl it is for php-curl do i need to install that ?

On Fri, Dec 28, 2012 at 2:41 PM, Tan Chween Tah jundatan85@gmail.comwrote:

so u mean curl does not come with eleasticsearch-0.20.1 version?

On Fri, Dec 28, 2012 at 2:36 PM, David Pilato david@pilato.fr wrote:

So you don't have curl on your system.
Install it or add it in your Path...

--
David :wink:
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs

Le 28 déc. 2012 à 08:19, Tan Chween Tah jundatan85@gmail.com a écrit :

i create the file.sh file and place the code
#!/bin/sh

http://cloud.github.com/downloads/elasticsearch/elasticsearch/elasticsearch-0.19.10.zip

#unzip elasticsearch-0.19.10.zip

#elasticsearch-0.19.10/bin/plugin -install
elasticsearch/elasticsearch-mapper-attachments/1.6.0

../../usr/local/elasticsearch-0.20.1/bin/elasticsearch

sleep 10

host=localhost:9200

curl -X DELETE "${host}/test"

curl -X PUT "${host}/test" -d '{

"settings" : { "index" : { "number_of_shards" : 1, "number_of_replicas"
: 0 }}

}'

curl -X GET
"${host}/_cluster/health?wait_for_status=green&pretty=1&timeout=5s"

curl -X PUT "${host}/test/attachment/_mapping" -d '{

"attachment" : {

"properties" : {

"file" : {

"type" : "attachment",

"fields" : {

"title" : { "store" : "yes" },

"file" : { "term_vector":"with_positions_offsets", "store":"yes" }

}

}

}

}

}'

curl -C - -O
Renesas Electronics Corporation

coded=cat fn6742.pdf | perl -MMIME::Base64 -ne 'print encode_base64($_)'

json="{"file":"${coded}"}"

echo "$json" > json.file

curl -X POST "${host}/test/attachment/" -d @json.file

echo

curl -XPOST "${host}/_refresh"

curl "${host}/_search?pretty=true" -d '{

"fields" : ["title"],

"query" : {

"query_string" : {

"query" : "amplifier"

}

},

"highlight" : {

"fields" : {

"file" : {}

}

}

}'
i run the file.sh from my terminal. it will said
./file.sh: 31: ./file.sh: curl: not found
./file.sh: 39: ./file.sh: curl: not found
./file.sh: 43: ./file.sh: curl: not found
./file.sh: 71: ./file.sh: curl: not found
cat: fn6742.pdf: No such file or directory
./file.sh: 81: ./file.sh: curl: not found

./file.sh: 87: ./file.sh: curl: not found
./file.sh: 91: ./file.sh: curl: not found

On Fri, Dec 28, 2012 at 12:11 PM, Tan Chween Tah jundatan85@gmail.comwrote:

hi thanks but the attachment don't seem to be working too .

On Thu, Dec 27, 2012 at 5:31 PM, David Pilato david@pilato.fr wrote:

**
Cool.
Try to play with attachments now: Follow this scripthttps://gist.github.com/3907010.

Le 27 décembre 2012 à 11:25, Tan Chween Tah jundatan85@gmail.com a
écrit :

ok it works now .. i can see the localhost:9200 which will return me

{
"ok" : true,
"status" : 200,
"name" : "Strong Guy",
"version" : {
"number" : "0.20.1",
"snapshot_build" : false
},
"tagline" : "You Know, for Search"
}

this mean that it is working fine and running. i will take a look again for the things i mention before.
Thanks for your helps David .
any advice on what is my next step after i get this ES running.

On Thu, Dec 27, 2012 at 4:59 PM, David Pilato david@pilato.frwrote:

Please keep the thread in the mailing list scope. Not outside
(don't send direct mails).

OK. Here are the steps you have to follow:
1/ stop all running shells and open a new one
Just check if you have an elasticsearch running in the background (
ps -ef | grep elasticsearch ) and kill the process if you find one.
2/ on a fresh clean elasticsearch dir (you should not find data, logs
dir), start bin/elasticsearch -f
3/ open a new shell and type curl http://localhost:9200

What happens?

Le 27 décembre 2012 à 10:48, jundatan85@gmail.com a écrit :

ok thanks. i will take a look later.

i am using ubuntu linux and using a root account

let solve the problem that my ES instance is not working. when i
type in locahost:9200 it said "unable to connect tp server at
localhost:9200"

On Thursday, December 27, 2012 5:30:44 PM UTC+8, David Pilato wrote:

Ok. First, you have to make sure that your ES instance is working
fine.
You should be able to do a curl localhost:9200 and see a JSON. If
not, don't go to the next steps and fix your problem! (BTW, tell me if you
run under linux or windows).

What you want to achieve is to index files. It's not one of the basic
feature of ES but it's available as a plugin ( GitHub - elastic/elasticsearch-mapper-attachments: Mapper Attachments Type plugin for Elasticsearch).
You have a full script here to try it:
https://github.com/elasticsearch/elasticsearch-mapper-attachments Test of attachments plugin · GitHub

But, it's without Hadoop. That gives me an idea for my
https://gist.github.com/3907010 scrutmydocshttp://www.scrutmydocs.org/ project.
I should add in the FSRiver (File System River) (or create a new one) the
possibility of fetching content from hdfs...

Does it help?

Le 27 décembre 2012 à 09:38, Tan Chween Tah < junda...@gmail.com> a
écrit :

Thanks david

What i am trying to do is like having big data of text or json file
and put distribute it in different computer using hadoop and using elastic
search to query the words so it will return the result faster .

You said it is working fine. so is there a example on how to insert a
text file or json file into the Elasticsearch and i am able to query the
words out. for eg. Test.txt contain words inside. and i want to search the
words like "happy" inside that test.txt file .. is it possible for elasitc
search to do that ?

nope i did not try just now. but now I have try opening localhost:9200
in my browser but it throw me an error "problem loading page".

any advice ?

thanks

On Thu, Dec 27, 2012 at 2:54 PM, David Pilato da...@pilato.frwrote:

Looks like everything is working here.
What do you expect to see?

Did you open localhost:9200 in your browser?

--
David :wink:
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs

Le 27 déc. 2012 à 06:51, Tan Chween Tah < junda...@gmail.com> a
écrit :
Thanks for the reply David, i have tried it out before and it still
not working. the terminal will be still hang

elasticsearch-0.20.1# bin/elasticsearch -f
[2012-12-27 17:21:55,023][INFO ][node ]
[Boomslang] {0.20.1}[2187]: initializing ...
[2012-12-27 17:21:55,034][INFO ][plugins ]
[Boomslang] loaded , sites
[2012-12-27 17:21:58,484][INFO ][node ]
[Boomslang] {0.20.1}[2187]: initialized
[2012-12-27 17:21:58,484][INFO ][node ]
[Boomslang] {0.20.1}[2187]: starting ...
[2012-12-27 17:21:58,674][INFO ][transport ]
[Boomslang] bound_address {inet[XXX.XX.XXX.XXX:9300]}, publish_address
{inet[/XXX.XXX.XXX.XXX:9300]}
[2012-12-27 17:22:01,922][INFO ][cluster.service ]
[Boomslang] new_master
[Boomslang][DuJAy1WLSdij0PNFPLt_0g][inet[/XXX.XXX.XXX.XXX:9300]], reason:
zen-disco-join (elected_as_master)
[2012-12-27 17:22:01,971][INFO ][discovery ]
[Boomslang] elasticsearch/DuJAy1WLSdij0PNFPLt_0g
[2012-12-27 17:22:02,010][INFO ][http ]
[Boomslang] bound_address {inet[/XXX.XXX.XXX.XXX:9200]}, publish_address
{inet[/XXX.XXX.XXX.XXX:9200]}
[2012-12-27 17:22:02,010][INFO ][node ]
[Boomslang] {0.20.1}[2187]: started
[2012-12-27 17:22:02,081][INFO ][gateway ]
[Boomslang] recovered [0] indices into cluster_state

I have read th website u have send me but i did not see anything
regarding such error .

Thanks
On Thu, Dec 27, 2012 at 12:36 PM, David Pilato da...@pilato.frwrote:

Welcome.

1st, try to run ES in standalone (without Hadoop): download, unzip,
launch bin/elasticsearch -f (from UNIX), bin/elasticsearch.bat from windows
2nd, in another shell, try curl localhost:9200
If you use windows, open this URL from a browser.

If it doesn't work, check that you have a Java (6 or 7) somewhere and
that JAVA_HOME is defined.

If it still does not work, report here any error you can see in logs.

BTW, read this: Elasticsearch Platform — Find real-time answers at scale | Elastic

HTH

--
David :wink:
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs

Le 27 déc. 2012 à 06:15,
http://www.elasticsearch.org/guide/reference/setup/installation.html
junda...@gmail.com a écrit :
Hi all

I am new to elasictc search. got some problem here setting up
elasictic search. i got a hadoop running up now . one master and one slave
. but after i download Elasticsearch and try to run /bin/elasticsearch -f.
it hangs there at some command line .. can i know what i need to change in
the config folder ? as i don't really understand the steps on the elastic
search website. can anyone got any better website for me to try it and
refer..

Thanks
Regards

--

--

--

--

--

--
David Pilato
http://www.scrutmydocs.org/
http://dev.david.pilato.fr/
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs

--
David Pilato
http://www.scrutmydocs.org/
http://dev.david.pilato.fr/
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs

--

--

--
David Pilato
http://www.scrutmydocs.org/
http://dev.david.pilato.fr/
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs

--

--

--

--

--

18

Thanks after installing the curl on my linux system and i ran the file.sh
file

i was return with some mapping error

{"ok":true,"acknowledged":true}{"ok":true,"acknowledged":true}{
"cluster_name" : "elasticsearch",
"status" : "green",
"timed_out" : false,
"number_of_nodes" : 6,
"number_of_data_nodes" : 6,
"active_primary_shards" : 1,
"active_shards" : 1,
"relocating_shards" : 0,
"initializing_shards" : 0,
"unassigned_shards" : 0
}{"error":"MapperParsingException[No handler for type [attachment] declared
on field [file]]","status":400}** Resuming transfer from byte position
416315
% Total % Received % Xferd Average Speed Time Time Time
Current
Dload Upload Total Spent Left
Speed
0 406k 0 0 0 0 0 0 --:--:-- --:--:--
--:--:-- 0
curl: (33) HTTP server doesn't seem to support byte ranges. Cannot resume.
{"ok":true,"_index":"test","_type":"attachment","_id":"5vC4T4jOTvKqDzZqqBpG9w","_version":1}
{"ok":true,"_shards":{"total":1,"successful":1,"failed":0}}{
"took" : 78,
"timed_out" : false,
"_shards" : {
"total" : 1,
"successful" : 1,
"failed" : 0
},
"hits" : {
"total" : 0,
"max_score" : null,
"hits" :
}

any idea ?

On Fri, Dec 28, 2012 at 2:58 PM, Ivan Brusic ivan@brusic.com wrote:

curl is a command-line utility. You should use your operating system's
package manager (yum/apt-get) to install it. Do not install php-curl.

Please use gist (https://gist.github.com/) when posting large amounts of
code. Easier for everyone to read.

--
Ivan

On Thu, Dec 27, 2012 at 11:54 PM, Tan Chween Tah jundatan85@gmail.comwrote:

i search online for curl it is for php-curl do i need to install that ?

On Fri, Dec 28, 2012 at 2:41 PM, Tan Chween Tah jundatan85@gmail.comwrote:

so u mean curl does not come with eleasticsearch-0.20.1 version?

On Fri, Dec 28, 2012 at 2:36 PM, David Pilato david@pilato.fr wrote:

So you don't have curl on your system.
Install it or add it in your Path...

--
David :wink:
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs

Le 28 déc. 2012 à 08:19, Tan Chween Tah jundatan85@gmail.com a
écrit :

i create the file.sh file and place the code
#!/bin/sh

http://cloud.github.com/downloads/elasticsearch/elasticsearch/elasticsearch-0.19.10.zip

#unzip elasticsearch-0.19.10.zip

#elasticsearch-0.19.10/bin/plugin -install
elasticsearch/elasticsearch-mapper-attachments/1.6.0

../../usr/local/elasticsearch-0.20.1/bin/elasticsearch

sleep 10

host=localhost:9200

curl -X DELETE "${host}/test"

curl -X PUT "${host}/test" -d '{

"settings" : { "index" : { "number_of_shards" : 1, "number_of_replicas"
: 0 }}

}'

curl -X GET
"${host}/_cluster/health?wait_for_status=green&pretty=1&timeout=5s"

curl -X PUT "${host}/test/attachment/_mapping" -d '{

"attachment" : {

"properties" : {

"file" : {

"type" : "attachment",

"fields" : {

"title" : { "store" : "yes" },

"file" : { "term_vector":"with_positions_offsets", "store":"yes" }

}

}

}

}

}'

curl -C - -O
Renesas Electronics Corporation

coded=cat fn6742.pdf | perl -MMIME::Base64 -ne 'print encode_base64($_)'

json="{"file":"${coded}"}"

echo "$json" > json.file

curl -X POST "${host}/test/attachment/" -d @json.file

echo

curl -XPOST "${host}/_refresh"

curl "${host}/_search?pretty=true" -d '{

"fields" : ["title"],

"query" : {

"query_string" : {

"query" : "amplifier"

}

},

"highlight" : {

"fields" : {

"file" : {}

}

}

}'
i run the file.sh from my terminal. it will said
./file.sh: 31: ./file.sh: curl: not found
./file.sh: 39: ./file.sh: curl: not found
./file.sh: 43: ./file.sh: curl: not found
./file.sh: 71: ./file.sh: curl: not found
cat: fn6742.pdf: No such file or directory
./file.sh: 81: ./file.sh: curl: not found

./file.sh: 87: ./file.sh: curl: not found
./file.sh: 91: ./file.sh: curl: not found

On Fri, Dec 28, 2012 at 12:11 PM, Tan Chween Tah jundatan85@gmail.comwrote:

hi thanks but the attachment don't seem to be working too .

On Thu, Dec 27, 2012 at 5:31 PM, David Pilato david@pilato.fr wrote:

**
Cool.
Try to play with attachments now: Follow this scripthttps://gist.github.com/3907010.

Le 27 décembre 2012 à 11:25, Tan Chween Tah jundatan85@gmail.com a
écrit :

ok it works now .. i can see the localhost:9200 which will return me

{
"ok" : true,
"status" : 200,
"name" : "Strong Guy",
"version" : {
"number" : "0.20.1",
"snapshot_build" : false
},
"tagline" : "You Know, for Search"
}

this mean that it is working fine and running. i will take a look again for the things i mention before.
Thanks for your helps David .
any advice on what is my next step after i get this ES running.

On Thu, Dec 27, 2012 at 4:59 PM, David Pilato david@pilato.frwrote:

Please keep the thread in the mailing list scope. Not outside
(don't send direct mails).

OK. Here are the steps you have to follow:
1/ stop all running shells and open a new one
Just check if you have an elasticsearch running in the background (
ps -ef | grep elasticsearch ) and kill the process if you find one.
2/ on a fresh clean elasticsearch dir (you should not find data,
logs dir), start bin/elasticsearch -f
3/ open a new shell and type curl http://localhost:9200

What happens?

Le 27 décembre 2012 à 10:48, jundatan85@gmail.com a écrit :

ok thanks. i will take a look later.

i am using ubuntu linux and using a root account

let solve the problem that my ES instance is not working. when i
type in locahost:9200 it said "unable to connect tp server at
localhost:9200"

On Thursday, December 27, 2012 5:30:44 PM UTC+8, David Pilato wrote:

Ok. First, you have to make sure that your ES instance is working
fine.
You should be able to do a curl localhost:9200 and see a JSON. If
not, don't go to the next steps and fix your problem! (BTW, tell me if you
run under linux or windows).

What you want to achieve is to index files. It's not one of the
basic feature of ES but it's available as a plugin ( GitHub - elastic/elasticsearch-mapper-attachments: Mapper Attachments Type plugin for Elasticsearch).
You have a full script here to try it:
https://github.com/elasticsearch/elasticsearch-mapper-attachments Test of attachments plugin · GitHub

But, it's without Hadoop. That gives me an idea for my
https://gist.github.com/3907010 scrutmydocshttp://www.scrutmydocs.org/ project.
I should add in the FSRiver (File System River) (or create a new one) the
possibility of fetching content from hdfs...

Does it help?

Le 27 décembre 2012 à 09:38, Tan Chween Tah < junda...@gmail.com> a
écrit :

Thanks david

What i am trying to do is like having big data of text or json file
and put distribute it in different computer using hadoop and using elastic
search to query the words so it will return the result faster .

You said it is working fine. so is there a example on how to insert a
text file or json file into the Elasticsearch and i am able to query the
words out. for eg. Test.txt contain words inside. and i want to search the
words like "happy" inside that test.txt file .. is it possible for elasitc
search to do that ?

nope i did not try just now. but now I have try opening
localhost:9200 in my browser but it throw me an error "problem loading
page".

any advice ?

thanks

On Thu, Dec 27, 2012 at 2:54 PM, David Pilato da...@pilato.frwrote:

Looks like everything is working here.
What do you expect to see?

Did you open localhost:9200 in your browser?

--
David :wink:
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs

Le 27 déc. 2012 à 06:51, Tan Chween Tah < junda...@gmail.com> a
écrit :
Thanks for the reply David, i have tried it out before and it
still not working. the terminal will be still hang

elasticsearch-0.20.1# bin/elasticsearch -f
[2012-12-27 17:21:55,023][INFO ][node ]
[Boomslang] {0.20.1}[2187]: initializing ...
[2012-12-27 17:21:55,034][INFO ][plugins ]
[Boomslang] loaded , sites
[2012-12-27 17:21:58,484][INFO ][node ]
[Boomslang] {0.20.1}[2187]: initialized
[2012-12-27 17:21:58,484][INFO ][node ]
[Boomslang] {0.20.1}[2187]: starting ...
[2012-12-27 17:21:58,674][INFO ][transport ]
[Boomslang] bound_address {inet[XXX.XX.XXX.XXX:9300]}, publish_address
{inet[/XXX.XXX.XXX.XXX:9300]}
[2012-12-27 17:22:01,922][INFO ][cluster.service ]
[Boomslang] new_master
[Boomslang][DuJAy1WLSdij0PNFPLt_0g][inet[/XXX.XXX.XXX.XXX:9300]], reason:
zen-disco-join (elected_as_master)
[2012-12-27 17:22:01,971][INFO ][discovery ]
[Boomslang] elasticsearch/DuJAy1WLSdij0PNFPLt_0g
[2012-12-27 17:22:02,010][INFO ][http ]
[Boomslang] bound_address {inet[/XXX.XXX.XXX.XXX:9200]}, publish_address
{inet[/XXX.XXX.XXX.XXX:9200]}
[2012-12-27 17:22:02,010][INFO ][node ]
[Boomslang] {0.20.1}[2187]: started
[2012-12-27 17:22:02,081][INFO ][gateway ]
[Boomslang] recovered [0] indices into cluster_state

I have read th website u have send me but i did not see anything
regarding such error .

Thanks
On Thu, Dec 27, 2012 at 12:36 PM, David Pilato da...@pilato.frwrote:

Welcome.

1st, try to run ES in standalone (without Hadoop): download, unzip,
launch bin/elasticsearch -f (from UNIX), bin/elasticsearch.bat from windows
2nd, in another shell, try curl localhost:9200
If you use windows, open this URL from a browser.

If it doesn't work, check that you have a Java (6 or 7) somewhere
and that JAVA_HOME is defined.

If it still does not work, report here any error you can see in
logs.

BTW, read this: Elasticsearch Platform — Find real-time answers at scale | Elastic

HTH

--
David :wink:
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs

Le 27 déc. 2012 à 06:15,
http://www.elasticsearch.org/guide/reference/setup/installation.html
junda...@gmail.com a écrit :
Hi all

I am new to elasictc search. got some problem here setting up
elasictic search. i got a hadoop running up now . one master and one slave
. but after i download Elasticsearch and try to run /bin/elasticsearch -f.
it hangs there at some command line .. can i know what i need to change in
the config folder ? as i don't really understand the steps on the elastic
search website. can anyone got any better website for me to try it and
refer..

Thanks
Regards

--

--

--

--

--

--
David Pilato
http://www.scrutmydocs.org/
http://dev.david.pilato.fr/
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs

--
David Pilato
http://www.scrutmydocs.org/
http://dev.david.pilato.fr/
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs

--

--

--
David Pilato
http://www.scrutmydocs.org/
http://dev.david.pilato.fr/
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs

--

--

--

--

--

--

19

The attachment plugin is not correctly setup.
You probably didn't execute: bin/plugin -install
elasticsearch/elasticsearch-mapper-attachments/1.6.0 and restart your ES
instance.

Have a look at plugin doc
https://github.com/elasticsearch/elasticsearch-mapper-attachments .

Also, look at this tutorial
http://www.elasticsearch.org/tutorials/2011/07/18/attachment-type-in-action.html
.

David.

Le 28 décembre 2012 à 10:01, Tan Chween Tah jundatan85@gmail.com a écrit :

Thanks after installing the curl on my linux system and i ran the file.sh file

i was return with some mapping error

{"ok":true,"acknowledged":true}{"ok":true,"acknowledged":true}{
"cluster_name" : "elasticsearch",
"status" : "green",
"timed_out" : false,
"number_of_nodes" : 6,
"number_of_data_nodes" : 6,
"active_primary_shards" : 1,
"active_shards" : 1,
"relocating_shards" : 0,
"initializing_shards" : 0,
"unassigned_shards" : 0
}{" error":"MapperParsingException[No handler for type [attachment] declared
on field [file]]","status":400}** Resuming transfer from byte position 416315
% Total % Received % Xferd Average Speed Time Time Time
Current
Dload Upload Total Spent Left Speed
0 406k 0 0 0 0 0 0 --:--:-- --:--:-- --:--:--
0
curl: (33) HTTP server doesn't seem to support byte ranges. Cannot resume.

{"ok":true,"_index":"test","_type":"attachment","_id":"5vC4T4jOTvKqDzZqqBpG9w","_version":1}
{"ok":true,"_shards":{"total":1,"successful":1,"failed":0}}{
"took" : 78,
"timed_out" : false,
"_shards" : {
"total" : 1,
"successful" : 1,
"failed" : 0
},
"hits" : {
"total" : 0,
"max_score" : null,
"hits" :
}

any idea ?

--
David Pilato
http://www.scrutmydocs.org/
http://dev.david.pilato.fr/
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs

--

20

Hi

Happy New Year

I have install the mapper and the restart the Elasticsearch but there is
still this error

curl: (33) HTTP server doesn't seem to support byte ranges. Cannot resume.

but the rest seems to be ok.

On Fri, Dec 28, 2012 at 4:32 PM, David Pilato david@pilato.fr wrote:

**
The attachment plugin is not correctly setup.
You probably didn't execute: bin/plugin -install
elasticsearch/elasticsearch-mapper-attachments/1.6.0 and restart your ES
instance.

Have a look at plugin dochttps://github.com/elasticsearch/elasticsearch-mapper-attachments.

Also, look at this tutorialhttp://www.elasticsearch.org/tutorials/2011/07/18/attachment-type-in-action.html.

David.

Le 28 décembre 2012 à 10:01, Tan Chween Tah jundatan85@gmail.com a
écrit :

Thanks after installing the curl on my linux system and i ran the file.sh
file

i was return with some mapping error

{"ok":true,"acknowledged":true}{"ok":true,"acknowledged":true}{
"cluster_name" : "elasticsearch",
"status" : "green",
"timed_out" : false,
"number_of_nodes" : 6,
"number_of_data_nodes" : 6,
"active_primary_shards" : 1,
"active_shards" : 1,
"relocating_shards" : 0,
"initializing_shards" : 0,
"unassigned_shards" : 0
}{" error":"MapperParsingException[No handler for type [attachment]
declared on field [file]]","status":400}** Resuming transfer from byte
position 416315
% Total % Received % Xferd Average Speed Time Time Time
Current
Dload Upload Total Spent Left
Speed
0 406k 0 0 0 0 0 0 --:--:-- --:--:--
--:--:-- 0
curl: (33) HTTP server doesn't seem to support byte ranges. Cannot resume.
{"ok":true,"_index":"test","_type":"attachment","_id":"5vC4T4jOTvKqDzZqqBpG9w","_version":1}

{"ok":true,"_shards":{"total":1,"successful":1,"failed":0}}{
"took" : 78,
"timed_out" : false,
"_shards" : {
"total" : 1,
"successful" : 1,
"failed" : 0
},
"hits" : {
"total" : 0,
"max_score" : null,
"hits" :
}

any idea ?

--
David Pilato
http://www.scrutmydocs.org/
http://dev.david.pilato.fr/
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs

--

--