# Elastic search and hadoop **URL:** \ **Category:** Elasticsearch\ **Created:** [December 27, 2012, 5:15am UTC](https://discuss.elastic.co/t/elastic-search-and-hadoop/10178 "2012-12-27T05:15:42Z")\ **Posts on this page:** 20\ **Page:** 1
**Author:** ![Tan\_Chween\_Tah](https://avatars.discourse-cdn.com/v4/letter/t/ba9def/32.png) [@Tan\_Chween\_Tah](https://discuss.elastic.co/u/Tan_Chween_Tah)\ **Post date:** [December 27, 2012, 5:15am UTC](https://discuss.elastic.co/t/elastic-search-and-hadoop/10178/1 "2012-12-27T05:15:42Z")
Hi all I am new to elasictc search. got some problem here setting up elasictic search. i got a hadoop running up now . one master and one slave . but after i download elastic search and try to run /bin/elasticsearch -f. it hangs there at some command line .. can i know what i need to change in the config folder ? as i don't really understand the steps on the elastic search website. can anyone got any better website for me to try it and refer.. Thanks Regards -- ---
**Author:** ![dadoonet](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dadoonet/32/137187_2.png) [@dadoonet](https://discuss.elastic.co/u/dadoonet)\ **Post date:** [December 27, 2012, 5:36am UTC](https://discuss.elastic.co/t/elastic-search-and-hadoop/10178/2 "2012-12-27T05:36:58Z")
Welcome. 1st, try to run ES in standalone (without Hadoop): download, unzip, launch bin/elasticsearch -f (from UNIX), bin/elasticsearch.bat from windows 2nd, in another shell, try curl localhost:9200 If you use windows, open this URL from a browser. If it doesn't work, check that you have a Java (6 or 7) somewhere and that JAVA\_HOME is defined. If it still does not work, report here any error you can see in logs. BTW, read this: [http://www.elasticsearch.org/guide/reference/setup/installation.html](http://www.elasticsearch.org/guide/reference/setup/installation.html) HTH -- David 😉 Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs Le 27 déc. 2012 à 06:15, [jundatan85@gmail.com](mailto:jundatan85@gmail.com) a écrit : Hi all I am new to elasictc search. got some problem here setting up elasictic search. i got a hadoop running up now . one master and one slave . but after i download elastic search and try to run /bin/elasticsearch -f. it hangs there at some command line .. can i know what i need to change in the config folder ? as i don't really understand the steps on the elastic search website. can anyone got any better website for me to try it and refer.. ## Thanks Regards -- ---
**Author:** ![Tan\_Chween\_Tah](https://avatars.discourse-cdn.com/v4/letter/t/ba9def/32.png) [@Tan\_Chween\_Tah](https://discuss.elastic.co/u/Tan_Chween_Tah)\ **Post date:** [December 27, 2012, 5:51am UTC](https://discuss.elastic.co/t/elastic-search-and-hadoop/10178/3 "2012-12-27T05:51:30Z")
Thanks for the reply David, i have tried it out before and it still not working. the terminal will be still hang elasticsearch-0.20.1# bin/elasticsearch -f [2012-12-27 17:21:55,023][INFO][node] [Boomslang] {0.20.1}[2187]: initializing ... [2012-12-27 17:21:55,034][INFO][plugins] [Boomslang] loaded , sites [2012-12-27 17:21:58,484][INFO][node] [Boomslang] {0.20.1}[2187]: initialized [2012-12-27 17:21:58,484][INFO][node] [Boomslang] {0.20.1}[2187]: starting ... [2012-12-27 17:21:58,674][INFO][transport] [Boomslang] bound\_address {inet[XXX.XX.XXX.XXX:9300]}, publish\_address {inet[/XXX.XXX.XXX.XXX:9300]} [2012-12-27 17:22:01,922][INFO][cluster.service] [Boomslang] new\_master [Boomslang][DuJAy1WLSdij0PNFPLt\_0g][inet[/XXX.XXX.XXX.XXX:9300]], reason: zen-disco-join (elected\_as\_master) [2012-12-27 17:22:01,971][INFO][discovery] [Boomslang] elasticsearch/DuJAy1WLSdij0PNFPLt\_0g [2012-12-27 17:22:02,010][INFO][http] [Boomslang] bound\_address {inet[/XXX.XXX.XXX.XXX:9200]}, publish\_address {inet[/XXX.XXX.XXX.XXX:9200]} [2012-12-27 17:22:02,010][INFO][node] [Boomslang] {0.20.1}[2187]: started [2012-12-27 17:22:02,081][INFO][gateway] [Boomslang] recovered [0] indices into cluster\_state I have read th website u have send me but i did not see anything regarding such error . Thanks On Thu, Dec 27, 2012 at 12:36 PM, David Pilato [david@pilato.fr](mailto:david@pilato.fr) wrote: > Welcome. > > 1st, try to run ES in standalone (without Hadoop): download, unzip, launch > bin/elasticsearch -f (from UNIX), bin/elasticsearch.bat from windows > 2nd, in another shell, try curl localhost:9200 > If you use windows, open this URL from a browser. > > If it doesn't work, check that you have a Java (6 or 7) somewhere and that > JAVA\_HOME is defined. > > If it still does not work, report here any error you can see in logs. > > BTW, read this: > [Elasticsearch Platform — Find real-time answers at scale | Elastic](http://www.elasticsearch.org/guide/reference/setup/installation.html) > > HTH > > -- > David 😉 > Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs > > Le 27 déc. 2012 à 06:15, [jundatan85@gmail.com](mailto:jundatan85@gmail.com) a écrit : > > Hi all > > I am new to elasictc search. got some problem here setting up elasictic > search. i got a hadoop running up now . one master and one slave . but > after i download Elasticsearch and try to run /bin/elasticsearch -f. it > hangs there at some command line .. can i know what i need to change in the > config folder ? as i don't really understand the steps on the elastic > search website. can anyone got any better website for me to try it and > refer.. > > Thanks > Regards > > -- > > -- -- ---
**Author:** ![dadoonet](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dadoonet/32/137187_2.png) [@dadoonet](https://discuss.elastic.co/u/dadoonet)\ **Post date:** [December 27, 2012, 7:54am UTC](https://discuss.elastic.co/t/elastic-search-and-hadoop/10178/4 "2012-12-27T07:54:41Z")
Looks like everything is working here. What do you expect to see? Did you open localhost:9200 in your browser? -- David 😉 Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs Le 27 déc. 2012 à 06:51, Tan Chween Tah [jundatan85@gmail.com](mailto:jundatan85@gmail.com) a écrit : Thanks for the reply David, i have tried it out before and it still not working. the terminal will be still hang elasticsearch-0.20.1# bin/elasticsearch -f [2012-12-27 17:21:55,023][INFO][node] [Boomslang] {0.20.1}[2187]: initializing ... [2012-12-27 17:21:55,034][INFO][plugins] [Boomslang] loaded , sites [2012-12-27 17:21:58,484][INFO][node] [Boomslang] {0.20.1}[2187]: initialized [2012-12-27 17:21:58,484][INFO][node] [Boomslang] {0.20.1}[2187]: starting ... [2012-12-27 17:21:58,674][INFO][transport] [Boomslang] bound\_address {inet[XXX.XX.XXX.XXX:9300]}, publish\_address {inet[/XXX.XXX.XXX.XXX:9300]} [2012-12-27 17:22:01,922][INFO][cluster.service] [Boomslang] new\_master [Boomslang][DuJAy1WLSdij0PNFPLt\_0g][inet[/XXX.XXX.XXX.XXX:9300]], reason: zen-disco-join (elected\_as\_master) [2012-12-27 17:22:01,971][INFO][discovery] [Boomslang] elasticsearch/DuJAy1WLSdij0PNFPLt\_0g [2012-12-27 17:22:02,010][INFO][http] [Boomslang] bound\_address {inet[/XXX.XXX.XXX.XXX:9200]}, publish\_address {inet[/XXX.XXX.XXX.XXX:9200]} [2012-12-27 17:22:02,010][INFO][node] [Boomslang] {0.20.1}[2187]: started [2012-12-27 17:22:02,081][INFO][gateway] [Boomslang] recovered [0] indices into cluster\_state I have read th website u have send me but i did not see anything regarding such error . Thanks On Thu, Dec 27, 2012 at 12:36 PM, David Pilato [david@pilato.fr](mailto:david@pilato.fr) wrote: > Welcome. > > 1st, try to run ES in standalone (without Hadoop): download, unzip, launch bin/elasticsearch -f (from UNIX), bin/elasticsearch.bat from windows > 2nd, in another shell, try curl localhost:9200 > If you use windows, open this URL from a browser. > > If it doesn't work, check that you have a Java (6 or 7) somewhere and that JAVA\_HOME is defined. > > If it still does not work, report here any error you can see in logs. > > BTW, read this: [Elasticsearch Platform — Find real-time answers at scale | Elastic](http://www.elasticsearch.org/guide/reference/setup/installation.html) > > HTH > > -- > David 😉 > Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs > > Le 27 déc. 2012 à 06:15, [jundatan85@gmail.com](mailto:jundatan85@gmail.com) a écrit : > > Hi all > > I am new to elasictc search. got some problem here setting up elasictic search. i got a hadoop running up now . one master and one slave . but after i download Elasticsearch and try to run /bin/elasticsearch -f. it hangs there at some command line .. can i know what i need to change in the config folder ? as i don't really understand the steps on the Elasticsearch website. can anyone got any better website for me to try it and refer.. > > ## Thanks Regards > > -- -- -- ---
**Author:** ![Tan\_Chween\_Tah](https://avatars.discourse-cdn.com/v4/letter/t/ba9def/32.png) [@Tan\_Chween\_Tah](https://discuss.elastic.co/u/Tan_Chween_Tah)\ **Post date:** [December 27, 2012, 8:38am UTC](https://discuss.elastic.co/t/elastic-search-and-hadoop/10178/5 "2012-12-27T08:38:51Z")
Thanks david What i am trying to do is like having big data of text or json file and put distribute it in different computer using hadoop and using Elasticsearch to query the words so it will return the result faster . You said it is working fine. so is there a example on how to insert a text file or json file into the Elasticsearch and i am able to query the words out. for eg. Test.txt contain words inside. and i want to search the words like "happy" inside that test.txt file .. is it possible for elasitc search to do that ? nope i did not try just now. but now I have try opening localhost:9200 in my browser but it throw me an error "problem loading page". any advice ? thanks On Thu, Dec 27, 2012 at 2:54 PM, David Pilato [david@pilato.fr](mailto:david@pilato.fr) wrote: > Looks like everything is working here. > What do you expect to see? > > Did you open localhost:9200 in your browser? > > -- > David 😉 > Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs > > Le 27 déc. 2012 à 06:51, Tan Chween Tah [jundatan85@gmail.com](mailto:jundatan85@gmail.com) a écrit : > > Thanks for the reply David, i have tried it out before and it still not > working. the terminal will be still hang > > elasticsearch-0.20.1# bin/elasticsearch -f > [2012-12-27 17:21:55,023][INFO][node] [Boomslang] > {0.20.1}[2187]: initializing ... > [2012-12-27 17:21:55,034][INFO][plugins] [Boomslang] > loaded , sites > [2012-12-27 17:21:58,484][INFO][node] [Boomslang] > {0.20.1}[2187]: initialized > [2012-12-27 17:21:58,484][INFO][node] [Boomslang] > {0.20.1}[2187]: starting ... > [2012-12-27 17:21:58,674][INFO][transport] [Boomslang] > bound\_address {inet[XXX.XX.XXX.XXX:9300]}, publish\_address > {inet[/XXX.XXX.XXX.XXX:9300]} > [2012-12-27 17:22:01,922][INFO][cluster.service] [Boomslang] > new\_master > [Boomslang][DuJAy1WLSdij0PNFPLt\_0g][inet[/XXX.XXX.XXX.XXX:9300]], reason: > zen-disco-join (elected\_as\_master) > [2012-12-27 17:22:01,971][INFO][discovery] [Boomslang] > elasticsearch/DuJAy1WLSdij0PNFPLt\_0g > [2012-12-27 17:22:02,010][INFO][http] [Boomslang] > bound\_address {inet[/XXX.XXX.XXX.XXX:9200]}, publish\_address > {inet[/XXX.XXX.XXX.XXX:9200]} > [2012-12-27 17:22:02,010][INFO][node] [Boomslang] > {0.20.1}[2187]: started > [2012-12-27 17:22:02,081][INFO][gateway] [Boomslang] > recovered [0] indices into cluster\_state > > I have read th website u have send me but i did not see anything regarding > such error . > > Thanks > > On Thu, Dec 27, 2012 at 12:36 PM, David Pilato [david@pilato.fr](mailto:david@pilato.fr) wrote: > > > Welcome. > > > > 1st, try to run ES in standalone (without Hadoop): download, unzip, > > launch bin/elasticsearch -f (from UNIX), bin/elasticsearch.bat from windows > > 2nd, in another shell, try curl localhost:9200 > > If you use windows, open this URL from a browser. > > > > If it doesn't work, check that you have a Java (6 or 7) somewhere and > > that JAVA\_HOME is defined. > > > > If it still does not work, report here any error you can see in logs. > > > > BTW, read this: > > [Elasticsearch Platform — Find real-time answers at scale | Elastic](http://www.elasticsearch.org/guide/reference/setup/installation.html) > > > > HTH > > > > -- > > David 😉 > > Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs > > > > Le 27 déc. 2012 à 06:15, [jundatan85@gmail.com](mailto:jundatan85@gmail.com) a écrit : > > > > Hi all > > > > I am new to elasictc search. got some problem here setting up elasictic > > search. i got a hadoop running up now . one master and one slave . but > > after i download Elasticsearch and try to run /bin/elasticsearch -f. it > > hangs there at some command line .. can i know what i need to change in the > > config folder ? as i don't really understand the steps on the elastic > > search website. can anyone got any better website for me to try it and > > refer.. > > > > Thanks > > Regards > > > > -- > > > > -- > > -- > > -- -- ---
**Author:** ![dadoonet](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dadoonet/32/137187_2.png) [@dadoonet](https://discuss.elastic.co/u/dadoonet)\ **Post date:** [December 27, 2012, 9:30am UTC](https://discuss.elastic.co/t/elastic-search-and-hadoop/10178/6 "2012-12-27T09:30:44Z")
Ok. First, you have to make sure that your ES instance is working fine. You should be able to do a curl localhost:9200 and see a JSON. If not, don't go to the next steps and fix your problem! (BTW, tell me if you run under linux or windows). What you want to achieve is to index files. It's not one of the basic feature of ES but it's available as a plugin ( > **[GitHub - elastic/elasticsearch-mapper-attachments: Mapper Attachments Type...](https://github.com/elastic/elasticsearch-mapper-attachments)** > > Mapper Attachments Type plugin for Elasticsearch. Contribute to elastic/elasticsearch-mapper-attachments development by creating an account on GitHub. [https://github.com/elasticsearch/elasticsearch-mapper-attachments](https://github.com/elasticsearch/elasticsearch-mapper-attachments) ). You have a full script here to try it: [Test of attachments plugin · GitHub](https://gist.github.com/3907010) [https://gist.github.com/3907010](https://gist.github.com/3907010) But, it's without Hadoop. That gives me an idea for my scrutmydocs [http://www.scrutmydocs.org/](http://www.scrutmydocs.org/) project. I should add in the FSRiver (File System River) (or create a new one) the possibility of fetching content from hdfs... Does it help? Le 27 décembre 2012 à 09:38, Tan Chween Tah [jundatan85@gmail.com](mailto:jundatan85@gmail.com) a écrit : > Thanks david > > What i am trying to do is like having big data of text or json file and put > distribute it in different computer using hadoop and using Elasticsearch to > query the words so it will return the result faster . > > You said it is working fine. so is there a example on how to insert a text > file or json file into the Elasticsearch and i am able to query the words > out. for eg. Test.txt contain words inside. and i want to search the words > like "happy" inside that test.txt file .. is it possible for elasitc search to > do that ? > > nope i did not try just now. but now I have try opening localhost:9200 in my > browser but it throw me an error "problem loading page". > > any advice ? > > thanks > > On Thu, Dec 27, 2012 at 2:54 PM, David Pilato \<[david@pilato.fr](mailto:david@pilato.fr) > [mailto:david@pilato.fr](mailto:david@pilato.fr) \> wrote: > > > > Looks like everything is working here. > > > What do you expect to see? > > > > Did you open localhost:9200 in your browser? > > > > -- > > David 😉 > > Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs > > > > Le 27 déc. 2012 à 06:51, Tan Chween Tah \< [jundatan85@gmail.com](mailto:jundatan85@gmail.com) > > [mailto:jundatan85@gmail.com](mailto:jundatan85@gmail.com) \> a écrit : > > Thanks for the reply David, i have tried it out before and it still not > > working. the terminal will be still hang > > > > elasticsearch-0.20.1# bin/elasticsearch -f > > [2012-12-27 17:21:55,023][INFO][node] [Boomslang] > > {0.20.1}[2187]: initializing ... > > [2012-12-27 17:21:55,034][INFO][plugins] [Boomslang] > > loaded , sites > > [2012-12-27 17:21:58,484][INFO][node] [Boomslang] > > {0.20.1}[2187]: initialized > > [2012-12-27 17:21:58,484][INFO][node] [Boomslang] > > {0.20.1}[2187]: starting ... > > [2012-12-27 17:21:58,674][INFO][transport] [Boomslang] > > bound\_address {inet[XXX.XX.XXX.XXX:9300]}, publish\_address > > {inet[/XXX.XXX.XXX.XXX:9300]} > > [2012-12-27 17:22:01,922][INFO][cluster.service] [Boomslang] > > new\_master [Boomslang][DuJAy1WLSdij0PNFPLt\_0g][inet[/XXX.XXX.XXX.XXX:9300]], > > reason: zen-disco-join (elected\_as\_master) > > [2012-12-27 17:22:01,971][INFO][discovery] [Boomslang] > > elasticsearch/DuJAy1WLSdij0PNFPLt\_0g > > [2012-12-27 17:22:02,010][INFO][http] [Boomslang] > > bound\_address {inet[/XXX.XXX.XXX.XXX:9200]}, publish\_address > > {inet[/XXX.XXX.XXX.XXX:9200]} > > [2012-12-27 17:22:02,010][INFO][node] [Boomslang] > > {0.20.1}[2187]: started > > [2012-12-27 17:22:02,081][INFO][gateway] [Boomslang] > > recovered [0] indices into cluster\_state > > > > I have read th website u have send me but i did not see anything > > regarding such error . > > > > Thanks > > > > On Thu, Dec 27, 2012 at 12:36 PM, David Pilato \<[david@pilato.fr](mailto:david@pilato.fr) > > [mailto:david@pilato.fr](mailto:david@pilato.fr) \> wrote: > > \> \> \> Welcome. > > > > > ``` > > > 1st, try to run ES in standalone (without Hadoop): download, unzip, > > > > > > ``` > > > > > > launch bin/elasticsearch -f (from UNIX), bin/elasticsearch.bat from > > > windows > > > 2nd, in another shell, try curl localhost:9200 > > > If you use windows, open this URL from a browser. > > > > > > ``` > > > If it doesn't work, check that you have a Java (6 or 7) somewhere and > > > > > > ``` > > > > > > that JAVA\_HOME is defined. > > > > > > ``` > > > If it still does not work, report here any error you can see in logs. > > > > > > BTW, read this: > > > > > > ``` > > > > > > [Elasticsearch Platform — Find real-time answers at scale | Elastic](http://www.elasticsearch.org/guide/reference/setup/installation.html) > > > [http://www.elasticsearch.org/guide/reference/setup/installation.html](http://www.elasticsearch.org/guide/reference/setup/installation.html) > > > > > > ``` > > > HTH > > > > > > -- > > > David ;-) > > > Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs > > > > > > Le 27 déc. 2012 à 06:15, jundatan85@gmail.com > > > > > > ``` > > > > > > [mailto:jundatan85@gmail.com](mailto:jundatan85@gmail.com) a écrit : > > > Hi all > > > > > > ``` > > > I am new to elasictc search. got some problem here setting up > > > > > > ``` > > > > > > elasictic search. i got a hadoop running up now . one master and one > > > slave . but after i download Elasticsearch and try to run > > > /bin/elasticsearch -f. it hangs there at some command line .. can i know > > > what i need to change in the config folder ? as i don't really understand > > > the steps on the Elasticsearch website. can anyone got any better website > > > for me to try it and refer.. > > > > > > ``` > > > Thanks > > > Regards > > > > > > -- > > > > > > -- > > > > > > ``` > > > > > > > > > > > > -- > > > > -- > > > > > > > -- -- David Pilato [http://www.scrutmydocs.org/](http://www.scrutmydocs.org/) [http://dev.david.pilato.fr/](http://dev.david.pilato.fr/) Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs -- ---
**Author:** ![dadoonet](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dadoonet/32/137187_2.png) [@dadoonet](https://discuss.elastic.co/u/dadoonet)\ **Post date:** [December 27, 2012, 9:59am UTC](https://discuss.elastic.co/t/elastic-search-and-hadoop/10178/7 "2012-12-27T09:59:57Z")
Please keep the thread in the mailing list scope. Not outside (don't send direct mails). OK. Here are the steps you have to follow: 1/ stop all running shells and open a new one Just check if you have an elasticsearch running in the background ( ps -ef | grep elasticsearch ) and kill the process if you find one. 2/ on a fresh clean elasticsearch dir (you should not find data, logs dir), start bin/elasticsearch -f 3/ open a new shell and type curl [http://localhost:9200](http://localhost:9200) What happens? Le 27 décembre 2012 à 10:48, [jundatan85@gmail.com](mailto:jundatan85@gmail.com) a écrit : > ok thanks. i will take a look later. > > i am using ubuntu linux and using a root account > > let solve the problem that my ES instance is not working. when i type in > locahost:9200 it said "unable to connect tp server at localhost:9200" > > On Thursday, December 27, 2012 5:30:44 PM UTC+8, David Pilato wrote: > > > > Ok. First, you have to make sure that your ES instance is working > > > fine. > > > You should be able to do a curl localhost:9200 and see a JSON. If not, > > > don't go to the next steps and fix your problem! (BTW, tell me if you run > > > under linux or windows). > > > > What you want to achieve is to index files. It's not one of the basic > > feature of ES but it's available as a plugin ( > > [GitHub - elastic/elasticsearch-mapper-attachments: Mapper Attachments Type plugin for Elasticsearch](https://github.com/elasticsearch/elasticsearch-mapper-attachments)). You have > > a full script here to try it: > > [https://github.com/elasticsearch/elasticsearch-mapper-attachments](https://github.com/elasticsearch/elasticsearch-mapper-attachments) > > [Test of attachments plugin · GitHub](https://gist.github.com/3907010) [https://gist.github.com/3907010](https://gist.github.com/3907010) > > > > But, it's without Hadoop. That gives me an idea for my > > [https://gist.github.com/3907010](https://gist.github.com/3907010) scrutmydocs [http://www.scrutmydocs.org/](http://www.scrutmydocs.org/) > > project. I should add in the FSRiver (File System River) (or create a new > > one) the possibility of fetching content from hdfs... > > > > Does it help? > > > > Le 27 décembre 2012 à 09:38, Tan Chween Tah \< [junda...@gmail.com](mailto:junda...@gmail.com)\> a écrit > > : > > > > ``` > > > > > Thanks david > > > > ``` > > > > > ``` > > > What i am trying to do is like having big data of text or json file > > > > > > ``` > > > > > > and put distribute it in different computer using hadoop and using elastic > > > search to query the words so it will return the result faster . > > > > > > ``` > > > You said it is working fine. so is there a example on how to insert a > > > > > > ``` > > > > > > text file or json file into the Elasticsearch and i am able to query the > > > words out. for eg. Test.txt contain words inside. and i want to search the > > > words like "happy" inside that test.txt file .. is it possible for elasitc > > > search to do that ? > > > > > > ``` > > > nope i did not try just now. but now I have try opening localhost:9200 > > > > > > ``` > > > > > > in my browser but it throw me an error "problem loading page". > > > > > > ``` > > > any advice ? > > > > > > thanks > > > > > > On Thu, Dec 27, 2012 at 2:54 PM, David Pilato wrote: > > > > > > > Looks like everything is working here. > > > > > > ``` > > > > > > > ``` > > > > What do you expect to see? > > > > > > > > Did you open localhost:9200 in your browser? > > > > > > > > -- > > > > David ;-) > > > > Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs > > > > > > > > Le 27 déc. 2012 à 06:51, Tan Chween Tah < junda...@gmail.com> a > > > > > > > > ``` > > > > > > > > écrit : > > > > Thanks for the reply David, i have tried it out before and it > > > > still not working. the terminal will be still hang > > > > > > > > ``` > > > > elasticsearch-0.20.1# bin/elasticsearch -f > > > > [2012-12-27 17:21:55,023][INFO][node] > > > > > > > > ``` > > > > > > > > [Boomslang] {0.20.1}[2187]: initializing ... > > > > [2012-12-27 17:21:55,034][INFO][plugins] > > > > [Boomslang] loaded , sites > > > > [2012-12-27 17:21:58,484][INFO][node] > > > > [Boomslang] {0.20.1}[2187]: initialized > > > > [2012-12-27 17:21:58,484][INFO][node] > > > > [Boomslang] {0.20.1}[2187]: starting ... > > > > [2012-12-27 17:21:58,674][INFO][transport] > > > > [Boomslang] bound\_address {inet[XXX.XX.XXX.XXX:9300]}, publish\_address > > > > {inet[/XXX.XXX.XXX.XXX:9300]} > > > > [2012-12-27 17:22:01,922][INFO][cluster.service] > > > > [Boomslang] new\_master > > > > [Boomslang][DuJAy1WLSdij0PNFPLt\_0g][inet[/XXX.XXX.XXX.XXX:9300]], > > > > reason: zen-disco-join (elected\_as\_master) > > > > [2012-12-27 17:22:01,971][INFO][discovery] > > > > [Boomslang] elasticsearch/DuJAy1WLSdij0PNFPLt\_0g > > > > [2012-12-27 17:22:02,010][INFO][http] > > > > [Boomslang] bound\_address {inet[/XXX.XXX.XXX.XXX:9200]}, publish\_address > > > > {inet[/XXX.XXX.XXX.XXX:9200]} > > > > [2012-12-27 17:22:02,010][INFO][node] > > > > [Boomslang] {0.20.1}[2187]: started > > > > [2012-12-27 17:22:02,081][INFO][gateway] > > > > [Boomslang] recovered [0] indices into cluster\_state > > > > > > > > ``` > > > > I have read th website u have send me but i did not see anything > > > > > > > > ``` > > > > > > > > regarding such error . > > > > > > > > ``` > > > > Thanks > > > > > > > > On Thu, Dec 27, 2012 at 12:36 PM, David Pilato > > > > > > > > ``` > > > > > > > > wrote: > > > > \> \> \> \> \> Welcome. > > > > > > > > > ``` > > > > > 1st, try to run ES in standalone (without Hadoop): download, > > > > > > > > > > ``` > > > > > > > > > > unzip, launch bin/elasticsearch -f (from UNIX), bin/elasticsearch.bat > > > > > from windows > > > > > 2nd, in another shell, try curl localhost:9200 > > > > > If you use windows, open this URL from a browser. > > > > > > > > > > ``` > > > > > If it doesn't work, check that you have a Java (6 or 7) > > > > > > > > > > ``` > > > > > > > > > > somewhere and that JAVA\_HOME is defined. > > > > > > > > > > ``` > > > > > If it still does not work, report here any error you can see > > > > > > > > > > ``` > > > > > > > > > > in logs. > > > > > > > > > > ``` > > > > > BTW, read this: > > > > > > > > > > ``` > > > > > > > > > > [Elasticsearch Platform — Find real-time answers at scale | Elastic](http://www.elasticsearch.org/guide/reference/setup/installation.html) > > > > > [http://www.elasticsearch.org/guide/reference/setup/installation.html](http://www.elasticsearch.org/guide/reference/setup/installation.html) > > > > > > > > > > ``` > > > > > HTH > > > > > > > > > > -- > > > > > David ;-) > > > > > Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs > > > > > > > > > > Le 27 déc. 2012 à 06:15, > > > > > > > > > > ``` > > > > > > > > > > [http://www.elasticsearch.org/guide/reference/setup/installation.html](http://www.elasticsearch.org/guide/reference/setup/installation.html) > > > > > [junda...@gmail.com](mailto:junda...@gmail.com) a écrit : > > > > > Hi all > > > > > > > > > > ``` > > > > > I am new to elasictc search. got some problem here setting up > > > > > > > > > > ``` > > > > > > > > > > elasictic search. i got a hadoop running up now . one master and one > > > > > slave . but after i download Elasticsearch and try to run > > > > > /bin/elasticsearch -f. it hangs there at some command line .. can i > > > > > know what i need to change in the config folder ? as i don't really > > > > > understand the steps on the Elasticsearch website. can anyone got any > > > > > better website for me to try it and refer.. > > > > > > > > > > ``` > > > > > Thanks > > > > > Regards > > > > > > > > > > -- > > > > > > > > > > -- > > > > > > > > > > > > > > > > > > > > > > > > ``` > > > > > > > > ``` > > > > -- > > > > > > > > -- > > > > > > > > -- > > > > > > > > > > > > > > > > > > > ``` > > > > > > ``` > > > -- > > > David Pilato > > > http://www.scrutmydocs.org/ > > > http://dev.david.pilato.fr/ > > > Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs > > > > > > ``` > > > > > > > > > -- David Pilato [http://www.scrutmydocs.org/](http://www.scrutmydocs.org/) [http://dev.david.pilato.fr/](http://dev.david.pilato.fr/) Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs -- ---
**Author:** ![Tan\_Chween\_Tah](https://avatars.discourse-cdn.com/v4/letter/t/ba9def/32.png) [@Tan\_Chween\_Tah](https://discuss.elastic.co/u/Tan_Chween_Tah)\ **Post date:** [December 27, 2012, 10:02am UTC](https://discuss.elastic.co/t/elastic-search-and-hadoop/10178/8 "2012-12-27T10:02:30Z")
ok thanks i will take a look later. i am using ubuntu linux root account now. let solve the es problem first. cos i can't view the json file u mention when i enter localhost:9200 on my browser. I think my es instance is not working. can i know is there any configuration i need to set. as i have edit the elasticsearch.yml. cluster name and network\_blind\_host. what other thing i need to set in order to view the localhost:9200. On Thursday, December 27, 2012 5:30:44 PM UTC+8, David Pilato wrote: > Ok. First, you have to make sure that your ES instance is working fine. > You should be able to do a curl localhost:9200 and see a JSON. If not, > don't go to the next steps and fix your problem! (BTW, tell me if you run > under linux or windows). > > What you want to achieve is to index files. It's not one of the basic > feature of ES but it's available as a plugin ( > [GitHub - elastic/elasticsearch-mapper-attachments: Mapper Attachments Type plugin for Elasticsearch](https://github.com/elasticsearch/elasticsearch-mapper-attachments)). You > have a full script here to try it: [Test of attachments plugin · GitHub](https://gist.github.com/3907010) > > But, it's without Hadoop. That gives me an idea for my scrutmydocs[http://www.scrutmydocs.org/](http://www.scrutmydocs.org/) project. > I should add in the FSRiver (File System River) (or create a new one) the > possibility of fetching content from hdfs... > > Does it help? > > Le 27 décembre 2012 à 09:38, Tan Chween Tah \<[junda...@gmail.com](mailto:junda...@gmail.com)\\> > a écrit : > > Thanks david > > What i am trying to do is like having big data of text or json file and > put distribute it in different computer using hadoop and using elastic > search to query the words so it will return the result faster . > > You said it is working fine. so is there a example on how to insert a text > file or json file into the Elasticsearch and i am able to query the words > out. for eg. Test.txt contain words inside. and i want to search the words > like "happy" inside that test.txt file .. is it possible for elasitc search > to do that ? > > nope i did not try just now. but now I have try opening localhost:9200 in > my browser but it throw me an error "problem loading page". > > any advice ? > > thanks > > On Thu, Dec 27, 2012 at 2:54 PM, David Pilato \<[da...@pilato.fr](mailto:da...@pilato.fr)\ > > > wrote: > > Looks like everything is working here. > What do you expect to see? > > Did you open localhost:9200 in your browser? > > -- > David 😉 > Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs > > Le 27 déc. 2012 à 06:51, Tan Chween Tah \< [junda...@gmail.com](mailto:junda...@gmail.com) \\> > a écrit : > Thanks for the reply David, i have tried it out before and it still not > working. the terminal will be still hang > > elasticsearch-0.20.1# bin/elasticsearch -f > [2012-12-27 17:21:55,023][INFO][node] [Boomslang] > {0.20.1}[2187]: initializing ... > [2012-12-27 17:21:55,034][INFO][plugins] [Boomslang] > loaded , sites > [2012-12-27 17:21:58,484][INFO][node] [Boomslang] > {0.20.1}[2187]: initialized > [2012-12-27 17:21:58,484][INFO][node] [Boomslang] > {0.20.1}[2187]: starting ... > [2012-12-27 17:21:58,674][INFO][transport] [Boomslang] > bound\_address {inet[XXX.XX.XXX.XXX:9300]}, publish\_address > {inet[/XXX.XXX.XXX.XXX:9300]} > [2012-12-27 17:22:01,922][INFO][cluster.service] [Boomslang] > new\_master > [Boomslang][DuJAy1WLSdij0PNFPLt\_0g][inet[/XXX.XXX.XXX.XXX:9300]], reason: > zen-disco-join (elected\_as\_master) > [2012-12-27 17:22:01,971][INFO][discovery] [Boomslang] > elasticsearch/DuJAy1WLSdij0PNFPLt\_0g > [2012-12-27 17:22:02,010][INFO][http] [Boomslang] > bound\_address {inet[/XXX.XXX.XXX.XXX:9200]}, publish\_address > {inet[/XXX.XXX.XXX.XXX:9200]} > [2012-12-27 17:22:02,010][INFO][node] [Boomslang] > {0.20.1}[2187]: started > [2012-12-27 17:22:02,081][INFO][gateway] [Boomslang] > recovered [0] indices into cluster\_state > > I have read th website u have send me but i did not see anything regarding > such error . > > Thanks > > On Thu, Dec 27, 2012 at 12:36 PM, David Pilato \<[da...@pilato.fr](mailto:da...@pilato.fr)\ > > > wrote: > > Welcome. > > 1st, try to run ES in standalone (without Hadoop): download, unzip, > launch bin/elasticsearch -f (from UNIX), bin/elasticsearch.bat from windows > 2nd, in another shell, try curl localhost:9200 > If you use windows, open this URL from a browser. > > If it doesn't work, check that you have a Java (6 or 7) somewhere and > that JAVA\_HOME is defined. > > If it still does not work, report here any error you can see in logs. > > BTW, read this: > [Elasticsearch Platform — Find real-time answers at scale | Elastic](http://www.elasticsearch.org/guide/reference/setup/installation.html) > > HTH > > -- > David 😉 > Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs > > Le 27 déc. 2012 à 06:15, [junda...@gmail.com](mailto:junda...@gmail.com) \ a écrit : > Hi all > > I am new to elasictc search. got some problem here setting up elasictic > search. i got a hadoop running up now . one master and one slave . but > after i download Elasticsearch and try to run /bin/elasticsearch -f. it > hangs there at some command line .. can i know what i need to change in the > config folder ? as i don't really understand the steps on the elastic > search website. can anyone got any better website for me to try it and > refer.. > > Thanks > Regards > > -- > > -- > > -- > > -- > > -- > > -- > David Pilato > [http://www.scrutmydocs.org/](http://www.scrutmydocs.org/) > [http://dev.david.pilato.fr/](http://dev.david.pilato.fr/) > Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs -- ---
**Author:** ![Tan\_Chween\_Tah](https://avatars.discourse-cdn.com/v4/letter/t/ba9def/32.png) [@Tan\_Chween\_Tah](https://discuss.elastic.co/u/Tan_Chween_Tah)\ **Post date:** [December 27, 2012, 10:25am UTC](https://discuss.elastic.co/t/elastic-search-and-hadoop/10178/9 "2012-12-27T10:25:02Z")
ok it works now .. i can see the localhost:9200 which will return me { "ok" : true, "status" : 200, "name" : "Strong Guy", "version" : { "number" : "0.20.1", "snapshot\_build" : false }, "tagline" : "You Know, for Search" } this mean that it is working fine and running. i will take a look again for the things i mention before. Thanks for your helps David . any advice on what is my next step after i get this ES running. On Thu, Dec 27, 2012 at 4:59 PM, David Pilato [david@pilato.fr](mailto:david@pilato.fr) wrote: > \*\* > Please keep the thread in the mailing list scope. Not outside (don't send > direct mails). > > OK. Here are the steps you have to follow: > 1/ stop all running shells and open a new one > Just check if you have an elasticsearch running in the background ( ps > -ef | grep elasticsearch ) and kill the process if you find one. > 2/ on a fresh clean elasticsearch dir (you should not find data, logs > dir), start bin/elasticsearch -f > 3/ open a new shell and type curl [http://localhost:9200](http://localhost:9200) > > What happens? > > Le 27 décembre 2012 à 10:48, [jundatan85@gmail.com](mailto:jundatan85@gmail.com) a écrit : > > ok thanks. i will take a look later. > > i am using ubuntu linux and using a root account > > let solve the problem that my ES instance is not working. when i type in > locahost:9200 it said "unable to connect tp server at localhost:9200" > > On Thursday, December 27, 2012 5:30:44 PM UTC+8, David Pilato wrote: > > Ok. First, you have to make sure that your ES instance is working fine. > You should be able to do a curl localhost:9200 and see a JSON. If not, > don't go to the next steps and fix your problem! (BTW, tell me if you run > under linux or windows). > > What you want to achieve is to index files. It's not one of the basic > feature of ES but it's available as a plugin ( [GitHub - elastic/elasticsearch-mapper-attachments: Mapper Attachments Type plugin for Elasticsearch](https://github.com/elasticsearch/elasticsearch-mapper-attachments)). > You have a full script here to try it: > [https://github.com/elasticsearch/elasticsearch-mapper-attachments](https://github.com/elasticsearch/elasticsearch-mapper-attachments) [Test of attachments plugin · GitHub](https://gist.github.com/3907010) > > But, it's without Hadoop. That gives me an idea for my > [https://gist.github.com/3907010](https://gist.github.com/3907010) scrutmydocs[http://www.scrutmydocs.org/](http://www.scrutmydocs.org/) project. > I should add in the FSRiver (File System River) (or create a new one) the > possibility of fetching content from hdfs... > > Does it help? > > Le 27 décembre 2012 à 09:38, Tan Chween Tah \< [junda...@gmail.com](mailto:junda...@gmail.com)\> a > écrit : > > Thanks david > > What i am trying to do is like having big data of text or json file and > put distribute it in different computer using hadoop and using elastic > search to query the words so it will return the result faster . > > You said it is working fine. so is there a example on how to insert a text > file or json file into the Elasticsearch and i am able to query the words > out. for eg. Test.txt contain words inside. and i want to search the words > like "happy" inside that test.txt file .. is it possible for elasitc search > to do that ? > > nope i did not try just now. but now I have try opening localhost:9200 in > my browser but it throw me an error "problem loading page". > > any advice ? > > thanks > > On Thu, Dec 27, 2012 at 2:54 PM, David Pilato [da...@pilato.fr](mailto:da...@pilato.fr) wrote: > > Looks like everything is working here. > What do you expect to see? > > Did you open localhost:9200 in your browser? > > -- > David 😉 > Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs > > Le 27 déc. 2012 à 06:51, Tan Chween Tah \< [junda...@gmail.com](mailto:junda...@gmail.com)\> a écrit : > Thanks for the reply David, i have tried it out before and it still not > working. the terminal will be still hang > > elasticsearch-0.20.1# bin/elasticsearch -f > [2012-12-27 17:21:55,023][INFO][node] [Boomslang] > {0.20.1}[2187]: initializing ... > [2012-12-27 17:21:55,034][INFO][plugins] [Boomslang] > loaded , sites > [2012-12-27 17:21:58,484][INFO][node] [Boomslang] > {0.20.1}[2187]: initialized > [2012-12-27 17:21:58,484][INFO][node] [Boomslang] > {0.20.1}[2187]: starting ... > [2012-12-27 17:21:58,674][INFO][transport] [Boomslang] > bound\_address {inet[XXX.XX.XXX.XXX:9300]}, publish\_address > {inet[/XXX.XXX.XXX.XXX:9300]} > [2012-12-27 17:22:01,922][INFO][cluster.service] [Boomslang] > new\_master > [Boomslang][DuJAy1WLSdij0PNFPLt\_0g][inet[/XXX.XXX.XXX.XXX:9300]], reason: > zen-disco-join (elected\_as\_master) > [2012-12-27 17:22:01,971][INFO][discovery] [Boomslang] > elasticsearch/DuJAy1WLSdij0PNFPLt\_0g > [2012-12-27 17:22:02,010][INFO][http] [Boomslang] > bound\_address {inet[/XXX.XXX.XXX.XXX:9200]}, publish\_address > {inet[/XXX.XXX.XXX.XXX:9200]} > [2012-12-27 17:22:02,010][INFO][node] [Boomslang] > {0.20.1}[2187]: started > [2012-12-27 17:22:02,081][INFO][gateway] [Boomslang] > recovered [0] indices into cluster\_state > > I have read th website u have send me but i did not see anything regarding > such error . > > Thanks > > On Thu, Dec 27, 2012 at 12:36 PM, David Pilato [da...@pilato.fr](mailto:da...@pilato.fr) wrote: > > Welcome. > > 1st, try to run ES in standalone (without Hadoop): download, unzip, > launch bin/elasticsearch -f (from UNIX), bin/elasticsearch.bat from windows > 2nd, in another shell, try curl localhost:9200 > If you use windows, open this URL from a browser. > > If it doesn't work, check that you have a Java (6 or 7) somewhere and > that JAVA\_HOME is defined. > > If it still does not work, report here any error you can see in logs. > > BTW, read this: [Elasticsearch Platform — Find real-time answers at scale | Elastic](http://www.elasticsearch.org/guide/reference/setup/installation.html) > > HTH > > -- > David 😉 > Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs > > Le 27 déc. 2012 à 06:15, > [http://www.elasticsearch.org/guide/reference/setup/installation.html](http://www.elasticsearch.org/guide/reference/setup/installation.html) > [junda...@gmail.com](mailto:junda...@gmail.com) a écrit : > Hi all > > I am new to elasictc search. got some problem here setting up elasictic > search. i got a hadoop running up now . one master and one slave . but > after i download Elasticsearch and try to run /bin/elasticsearch -f. it > hangs there at some command line .. can i know what i need to change in the > config folder ? as i don't really understand the steps on the elastic > search website. can anyone got any better website for me to try it and > refer.. > > Thanks > Regards > > -- > > -- > > -- > > -- > > -- > > -- > David Pilato > [http://www.scrutmydocs.org/](http://www.scrutmydocs.org/) > [http://dev.david.pilato.fr/](http://dev.david.pilato.fr/) > Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs > > -- > David Pilato > [http://www.scrutmydocs.org/](http://www.scrutmydocs.org/) > [http://dev.david.pilato.fr/](http://dev.david.pilato.fr/) > Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs > > -- -- ---
**Author:** ![dadoonet](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dadoonet/32/137187_2.png) [@dadoonet](https://discuss.elastic.co/u/dadoonet)\ **Post date:** [December 27, 2012, 10:31am UTC](https://discuss.elastic.co/t/elastic-search-and-hadoop/10178/10 "2012-12-27T10:31:32Z")
Cool. Try to play with attachments now: Follow this script [https://gist.github.com/3907010](https://gist.github.com/3907010) . Le 27 décembre 2012 à 11:25, Tan Chween Tah [jundatan85@gmail.com](mailto:jundatan85@gmail.com) a écrit : > ok it works now .. i can see the localhost:9200 which will return me > > { > "ok" : true, > "status" : 200, > "name" : "Strong Guy", > "version" : { > "number" : "0.20.1", > "snapshot\_build" : false > }, > "tagline" : "You Know, for Search" > } > > this mean that it is working fine and running. i will take a look again for > the things i mention before. > Thanks for your helps David . > any advice on what is my next step after i get this ES running. > > On Thu, Dec 27, 2012 at 4:59 PM, David Pilato \<[david@pilato.fr](mailto:david@pilato.fr) > [mailto:david@pilato.fr](mailto:david@pilato.fr) \> wrote: > > > > Please keep the thread in the mailing list scope. Not outside (don't > > > send direct mails). > > > > OK. Here are the steps you have to follow: > > 1/ stop all running shells and open a new one > > Just check if you have an elasticsearch running in the background ( ps > > -ef | grep elasticsearch ) and kill the process if you find one. > > 2/ on a fresh clean elasticsearch dir (you should not find data, logs > > dir), start bin/elasticsearch -f > > 3/ open a new shell and type curl [http://localhost:9200](http://localhost:9200) > > [http://localhost:9200](http://localhost:9200) > > > > What happens? > > > > Le 27 décembre 2012 à 10:48, [jundatan85@gmail.com](mailto:jundatan85@gmail.com) > > [mailto:jundatan85@gmail.com](mailto:jundatan85@gmail.com) a écrit : > > > > ``` > > > > > ok thanks. i will take a look later. > > > > ``` > > > > > ``` > > > i am using ubuntu linux and using a root account > > > > > > let solve the problem that my ES instance is not working. when i type > > > > > > ``` > > > > > > in locahost:9200 it said "unable to connect tp server at localhost:9200" > > > > > > ``` > > > On Thursday, December 27, 2012 5:30:44 PM UTC+8, David Pilato wrote: > > > > > > > Ok. First, you have to make sure that your ES instance > > > > > > > is working fine. > > > > > > ``` > > > > > > > ``` > > > > You should be able to do a curl localhost:9200 and see a JSON. If > > > > > > > > ``` > > > > > > > > not, don't go to the next steps and fix your problem! (BTW, tell me if > > > > you run under linux or windows). > > > > > > > > ``` > > > > What you want to achieve is to index files. It's not one of the > > > > > > > > ``` > > > > > > > > basic feature of ES but it's available as a plugin ( > > > > [GitHub - elastic/elasticsearch-mapper-attachments: Mapper Attachments Type plugin for Elasticsearch](https://github.com/elasticsearch/elasticsearch-mapper-attachments)). You > > > > have a full script here to try it: > > > > [https://github.com/elasticsearch/elasticsearch-mapper-attachments](https://github.com/elasticsearch/elasticsearch-mapper-attachments) > > > > [Test of attachments plugin · GitHub](https://gist.github.com/3907010) [https://gist.github.com/3907010](https://gist.github.com/3907010) > > > > > > > > ``` > > > > But, it's without Hadoop. That gives me an idea for my > > > > > > > > ``` > > > > > > > > [https://gist.github.com/3907010](https://gist.github.com/3907010) scrutmydocs > > > > [http://www.scrutmydocs.org/](http://www.scrutmydocs.org/) project. I should add in the FSRiver > > > > (File System River) (or create a new one) the possibility of fetching > > > > content from hdfs... > > > > > > > > ``` > > > > Does it help? > > > > > > > > Le 27 décembre 2012 à 09:38, Tan Chween Tah < junda...@gmail.com> > > > > > > > > ``` > > > > > > > > a écrit : > > > > > > > > ``` > > > > > > > > > Thanks david > > > > > > > > ``` > > > > > > > > > ``` > > > > > What i am trying to do is like having big data of text or json > > > > > > > > > > ``` > > > > > > > > > > file and put distribute it in different computer using hadoop and > > > > > using Elasticsearch to query the words so it will return the result > > > > > faster . > > > > > > > > > > ``` > > > > > You said it is working fine. so is there a example on how to > > > > > > > > > > ``` > > > > > > > > > > insert a text file or json file into the Elasticsearch and i am able > > > > > to query the words out. for eg. Test.txt contain words inside. and i > > > > > want to search the words like "happy" inside that test.txt file .. is > > > > > it possible for elasitc search to do that ? > > > > > > > > > > ``` > > > > > nope i did not try just now. but now I have try opening > > > > > > > > > > ``` > > > > > > > > > > localhost:9200 in my browser but it throw me an error "problem loading > > > > > page". > > > > > > > > > > ``` > > > > > any advice ? > > > > > > > > > > thanks > > > > > > > > > > On Thu, Dec 27, 2012 at 2:54 PM, David Pilato > > > > > > > > > > ``` > > > > > > > > > > wrote: > > > > > \> \> \> \> \> \> Looks like everything is working here. > > > > > > > > > > > ``` > > > > > > What do you expect to see? > > > > > > > > > > > > Did you open localhost:9200 in your browser? > > > > > > > > > > > > -- > > > > > > David ;-) > > > > > > Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs > > > > > > > > > > > > Le 27 déc. 2012 à 06:51, Tan Chween Tah < > > > > > > > > > > > > ``` > > > > > > > > > > > > [junda...@gmail.com](mailto:junda...@gmail.com)\> a écrit : > > > > > > Thanks for the reply David, i have tried it out before and > > > > > > it still not working. the terminal will be still hang > > > > > > > > > > > > ``` > > > > > > elasticsearch-0.20.1# bin/elasticsearch -f > > > > > > [2012-12-27 17:21:55,023][INFO][node] > > > > > > > > > > > > ``` > > > > > > > > > > > > [Boomslang] {0.20.1}[2187]: initializing ... > > > > > > [2012-12-27 17:21:55,034][INFO][plugins] > > > > > > [Boomslang] loaded , sites > > > > > > [2012-12-27 17:21:58,484][INFO][node] > > > > > > [Boomslang] {0.20.1}[2187]: initialized > > > > > > [2012-12-27 17:21:58,484][INFO][node] > > > > > > [Boomslang] {0.20.1}[2187]: starting ... > > > > > > [2012-12-27 17:21:58,674][INFO][transport] > > > > > > [Boomslang] bound\_address {inet[XXX.XX.XXX.XXX:9300]}, > > > > > > publish\_address {inet[/XXX.XXX.XXX.XXX:9300]} > > > > > > [2012-12-27 17:22:01,922][INFO][cluster.service] > > > > > > [Boomslang] new\_master > > > > > > [Boomslang][DuJAy1WLSdij0PNFPLt\_0g][inet[/XXX.XXX.XXX.XXX:9300]], > > > > > > reason: zen-disco-join (elected\_as\_master) > > > > > > [2012-12-27 17:22:01,971][INFO][discovery] > > > > > > [Boomslang] elasticsearch/DuJAy1WLSdij0PNFPLt\_0g > > > > > > [2012-12-27 17:22:02,010][INFO][http] > > > > > > [Boomslang] bound\_address {inet[/XXX.XXX.XXX.XXX:9200]}, > > > > > > publish\_address {inet[/XXX.XXX.XXX.XXX:9200]} > > > > > > [2012-12-27 17:22:02,010][INFO][node] > > > > > > [Boomslang] {0.20.1}[2187]: started > > > > > > [2012-12-27 17:22:02,081][INFO][gateway] > > > > > > [Boomslang] recovered [0] indices into cluster\_state > > > > > > > > > > > > ``` > > > > > > I have read th website u have send me but i did not see > > > > > > > > > > > > ``` > > > > > > > > > > > > anything regarding such error . > > > > > > > > > > > > ``` > > > > > > Thanks > > > > > > On Thu, Dec 27, 2012 at 12:36 PM, David Pilato > > > > > > > > > > > > ``` > > > > > > > > > > > > [da...@pilato.fr](mailto:da...@pilato.fr) wrote: > > > > > > \> \> \> \> \> \> \> Welcome. > > > > > > > > > > > > > ``` > > > > > > > 1st, try to run ES in standalone (without Hadoop): > > > > > > > > > > > > > > ``` > > > > > > > > > > > > > > download, unzip, launch bin/elasticsearch -f (from UNIX), > > > > > > > bin/elasticsearch.bat from windows > > > > > > > 2nd, in another shell, try curl localhost:9200 > > > > > > > If you use windows, open this URL from a browser. > > > > > > > > > > > > > > ``` > > > > > > > If it doesn't work, check that you have a Java (6 or 7) > > > > > > > > > > > > > > ``` > > > > > > > > > > > > > > somewhere and that JAVA\_HOME is defined. > > > > > > > > > > > > > > ``` > > > > > > > If it still does not work, report here any error you > > > > > > > > > > > > > > ``` > > > > > > > > > > > > > > can see in logs. > > > > > > > > > > > > > > ``` > > > > > > > BTW, read this: > > > > > > > > > > > > > > ``` > > > > > > > > > > > > > > [Elasticsearch Platform — Find real-time answers at scale | Elastic](http://www.elasticsearch.org/guide/reference/setup/installation.html) > > > > > > > [http://www.elasticsearch.org/guide/reference/setup/installation.html](http://www.elasticsearch.org/guide/reference/setup/installation.html) > > > > > > > > > > > > > > ``` > > > > > > > HTH > > > > > > > > > > > > > > -- > > > > > > > David ;-) > > > > > > > Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs > > > > > > > > > > > > > > Le 27 déc. 2012 à 06:15, > > > > > > > > > > > > > > ``` > > > > > > > > > > > > > > [http://www.elasticsearch.org/guide/reference/setup/installation.html](http://www.elasticsearch.org/guide/reference/setup/installation.html) > > > > > > > [junda...@gmail.com](mailto:junda...@gmail.com) a écrit : > > > > > > > Hi all > > > > > > > > > > > > > > ``` > > > > > > > I am new to elasictc search. got some problem here > > > > > > > > > > > > > > ``` > > > > > > > > > > > > > > setting up elasictic search. i got a hadoop running up now . one > > > > > > > master and one slave . but after i download Elasticsearch and try > > > > > > > to run /bin/elasticsearch -f. it hangs there at some command line > > > > > > > .. can i know what i need to change in the config folder ? as i > > > > > > > don't really understand the steps on the Elasticsearch website. > > > > > > > can anyone got any better website for me to try it and refer.. > > > > > > > > > > > > > > ``` > > > > > > > Thanks > > > > > > > Regards > > > > > > > > > > > > > > -- > > > > > > > > > > > > > > -- > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > ``` > > > > > > > > > > > > ``` > > > > > > -- > > > > > > > > > > > > -- > > > > > > > > > > > > -- > > > > > > > > > > > > > > > > > > > > > > > > > > > > > ``` > > > > > > > > > > ``` > > > > > -- > > > > > David Pilato > > > > > http://www.scrutmydocs.org/ > > > > > http://dev.david.pilato.fr/ > > > > > Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs > > > > > > > > > > > > > > > > > > > > > > > > > > > ``` > > > > > > > > > > > > -- > > David Pilato > > [http://www.scrutmydocs.org/](http://www.scrutmydocs.org/) [http://www.scrutmydocs.org/](http://www.scrutmydocs.org/) > > [http://dev.david.pilato.fr/](http://dev.david.pilato.fr/) [http://dev.david.pilato.fr/](http://dev.david.pilato.fr/) > > Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs > > > > -- > > > > > > > -- -- David Pilato [http://www.scrutmydocs.org/](http://www.scrutmydocs.org/) [http://dev.david.pilato.fr/](http://dev.david.pilato.fr/) Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs -- ---
**Author:** ![Tan\_Chween\_Tah](https://avatars.discourse-cdn.com/v4/letter/t/ba9def/32.png) [@Tan\_Chween\_Tah](https://discuss.elastic.co/u/Tan_Chween_Tah)\ **Post date:** [December 28, 2012, 5:11am UTC](https://discuss.elastic.co/t/elastic-search-and-hadoop/10178/11 "2012-12-28T05:11:54Z")
hi thanks but the attachment don't seem to be working too . On Thu, Dec 27, 2012 at 5:31 PM, David Pilato [david@pilato.fr](mailto:david@pilato.fr) wrote: > \*\* > Cool. > Try to play with attachments now: Follow this script[https://gist.github.com/3907010](https://gist.github.com/3907010). > > Le 27 décembre 2012 à 11:25, Tan Chween Tah [jundatan85@gmail.com](mailto:jundatan85@gmail.com) a > écrit : > > ok it works now .. i can see the localhost:9200 which will return me > > { > "ok" : true, > "status" : 200, > "name" : "Strong Guy", > "version" : { > "number" : "0.20.1", > "snapshot\_build" : false > }, > "tagline" : "You Know, for Search" > } > > this mean that it is working fine and running. i will take a look again for the things i mention before. > Thanks for your helps David . > any advice on what is my next step after i get this ES running. > > On Thu, Dec 27, 2012 at 4:59 PM, David Pilato [david@pilato.fr](mailto:david@pilato.fr) wrote: > > Please keep the thread in the mailing list scope. Not outside (don't > send direct mails). > > OK. Here are the steps you have to follow: > 1/ stop all running shells and open a new one > Just check if you have an elasticsearch running in the background ( ps > -ef | grep elasticsearch ) and kill the process if you find one. > 2/ on a fresh clean elasticsearch dir (you should not find data, logs > dir), start bin/elasticsearch -f > 3/ open a new shell and type curl [http://localhost:9200](http://localhost:9200) > > What happens? > > Le 27 décembre 2012 à 10:48, [jundatan85@gmail.com](mailto:jundatan85@gmail.com) a écrit : > > ok thanks. i will take a look later. > > i am using ubuntu linux and using a root account > > let solve the problem that my ES instance is not working. when i type in > locahost:9200 it said "unable to connect tp server at localhost:9200" > > On Thursday, December 27, 2012 5:30:44 PM UTC+8, David Pilato wrote: > > Ok. First, you have to make sure that your ES instance is working fine. > You should be able to do a curl localhost:9200 and see a JSON. If not, > don't go to the next steps and fix your problem! (BTW, tell me if you run > under linux or windows). > > What you want to achieve is to index files. It's not one of the basic > feature of ES but it's available as a plugin ( [GitHub - elastic/elasticsearch-mapper-attachments: Mapper Attachments Type plugin for Elasticsearch](https://github.com/elasticsearch/elasticsearch-mapper-attachments)). > You have a full script here to try it: > [https://github.com/elasticsearch/elasticsearch-mapper-attachments](https://github.com/elasticsearch/elasticsearch-mapper-attachments) [Test of attachments plugin · GitHub](https://gist.github.com/3907010) > > But, it's without Hadoop. That gives me an idea for my > [https://gist.github.com/3907010](https://gist.github.com/3907010) scrutmydocs[http://www.scrutmydocs.org/](http://www.scrutmydocs.org/) project. > I should add in the FSRiver (File System River) (or create a new one) the > possibility of fetching content from hdfs... > > Does it help? > > Le 27 décembre 2012 à 09:38, Tan Chween Tah \< [junda...@gmail.com](mailto:junda...@gmail.com)\> a > écrit : > > Thanks david > > What i am trying to do is like having big data of text or json file and > put distribute it in different computer using hadoop and using elastic > search to query the words so it will return the result faster . > > You said it is working fine. so is there a example on how to insert a text > file or json file into the Elasticsearch and i am able to query the words > out. for eg. Test.txt contain words inside. and i want to search the words > like "happy" inside that test.txt file .. is it possible for elasitc search > to do that ? > > nope i did not try just now. but now I have try opening localhost:9200 in > my browser but it throw me an error "problem loading page". > > any advice ? > > thanks > > On Thu, Dec 27, 2012 at 2:54 PM, David Pilato [da...@pilato.fr](mailto:da...@pilato.fr) wrote: > > Looks like everything is working here. > What do you expect to see? > > Did you open localhost:9200 in your browser? > > -- > David 😉 > Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs > > Le 27 déc. 2012 à 06:51, Tan Chween Tah \< [junda...@gmail.com](mailto:junda...@gmail.com)\> a écrit : > Thanks for the reply David, i have tried it out before and it still not > working. the terminal will be still hang > > elasticsearch-0.20.1# bin/elasticsearch -f > [2012-12-27 17:21:55,023][INFO][node] [Boomslang] > {0.20.1}[2187]: initializing ... > [2012-12-27 17:21:55,034][INFO][plugins] [Boomslang] > loaded , sites > [2012-12-27 17:21:58,484][INFO][node] [Boomslang] > {0.20.1}[2187]: initialized > [2012-12-27 17:21:58,484][INFO][node] [Boomslang] > {0.20.1}[2187]: starting ... > [2012-12-27 17:21:58,674][INFO][transport] [Boomslang] > bound\_address {inet[XXX.XX.XXX.XXX:9300]}, publish\_address > {inet[/XXX.XXX.XXX.XXX:9300]} > [2012-12-27 17:22:01,922][INFO][cluster.service] [Boomslang] > new\_master > [Boomslang][DuJAy1WLSdij0PNFPLt\_0g][inet[/XXX.XXX.XXX.XXX:9300]], reason: > zen-disco-join (elected\_as\_master) > [2012-12-27 17:22:01,971][INFO][discovery] [Boomslang] > elasticsearch/DuJAy1WLSdij0PNFPLt\_0g > [2012-12-27 17:22:02,010][INFO][http] [Boomslang] > bound\_address {inet[/XXX.XXX.XXX.XXX:9200]}, publish\_address > {inet[/XXX.XXX.XXX.XXX:9200]} > [2012-12-27 17:22:02,010][INFO][node] [Boomslang] > {0.20.1}[2187]: started > [2012-12-27 17:22:02,081][INFO][gateway] [Boomslang] > recovered [0] indices into cluster\_state > > I have read th website u have send me but i did not see anything regarding > such error . > > Thanks > On Thu, Dec 27, 2012 at 12:36 PM, David Pilato [da...@pilato.fr](mailto:da...@pilato.fr) wrote: > > Welcome. > > 1st, try to run ES in standalone (without Hadoop): download, unzip, > launch bin/elasticsearch -f (from UNIX), bin/elasticsearch.bat from windows > 2nd, in another shell, try curl localhost:9200 > If you use windows, open this URL from a browser. > > If it doesn't work, check that you have a Java (6 or 7) somewhere and > that JAVA\_HOME is defined. > > If it still does not work, report here any error you can see in logs. > > BTW, read this: [Elasticsearch Platform — Find real-time answers at scale | Elastic](http://www.elasticsearch.org/guide/reference/setup/installation.html) > > HTH > > -- > David 😉 > Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs > > Le 27 déc. 2012 à 06:15, > [http://www.elasticsearch.org/guide/reference/setup/installation.html](http://www.elasticsearch.org/guide/reference/setup/installation.html) > [junda...@gmail.com](mailto:junda...@gmail.com) a écrit : > Hi all > > I am new to elasictc search. got some problem here setting up elasictic > search. i got a hadoop running up now . one master and one slave . but > after i download Elasticsearch and try to run /bin/elasticsearch -f. it > hangs there at some command line .. can i know what i need to change in the > config folder ? as i don't really understand the steps on the elastic > search website. can anyone got any better website for me to try it and > refer.. > > Thanks > Regards > > -- > > -- > > -- > > -- > > -- > > -- > David Pilato > [http://www.scrutmydocs.org/](http://www.scrutmydocs.org/) > [http://dev.david.pilato.fr/](http://dev.david.pilato.fr/) > Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs > > -- > David Pilato > [http://www.scrutmydocs.org/](http://www.scrutmydocs.org/) > [http://dev.david.pilato.fr/](http://dev.david.pilato.fr/) > Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs > > -- > > -- > > -- > David Pilato > [http://www.scrutmydocs.org/](http://www.scrutmydocs.org/) > [http://dev.david.pilato.fr/](http://dev.david.pilato.fr/) > Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs > > -- -- ---
**Author:** ![dadoonet](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dadoonet/32/137187_2.png) [@dadoonet](https://discuss.elastic.co/u/dadoonet)\ **Post date:** [December 28, 2012, 6:51am UTC](https://discuss.elastic.co/t/elastic-search-and-hadoop/10178/12 "2012-12-28T06:51:24Z")
If you need help, you have to give some details as "doesn't seem to work" is not enough to find your problem. So, what did you do? What can you see? Is there any errors in logs? -- David 😉 Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs Le 28 déc. 2012 à 06:11, Tan Chween Tah [jundatan85@gmail.com](mailto:jundatan85@gmail.com) a écrit : hi thanks but the attachment don't seem to be working too . On Thu, Dec 27, 2012 at 5:31 PM, David Pilato [david@pilato.fr](mailto:david@pilato.fr) wrote: > Cool. > Try to play with attachments now: Follow this script. > > Le 27 décembre 2012 à 11:25, Tan Chween Tah [jundatan85@gmail.com](mailto:jundatan85@gmail.com) a écrit : > > > ok it works now .. i can see the localhost:9200 which will return me > > > > { > > "ok" : true, > > "status" : 200, > > "name" : "Strong Guy", > > "version" : { > > "number" : "0.20.1", > > "snapshot\_build" : false > > }, > > "tagline" : "You Know, for Search" > > } > > > > this mean that it is working fine and running. i will take a look again for the things i mention before. > > Thanks for your helps David . > > any advice on what is my next step after i get this ES running. > > > > On Thu, Dec 27, 2012 at 4:59 PM, David Pilato [david@pilato.fr](mailto:david@pilato.fr) wrote: > > Please keep the thread in the mailing list scope. Not outside (don't send direct mails). > > > > OK. Here are the steps you have to follow: > > 1/ stop all running shells and open a new one > > Just check if you have an elasticsearch running in the background ( ps -ef | grep elasticsearch ) and kill the process if you find one. > > 2/ on a fresh clean elasticsearch dir (you should not find data, logs dir), start bin/elasticsearch -f > > 3/ open a new shell and type curl [http://localhost:9200](http://localhost:9200) > > > > What happens? > > > > Le 27 décembre 2012 à 10:48, [jundatan85@gmail.com](mailto:jundatan85@gmail.com) a écrit : > > > > > ok thanks. i will take a look later. > > > > > > i am using ubuntu linux and using a root account > > > > > > let solve the problem that my ES instance is not working. when i type in locahost:9200 it said "unable to connect tp server at localhost:9200" > > > > > > On Thursday, December 27, 2012 5:30:44 PM UTC+8, David Pilato wrote: > > > Ok. First, you have to make sure that your ES instance is working fine. > > > You should be able to do a curl localhost:9200 and see a JSON. If not, don't go to the next steps and fix your problem! (BTW, tell me if you run under linux or windows). > > > > > > What you want to achieve is to index files. It's not one of the basic feature of ES but it's available as a plugin ( [GitHub - elastic/elasticsearch-mapper-attachments: Mapper Attachments Type plugin for Elasticsearch](https://github.com/elasticsearch/elasticsearch-mapper-attachments)). You have a full script here to try it: [Test of attachments plugin · GitHub](https://gist.github.com/3907010) > > > > > > But, it's without Hadoop. That gives me an idea for my scrutmydocs project. I should add in the FSRiver (File System River) (or create a new one) the possibility of fetching content from hdfs... > > > > > > Does it help? > > > > > > Le 27 décembre 2012 à 09:38, Tan Chween Tah \< [junda...@gmail.com](mailto:junda...@gmail.com)\> a écrit : > > > > > > > Thanks david > > > > > > > > What i am trying to do is like having big data of text or json file and put distribute it in different computer using hadoop and using Elasticsearch to query the words so it will return the result faster . > > > > > > > > You said it is working fine. so is there a example on how to insert a text file or json file into the Elasticsearch and i am able to query the words out. for eg. Test.txt contain words inside. and i want to search the words like "happy" inside that test.txt file .. is it possible for elasitc search to do that ? > > > > > > > > nope i did not try just now. but now I have try opening localhost:9200 in my browser but it throw me an error "problem loading page". > > > > > > > > any advice ? > > > > > > > > thanks > > > > > > > > On Thu, Dec 27, 2012 at 2:54 PM, David Pilato [da...@pilato.fr](mailto:da...@pilato.fr) wrote: > > > > Looks like everything is working here. > > > > What do you expect to see? > > > > > > > > Did you open localhost:9200 in your browser? > > > > > > > > -- > > > > David 😉 > > > > Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs > > > > > > > > Le 27 déc. 2012 à 06:51, Tan Chween Tah \< [junda...@gmail.com](mailto:junda...@gmail.com)\> a écrit : > > > > Thanks for the reply David, i have tried it out before and it still not working. the terminal will be still hang > > > > > > > > elasticsearch-0.20.1# bin/elasticsearch -f > > > > [2012-12-27 17:21:55,023][INFO][node] [Boomslang] {0.20.1}[2187]: initializing ... > > > > [2012-12-27 17:21:55,034][INFO][plugins] [Boomslang] loaded , sites > > > > [2012-12-27 17:21:58,484][INFO][node] [Boomslang] {0.20.1}[2187]: initialized > > > > [2012-12-27 17:21:58,484][INFO][node] [Boomslang] {0.20.1}[2187]: starting ... > > > > [2012-12-27 17:21:58,674][INFO][transport] [Boomslang] bound\_address {inet[XXX.XX.XXX.XXX:9300]}, publish\_address {inet[/XXX.XXX.XXX.XXX:9300]} > > > > [2012-12-27 17:22:01,922][INFO][cluster.service] [Boomslang] new\_master [Boomslang][DuJAy1WLSdij0PNFPLt\_0g][inet[/XXX.XXX.XXX.XXX:9300]], reason: zen-disco-join (elected\_as\_master) > > > > [2012-12-27 17:22:01,971][INFO][discovery] [Boomslang] elasticsearch/DuJAy1WLSdij0PNFPLt\_0g > > > > [2012-12-27 17:22:02,010][INFO][http] [Boomslang] bound\_address {inet[/XXX.XXX.XXX.XXX:9200]}, publish\_address {inet[/XXX.XXX.XXX.XXX:9200]} > > > > [2012-12-27 17:22:02,010][INFO][node] [Boomslang] {0.20.1}[2187]: started > > > > [2012-12-27 17:22:02,081][INFO][gateway] [Boomslang] recovered [0] indices into cluster\_state > > > > > > > > I have read th website u have send me but i did not see anything regarding such error . > > > > > > > > Thanks > > > > On Thu, Dec 27, 2012 at 12:36 PM, David Pilato [da...@pilato.fr](mailto:da...@pilato.fr) wrote: > > > > Welcome. > > > > > > > > 1st, try to run ES in standalone (without Hadoop): download, unzip, launch bin/elasticsearch -f (from UNIX), bin/elasticsearch.bat from windows > > > > 2nd, in another shell, try curl localhost:9200 > > > > If you use windows, open this URL from a browser. > > > > > > > > If it doesn't work, check that you have a Java (6 or 7) somewhere and that JAVA\_HOME is defined. > > > > > > > > If it still does not work, report here any error you can see in logs. > > > > > > > > BTW, read this: [Elasticsearch Platform — Find real-time answers at scale | Elastic](http://www.elasticsearch.org/guide/reference/setup/installation.html) > > > > > > > > HTH > > > > > > > > -- > > > > David 😉 > > > > Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs > > > > > > > > Le 27 déc. 2012 à 06:15, [junda...@gmail.com](mailto:junda...@gmail.com) a écrit : > > > > Hi all > > > > > > > > I am new to elasictc search. got some problem here setting up elasictic search. i got a hadoop running up now . one master and one slave . but after i download Elasticsearch and try to run /bin/elasticsearch -f. it hangs there at some command line .. can i know what i need to change in the config folder ? as i don't really understand the steps on the Elasticsearch website. can anyone got any better website for me to try it and refer.. > > > > > > > > Thanks > > > > Regards > > > > > > > > -- > > > > > > > > -- > > > > > > > > -- > > > > > > > > -- > > > > > > > > -- > > > > > > > > -- > > > > David Pilato > > > > [http://www.scrutmydocs.org/](http://www.scrutmydocs.org/) > > > > [http://dev.david.pilato.fr/](http://dev.david.pilato.fr/) > > > > Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs > > > > -- > > David Pilato > > [http://www.scrutmydocs.org/](http://www.scrutmydocs.org/) > > [http://dev.david.pilato.fr/](http://dev.david.pilato.fr/) > > Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs > > > > -- > > > > -- > > ## -- David Pilato [http://www.scrutmydocs.org/](http://www.scrutmydocs.org/) [http://dev.david.pilato.fr/](http://dev.david.pilato.fr/) Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs -- -- ---
**Author:** ![Tan\_Chween\_Tah](https://avatars.discourse-cdn.com/v4/letter/t/ba9def/32.png) [@Tan\_Chween\_Tah](https://discuss.elastic.co/u/Tan_Chween_Tah)\ **Post date:** [December 28, 2012, 7:19am UTC](https://discuss.elastic.co/t/elastic-search-and-hadoop/10178/13 "2012-12-28T07:19:48Z")
i create the file.sh file and place the code #!/bin/sh # [http://cloud.github.com/downloads/elasticsearch/elasticsearch/elasticsearch-0.19.10.zip](http://cloud.github.com/downloads/elasticsearch/elasticsearch/elasticsearch-0.19.10.zip) #unzip elasticsearch-0.19.10.zip #elasticsearch-0.19.10/bin/plugin -install elasticsearch/elasticsearch-mapper-attachments/1.6.0 ../../usr/local/elasticsearch-0.20.1/bin/elasticsearch sleep 10 host=localhost:9200 curl -X DELETE "${host}/test" curl -X PUT "${host}/test" -d '{ "settings" : { "index" : { "number\_of\_shards" : 1, "number\_of\_replicas" : 0 }} }' curl -X GET "${host}/\_cluster/health?wait\_for\_status=green&pretty=1&timeout=5s" curl -X PUT "${host}/test/attachment/\_mapping" -d '{ "attachment" : { "properties" : { "file" : { "type" : "attachment", "fields" : { "title" : { "store" : "yes" }, "file" : { "term\_vector":"with\_positions\_offsets", "store":"yes" } } } } } }' curl -C - -O > **[Renesas Electronics Corporation | Renesas](https://www.renesas.com/en)** > > A global leader in microcontrollers, analog, power and SoC products, Renesas delivers trusted embedded design innovation to shape a limitless future. coded=`cat fn6742.pdf | perl -MMIME::Base64 -ne 'print encode_base64($_)'` json="{"file":"${coded}"}" echo "$json" \> json.file curl -X POST "${host}/test/attachment/" -d @json.file echo curl -XPOST "${host}/\_refresh" curl "${host}/\_search?pretty=true" -d '{ "fields" : ["title"], "query" : { "query\_string" : { "query" : "amplifier" } }, "highlight" : { "fields" : { "file" : {} } } }' i run the file.sh from my terminal. it will said ./file.sh: 31: ./file.sh: curl: not found ./file.sh: 39: ./file.sh: curl: not found ./file.sh: 43: ./file.sh: curl: not found ./file.sh: 71: ./file.sh: curl: not found cat: fn6742.pdf: No such file or directory ./file.sh: 81: ./file.sh: curl: not found ./file.sh: 87: ./file.sh: curl: not found ./file.sh: 91: ./file.sh: curl: not found On Fri, Dec 28, 2012 at 12:11 PM, Tan Chween Tah [jundatan85@gmail.com](mailto:jundatan85@gmail.com)wrote: > hi thanks but the attachment don't seem to be working too . > > On Thu, Dec 27, 2012 at 5:31 PM, David Pilato [david@pilato.fr](mailto:david@pilato.fr) wrote: > > > \*\* > > Cool. > > Try to play with attachments now: Follow this script[https://gist.github.com/3907010](https://gist.github.com/3907010). > > > > Le 27 décembre 2012 à 11:25, Tan Chween Tah [jundatan85@gmail.com](mailto:jundatan85@gmail.com) a > > écrit : > > > > ok it works now .. i can see the localhost:9200 which will return me > > > > { > > "ok" : true, > > "status" : 200, > > "name" : "Strong Guy", > > "version" : { > > "number" : "0.20.1", > > "snapshot\_build" : false > > }, > > "tagline" : "You Know, for Search" > > } > > > > this mean that it is working fine and running. i will take a look again for the things i mention before. > > Thanks for your helps David . > > any advice on what is my next step after i get this ES running. > > > > On Thu, Dec 27, 2012 at 4:59 PM, David Pilato [david@pilato.fr](mailto:david@pilato.fr) wrote: > > > > Please keep the thread in the mailing list scope. Not outside (don't > > send direct mails). > > > > OK. Here are the steps you have to follow: > > 1/ stop all running shells and open a new one > > Just check if you have an elasticsearch running in the background ( ps > > -ef | grep elasticsearch ) and kill the process if you find one. > > 2/ on a fresh clean elasticsearch dir (you should not find data, logs > > dir), start bin/elasticsearch -f > > 3/ open a new shell and type curl [http://localhost:9200](http://localhost:9200) > > > > What happens? > > > > Le 27 décembre 2012 à 10:48, [jundatan85@gmail.com](mailto:jundatan85@gmail.com) a écrit : > > > > ok thanks. i will take a look later. > > > > i am using ubuntu linux and using a root account > > > > let solve the problem that my ES instance is not working. when i type > > in locahost:9200 it said "unable to connect tp server at localhost:9200" > > > > On Thursday, December 27, 2012 5:30:44 PM UTC+8, David Pilato wrote: > > > > Ok. First, you have to make sure that your ES instance is working > > fine. > > You should be able to do a curl localhost:9200 and see a JSON. If not, > > don't go to the next steps and fix your problem! (BTW, tell me if you run > > under linux or windows). > > > > What you want to achieve is to index files. It's not one of the basic > > feature of ES but it's available as a plugin ( [GitHub - elastic/elasticsearch-mapper-attachments: Mapper Attachments Type plugin for Elasticsearch](https://github.com/elasticsearch/elasticsearch-mapper-attachments)). > > You have a full script here to try it: > > [https://github.com/elasticsearch/elasticsearch-mapper-attachments](https://github.com/elasticsearch/elasticsearch-mapper-attachments) [Test of attachments plugin · GitHub](https://gist.github.com/3907010) > > > > But, it's without Hadoop. That gives me an idea for my > > [https://gist.github.com/3907010](https://gist.github.com/3907010) scrutmydocs[http://www.scrutmydocs.org/](http://www.scrutmydocs.org/) project. > > I should add in the FSRiver (File System River) (or create a new one) the > > possibility of fetching content from hdfs... > > > > Does it help? > > > > Le 27 décembre 2012 à 09:38, Tan Chween Tah \< [junda...@gmail.com](mailto:junda...@gmail.com)\> a > > écrit : > > > > Thanks david > > > > What i am trying to do is like having big data of text or json file and > > put distribute it in different computer using hadoop and using elastic > > search to query the words so it will return the result faster . > > > > You said it is working fine. so is there a example on how to insert a > > text file or json file into the Elasticsearch and i am able to query the > > words out. for eg. Test.txt contain words inside. and i want to search the > > words like "happy" inside that test.txt file .. is it possible for elasitc > > search to do that ? > > > > nope i did not try just now. but now I have try opening localhost:9200 in > > my browser but it throw me an error "problem loading page". > > > > any advice ? > > > > thanks > > > > On Thu, Dec 27, 2012 at 2:54 PM, David Pilato [da...@pilato.fr](mailto:da...@pilato.fr) wrote: > > > > Looks like everything is working here. > > What do you expect to see? > > > > Did you open localhost:9200 in your browser? > > > > -- > > David 😉 > > Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs > > > > Le 27 déc. 2012 à 06:51, Tan Chween Tah \< [junda...@gmail.com](mailto:junda...@gmail.com)\> a écrit : > > Thanks for the reply David, i have tried it out before and it still > > not working. the terminal will be still hang > > > > elasticsearch-0.20.1# bin/elasticsearch -f > > [2012-12-27 17:21:55,023][INFO][node] [Boomslang] > > {0.20.1}[2187]: initializing ... > > [2012-12-27 17:21:55,034][INFO][plugins] [Boomslang] > > loaded , sites > > [2012-12-27 17:21:58,484][INFO][node] [Boomslang] > > {0.20.1}[2187]: initialized > > [2012-12-27 17:21:58,484][INFO][node] [Boomslang] > > {0.20.1}[2187]: starting ... > > [2012-12-27 17:21:58,674][INFO][transport] [Boomslang] > > bound\_address {inet[XXX.XX.XXX.XXX:9300]}, publish\_address > > {inet[/XXX.XXX.XXX.XXX:9300]} > > [2012-12-27 17:22:01,922][INFO][cluster.service] [Boomslang] > > new\_master > > [Boomslang][DuJAy1WLSdij0PNFPLt\_0g][inet[/XXX.XXX.XXX.XXX:9300]], reason: > > zen-disco-join (elected\_as\_master) > > [2012-12-27 17:22:01,971][INFO][discovery] [Boomslang] > > elasticsearch/DuJAy1WLSdij0PNFPLt\_0g > > [2012-12-27 17:22:02,010][INFO][http] [Boomslang] > > bound\_address {inet[/XXX.XXX.XXX.XXX:9200]}, publish\_address > > {inet[/XXX.XXX.XXX.XXX:9200]} > > [2012-12-27 17:22:02,010][INFO][node] [Boomslang] > > {0.20.1}[2187]: started > > [2012-12-27 17:22:02,081][INFO][gateway] [Boomslang] > > recovered [0] indices into cluster\_state > > > > I have read th website u have send me but i did not see anything > > regarding such error . > > > > Thanks > > On Thu, Dec 27, 2012 at 12:36 PM, David Pilato [da...@pilato.fr](mailto:da...@pilato.fr)wrote: > > > > Welcome. > > > > 1st, try to run ES in standalone (without Hadoop): download, unzip, > > launch bin/elasticsearch -f (from UNIX), bin/elasticsearch.bat from windows > > 2nd, in another shell, try curl localhost:9200 > > If you use windows, open this URL from a browser. > > > > If it doesn't work, check that you have a Java (6 or 7) somewhere and > > that JAVA\_HOME is defined. > > > > If it still does not work, report here any error you can see in logs. > > > > BTW, read this: [Elastic — The Search AI Company | Elastic](http://www.elasticsearch.org/guide/reference/setup/installation.html) > > > > HTH > > > > -- > > David 😉 > > Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs > > > > Le 27 déc. 2012 à 06:15, > > [http://www.elasticsearch.org/guide/reference/setup/installation.html](http://www.elasticsearch.org/guide/reference/setup/installation.html) > > [junda...@gmail.com](mailto:junda...@gmail.com) a écrit : > > Hi all > > > > I am new to elasictc search. got some problem here setting up elasictic > > search. i got a hadoop running up now . one master and one slave . but > > after i download Elasticsearch and try to run /bin/elasticsearch -f. it > > hangs there at some command line .. can i know what i need to change in the > > config folder ? as i don't really understand the steps on the elastic > > search website. can anyone got any better website for me to try it and > > refer.. > > > > Thanks > > Regards > > > > -- > > > > -- > > > > -- > > > > -- > > > > -- > > > > -- > > David Pilato > > [http://www.scrutmydocs.org/](http://www.scrutmydocs.org/) > > [http://dev.david.pilato.fr/](http://dev.david.pilato.fr/) > > Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs > > > > -- > > David Pilato > > [http://www.scrutmydocs.org/](http://www.scrutmydocs.org/) > > [http://dev.david.pilato.fr/](http://dev.david.pilato.fr/) > > Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs > > > > -- > > > > -- > > > > -- > > David Pilato > > [http://www.scrutmydocs.org/](http://www.scrutmydocs.org/) > > [http://dev.david.pilato.fr/](http://dev.david.pilato.fr/) > > Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs > > > > -- -- ---
**Author:** ![dadoonet](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dadoonet/32/137187_2.png) [@dadoonet](https://discuss.elastic.co/u/dadoonet)\ **Post date:** [December 28, 2012, 7:36am UTC](https://discuss.elastic.co/t/elastic-search-and-hadoop/10178/14 "2012-12-28T07:36:04Z")
So you don't have curl on your system. Install it or add it in your Path... -- David 😉 Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs Le 28 déc. 2012 à 08:19, Tan Chween Tah [jundatan85@gmail.com](mailto:jundatan85@gmail.com) a écrit : i create the file.sh file and place the code #!/bin/sh #[http://cloud.github.com/downloads/elasticsearch/elasticsearch/elasticsearch-0.19.10.zip](http://cloud.github.com/downloads/elasticsearch/elasticsearch/elasticsearch-0.19.10.zip) #unzip elasticsearch-0.19.10.zip #elasticsearch-0.19.10/bin/plugin -install elasticsearch/elasticsearch-mapper-attachments/1.6.0 ../../usr/local/elasticsearch-0.20.1/bin/elasticsearch sleep 10 host=localhost:9200 curl -X DELETE "${host}/test" curl -X PUT "${host}/test" -d '{ "settings" : { "index" : { "number\_of\_shards" : 1, "number\_of\_replicas" : 0 }} }' curl -X GET "${host}/\_cluster/health?wait\_for\_status=green&pretty=1&timeout=5s" curl -X PUT "${host}/test/attachment/\_mapping" -d '{ "attachment" : { "properties" : { "file" : { "type" : "attachment", "fields" : { "title" : { "store" : "yes" }, "file" : { "term\_vector":"with\_positions\_offsets", "store":"yes" } } } } } }' curl -C - -O [Renesas Electronics Corporation](http://www.intersil.com/content/dam/Intersil/documents/fn67/fn6742.pdf) coded=`cat fn6742.pdf | perl -MMIME::Base64 -ne 'print encode_base64($_)'` json="{"file":"${coded}"}" echo "$json" \> json.file curl -X POST "${host}/test/attachment/" -d @json.file echo curl -XPOST "${host}/\_refresh" curl "${host}/\_search?pretty=true" -d '{ "fields" : ["title"], "query" : { "query\_string" : { "query" : "amplifier" } }, "highlight" : { "fields" : { "file" : {} } } }' i run the file.sh from my terminal. it will said ./file.sh: 31: ./file.sh: curl: not found ./file.sh: 39: ./file.sh: curl: not found ./file.sh: 43: ./file.sh: curl: not found ./file.sh: 71: ./file.sh: curl: not found cat: fn6742.pdf: No such file or directory ./file.sh: 81: ./file.sh: curl: not found ./file.sh: 87: ./file.sh: curl: not found ./file.sh: 91: ./file.sh: curl: not found On Fri, Dec 28, 2012 at 12:11 PM, Tan Chween Tah [jundatan85@gmail.com](mailto:jundatan85@gmail.com) wrote: > hi thanks but the attachment don't seem to be working too . > > On Thu, Dec 27, 2012 at 5:31 PM, David Pilato [david@pilato.fr](mailto:david@pilato.fr) wrote: > > > Cool. > > Try to play with attachments now: Follow this script. > > > > Le 27 décembre 2012 à 11:25, Tan Chween Tah [jundatan85@gmail.com](mailto:jundatan85@gmail.com) a écrit : > > > > > ok it works now .. i can see the localhost:9200 which will return me > > > > > > { > > > "ok" : true, > > > "status" : 200, > > > "name" : "Strong Guy", > > > "version" : { > > > "number" : "0.20.1", > > > "snapshot\_build" : false > > > }, > > > "tagline" : "You Know, for Search" > > > } > > > > > > this mean that it is working fine and running. i will take a look again for the things i mention before. > > > Thanks for your helps David . > > > any advice on what is my next step after i get this ES running. > > > > > > On Thu, Dec 27, 2012 at 4:59 PM, David Pilato [david@pilato.fr](mailto:david@pilato.fr) wrote: > > > Please keep the thread in the mailing list scope. Not outside (don't send direct mails). > > > > > > OK. Here are the steps you have to follow: > > > 1/ stop all running shells and open a new one > > > Just check if you have an elasticsearch running in the background ( ps -ef | grep elasticsearch ) and kill the process if you find one. > > > 2/ on a fresh clean elasticsearch dir (you should not find data, logs dir), start bin/elasticsearch -f > > > 3/ open a new shell and type curl [http://localhost:9200](http://localhost:9200) > > > > > > What happens? > > > > > > Le 27 décembre 2012 à 10:48, [jundatan85@gmail.com](mailto:jundatan85@gmail.com) a écrit : > > > > > > > ok thanks. i will take a look later. > > > > > > > > i am using ubuntu linux and using a root account > > > > > > > > let solve the problem that my ES instance is not working. when i type in locahost:9200 it said "unable to connect tp server at localhost:9200" > > > > > > > > On Thursday, December 27, 2012 5:30:44 PM UTC+8, David Pilato wrote: > > > > Ok. First, you have to make sure that your ES instance is working fine. > > > > You should be able to do a curl localhost:9200 and see a JSON. If not, don't go to the next steps and fix your problem! (BTW, tell me if you run under linux or windows). > > > > > > > > What you want to achieve is to index files. It's not one of the basic feature of ES but it's available as a plugin ( [GitHub - elastic/elasticsearch-mapper-attachments: Mapper Attachments Type plugin for Elasticsearch](https://github.com/elasticsearch/elasticsearch-mapper-attachments)). You have a full script here to try it: [Test of attachments plugin · GitHub](https://gist.github.com/3907010) > > > > > > > > But, it's without Hadoop. That gives me an idea for my scrutmydocs project. I should add in the FSRiver (File System River) (or create a new one) the possibility of fetching content from hdfs... > > > > > > > > Does it help? > > > > > > > > Le 27 décembre 2012 à 09:38, Tan Chween Tah \< [junda...@gmail.com](mailto:junda...@gmail.com)\> a écrit : > > > > > > > > > Thanks david > > > > > > > > > > What i am trying to do is like having big data of text or json file and put distribute it in different computer using hadoop and using Elasticsearch to query the words so it will return the result faster . > > > > > > > > > > You said it is working fine. so is there a example on how to insert a text file or json file into the Elasticsearch and i am able to query the words out. for eg. Test.txt contain words inside. and i want to search the words like "happy" inside that test.txt file .. is it possible for elasitc search to do that ? > > > > > > > > > > nope i did not try just now. but now I have try opening localhost:9200 in my browser but it throw me an error "problem loading page". > > > > > > > > > > any advice ? > > > > > > > > > > thanks > > > > > > > > > > On Thu, Dec 27, 2012 at 2:54 PM, David Pilato [da...@pilato.fr](mailto:da...@pilato.fr) wrote: > > > > > Looks like everything is working here. > > > > > What do you expect to see? > > > > > > > > > > Did you open localhost:9200 in your browser? > > > > > > > > > > -- > > > > > David 😉 > > > > > Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs > > > > > > > > > > Le 27 déc. 2012 à 06:51, Tan Chween Tah \< [junda...@gmail.com](mailto:junda...@gmail.com)\> a écrit : > > > > > Thanks for the reply David, i have tried it out before and it still not working. the terminal will be still hang > > > > > > > > > > elasticsearch-0.20.1# bin/elasticsearch -f > > > > > [2012-12-27 17:21:55,023][INFO][node] [Boomslang] {0.20.1}[2187]: initializing ... > > > > > [2012-12-27 17:21:55,034][INFO][plugins] [Boomslang] loaded , sites > > > > > [2012-12-27 17:21:58,484][INFO][node] [Boomslang] {0.20.1}[2187]: initialized > > > > > [2012-12-27 17:21:58,484][INFO][node] [Boomslang] {0.20.1}[2187]: starting ... > > > > > [2012-12-27 17:21:58,674][INFO][transport] [Boomslang] bound\_address {inet[XXX.XX.XXX.XXX:9300]}, publish\_address {inet[/XXX.XXX.XXX.XXX:9300]} > > > > > [2012-12-27 17:22:01,922][INFO][cluster.service] [Boomslang] new\_master [Boomslang][DuJAy1WLSdij0PNFPLt\_0g][inet[/XXX.XXX.XXX.XXX:9300]], reason: zen-disco-join (elected\_as\_master) > > > > > [2012-12-27 17:22:01,971][INFO][discovery] [Boomslang] elasticsearch/DuJAy1WLSdij0PNFPLt\_0g > > > > > [2012-12-27 17:22:02,010][INFO][http] [Boomslang] bound\_address {inet[/XXX.XXX.XXX.XXX:9200]}, publish\_address {inet[/XXX.XXX.XXX.XXX:9200]} > > > > > [2012-12-27 17:22:02,010][INFO][node] [Boomslang] {0.20.1}[2187]: started > > > > > [2012-12-27 17:22:02,081][INFO][gateway] [Boomslang] recovered [0] indices into cluster\_state > > > > > > > > > > I have read th website u have send me but i did not see anything regarding such error . > > > > > > > > > > Thanks > > > > > On Thu, Dec 27, 2012 at 12:36 PM, David Pilato [da...@pilato.fr](mailto:da...@pilato.fr) wrote: > > > > > Welcome. > > > > > > > > > > 1st, try to run ES in standalone (without Hadoop): download, unzip, launch bin/elasticsearch -f (from UNIX), bin/elasticsearch.bat from windows > > > > > 2nd, in another shell, try curl localhost:9200 > > > > > If you use windows, open this URL from a browser. > > > > > > > > > > If it doesn't work, check that you have a Java (6 or 7) somewhere and that JAVA\_HOME is defined. > > > > > > > > > > If it still does not work, report here any error you can see in logs. > > > > > > > > > > BTW, read this: [Elasticsearch Platform — Find real-time answers at scale | Elastic](http://www.elasticsearch.org/guide/reference/setup/installation.html) > > > > > > > > > > HTH > > > > > > > > > > -- > > > > > David 😉 > > > > > Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs > > > > > > > > > > Le 27 déc. 2012 à 06:15, [junda...@gmail.com](mailto:junda...@gmail.com) a écrit : > > > > > Hi all > > > > > > > > > > I am new to elasictc search. got some problem here setting up elasictic search. i got a hadoop running up now . one master and one slave . but after i download Elasticsearch and try to run /bin/elasticsearch -f. it hangs there at some command line .. can i know what i need to change in the config folder ? as i don't really understand the steps on the Elasticsearch website. can anyone got any better website for me to try it and refer.. > > > > > > > > > > Thanks > > > > > Regards > > > > > > > > > > -- > > > > > > > > > > -- > > > > > > > > > > -- > > > > > > > > > > -- > > > > > > > > > > -- > > > > > > > > > > -- > > > > > David Pilato > > > > > [http://www.scrutmydocs.org/](http://www.scrutmydocs.org/) > > > > > [http://dev.david.pilato.fr/](http://dev.david.pilato.fr/) > > > > > Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs > > > > > > -- > > > David Pilato > > > [http://www.scrutmydocs.org/](http://www.scrutmydocs.org/) > > > [http://dev.david.pilato.fr/](http://dev.david.pilato.fr/) > > > Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs > > > > > > -- > > > > > > -- > > > > ## -- David Pilato [http://www.scrutmydocs.org/](http://www.scrutmydocs.org/) [http://dev.david.pilato.fr/](http://dev.david.pilato.fr/) Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs -- -- ---
**Author:** ![Tan\_Chween\_Tah](https://avatars.discourse-cdn.com/v4/letter/t/ba9def/32.png) [@Tan\_Chween\_Tah](https://discuss.elastic.co/u/Tan_Chween_Tah)\ **Post date:** [December 28, 2012, 7:41am UTC](https://discuss.elastic.co/t/elastic-search-and-hadoop/10178/15 "2012-12-28T07:41:24Z")
so u mean curl does not come with eleasticsearch-0.20.1 version? On Fri, Dec 28, 2012 at 2:36 PM, David Pilato [david@pilato.fr](mailto:david@pilato.fr) wrote: > So you don't have curl on your system. > Install it or add it in your Path... > > -- > David 😉 > Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs > > Le 28 déc. 2012 à 08:19, Tan Chween Tah [jundatan85@gmail.com](mailto:jundatan85@gmail.com) a écrit : > > i create the file.sh file and place the code > #!/bin/sh > > # > > [http://cloud.github.com/downloads/elasticsearch/elasticsearch/elasticsearch-0.19.10.zip](http://cloud.github.com/downloads/elasticsearch/elasticsearch/elasticsearch-0.19.10.zip) > > #unzip elasticsearch-0.19.10.zip > > #elasticsearch-0.19.10/bin/plugin -install > elasticsearch/elasticsearch-mapper-attachments/1.6.0 > > ../../usr/local/elasticsearch-0.20.1/bin/elasticsearch > > sleep 10 > > host=localhost:9200 > > curl -X DELETE "${host}/test" > > curl -X PUT "${host}/test" -d '{ > > "settings" : { "index" : { "number\_of\_shards" : 1, "number\_of\_replicas" : > 0 }} > > }' > > curl -X GET > "${host}/\_cluster/health?wait\_for\_status=green&pretty=1&timeout=5s" > > curl -X PUT "${host}/test/attachment/\_mapping" -d '{ > > "attachment" : { > > "properties" : { > > "file" : { > > "type" : "attachment", > > "fields" : { > > "title" : { "store" : "yes" }, > > "file" : { "term\_vector":"with\_positions\_offsets", "store":"yes" } > > } > > } > > } > > } > > }' > > curl -C - -O > [Renesas Electronics Corporation](http://www.intersil.com/content/dam/Intersil/documents/fn67/fn6742.pdf) > > coded=`cat fn6742.pdf | perl -MMIME::Base64 -ne 'print encode_base64($_)'` > > json="{"file":"${coded}"}" > > echo "$json" \> json.file > > curl -X POST "${host}/test/attachment/" -d @json.file > > echo > > curl -XPOST "${host}/\_refresh" > > curl "${host}/\_search?pretty=true" -d '{ > > "fields" : ["title"], > > "query" : { > > "query\_string" : { > > "query" : "amplifier" > > } > > }, > > "highlight" : { > > "fields" : { > > "file" : {} > > } > > } > > }' > i run the file.sh from my terminal. it will said > ./file.sh: 31: ./file.sh: curl: not found > ./file.sh: 39: ./file.sh: curl: not found > ./file.sh: 43: ./file.sh: curl: not found > ./file.sh: 71: ./file.sh: curl: not found > cat: fn6742.pdf: No such file or directory > ./file.sh: 81: ./file.sh: curl: not found > > ./file.sh: 87: ./file.sh: curl: not found > ./file.sh: 91: ./file.sh: curl: not found > > On Fri, Dec 28, 2012 at 12:11 PM, Tan Chween Tah [jundatan85@gmail.com](mailto:jundatan85@gmail.com)wrote: > > > hi thanks but the attachment don't seem to be working too . > > > > On Thu, Dec 27, 2012 at 5:31 PM, David Pilato [david@pilato.fr](mailto:david@pilato.fr) wrote: > > > > > \*\* > > > Cool. > > > Try to play with attachments now: Follow this script[https://gist.github.com/3907010](https://gist.github.com/3907010). > > > > > > Le 27 décembre 2012 à 11:25, Tan Chween Tah [jundatan85@gmail.com](mailto:jundatan85@gmail.com) a > > > écrit : > > > > > > ok it works now .. i can see the localhost:9200 which will return me > > > > > > { > > > "ok" : true, > > > "status" : 200, > > > "name" : "Strong Guy", > > > "version" : { > > > "number" : "0.20.1", > > > "snapshot\_build" : false > > > }, > > > "tagline" : "You Know, for Search" > > > } > > > > > > this mean that it is working fine and running. i will take a look again for the things i mention before. > > > Thanks for your helps David . > > > any advice on what is my next step after i get this ES running. > > > > > > On Thu, Dec 27, 2012 at 4:59 PM, David Pilato [david@pilato.fr](mailto:david@pilato.fr) wrote: > > > > > > Please keep the thread in the mailing list scope. Not outside (don't > > > send direct mails). > > > > > > OK. Here are the steps you have to follow: > > > 1/ stop all running shells and open a new one > > > Just check if you have an elasticsearch running in the background ( ps > > > -ef | grep elasticsearch ) and kill the process if you find one. > > > 2/ on a fresh clean elasticsearch dir (you should not find data, logs > > > dir), start bin/elasticsearch -f > > > 3/ open a new shell and type curl [http://localhost:9200](http://localhost:9200) > > > > > > What happens? > > > > > > Le 27 décembre 2012 à 10:48, [jundatan85@gmail.com](mailto:jundatan85@gmail.com) a écrit : > > > > > > ok thanks. i will take a look later. > > > > > > i am using ubuntu linux and using a root account > > > > > > let solve the problem that my ES instance is not working. when i type > > > in locahost:9200 it said "unable to connect tp server at localhost:9200" > > > > > > On Thursday, December 27, 2012 5:30:44 PM UTC+8, David Pilato wrote: > > > > > > Ok. First, you have to make sure that your ES instance is working > > > fine. > > > You should be able to do a curl localhost:9200 and see a JSON. If not, > > > don't go to the next steps and fix your problem! (BTW, tell me if you run > > > under linux or windows). > > > > > > What you want to achieve is to index files. It's not one of the basic > > > feature of ES but it's available as a plugin ( [GitHub - elastic/elasticsearch-mapper-attachments: Mapper Attachments Type plugin for Elasticsearch](https://github.com/elasticsearch/elasticsearch-mapper-attachments)). > > > You have a full script here to try it: > > > [https://github.com/elasticsearch/elasticsearch-mapper-attachments](https://github.com/elasticsearch/elasticsearch-mapper-attachments) [Test of attachments plugin · GitHub](https://gist.github.com/3907010) > > > > > > But, it's without Hadoop. That gives me an idea for my > > > [https://gist.github.com/3907010](https://gist.github.com/3907010) scrutmydocs[http://www.scrutmydocs.org/](http://www.scrutmydocs.org/) project. > > > I should add in the FSRiver (File System River) (or create a new one) the > > > possibility of fetching content from hdfs... > > > > > > Does it help? > > > > > > Le 27 décembre 2012 à 09:38, Tan Chween Tah \< [junda...@gmail.com](mailto:junda...@gmail.com)\> a > > > écrit : > > > > > > Thanks david > > > > > > What i am trying to do is like having big data of text or json file and > > > put distribute it in different computer using hadoop and using elastic > > > search to query the words so it will return the result faster . > > > > > > You said it is working fine. so is there a example on how to insert a > > > text file or json file into the Elasticsearch and i am able to query the > > > words out. for eg. Test.txt contain words inside. and i want to search the > > > words like "happy" inside that test.txt file .. is it possible for elasitc > > > search to do that ? > > > > > > nope i did not try just now. but now I have try opening localhost:9200 > > > in my browser but it throw me an error "problem loading page". > > > > > > any advice ? > > > > > > thanks > > > > > > On Thu, Dec 27, 2012 at 2:54 PM, David Pilato [da...@pilato.fr](mailto:da...@pilato.fr)wrote: > > > > > > Looks like everything is working here. > > > What do you expect to see? > > > > > > Did you open localhost:9200 in your browser? > > > > > > -- > > > David 😉 > > > Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs > > > > > > Le 27 déc. 2012 à 06:51, Tan Chween Tah \< [junda...@gmail.com](mailto:junda...@gmail.com)\> a écrit : > > > Thanks for the reply David, i have tried it out before and it still > > > not working. the terminal will be still hang > > > > > > elasticsearch-0.20.1# bin/elasticsearch -f > > > [2012-12-27 17:21:55,023][INFO][node] [Boomslang] > > > {0.20.1}[2187]: initializing ... > > > [2012-12-27 17:21:55,034][INFO][plugins] [Boomslang] > > > loaded , sites > > > [2012-12-27 17:21:58,484][INFO][node] [Boomslang] > > > {0.20.1}[2187]: initialized > > > [2012-12-27 17:21:58,484][INFO][node] [Boomslang] > > > {0.20.1}[2187]: starting ... > > > [2012-12-27 17:21:58,674][INFO][transport] [Boomslang] > > > bound\_address {inet[XXX.XX.XXX.XXX:9300]}, publish\_address > > > {inet[/XXX.XXX.XXX.XXX:9300]} > > > [2012-12-27 17:22:01,922][INFO][cluster.service] [Boomslang] > > > new\_master > > > [Boomslang][DuJAy1WLSdij0PNFPLt\_0g][inet[/XXX.XXX.XXX.XXX:9300]], reason: > > > zen-disco-join (elected\_as\_master) > > > [2012-12-27 17:22:01,971][INFO][discovery] [Boomslang] > > > elasticsearch/DuJAy1WLSdij0PNFPLt\_0g > > > [2012-12-27 17:22:02,010][INFO][http] [Boomslang] > > > bound\_address {inet[/XXX.XXX.XXX.XXX:9200]}, publish\_address > > > {inet[/XXX.XXX.XXX.XXX:9200]} > > > [2012-12-27 17:22:02,010][INFO][node] [Boomslang] > > > {0.20.1}[2187]: started > > > [2012-12-27 17:22:02,081][INFO][gateway] [Boomslang] > > > recovered [0] indices into cluster\_state > > > > > > I have read th website u have send me but i did not see anything > > > regarding such error . > > > > > > Thanks > > > On Thu, Dec 27, 2012 at 12:36 PM, David Pilato [da...@pilato.fr](mailto:da...@pilato.fr)wrote: > > > > > > Welcome. > > > > > > 1st, try to run ES in standalone (without Hadoop): download, unzip, > > > launch bin/elasticsearch -f (from UNIX), bin/elasticsearch.bat from windows > > > 2nd, in another shell, try curl localhost:9200 > > > If you use windows, open this URL from a browser. > > > > > > If it doesn't work, check that you have a Java (6 or 7) somewhere and > > > that JAVA\_HOME is defined. > > > > > > If it still does not work, report here any error you can see in logs. > > > > > > BTW, read this: [Elasticsearch Platform — Find real-time answers at scale | Elastic](http://www.elasticsearch.org/guide/reference/setup/installation.html) > > > > > > HTH > > > > > > -- > > > David 😉 > > > Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs > > > > > > Le 27 déc. 2012 à 06:15, > > > [http://www.elasticsearch.org/guide/reference/setup/installation.html](http://www.elasticsearch.org/guide/reference/setup/installation.html) > > > [junda...@gmail.com](mailto:junda...@gmail.com) a écrit : > > > Hi all > > > > > > I am new to elasictc search. got some problem here setting up > > > elasictic search. i got a hadoop running up now . one master and one slave > > > . but after i download Elasticsearch and try to run /bin/elasticsearch -f. > > > it hangs there at some command line .. can i know what i need to change in > > > the config folder ? as i don't really understand the steps on the elastic > > > search website. can anyone got any better website for me to try it and > > > refer.. > > > > > > Thanks > > > Regards > > > > > > -- > > > > > > -- > > > > > > -- > > > > > > -- > > > > > > -- > > > > > > -- > > > David Pilato > > > [http://www.scrutmydocs.org/](http://www.scrutmydocs.org/) > > > [http://dev.david.pilato.fr/](http://dev.david.pilato.fr/) > > > Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs > > > > > > -- > > > David Pilato > > > [http://www.scrutmydocs.org/](http://www.scrutmydocs.org/) > > > [http://dev.david.pilato.fr/](http://dev.david.pilato.fr/) > > > Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs > > > > > > -- > > > > > > -- > > > > > > -- > > > David Pilato > > > [http://www.scrutmydocs.org/](http://www.scrutmydocs.org/) > > > [http://dev.david.pilato.fr/](http://dev.david.pilato.fr/) > > > Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs > > > > > > -- > > -- > > -- -- ---
**Author:** ![Tan\_Chween\_Tah](https://avatars.discourse-cdn.com/v4/letter/t/ba9def/32.png) [@Tan\_Chween\_Tah](https://discuss.elastic.co/u/Tan_Chween_Tah)\ **Post date:** [December 28, 2012, 7:54am UTC](https://discuss.elastic.co/t/elastic-search-and-hadoop/10178/16 "2012-12-28T07:54:00Z")
i search online for curl it is for php-curl do i need to install that ? On Fri, Dec 28, 2012 at 2:41 PM, Tan Chween Tah [jundatan85@gmail.com](mailto:jundatan85@gmail.com)wrote: > so u mean curl does not come with eleasticsearch-0.20.1 version? > > On Fri, Dec 28, 2012 at 2:36 PM, David Pilato [david@pilato.fr](mailto:david@pilato.fr) wrote: > > > So you don't have curl on your system. > > Install it or add it in your Path... > > > > -- > > David 😉 > > Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs > > > > Le 28 déc. 2012 à 08:19, Tan Chween Tah [jundatan85@gmail.com](mailto:jundatan85@gmail.com) a écrit : > > > > i create the file.sh file and place the code > > #!/bin/sh > > > > # > > > > [http://cloud.github.com/downloads/elasticsearch/elasticsearch/elasticsearch-0.19.10.zip](http://cloud.github.com/downloads/elasticsearch/elasticsearch/elasticsearch-0.19.10.zip) > > > > #unzip elasticsearch-0.19.10.zip > > > > #elasticsearch-0.19.10/bin/plugin -install > > elasticsearch/elasticsearch-mapper-attachments/1.6.0 > > > > ../../usr/local/elasticsearch-0.20.1/bin/elasticsearch > > > > sleep 10 > > > > host=localhost:9200 > > > > curl -X DELETE "${host}/test" > > > > curl -X PUT "${host}/test" -d '{ > > > > "settings" : { "index" : { "number\_of\_shards" : 1, "number\_of\_replicas" : > > 0 }} > > > > }' > > > > curl -X GET > > "${host}/\_cluster/health?wait\_for\_status=green&pretty=1&timeout=5s" > > > > curl -X PUT "${host}/test/attachment/\_mapping" -d '{ > > > > "attachment" : { > > > > "properties" : { > > > > "file" : { > > > > "type" : "attachment", > > > > "fields" : { > > > > "title" : { "store" : "yes" }, > > > > "file" : { "term\_vector":"with\_positions\_offsets", "store":"yes" } > > > > } > > > > } > > > > } > > > > } > > > > }' > > > > curl -C - -O > > [Renesas Electronics Corporation](http://www.intersil.com/content/dam/Intersil/documents/fn67/fn6742.pdf) > > > > coded=`cat fn6742.pdf | perl -MMIME::Base64 -ne 'print encode_base64($_)'` > > > > json="{"file":"${coded}"}" > > > > echo "$json" \> json.file > > > > curl -X POST "${host}/test/attachment/" -d @json.file > > > > echo > > > > curl -XPOST "${host}/\_refresh" > > > > curl "${host}/\_search?pretty=true" -d '{ > > > > "fields" : ["title"], > > > > "query" : { > > > > "query\_string" : { > > > > "query" : "amplifier" > > > > } > > > > }, > > > > "highlight" : { > > > > "fields" : { > > > > "file" : {} > > > > } > > > > } > > > > }' > > i run the file.sh from my terminal. it will said > > ./file.sh: 31: ./file.sh: curl: not found > > ./file.sh: 39: ./file.sh: curl: not found > > ./file.sh: 43: ./file.sh: curl: not found > > ./file.sh: 71: ./file.sh: curl: not found > > cat: fn6742.pdf: No such file or directory > > ./file.sh: 81: ./file.sh: curl: not found > > > > ./file.sh: 87: ./file.sh: curl: not found > > ./file.sh: 91: ./file.sh: curl: not found > > > > On Fri, Dec 28, 2012 at 12:11 PM, Tan Chween Tah [jundatan85@gmail.com](mailto:jundatan85@gmail.com)wrote: > > > > > hi thanks but the attachment don't seem to be working too . > > > > > > On Thu, Dec 27, 2012 at 5:31 PM, David Pilato [david@pilato.fr](mailto:david@pilato.fr) wrote: > > > > > > > \*\* > > > > Cool. > > > > Try to play with attachments now: Follow this script[https://gist.github.com/3907010](https://gist.github.com/3907010). > > > > > > > > Le 27 décembre 2012 à 11:25, Tan Chween Tah [jundatan85@gmail.com](mailto:jundatan85@gmail.com) a > > > > écrit : > > > > > > > > ok it works now .. i can see the localhost:9200 which will return me > > > > > > > > { > > > > "ok" : true, > > > > "status" : 200, > > > > "name" : "Strong Guy", > > > > "version" : { > > > > "number" : "0.20.1", > > > > "snapshot\_build" : false > > > > }, > > > > "tagline" : "You Know, for Search" > > > > } > > > > > > > > this mean that it is working fine and running. i will take a look again for the things i mention before. > > > > Thanks for your helps David . > > > > any advice on what is my next step after i get this ES running. > > > > > > > > On Thu, Dec 27, 2012 at 4:59 PM, David Pilato [david@pilato.fr](mailto:david@pilato.fr)wrote: > > > > > > > > Please keep the thread in the mailing list scope. Not outside (don't > > > > send direct mails). > > > > > > > > OK. Here are the steps you have to follow: > > > > 1/ stop all running shells and open a new one > > > > Just check if you have an elasticsearch running in the background ( ps > > > > -ef | grep elasticsearch ) and kill the process if you find one. > > > > 2/ on a fresh clean elasticsearch dir (you should not find data, logs > > > > dir), start bin/elasticsearch -f > > > > 3/ open a new shell and type curl [http://localhost:9200](http://localhost:9200) > > > > > > > > What happens? > > > > > > > > Le 27 décembre 2012 à 10:48, [jundatan85@gmail.com](mailto:jundatan85@gmail.com) a écrit : > > > > > > > > ok thanks. i will take a look later. > > > > > > > > i am using ubuntu linux and using a root account > > > > > > > > let solve the problem that my ES instance is not working. when i type > > > > in locahost:9200 it said "unable to connect tp server at localhost:9200" > > > > > > > > On Thursday, December 27, 2012 5:30:44 PM UTC+8, David Pilato wrote: > > > > > > > > Ok. First, you have to make sure that your ES instance is working > > > > fine. > > > > You should be able to do a curl localhost:9200 and see a JSON. If not, > > > > don't go to the next steps and fix your problem! (BTW, tell me if you run > > > > under linux or windows). > > > > > > > > What you want to achieve is to index files. It's not one of the basic > > > > feature of ES but it's available as a plugin ( [GitHub - elastic/elasticsearch-mapper-attachments: Mapper Attachments Type plugin for Elasticsearch](https://github.com/elasticsearch/elasticsearch-mapper-attachments)). > > > > You have a full script here to try it: > > > > [https://github.com/elasticsearch/elasticsearch-mapper-attachments](https://github.com/elasticsearch/elasticsearch-mapper-attachments) [Test of attachments plugin · GitHub](https://gist.github.com/3907010) > > > > > > > > But, it's without Hadoop. That gives me an idea for my > > > > [https://gist.github.com/3907010](https://gist.github.com/3907010) scrutmydocs[http://www.scrutmydocs.org/](http://www.scrutmydocs.org/) project. > > > > I should add in the FSRiver (File System River) (or create a new one) the > > > > possibility of fetching content from hdfs... > > > > > > > > Does it help? > > > > > > > > Le 27 décembre 2012 à 09:38, Tan Chween Tah \< [junda...@gmail.com](mailto:junda...@gmail.com)\> a > > > > écrit : > > > > > > > > Thanks david > > > > > > > > What i am trying to do is like having big data of text or json file and > > > > put distribute it in different computer using hadoop and using elastic > > > > search to query the words so it will return the result faster . > > > > > > > > You said it is working fine. so is there a example on how to insert a > > > > text file or json file into the Elasticsearch and i am able to query the > > > > words out. for eg. Test.txt contain words inside. and i want to search the > > > > words like "happy" inside that test.txt file .. is it possible for elasitc > > > > search to do that ? > > > > > > > > nope i did not try just now. but now I have try opening localhost:9200 > > > > in my browser but it throw me an error "problem loading page". > > > > > > > > any advice ? > > > > > > > > thanks > > > > > > > > On Thu, Dec 27, 2012 at 2:54 PM, David Pilato [da...@pilato.fr](mailto:da...@pilato.fr)wrote: > > > > > > > > Looks like everything is working here. > > > > What do you expect to see? > > > > > > > > Did you open localhost:9200 in your browser? > > > > > > > > -- > > > > David 😉 > > > > Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs > > > > > > > > Le 27 déc. 2012 à 06:51, Tan Chween Tah \< [junda...@gmail.com](mailto:junda...@gmail.com)\> a > > > > écrit : > > > > Thanks for the reply David, i have tried it out before and it still > > > > not working. the terminal will be still hang > > > > > > > > elasticsearch-0.20.1# bin/elasticsearch -f > > > > [2012-12-27 17:21:55,023][INFO][node] [Boomslang] > > > > {0.20.1}[2187]: initializing ... > > > > [2012-12-27 17:21:55,034][INFO][plugins] [Boomslang] > > > > loaded , sites > > > > [2012-12-27 17:21:58,484][INFO][node] [Boomslang] > > > > {0.20.1}[2187]: initialized > > > > [2012-12-27 17:21:58,484][INFO][node] [Boomslang] > > > > {0.20.1}[2187]: starting ... > > > > [2012-12-27 17:21:58,674][INFO][transport] [Boomslang] > > > > bound\_address {inet[XXX.XX.XXX.XXX:9300]}, publish\_address > > > > {inet[/XXX.XXX.XXX.XXX:9300]} > > > > [2012-12-27 17:22:01,922][INFO][cluster.service] [Boomslang] > > > > new\_master > > > > [Boomslang][DuJAy1WLSdij0PNFPLt\_0g][inet[/XXX.XXX.XXX.XXX:9300]], reason: > > > > zen-disco-join (elected\_as\_master) > > > > [2012-12-27 17:22:01,971][INFO][discovery] [Boomslang] > > > > elasticsearch/DuJAy1WLSdij0PNFPLt\_0g > > > > [2012-12-27 17:22:02,010][INFO][http] [Boomslang] > > > > bound\_address {inet[/XXX.XXX.XXX.XXX:9200]}, publish\_address > > > > {inet[/XXX.XXX.XXX.XXX:9200]} > > > > [2012-12-27 17:22:02,010][INFO][node] [Boomslang] > > > > {0.20.1}[2187]: started > > > > [2012-12-27 17:22:02,081][INFO][gateway] [Boomslang] > > > > recovered [0] indices into cluster\_state > > > > > > > > I have read th website u have send me but i did not see anything > > > > regarding such error . > > > > > > > > Thanks > > > > On Thu, Dec 27, 2012 at 12:36 PM, David Pilato [da...@pilato.fr](mailto:da...@pilato.fr)wrote: > > > > > > > > Welcome. > > > > > > > > 1st, try to run ES in standalone (without Hadoop): download, unzip, > > > > launch bin/elasticsearch -f (from UNIX), bin/elasticsearch.bat from windows > > > > 2nd, in another shell, try curl localhost:9200 > > > > If you use windows, open this URL from a browser. > > > > > > > > If it doesn't work, check that you have a Java (6 or 7) somewhere and > > > > that JAVA\_HOME is defined. > > > > > > > > If it still does not work, report here any error you can see in logs. > > > > > > > > BTW, read this: [Elasticsearch Platform — Find real-time answers at scale | Elastic](http://www.elasticsearch.org/guide/reference/setup/installation.html) > > > > > > > > HTH > > > > > > > > -- > > > > David 😉 > > > > Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs > > > > > > > > Le 27 déc. 2012 à 06:15, > > > > [http://www.elasticsearch.org/guide/reference/setup/installation.html](http://www.elasticsearch.org/guide/reference/setup/installation.html) > > > > [junda...@gmail.com](mailto:junda...@gmail.com) a écrit : > > > > Hi all > > > > > > > > I am new to elasictc search. got some problem here setting up > > > > elasictic search. i got a hadoop running up now . one master and one slave > > > > . but after i download Elasticsearch and try to run /bin/elasticsearch -f. > > > > it hangs there at some command line .. can i know what i need to change in > > > > the config folder ? as i don't really understand the steps on the elastic > > > > search website. can anyone got any better website for me to try it and > > > > refer.. > > > > > > > > Thanks > > > > Regards > > > > > > > > -- > > > > > > > > -- > > > > > > > > -- > > > > > > > > -- > > > > > > > > -- > > > > > > > > -- > > > > David Pilato > > > > [http://www.scrutmydocs.org/](http://www.scrutmydocs.org/) > > > > [http://dev.david.pilato.fr/](http://dev.david.pilato.fr/) > > > > Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs > > > > > > > > -- > > > > David Pilato > > > > [http://www.scrutmydocs.org/](http://www.scrutmydocs.org/) > > > > [http://dev.david.pilato.fr/](http://dev.david.pilato.fr/) > > > > Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs > > > > > > > > -- > > > > > > > > -- > > > > > > > > -- > > > > David Pilato > > > > [http://www.scrutmydocs.org/](http://www.scrutmydocs.org/) > > > > [http://dev.david.pilato.fr/](http://dev.david.pilato.fr/) > > > > Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs > > > > > > > > -- > > > > -- > > > > -- -- ---
**Author:** ![Ivan](https://avatars.discourse-cdn.com/v4/letter/i/df788c/32.png) [@Ivan](https://discuss.elastic.co/u/Ivan)\ **Post date:** [December 28, 2012, 7:58am UTC](https://discuss.elastic.co/t/elastic-search-and-hadoop/10178/17 "2012-12-28T07:58:01Z")
curl is a command-line utility. You should use your operating system's package manager (yum/apt-get) to install it. Do not install php-curl. Please use gist ([https://gist.github.com/](https://gist.github.com/)) when posting large amounts of code. Easier for everyone to read. -- Ivan On Thu, Dec 27, 2012 at 11:54 PM, Tan Chween Tah [jundatan85@gmail.com](mailto:jundatan85@gmail.com)wrote: > i search online for curl it is for php-curl do i need to install that ? > > On Fri, Dec 28, 2012 at 2:41 PM, Tan Chween Tah [jundatan85@gmail.com](mailto:jundatan85@gmail.com)wrote: > > > so u mean curl does not come with eleasticsearch-0.20.1 version? > > > > On Fri, Dec 28, 2012 at 2:36 PM, David Pilato [david@pilato.fr](mailto:david@pilato.fr) wrote: > > > > > So you don't have curl on your system. > > > Install it or add it in your Path... > > > > > > -- > > > David 😉 > > > Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs > > > > > > Le 28 déc. 2012 à 08:19, Tan Chween Tah [jundatan85@gmail.com](mailto:jundatan85@gmail.com) a écrit : > > > > > > i create the file.sh file and place the code > > > #!/bin/sh > > > > > > # > > > > > > [http://cloud.github.com/downloads/elasticsearch/elasticsearch/elasticsearch-0.19.10.zip](http://cloud.github.com/downloads/elasticsearch/elasticsearch/elasticsearch-0.19.10.zip) > > > > > > #unzip elasticsearch-0.19.10.zip > > > > > > #elasticsearch-0.19.10/bin/plugin -install > > > elasticsearch/elasticsearch-mapper-attachments/1.6.0 > > > > > > ../../usr/local/elasticsearch-0.20.1/bin/elasticsearch > > > > > > sleep 10 > > > > > > host=localhost:9200 > > > > > > curl -X DELETE "${host}/test" > > > > > > curl -X PUT "${host}/test" -d '{ > > > > > > "settings" : { "index" : { "number\_of\_shards" : 1, "number\_of\_replicas" > > > : 0 }} > > > > > > }' > > > > > > curl -X GET > > > "${host}/\_cluster/health?wait\_for\_status=green&pretty=1&timeout=5s" > > > > > > curl -X PUT "${host}/test/attachment/\_mapping" -d '{ > > > > > > "attachment" : { > > > > > > "properties" : { > > > > > > "file" : { > > > > > > "type" : "attachment", > > > > > > "fields" : { > > > > > > "title" : { "store" : "yes" }, > > > > > > "file" : { "term\_vector":"with\_positions\_offsets", "store":"yes" } > > > > > > } > > > > > > } > > > > > > } > > > > > > } > > > > > > }' > > > > > > curl -C - -O > > > [Renesas Electronics Corporation](http://www.intersil.com/content/dam/Intersil/documents/fn67/fn6742.pdf) > > > > > > coded=`cat fn6742.pdf | perl -MMIME::Base64 -ne 'print encode_base64($_)'` > > > > > > json="{"file":"${coded}"}" > > > > > > echo "$json" \> json.file > > > > > > curl -X POST "${host}/test/attachment/" -d @json.file > > > > > > echo > > > > > > curl -XPOST "${host}/\_refresh" > > > > > > curl "${host}/\_search?pretty=true" -d '{ > > > > > > "fields" : ["title"], > > > > > > "query" : { > > > > > > "query\_string" : { > > > > > > "query" : "amplifier" > > > > > > } > > > > > > }, > > > > > > "highlight" : { > > > > > > "fields" : { > > > > > > "file" : {} > > > > > > } > > > > > > } > > > > > > }' > > > i run the file.sh from my terminal. it will said > > > ./file.sh: 31: ./file.sh: curl: not found > > > ./file.sh: 39: ./file.sh: curl: not found > > > ./file.sh: 43: ./file.sh: curl: not found > > > ./file.sh: 71: ./file.sh: curl: not found > > > cat: fn6742.pdf: No such file or directory > > > ./file.sh: 81: ./file.sh: curl: not found > > > > > > ./file.sh: 87: ./file.sh: curl: not found > > > ./file.sh: 91: ./file.sh: curl: not found > > > > > > On Fri, Dec 28, 2012 at 12:11 PM, Tan Chween Tah [jundatan85@gmail.com](mailto:jundatan85@gmail.com)wrote: > > > > > > > hi thanks but the attachment don't seem to be working too . > > > > > > > > On Thu, Dec 27, 2012 at 5:31 PM, David Pilato [david@pilato.fr](mailto:david@pilato.fr) wrote: > > > > > > > > > \*\* > > > > > Cool. > > > > > Try to play with attachments now: Follow this script[https://gist.github.com/3907010](https://gist.github.com/3907010). > > > > > > > > > > Le 27 décembre 2012 à 11:25, Tan Chween Tah [jundatan85@gmail.com](mailto:jundatan85@gmail.com) a > > > > > écrit : > > > > > > > > > > ok it works now .. i can see the localhost:9200 which will return me > > > > > > > > > > { > > > > > "ok" : true, > > > > > "status" : 200, > > > > > "name" : "Strong Guy", > > > > > "version" : { > > > > > "number" : "0.20.1", > > > > > "snapshot\_build" : false > > > > > }, > > > > > "tagline" : "You Know, for Search" > > > > > } > > > > > > > > > > this mean that it is working fine and running. i will take a look again for the things i mention before. > > > > > Thanks for your helps David . > > > > > any advice on what is my next step after i get this ES running. > > > > > > > > > > On Thu, Dec 27, 2012 at 4:59 PM, David Pilato [david@pilato.fr](mailto:david@pilato.fr)wrote: > > > > > > > > > > Please keep the thread in the mailing list scope. Not outside > > > > > (don't send direct mails). > > > > > > > > > > OK. Here are the steps you have to follow: > > > > > 1/ stop all running shells and open a new one > > > > > Just check if you have an elasticsearch running in the background ( > > > > > ps -ef | grep elasticsearch ) and kill the process if you find one. > > > > > 2/ on a fresh clean elasticsearch dir (you should not find data, logs > > > > > dir), start bin/elasticsearch -f > > > > > 3/ open a new shell and type curl [http://localhost:9200](http://localhost:9200) > > > > > > > > > > What happens? > > > > > > > > > > Le 27 décembre 2012 à 10:48, [jundatan85@gmail.com](mailto:jundatan85@gmail.com) a écrit : > > > > > > > > > > ok thanks. i will take a look later. > > > > > > > > > > i am using ubuntu linux and using a root account > > > > > > > > > > let solve the problem that my ES instance is not working. when i > > > > > type in locahost:9200 it said "unable to connect tp server at > > > > > localhost:9200" > > > > > > > > > > On Thursday, December 27, 2012 5:30:44 PM UTC+8, David Pilato wrote: > > > > > > > > > > Ok. First, you have to make sure that your ES instance is working > > > > > fine. > > > > > You should be able to do a curl localhost:9200 and see a JSON. If > > > > > not, don't go to the next steps and fix your problem! (BTW, tell me if you > > > > > run under linux or windows). > > > > > > > > > > What you want to achieve is to index files. It's not one of the basic > > > > > feature of ES but it's available as a plugin ( [GitHub - elastic/elasticsearch-mapper-attachments: Mapper Attachments Type plugin for Elasticsearch](https://github.com/elasticsearch/elasticsearch-mapper-attachments)). > > > > > You have a full script here to try it: > > > > > [https://github.com/elasticsearch/elasticsearch-mapper-attachments](https://github.com/elasticsearch/elasticsearch-mapper-attachments) [Test of attachments plugin · GitHub](https://gist.github.com/3907010) > > > > > > > > > > But, it's without Hadoop. That gives me an idea for my > > > > > [https://gist.github.com/3907010](https://gist.github.com/3907010) scrutmydocs[http://www.scrutmydocs.org/](http://www.scrutmydocs.org/) project. > > > > > I should add in the FSRiver (File System River) (or create a new one) the > > > > > possibility of fetching content from hdfs... > > > > > > > > > > Does it help? > > > > > > > > > > Le 27 décembre 2012 à 09:38, Tan Chween Tah \< [junda...@gmail.com](mailto:junda...@gmail.com)\> a > > > > > écrit : > > > > > > > > > > Thanks david > > > > > > > > > > What i am trying to do is like having big data of text or json file > > > > > and put distribute it in different computer using hadoop and using elastic > > > > > search to query the words so it will return the result faster . > > > > > > > > > > You said it is working fine. so is there a example on how to insert a > > > > > text file or json file into the Elasticsearch and i am able to query the > > > > > words out. for eg. Test.txt contain words inside. and i want to search the > > > > > words like "happy" inside that test.txt file .. is it possible for elasitc > > > > > search to do that ? > > > > > > > > > > nope i did not try just now. but now I have try opening localhost:9200 > > > > > in my browser but it throw me an error "problem loading page". > > > > > > > > > > any advice ? > > > > > > > > > > thanks > > > > > > > > > > On Thu, Dec 27, 2012 at 2:54 PM, David Pilato [da...@pilato.fr](mailto:da...@pilato.fr)wrote: > > > > > > > > > > Looks like everything is working here. > > > > > What do you expect to see? > > > > > > > > > > Did you open localhost:9200 in your browser? > > > > > > > > > > -- > > > > > David 😉 > > > > > Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs > > > > > > > > > > Le 27 déc. 2012 à 06:51, Tan Chween Tah \< [junda...@gmail.com](mailto:junda...@gmail.com)\> a > > > > > écrit : > > > > > Thanks for the reply David, i have tried it out before and it still > > > > > not working. the terminal will be still hang > > > > > > > > > > elasticsearch-0.20.1# bin/elasticsearch -f > > > > > [2012-12-27 17:21:55,023][INFO][node] > > > > > [Boomslang] {0.20.1}[2187]: initializing ... > > > > > [2012-12-27 17:21:55,034][INFO][plugins] > > > > > [Boomslang] loaded , sites > > > > > [2012-12-27 17:21:58,484][INFO][node] > > > > > [Boomslang] {0.20.1}[2187]: initialized > > > > > [2012-12-27 17:21:58,484][INFO][node] > > > > > [Boomslang] {0.20.1}[2187]: starting ... > > > > > [2012-12-27 17:21:58,674][INFO][transport] > > > > > [Boomslang] bound\_address {inet[XXX.XX.XXX.XXX:9300]}, publish\_address > > > > > {inet[/XXX.XXX.XXX.XXX:9300]} > > > > > [2012-12-27 17:22:01,922][INFO][cluster.service] > > > > > [Boomslang] new\_master > > > > > [Boomslang][DuJAy1WLSdij0PNFPLt\_0g][inet[/XXX.XXX.XXX.XXX:9300]], reason: > > > > > zen-disco-join (elected\_as\_master) > > > > > [2012-12-27 17:22:01,971][INFO][discovery] > > > > > [Boomslang] elasticsearch/DuJAy1WLSdij0PNFPLt\_0g > > > > > [2012-12-27 17:22:02,010][INFO][http] > > > > > [Boomslang] bound\_address {inet[/XXX.XXX.XXX.XXX:9200]}, publish\_address > > > > > {inet[/XXX.XXX.XXX.XXX:9200]} > > > > > [2012-12-27 17:22:02,010][INFO][node] > > > > > [Boomslang] {0.20.1}[2187]: started > > > > > [2012-12-27 17:22:02,081][INFO][gateway] > > > > > [Boomslang] recovered [0] indices into cluster\_state > > > > > > > > > > I have read th website u have send me but i did not see anything > > > > > regarding such error . > > > > > > > > > > Thanks > > > > > On Thu, Dec 27, 2012 at 12:36 PM, David Pilato [da...@pilato.fr](mailto:da...@pilato.fr)wrote: > > > > > > > > > > Welcome. > > > > > > > > > > 1st, try to run ES in standalone (without Hadoop): download, unzip, > > > > > launch bin/elasticsearch -f (from UNIX), bin/elasticsearch.bat from windows > > > > > 2nd, in another shell, try curl localhost:9200 > > > > > If you use windows, open this URL from a browser. > > > > > > > > > > If it doesn't work, check that you have a Java (6 or 7) somewhere and > > > > > that JAVA\_HOME is defined. > > > > > > > > > > If it still does not work, report here any error you can see in logs. > > > > > > > > > > BTW, read this: [Elasticsearch Platform — Find real-time answers at scale | Elastic](http://www.elasticsearch.org/guide/reference/setup/installation.html) > > > > > > > > > > HTH > > > > > > > > > > -- > > > > > David 😉 > > > > > Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs > > > > > > > > > > Le 27 déc. 2012 à 06:15, > > > > > [http://www.elasticsearch.org/guide/reference/setup/installation.html](http://www.elasticsearch.org/guide/reference/setup/installation.html) > > > > > [junda...@gmail.com](mailto:junda...@gmail.com) a écrit : > > > > > Hi all > > > > > > > > > > I am new to elasictc search. got some problem here setting up > > > > > elasictic search. i got a hadoop running up now . one master and one slave > > > > > . but after i download Elasticsearch and try to run /bin/elasticsearch -f. > > > > > it hangs there at some command line .. can i know what i need to change in > > > > > the config folder ? as i don't really understand the steps on the elastic > > > > > search website. can anyone got any better website for me to try it and > > > > > refer.. > > > > > > > > > > Thanks > > > > > Regards > > > > > > > > > > -- > > > > > > > > > > -- > > > > > > > > > > -- > > > > > > > > > > -- > > > > > > > > > > -- > > > > > > > > > > -- > > > > > David Pilato > > > > > [http://www.scrutmydocs.org/](http://www.scrutmydocs.org/) > > > > > [http://dev.david.pilato.fr/](http://dev.david.pilato.fr/) > > > > > Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs > > > > > > > > > > -- > > > > > David Pilato > > > > > [http://www.scrutmydocs.org/](http://www.scrutmydocs.org/) > > > > > [http://dev.david.pilato.fr/](http://dev.david.pilato.fr/) > > > > > Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs > > > > > > > > > > -- > > > > > > > > > > -- > > > > > > > > > > -- > > > > > David Pilato > > > > > [http://www.scrutmydocs.org/](http://www.scrutmydocs.org/) > > > > > [http://dev.david.pilato.fr/](http://dev.david.pilato.fr/) > > > > > Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs > > > > > > > > > > -- > > > > > > -- > > > > > > -- > > -- -- ---
**Author:** ![Tan\_Chween\_Tah](https://avatars.discourse-cdn.com/v4/letter/t/ba9def/32.png) [@Tan\_Chween\_Tah](https://discuss.elastic.co/u/Tan_Chween_Tah)\ **Post date:** [December 28, 2012, 9:01am UTC](https://discuss.elastic.co/t/elastic-search-and-hadoop/10178/18 "2012-12-28T09:01:31Z")
Thanks after installing the curl on my linux system and i ran the file.sh file i was return with some mapping error {"ok":true,"acknowledged":true}{"ok":true,"acknowledged":true}{ "cluster\_name" : "elasticsearch", "status" : "green", "timed\_out" : false, "number\_of\_nodes" : 6, "number\_of\_data\_nodes" : 6, "active\_primary\_shards" : 1, "active\_shards" : 1, "relocating\_shards" : 0, "initializing\_shards" : 0, "unassigned\_shards" : 0 }{"error":"MapperParsingException[No handler for type [attachment] declared on field [file]]","status":400}\*\* Resuming transfer from byte position 416315 % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 406k 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 curl: (33) HTTP server doesn't seem to support byte ranges. Cannot resume. {"ok":true,"\_index":"test","\_type":"attachment","\_id":"5vC4T4jOTvKqDzZqqBpG9w","\_version":1} {"ok":true,"\_shards":{"total":1,"successful":1,"failed":0}}{ "took" : 78, "timed\_out" : false, "\_shards" : { "total" : 1, "successful" : 1, "failed" : 0 }, "hits" : { "total" : 0, "max\_score" : null, "hits" : } any idea ? On Fri, Dec 28, 2012 at 2:58 PM, Ivan Brusic [ivan@brusic.com](mailto:ivan@brusic.com) wrote: > curl is a command-line utility. You should use your operating system's > package manager (yum/apt-get) to install it. Do not install php-curl. > > Please use gist ([https://gist.github.com/](https://gist.github.com/)) when posting large amounts of > code. Easier for everyone to read. > > -- > Ivan > > On Thu, Dec 27, 2012 at 11:54 PM, Tan Chween Tah [jundatan85@gmail.com](mailto:jundatan85@gmail.com)wrote: > > > i search online for curl it is for php-curl do i need to install that ? > > > > On Fri, Dec 28, 2012 at 2:41 PM, Tan Chween Tah [jundatan85@gmail.com](mailto:jundatan85@gmail.com)wrote: > > > > > so u mean curl does not come with eleasticsearch-0.20.1 version? > > > > > > On Fri, Dec 28, 2012 at 2:36 PM, David Pilato [david@pilato.fr](mailto:david@pilato.fr) wrote: > > > > > > > So you don't have curl on your system. > > > > Install it or add it in your Path... > > > > > > > > -- > > > > David 😉 > > > > Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs > > > > > > > > Le 28 déc. 2012 à 08:19, Tan Chween Tah [jundatan85@gmail.com](mailto:jundatan85@gmail.com) a > > > > écrit : > > > > > > > > i create the file.sh file and place the code > > > > #!/bin/sh > > > > > > > > # > > > > > > > > [http://cloud.github.com/downloads/elasticsearch/elasticsearch/elasticsearch-0.19.10.zip](http://cloud.github.com/downloads/elasticsearch/elasticsearch/elasticsearch-0.19.10.zip) > > > > > > > > #unzip elasticsearch-0.19.10.zip > > > > > > > > #elasticsearch-0.19.10/bin/plugin -install > > > > elasticsearch/elasticsearch-mapper-attachments/1.6.0 > > > > > > > > ../../usr/local/elasticsearch-0.20.1/bin/elasticsearch > > > > > > > > sleep 10 > > > > > > > > host=localhost:9200 > > > > > > > > curl -X DELETE "${host}/test" > > > > > > > > curl -X PUT "${host}/test" -d '{ > > > > > > > > "settings" : { "index" : { "number\_of\_shards" : 1, "number\_of\_replicas" > > > > : 0 }} > > > > > > > > }' > > > > > > > > curl -X GET > > > > "${host}/\_cluster/health?wait\_for\_status=green&pretty=1&timeout=5s" > > > > > > > > curl -X PUT "${host}/test/attachment/\_mapping" -d '{ > > > > > > > > "attachment" : { > > > > > > > > "properties" : { > > > > > > > > "file" : { > > > > > > > > "type" : "attachment", > > > > > > > > "fields" : { > > > > > > > > "title" : { "store" : "yes" }, > > > > > > > > "file" : { "term\_vector":"with\_positions\_offsets", "store":"yes" } > > > > > > > > } > > > > > > > > } > > > > > > > > } > > > > > > > > } > > > > > > > > }' > > > > > > > > curl -C - -O > > > > [Renesas Electronics Corporation](http://www.intersil.com/content/dam/Intersil/documents/fn67/fn6742.pdf) > > > > > > > > coded=`cat fn6742.pdf | perl -MMIME::Base64 -ne 'print encode_base64($_)'` > > > > > > > > json="{"file":"${coded}"}" > > > > > > > > echo "$json" \> json.file > > > > > > > > curl -X POST "${host}/test/attachment/" -d @json.file > > > > > > > > echo > > > > > > > > curl -XPOST "${host}/\_refresh" > > > > > > > > curl "${host}/\_search?pretty=true" -d '{ > > > > > > > > "fields" : ["title"], > > > > > > > > "query" : { > > > > > > > > "query\_string" : { > > > > > > > > "query" : "amplifier" > > > > > > > > } > > > > > > > > }, > > > > > > > > "highlight" : { > > > > > > > > "fields" : { > > > > > > > > "file" : {} > > > > > > > > } > > > > > > > > } > > > > > > > > }' > > > > i run the file.sh from my terminal. it will said > > > > ./file.sh: 31: ./file.sh: curl: not found > > > > ./file.sh: 39: ./file.sh: curl: not found > > > > ./file.sh: 43: ./file.sh: curl: not found > > > > ./file.sh: 71: ./file.sh: curl: not found > > > > cat: fn6742.pdf: No such file or directory > > > > ./file.sh: 81: ./file.sh: curl: not found > > > > > > > > ./file.sh: 87: ./file.sh: curl: not found > > > > ./file.sh: 91: ./file.sh: curl: not found > > > > > > > > On Fri, Dec 28, 2012 at 12:11 PM, Tan Chween Tah [jundatan85@gmail.com](mailto:jundatan85@gmail.com)wrote: > > > > > > > > > hi thanks but the attachment don't seem to be working too . > > > > > > > > > > On Thu, Dec 27, 2012 at 5:31 PM, David Pilato [david@pilato.fr](mailto:david@pilato.fr) wrote: > > > > > > > > > > > \*\* > > > > > > Cool. > > > > > > Try to play with attachments now: Follow this script[https://gist.github.com/3907010](https://gist.github.com/3907010). > > > > > > > > > > > > Le 27 décembre 2012 à 11:25, Tan Chween Tah [jundatan85@gmail.com](mailto:jundatan85@gmail.com) a > > > > > > écrit : > > > > > > > > > > > > ok it works now .. i can see the localhost:9200 which will return me > > > > > > > > > > > > { > > > > > > "ok" : true, > > > > > > "status" : 200, > > > > > > "name" : "Strong Guy", > > > > > > "version" : { > > > > > > "number" : "0.20.1", > > > > > > "snapshot\_build" : false > > > > > > }, > > > > > > "tagline" : "You Know, for Search" > > > > > > } > > > > > > > > > > > > this mean that it is working fine and running. i will take a look again for the things i mention before. > > > > > > Thanks for your helps David . > > > > > > any advice on what is my next step after i get this ES running. > > > > > > > > > > > > On Thu, Dec 27, 2012 at 4:59 PM, David Pilato [david@pilato.fr](mailto:david@pilato.fr)wrote: > > > > > > > > > > > > Please keep the thread in the mailing list scope. Not outside > > > > > > (don't send direct mails). > > > > > > > > > > > > OK. Here are the steps you have to follow: > > > > > > 1/ stop all running shells and open a new one > > > > > > Just check if you have an elasticsearch running in the background ( > > > > > > ps -ef | grep elasticsearch ) and kill the process if you find one. > > > > > > 2/ on a fresh clean elasticsearch dir (you should not find data, > > > > > > logs dir), start bin/elasticsearch -f > > > > > > 3/ open a new shell and type curl [http://localhost:9200](http://localhost:9200) > > > > > > > > > > > > What happens? > > > > > > > > > > > > Le 27 décembre 2012 à 10:48, [jundatan85@gmail.com](mailto:jundatan85@gmail.com) a écrit : > > > > > > > > > > > > ok thanks. i will take a look later. > > > > > > > > > > > > i am using ubuntu linux and using a root account > > > > > > > > > > > > let solve the problem that my ES instance is not working. when i > > > > > > type in locahost:9200 it said "unable to connect tp server at > > > > > > localhost:9200" > > > > > > > > > > > > On Thursday, December 27, 2012 5:30:44 PM UTC+8, David Pilato wrote: > > > > > > > > > > > > Ok. First, you have to make sure that your ES instance is working > > > > > > fine. > > > > > > You should be able to do a curl localhost:9200 and see a JSON. If > > > > > > not, don't go to the next steps and fix your problem! (BTW, tell me if you > > > > > > run under linux or windows). > > > > > > > > > > > > What you want to achieve is to index files. It's not one of the > > > > > > basic feature of ES but it's available as a plugin ( [GitHub - elastic/elasticsearch-mapper-attachments: Mapper Attachments Type plugin for Elasticsearch](https://github.com/elasticsearch/elasticsearch-mapper-attachments)). > > > > > > You have a full script here to try it: > > > > > > [https://github.com/elasticsearch/elasticsearch-mapper-attachments](https://github.com/elasticsearch/elasticsearch-mapper-attachments) [Test of attachments plugin · GitHub](https://gist.github.com/3907010) > > > > > > > > > > > > But, it's without Hadoop. That gives me an idea for my > > > > > > [https://gist.github.com/3907010](https://gist.github.com/3907010) scrutmydocs[http://www.scrutmydocs.org/](http://www.scrutmydocs.org/) project. > > > > > > I should add in the FSRiver (File System River) (or create a new one) the > > > > > > possibility of fetching content from hdfs... > > > > > > > > > > > > Does it help? > > > > > > > > > > > > Le 27 décembre 2012 à 09:38, Tan Chween Tah \< [junda...@gmail.com](mailto:junda...@gmail.com)\> a > > > > > > écrit : > > > > > > > > > > > > Thanks david > > > > > > > > > > > > What i am trying to do is like having big data of text or json file > > > > > > and put distribute it in different computer using hadoop and using elastic > > > > > > search to query the words so it will return the result faster . > > > > > > > > > > > > You said it is working fine. so is there a example on how to insert a > > > > > > text file or json file into the Elasticsearch and i am able to query the > > > > > > words out. for eg. Test.txt contain words inside. and i want to search the > > > > > > words like "happy" inside that test.txt file .. is it possible for elasitc > > > > > > search to do that ? > > > > > > > > > > > > nope i did not try just now. but now I have try opening > > > > > > localhost:9200 in my browser but it throw me an error "problem loading > > > > > > page". > > > > > > > > > > > > any advice ? > > > > > > > > > > > > thanks > > > > > > > > > > > > On Thu, Dec 27, 2012 at 2:54 PM, David Pilato [da...@pilato.fr](mailto:da...@pilato.fr)wrote: > > > > > > > > > > > > Looks like everything is working here. > > > > > > What do you expect to see? > > > > > > > > > > > > Did you open localhost:9200 in your browser? > > > > > > > > > > > > -- > > > > > > David 😉 > > > > > > Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs > > > > > > > > > > > > Le 27 déc. 2012 à 06:51, Tan Chween Tah \< [junda...@gmail.com](mailto:junda...@gmail.com)\> a > > > > > > écrit : > > > > > > Thanks for the reply David, i have tried it out before and it > > > > > > still not working. the terminal will be still hang > > > > > > > > > > > > elasticsearch-0.20.1# bin/elasticsearch -f > > > > > > [2012-12-27 17:21:55,023][INFO][node] > > > > > > [Boomslang] {0.20.1}[2187]: initializing ... > > > > > > [2012-12-27 17:21:55,034][INFO][plugins] > > > > > > [Boomslang] loaded , sites > > > > > > [2012-12-27 17:21:58,484][INFO][node] > > > > > > [Boomslang] {0.20.1}[2187]: initialized > > > > > > [2012-12-27 17:21:58,484][INFO][node] > > > > > > [Boomslang] {0.20.1}[2187]: starting ... > > > > > > [2012-12-27 17:21:58,674][INFO][transport] > > > > > > [Boomslang] bound\_address {inet[XXX.XX.XXX.XXX:9300]}, publish\_address > > > > > > {inet[/XXX.XXX.XXX.XXX:9300]} > > > > > > [2012-12-27 17:22:01,922][INFO][cluster.service] > > > > > > [Boomslang] new\_master > > > > > > [Boomslang][DuJAy1WLSdij0PNFPLt\_0g][inet[/XXX.XXX.XXX.XXX:9300]], reason: > > > > > > zen-disco-join (elected\_as\_master) > > > > > > [2012-12-27 17:22:01,971][INFO][discovery] > > > > > > [Boomslang] elasticsearch/DuJAy1WLSdij0PNFPLt\_0g > > > > > > [2012-12-27 17:22:02,010][INFO][http] > > > > > > [Boomslang] bound\_address {inet[/XXX.XXX.XXX.XXX:9200]}, publish\_address > > > > > > {inet[/XXX.XXX.XXX.XXX:9200]} > > > > > > [2012-12-27 17:22:02,010][INFO][node] > > > > > > [Boomslang] {0.20.1}[2187]: started > > > > > > [2012-12-27 17:22:02,081][INFO][gateway] > > > > > > [Boomslang] recovered [0] indices into cluster\_state > > > > > > > > > > > > I have read th website u have send me but i did not see anything > > > > > > regarding such error . > > > > > > > > > > > > Thanks > > > > > > On Thu, Dec 27, 2012 at 12:36 PM, David Pilato [da...@pilato.fr](mailto:da...@pilato.fr)wrote: > > > > > > > > > > > > Welcome. > > > > > > > > > > > > 1st, try to run ES in standalone (without Hadoop): download, unzip, > > > > > > launch bin/elasticsearch -f (from UNIX), bin/elasticsearch.bat from windows > > > > > > 2nd, in another shell, try curl localhost:9200 > > > > > > If you use windows, open this URL from a browser. > > > > > > > > > > > > If it doesn't work, check that you have a Java (6 or 7) somewhere > > > > > > and that JAVA\_HOME is defined. > > > > > > > > > > > > If it still does not work, report here any error you can see in > > > > > > logs. > > > > > > > > > > > > BTW, read this: [Elasticsearch Platform — Find real-time answers at scale | Elastic](http://www.elasticsearch.org/guide/reference/setup/installation.html) > > > > > > > > > > > > HTH > > > > > > > > > > > > -- > > > > > > David 😉 > > > > > > Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs > > > > > > > > > > > > Le 27 déc. 2012 à 06:15, > > > > > > [http://www.elasticsearch.org/guide/reference/setup/installation.html](http://www.elasticsearch.org/guide/reference/setup/installation.html) > > > > > > [junda...@gmail.com](mailto:junda...@gmail.com) a écrit : > > > > > > Hi all > > > > > > > > > > > > I am new to elasictc search. got some problem here setting up > > > > > > elasictic search. i got a hadoop running up now . one master and one slave > > > > > > . but after i download Elasticsearch and try to run /bin/elasticsearch -f. > > > > > > it hangs there at some command line .. can i know what i need to change in > > > > > > the config folder ? as i don't really understand the steps on the elastic > > > > > > search website. can anyone got any better website for me to try it and > > > > > > refer.. > > > > > > > > > > > > Thanks > > > > > > Regards > > > > > > > > > > > > -- > > > > > > > > > > > > -- > > > > > > > > > > > > -- > > > > > > > > > > > > -- > > > > > > > > > > > > -- > > > > > > > > > > > > -- > > > > > > David Pilato > > > > > > [http://www.scrutmydocs.org/](http://www.scrutmydocs.org/) > > > > > > [http://dev.david.pilato.fr/](http://dev.david.pilato.fr/) > > > > > > Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs > > > > > > > > > > > > -- > > > > > > David Pilato > > > > > > [http://www.scrutmydocs.org/](http://www.scrutmydocs.org/) > > > > > > [http://dev.david.pilato.fr/](http://dev.david.pilato.fr/) > > > > > > Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs > > > > > > > > > > > > -- > > > > > > > > > > > > -- > > > > > > > > > > > > -- > > > > > > David Pilato > > > > > > [http://www.scrutmydocs.org/](http://www.scrutmydocs.org/) > > > > > > [http://dev.david.pilato.fr/](http://dev.david.pilato.fr/) > > > > > > Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs > > > > > > > > > > > > -- > > > > > > > > -- > > > > > > > > -- > > > > -- > > -- -- ---
**Author:** ![dadoonet](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dadoonet/32/137187_2.png) [@dadoonet](https://discuss.elastic.co/u/dadoonet)\ **Post date:** [December 28, 2012, 9:32am UTC](https://discuss.elastic.co/t/elastic-search-and-hadoop/10178/19 "2012-12-28T09:32:20Z")
The attachment plugin is not correctly setup. You probably didn't execute: bin/plugin -install elasticsearch/elasticsearch-mapper-attachments/1.6.0 and restart your ES instance. Have a look at plugin doc [https://github.com/elasticsearch/elasticsearch-mapper-attachments](https://github.com/elasticsearch/elasticsearch-mapper-attachments) . Also, look at this tutorial [http://www.elasticsearch.org/tutorials/2011/07/18/attachment-type-in-action.html](http://www.elasticsearch.org/tutorials/2011/07/18/attachment-type-in-action.html) . David. Le 28 décembre 2012 à 10:01, Tan Chween Tah [jundatan85@gmail.com](mailto:jundatan85@gmail.com) a écrit : > Thanks after installing the curl on my linux system and i ran the file.sh file > > i was return with some mapping error > > {"ok":true,"acknowledged":true}{"ok":true,"acknowledged":true}{ > "cluster\_name" : "elasticsearch", > "status" : "green", > "timed\_out" : false, > "number\_of\_nodes" : 6, > "number\_of\_data\_nodes" : 6, > "active\_primary\_shards" : 1, > "active\_shards" : 1, > "relocating\_shards" : 0, > "initializing\_shards" : 0, > "unassigned\_shards" : 0 > }{" error":"MapperParsingException[No handler for type [attachment] declared > on field [file]]","status":400}\*\* Resuming transfer from byte position 416315 > % Total % Received % Xferd Average Speed Time Time Time > Current > Dload Upload Total Spent Left Speed > 0 406k 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- > 0 > curl: (33) HTTP server doesn't seem to support byte ranges. Cannot resume. > > {"ok":true,"\_index":"test","\_type":"attachment","\_id":"5vC4T4jOTvKqDzZqqBpG9w","\_version":1} > {"ok":true,"\_shards":{"total":1,"successful":1,"failed":0}}{ > "took" : 78, > "timed\_out" : false, > "\_shards" : { > "total" : 1, > "successful" : 1, > "failed" : 0 > }, > "hits" : { > "total" : 0, > "max\_score" : null, > "hits" : > } > > any idea ? -- David Pilato [http://www.scrutmydocs.org/](http://www.scrutmydocs.org/) [http://dev.david.pilato.fr/](http://dev.david.pilato.fr/) Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs -- ---
**Author:** ![Tan\_Chween\_Tah](https://avatars.discourse-cdn.com/v4/letter/t/ba9def/32.png) [@Tan\_Chween\_Tah](https://discuss.elastic.co/u/Tan_Chween_Tah)\ **Post date:** [January 2, 2013, 5:18am UTC](https://discuss.elastic.co/t/elastic-search-and-hadoop/10178/20 "2013-01-02T05:18:51Z")
Hi Happy New Year I have install the mapper and the restart the Elasticsearch but there is still this error curl: (33) HTTP server doesn't seem to support byte ranges. Cannot resume. but the rest seems to be ok. On Fri, Dec 28, 2012 at 4:32 PM, David Pilato [david@pilato.fr](mailto:david@pilato.fr) wrote: > \*\* > The attachment plugin is not correctly setup. > You probably didn't execute: bin/plugin -install > elasticsearch/elasticsearch-mapper-attachments/1.6.0 and restart your ES > instance. > > Have a look at plugin doc[https://github.com/elasticsearch/elasticsearch-mapper-attachments](https://github.com/elasticsearch/elasticsearch-mapper-attachments). > > Also, look at this tutorial[http://www.elasticsearch.org/tutorials/2011/07/18/attachment-type-in-action.html](http://www.elasticsearch.org/tutorials/2011/07/18/attachment-type-in-action.html). > > David. > > Le 28 décembre 2012 à 10:01, Tan Chween Tah [jundatan85@gmail.com](mailto:jundatan85@gmail.com) a > écrit : > > Thanks after installing the curl on my linux system and i ran the file.sh > file > > i was return with some mapping error > > {"ok":true,"acknowledged":true}{"ok":true,"acknowledged":true}{ > "cluster\_name" : "elasticsearch", > "status" : "green", > "timed\_out" : false, > "number\_of\_nodes" : 6, > "number\_of\_data\_nodes" : 6, > "active\_primary\_shards" : 1, > "active\_shards" : 1, > "relocating\_shards" : 0, > "initializing\_shards" : 0, > "unassigned\_shards" : 0 > }{" error":"MapperParsingException[No handler for type [attachment] > declared on field [file]]","status":400}\*\* Resuming transfer from byte > position 416315 > % Total % Received % Xferd Average Speed Time Time Time > Current > Dload Upload Total Spent Left > Speed > 0 406k 0 0 0 0 0 0 --:--:-- --:--:-- > --:--:-- 0 > curl: (33) HTTP server doesn't seem to support byte ranges. Cannot resume. > {"ok":true,"\_index":"test","\_type":"attachment","\_id":"5vC4T4jOTvKqDzZqqBpG9w","\_version":1} > > {"ok":true,"\_shards":{"total":1,"successful":1,"failed":0}}{ > "took" : 78, > "timed\_out" : false, > "\_shards" : { > "total" : 1, > "successful" : 1, > "failed" : 0 > }, > "hits" : { > "total" : 0, > "max\_score" : null, > "hits" : > } > > any idea ? > > -- > David Pilato > [http://www.scrutmydocs.org/](http://www.scrutmydocs.org/) > [http://dev.david.pilato.fr/](http://dev.david.pilato.fr/) > Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs > > -- -- [Next page](https://discuss.elastic.co/t/elastic-search-and-hadoop/10178.md?page=2)