How start with elasticsearch?


(Anibal Ardid) #1

Hi ! i'm begginer with big data search engines... I only have experience
with mysql.

But in my work we need to do new project, and use big data database.

We need:

  • full text search
  • synonyms
  • related search
  • fast and scalable

So , I found elasticsearch ... but I don't know how start ... I've download
the package, but in the guides I didn't found how start to configure, load
data, etc.

best regards !

--


(David Pilato) #2

I think that the elasticsearch.org front page explains all the basics you need to know to start.

What is your problem?
Starting a node?
Indexing a doc?
Searching ?

What language do you plan to use (java, php, ruby,...) ?

--
David :wink:
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs

Le 31 oct. 2012 à 14:54, Anibal Ardid anibalardid@gmail.com a écrit :

Hi ! i'm begginer with big data search engines... I only have experience with mysql.

But in my work we need to do new project, and use big data database.

We need:

  • full text search
  • synonyms
  • related search
  • fast and scalable

So , I found elasticsearch ... but I don't know how start ... I've download the package, but in the guides I didn't found how start to configure, load data, etc.

best regards !

--


(Anibal Ardid) #3

Hi ! For example, I run elasticsearch and http://localhost:9200 works fine.
I can put data and get data from this example:
http://www.elasticsearchtutorial.com/elasticsearch-in-5-minutes.html

but, for example i dont understand how configure the "settings" , for
example to use synonyms ...
how search text in all "columns" ...

best regards !

2012/10/31 David Pilato david@pilato.fr

I think that the elasticsearch.org front page explains all the basics you
need to know to start.

What is your problem?
Starting a node?
Indexing a doc?
Searching ?

What language do you plan to use (java, php, ruby,...) ?

--
David :wink:
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs

Le 31 oct. 2012 à 14:54, Anibal Ardid anibalardid@gmail.com a écrit :

Hi ! i'm begginer with big data search engines... I only have experience
with mysql.

But in my work we need to do new project, and use big data database.

We need:

  • full text search
  • synonyms
  • related search
  • fast and scalable

So , I found elasticsearch ... but I don't know how start ... I've
download the package, but in the guides I didn't found how start to
configure, load data, etc.

best regards !

--

--

--


(David Pilato) #4

Search in all is http://www.elasticsearch.org/guide/reference/query-dsl/query-string-query.html
To use synonyms, you need to define a mapping for your fields :

Synonyms are used in an analyzer : http://www.elasticsearch.org/guide/reference/index-modules/analysis/
It's a token filter that replace one word to another at index time (and query time): http://www.elasticsearch.org/guide/reference/index-modules/analysis/synonym-tokenfilter.html

Does it help?

--
David :wink:
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs

Le 31 oct. 2012 à 15:55, Anibal Ardid anibalardid@gmail.com a écrit :

Hi ! For example, I run elasticsearch and http://localhost:9200 works fine.
I can put data and get data from this example:
http://www.elasticsearchtutorial.com/elasticsearch-in-5-minutes.html

but, for example i dont understand how configure the "settings" , for example to use synonyms ...
how search text in all "columns" ...

best regards !

2012/10/31 David Pilato david@pilato.fr

I think that the elasticsearch.org front page explains all the basics you need to know to start.

What is your problem?
Starting a node?
Indexing a doc?
Searching ?

What language do you plan to use (java, php, ruby,...) ?

--
David :wink:
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs

Le 31 oct. 2012 à 14:54, Anibal Ardid anibalardid@gmail.com a écrit :

Hi ! i'm begginer with big data search engines... I only have experience with mysql.

But in my work we need to do new project, and use big data database.

We need:

  • full text search
  • synonyms
  • related search
  • fast and scalable

So , I found elasticsearch ... but I don't know how start ... I've download the package, but in the guides I didn't found how start to configure, load data, etc.

best regards !

--

--

--


(Anibal Ardid) #5

point 1 - PERFECT !

the other ... synonym ...
i don't understand how it works ... and the settings of analyzers where
go...

i need to put the synonym with _mapping in every query ?

sorry, but for me , the documentation is not very clear :frowning:

2012/10/31 David Pilato david@pilato.fr

Search in all is
http://www.elasticsearch.org/guide/reference/query-dsl/query-string-query.html
To use synonyms, you need to define a mapping for your fields :

http://www.elasticsearch.org/guide/reference/api/admin-indices-put-mapping.html

Synonyms are used in an analyzer :
http://www.elasticsearch.org/guide/reference/index-modules/analysis/
It's a token filter that replace one word to another at index time (and
query time):
http://www.elasticsearch.org/guide/reference/index-modules/analysis/synonym-tokenfilter.html

Does it help?

--
David :wink:
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs

Le 31 oct. 2012 à 15:55, Anibal Ardid anibalardid@gmail.com a écrit :

Hi ! For example, I run elasticsearch and http://localhost:9200 works
fine.
I can put data and get data from this example:
http://www.elasticsearchtutorial.com/elasticsearch-in-5-minutes.html

but, for example i dont understand how configure the "settings" , for
example to use synonyms ...
how search text in all "columns" ...

best regards !

2012/10/31 David Pilato david@pilato.fr

I think that the elasticsearch.org front page explains all the basics
you need to know to start.

What is your problem?
Starting a node?
Indexing a doc?
Searching ?

What language do you plan to use (java, php, ruby,...) ?

--
David :wink:
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs

Le 31 oct. 2012 à 14:54, Anibal Ardid anibalardid@gmail.com a écrit :

Hi ! i'm begginer with big data search engines... I only have experience
with mysql.

But in my work we need to do new project, and use big data database.

We need:

  • full text search
  • synonyms
  • related search
  • fast and scalable

So , I found elasticsearch ... but I don't know how start ... I've
download the package, but in the guides I didn't found how start to
configure, load data, etc.

best regards !

--

--

--

--

--


(David Pilato) #6

Mapping is the definition of how ES will index your docs.
If you don't give one, ES auto guess the mapping with default settings (english language analyzer for example).

You define mapping once before sending your first doc.

One advice. Send your first doc and then get its mapping: http://www.elasticsearch.org/guide/reference/api/admin-indices-get-mapping.html

Then, delete your type: http://www.elasticsearch.org/guide/reference/api/admin-indices-delete-mapping.html

Modify the mapping you get just before and adapt it to your needs.
Then, put it in ES: http://www.elasticsearch.org/guide/reference/api/admin-indices-put-mapping.html

If you need to define your own analyzer, you will have to define it AT FIRST, when creating your index: http://www.elasticsearch.org/guide/reference/api/admin-indices-create-index.html

See also: http://www.elasticsearch.org/guide/reference/index-modules/analysis/custom-analyzer.html

To test it, I recommand the Analyze API: http://www.elasticsearch.org/guide/reference/api/admin-indices-analyze.html

BTW, with which language are you going to use ES?

--
David :wink:
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs

Le 31 oct. 2012 à 16:34, Anibal Ardid anibalardid@gmail.com a écrit :

point 1 - PERFECT !

the other ... synonym ...
i don't understand how it works ... and the settings of analyzers where go...

i need to put the synonym with _mapping in every query ?

sorry, but for me , the documentation is not very clear :frowning:

2012/10/31 David Pilato david@pilato.fr

Search in all is http://www.elasticsearch.org/guide/reference/query-dsl/query-string-query.html
To use synonyms, you need to define a mapping for your fields :

Synonyms are used in an analyzer : http://www.elasticsearch.org/guide/reference/index-modules/analysis/
It's a token filter that replace one word to another at index time (and query time): http://www.elasticsearch.org/guide/reference/index-modules/analysis/synonym-tokenfilter.html

Does it help?

--
David :wink:
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs

Le 31 oct. 2012 à 15:55, Anibal Ardid anibalardid@gmail.com a écrit :

Hi ! For example, I run elasticsearch and http://localhost:9200 works fine.
I can put data and get data from this example:
http://www.elasticsearchtutorial.com/elasticsearch-in-5-minutes.html

but, for example i dont understand how configure the "settings" , for example to use synonyms ...
how search text in all "columns" ...

best regards !

2012/10/31 David Pilato david@pilato.fr

I think that the elasticsearch.org front page explains all the basics you need to know to start.

What is your problem?
Starting a node?
Indexing a doc?
Searching ?

What language do you plan to use (java, php, ruby,...) ?

--
David :wink:
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs

Le 31 oct. 2012 à 14:54, Anibal Ardid anibalardid@gmail.com a écrit :

Hi ! i'm begginer with big data search engines... I only have experience with mysql.

But in my work we need to do new project, and use big data database.

We need:

  • full text search
  • synonyms
  • related search
  • fast and scalable

So , I found elasticsearch ... but I don't know how start ... I've download the package, but in the guides I didn't found how start to configure, load data, etc.

best regards !

--

--

--

--

--


(Anibal Ardid) #7

Thanks, but without examples I can't understand very well.

I speak spanish ...

I use PHP , and the searchs prefered are in latin.

Do you have any example of complete setup or step by step ?

2012/10/31 David Pilato david@pilato.fr

Mapping is the definition of how ES will index your docs.
If you don't give one, ES auto guess the mapping with default settings
(english language analyzer for example).

You define mapping once before sending your first doc.

One advice. Send your first doc and then get its mapping:
http://www.elasticsearch.org/guide/reference/api/admin-indices-get-mapping.html

Then, delete your type:
http://www.elasticsearch.org/guide/reference/api/admin-indices-delete-mapping.html

Modify the mapping you get just before and adapt it to your needs.
Then, put it in ES:
http://www.elasticsearch.org/guide/reference/api/admin-indices-put-mapping.html

If you need to define your own analyzer, you will have to define it AT
FIRST, when creating your index:
http://www.elasticsearch.org/guide/reference/api/admin-indices-create-index.html

See also:
http://www.elasticsearch.org/guide/reference/index-modules/analysis/custom-analyzer.html

To test it, I recommand the Analyze API:
http://www.elasticsearch.org/guide/reference/api/admin-indices-analyze.html

BTW, with which language are you going to use ES?

--
David :wink:
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs

Le 31 oct. 2012 à 16:34, Anibal Ardid anibalardid@gmail.com a écrit :

point 1 - PERFECT !

the other ... synonym ...
i don't understand how it works ... and the settings of analyzers where
go...

i need to put the synonym with _mapping in every query ?

sorry, but for me , the documentation is not very clear :frowning:

2012/10/31 David Pilato david@pilato.fr

Search in all is
http://www.elasticsearch.org/guide/reference/query-dsl/query-string-query.html
To use synonyms, you need to define a mapping for your fields :

http://www.elasticsearch.org/guide/reference/api/admin-indices-put-mapping.html

Synonyms are used in an analyzer :
http://www.elasticsearch.org/guide/reference/index-modules/analysis/
It's a token filter that replace one word to another at index time (and
query time):
http://www.elasticsearch.org/guide/reference/index-modules/analysis/synonym-tokenfilter.html

Does it help?

--
David :wink:
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs

Le 31 oct. 2012 à 15:55, Anibal Ardid anibalardid@gmail.com a écrit :

Hi ! For example, I run elasticsearch and http://localhost:9200 works
fine.
I can put data and get data from this example:
http://www.elasticsearchtutorial.com/elasticsearch-in-5-minutes.html

but, for example i dont understand how configure the "settings" , for
example to use synonyms ...
how search text in all "columns" ...

best regards !

2012/10/31 David Pilato david@pilato.fr

I think that the elasticsearch.org front page explains all the basics
you need to know to start.

What is your problem?
Starting a node?
Indexing a doc?
Searching ?

What language do you plan to use (java, php, ruby,...) ?

--
David :wink:
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs

Le 31 oct. 2012 à 14:54, Anibal Ardid anibalardid@gmail.com a écrit :

Hi ! i'm begginer with big data search engines... I only have experience
with mysql.

But in my work we need to do new project, and use big data database.

We need:

  • full text search
  • synonyms
  • related search
  • fast and scalable

So , I found elasticsearch ... but I don't know how start ... I've
download the package, but in the guides I didn't found how start to
configure, load data, etc.

best regards !

--

--

--

--

--

--

--


(ferhatsb) #8

Hi Anibal,

Our php samples and documentation may help you at client side;

http://dev.searchbox.io/php/
https://github.com/searchbox-io/php-elastica-sample

Also we will announce ES wordpress plugin soon(2-3 weeks), you can check
its source as well.

Have fun,

Ferhat
www.searchbox.io

On Wednesday, October 31, 2012 10:45:14 PM UTC+2, Anibal Ardid wrote:

Thanks, but without examples I can't understand very well.

I speak spanish ...

I use PHP , and the searchs prefered are in latin.

Do you have any example of complete setup or step by step ?

2012/10/31 David Pilato <da...@pilato.fr <javascript:>>

Mapping is the definition of how ES will index your docs.
If you don't give one, ES auto guess the mapping with default settings
(english language analyzer for example).

You define mapping once before sending your first doc.

One advice. Send your first doc and then get its mapping:
http://www.elasticsearch.org/guide/reference/api/admin-indices-get-mapping.html

Then, delete your type:
http://www.elasticsearch.org/guide/reference/api/admin-indices-delete-mapping.html

Modify the mapping you get just before and adapt it to your needs.
Then, put it in ES:
http://www.elasticsearch.org/guide/reference/api/admin-indices-put-mapping.html

If you need to define your own analyzer, you will have to define it AT
FIRST, when creating your index:
http://www.elasticsearch.org/guide/reference/api/admin-indices-create-index.html

See also:
http://www.elasticsearch.org/guide/reference/index-modules/analysis/custom-analyzer.html

To test it, I recommand the Analyze API:
http://www.elasticsearch.org/guide/reference/api/admin-indices-analyze.html

BTW, with which language are you going to use ES?

--
David :wink:
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs

Le 31 oct. 2012 à 16:34, Anibal Ardid <aniba...@gmail.com <javascript:>>
a écrit :

point 1 - PERFECT !

the other ... synonym ...
i don't understand how it works ... and the settings of analyzers where
go...

i need to put the synonym with _mapping in every query ?

sorry, but for me , the documentation is not very clear :frowning:

2012/10/31 David Pilato <da...@pilato.fr <javascript:>>

Search in all is
http://www.elasticsearch.org/guide/reference/query-dsl/query-string-query.html
To use synonyms, you need to define a mapping for your fields :

http://www.elasticsearch.org/guide/reference/api/admin-indices-put-mapping.html

Synonyms are used in an analyzer :
http://www.elasticsearch.org/guide/reference/index-modules/analysis/
It's a token filter that replace one word to another at index time (and
query time):
http://www.elasticsearch.org/guide/reference/index-modules/analysis/synonym-tokenfilter.html

Does it help?

--
David :wink:
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs

Le 31 oct. 2012 à 15:55, Anibal Ardid <aniba...@gmail.com <javascript:>>
a écrit :

Hi ! For example, I run elasticsearch and http://localhost:9200 works
fine.
I can put data and get data from this example:
http://www.elasticsearchtutorial.com/elasticsearch-in-5-minutes.html

but, for example i dont understand how configure the "settings" , for
example to use synonyms ...
how search text in all "columns" ...

best regards !

2012/10/31 David Pilato <da...@pilato.fr <javascript:>>

I think that the elasticsearch.org front page explains all the basics
you need to know to start.

What is your problem?
Starting a node?
Indexing a doc?
Searching ?

What language do you plan to use (java, php, ruby,...) ?

--
David :wink:
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs

Le 31 oct. 2012 à 14:54, Anibal Ardid <aniba...@gmail.com <javascript:>>
a écrit :

Hi ! i'm begginer with big data search engines... I only have
experience with mysql.

But in my work we need to do new project, and use big data database.

We need:

  • full text search
  • synonyms
  • related search
  • fast and scalable

So , I found elasticsearch ... but I don't know how start ... I've
download the package, but in the guides I didn't found how start to
configure, load data, etc.

best regards !

--

--

--

--

--

--

--


(Anibal Ardid) #9

best regards !
I'm developing a new web application, a search engine to my forum, but with
results of another forums.

2012/11/2 ferhatsb ferhat.sobay@gmail.com

Hi Anibal,

Our php samples and documentation may help you at client side;

http://dev.searchbox.io/php/
https://github.com/searchbox-io/php-elastica-sample

Also we will announce ES wordpress plugin soon(2-3 weeks), you can check
its source as well.

Have fun,

Ferhat
www.searchbox.io

On Wednesday, October 31, 2012 10:45:14 PM UTC+2, Anibal Ardid wrote:

Thanks, but without examples I can't understand very well.

I speak spanish ...

I use PHP , and the searchs prefered are in latin.

Do you have any example of complete setup or step by step ?

2012/10/31 David Pilato da...@pilato.fr

Mapping is the definition of how ES will index your docs.
If you don't give one, ES auto guess the mapping with default settings
(english language analyzer for example).

You define mapping once before sending your first doc.

One advice. Send your first doc and then get its mapping: http://www.**
elasticsearch.org/guide/**reference/api/admin-indices-**get-mapping.htmlhttp://www.elasticsearch.org/guide/reference/api/admin-indices-get-mapping.html

Then, delete your type: http://www.elasticsearch.org/guide/
reference/api/admin-indices-**delete-mapping.htmlhttp://www.elasticsearch.org/guide/reference/api/admin-indices-delete-mapping.html

Modify the mapping you get just before and adapt it to your needs.
Then, put it in ES: http://www.elasticsearch.**
org/guide/reference/api/admin-**indices-put-mapping.htmlhttp://www.elasticsearch.org/guide/reference/api/admin-indices-put-mapping.html

If you need to define your own analyzer, you will have to define it AT
FIRST, when creating your index: http://www.elasticsearch.org/guide/
reference/api/admin-indices-**create-index.htmlhttp://www.elasticsearch.org/guide/reference/api/admin-indices-create-index.html

See also: http://www.elasticsearch.org/guide/
reference/index-modules/**analysis/custom-analyzer.htmlhttp://www.elasticsearch.org/guide/reference/index-modules/analysis/custom-analyzer.html

To test it, I recommand the Analyze API: http://www.elasticsearch.**
org/guide/reference/api/admin-**indices-analyze.htmlhttp://www.elasticsearch.org/guide/reference/api/admin-indices-analyze.html

BTW, with which language are you going to use ES?

--
David :wink:
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs

Le 31 oct. 2012 à 16:34, Anibal Ardid aniba...@gmail.com a écrit :

point 1 - PERFECT !

the other ... synonym ...
i don't understand how it works ... and the settings of analyzers where
go...

i need to put the synonym with _mapping in every query ?

sorry, but for me , the documentation is not very clear :frowning:

2012/10/31 David Pilato da...@pilato.fr

Search in all is http://www.elasticsearch.**
org/guide/reference/query-dsl/**query-string-query.htmlhttp://www.elasticsearch.org/guide/reference/query-dsl/query-string-query.html
To use synonyms, you need to define a mapping for your fields :

Synonyms are used in an analyzer : http://www.elasticsearch.**
org/guide/reference/index-**modules/analysis/http://www.elasticsearch.org/guide/reference/index-modules/analysis/
It's a token filter that replace one word to another at index time (and
query time): http://www.elasticsearch.org/guide/
reference/index-modules/**analysis/synonym-tokenfilter.**htmlhttp://www.elasticsearch.org/guide/reference/index-modules/analysis/synonym-tokenfilter.html

Does it help?

--
David :wink:
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs

Le 31 oct. 2012 à 15:55, Anibal Ardid aniba...@gmail.com a écrit :

Hi ! For example, I run elasticsearch and http://localhost:9200 **works
fine.
I can put data and get data from this example:
http://www.**elasticsearchtutorial.com/elasticsearch-in-5-minutes.
htmlhttp://www.elasticsearchtutorial.com/elasticsearch-in-5-minutes.html

but, for example i dont understand how configure the "settings" , for
example to use synonyms ...
how search text in all "columns" ...

best regards !

2012/10/31 David Pilato da...@pilato.fr

I think that the elasticsearch.org front page explains all the basics
you need to know to start.

What is your problem?
Starting a node?
Indexing a doc?
Searching ?

What language do you plan to use (java, php, ruby,...) ?

--
David :wink:
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs

Le 31 oct. 2012 à 14:54, Anibal Ardid aniba...@gmail.com a écrit :

Hi ! i'm begginer with big data search engines... I only have
experience with mysql.

But in my work we need to do new project, and use big data database.

We need:

  • full text search
  • synonyms
  • related search
  • fast and scalable

So , I found elasticsearch ... but I don't know how start ... I've
download the package, but in the guides I didn't found how start to
configure, load data, etc.

best regards !

--

--

--

--

--

--

--

--


(system) #10