"index":"no" does not work

hamazasp_avetisyan · August 17, 2011, 9:47am

Hi,
I'm using dynamic mapping for indexing. Above you can see PHP
structure of data.

array("mailing_index" =>
array("properties" =>
array(
"f_id" =>
array("type" => "long"),
"f_from" =>
array("type" => "string",
"index" => "analyzed", "analyzer" => "default"),
"f_subject" =>
array("type" => "string",
"index" => "not_analyzed"),
"f_body" =>
array("type" => "string",
"index" => "analyzed", "analyzer" => "default"),
"f_reply_to" =>
array("type" => "string",
"index" => "no"),
"f_type" =>
array("type" => "string",
"index" => "not_analyzed"),
"f_status" =>
array("type" => "integer",
"index" => "no"),
"f_datetime" =>
array("type" => "long",
"index" => "not_analyzed"),
"f_userid" =>
array("type" => "long",
"index" => "not_analyzed"),
)
)
)

As you can see "f_reply_to" field marked as "index" => "no". But I am
able to perform search by this field. In documentation of elastic
search we can find a line " "index:no" means that it won’t be
searchable at all". Used the 0.17.6 version of elasticsearch. Same
behavior for 0.17.0.

Maybe I'm doing something wrong, please help me to understand the
situation.

//////////////////////// config file
content //////////////////////////////////
node :
data : true
gateway :
type : fs
index :
analysis :
analyzer :
default :
type : custom
tokenizer : standard
filter : [standard, lowercase, porterStem, stop]

network.publish_host: 127.0.0.1
network.bind_host: 127.0.0.1
network.host: 127.0.0.1

node.data: true # Default

http.port: 9200 # Default

cluster.name: "TestCluster"

//////////////////////// end of config file
content ////////////////////////////////

Thanks in advance
H. Avetsyan

kimchy · August 17, 2011, 11:42am

Two things: How do you search for the value? Do you search against the
specific field? By default, it is added to the _all field (and its the
default field being searched on). You can disable it from being added to the
_all field as well. Also, make sure the mapping you set is actually the
mapping you identified by elasticsearch, use the get mapping API to check it
out.

On Wed, Aug 17, 2011 at 12:47 PM, hamazasp.avetisyan <
hamazasp.avetisyan@gmail.com> wrote:

Hi,
I'm using dynamic mapping for indexing. Above you can see PHP
structure of data.

array("mailing_index" =>
array("properties" =>
array(
"f_id" =>
array("type" => "long"),
"f_from" =>
array("type" => "string",
"index" => "analyzed", "analyzer" => "default"),
"f_subject" =>
array("type" => "string",
"index" => "not_analyzed"),
"f_body" =>
array("type" => "string",
"index" => "analyzed", "analyzer" => "default"),
"f_reply_to" =>
array("type" => "string",
"index" => "no"),
"f_type" =>
array("type" => "string",
"index" => "not_analyzed"),
"f_status" =>
array("type" => "integer",
"index" => "no"),
"f_datetime" =>
array("type" => "long",
"index" => "not_analyzed"),
"f_userid" =>
array("type" => "long",
"index" => "not_analyzed"),
)
)
)

As you can see "f_reply_to" field marked as "index" => "no". But I am
able to perform search by this field. In documentation of elastic
search we can find a line " "index:no" means that it won’t be
searchable at all". Used the 0.17.6 version of elasticsearch. Same
behavior for 0.17.0.

Maybe I'm doing something wrong, please help me to understand the
situation.

//////////////////////// config file
content //////////////////////////////////
node :
data : true
gateway :
type : fs
index :
analysis :
analyzer :
default :
type : custom
tokenizer : standard
filter : [standard, lowercase, porterStem, stop]

network.publish_host: 127.0.0.1
network.bind_host: 127.0.0.1
network.host: 127.0.0.1

node.data: true # Default

http.port: 9200 # Default

cluster.name: "TestCluster"

//////////////////////// end of config file
content ////////////////////////////////

Thanks in advance
H. Avetsyan

hamazasp_avetisyan · August 18, 2011, 8:20am

Hi, thank you for reply!

For mapping I am using the following URL

host:port/my_db/mailing_index/_mapping

As you can see no "_all" specified

For searching I am using the following URL
host:port/TestCluster/mailing_index/_search

The argument for sort operation contains just a Boolean condition(with
query string), limits and sorting. No "_all" specified.

I've checked the structure of index using get mapping API, everything
is OK (as I specified in argument for mapping).

So the issue still exists.

Best regards,
H.Avetisyan

On Aug 17, 4:42 pm, Shay Banon kim...@gmail.com wrote:

Two things: How do you search for the value? Do you search against the
specific field? By default, it is added to the _all field (and its the
default field being searched on). You can disable it from being added to the
_all field as well. Also, make sure the mapping you set is actually the
mapping you identified by elasticsearch, use the get mapping API to check it
out.

On Wed, Aug 17, 2011 at 12:47 PM, hamazasp.avetisyan <

hamazasp.avetis...@gmail.com> wrote:

Hi,
I'm using dynamic mapping for indexing. Above you can see PHP
structure of data.

array("mailing_index" =>
array("properties" =>
array(
"f_id" =>
array("type" => "long"),
"f_from" =>
array("type" => "string",
"index" => "analyzed", "analyzer" => "default"),
"f_subject" =>
array("type" => "string",
"index" => "not_analyzed"),
"f_body" =>
array("type" => "string",
"index" => "analyzed", "analyzer" => "default"),
"f_reply_to" =>
array("type" => "string",
"index" => "no"),
"f_type" =>
array("type" => "string",
"index" => "not_analyzed"),
"f_status" =>
array("type" => "integer",
"index" => "no"),
"f_datetime" =>
array("type" => "long",
"index" => "not_analyzed"),
"f_userid" =>
array("type" => "long",
"index" => "not_analyzed"),
)
)
)

As you can see "f_reply_to" field marked as "index" => "no". But I am
able to perform search by this field. In documentation of elastic
search we can find a line " "index:no" means that it won’t be
searchable at all". Used the 0.17.6 version of elasticsearch. Same
behavior for 0.17.0.

Maybe I'm doing something wrong, please help me to understand the
situation.

//////////////////////// config file
content //////////////////////////////////
node :
data : true
gateway :
type : fs
index :
analysis :
analyzer :
default :
type : custom
tokenizer : standard
filter : [standard, lowercase, porterStem, stop]

network.publish_host: 127.0.0.1
network.bind_host: 127.0.0.1
network.host: 127.0.0.1

node.data: true # Default

http.port: 9200 # Default

cluster.name: "TestCluster"

//////////////////////// end of config file
content ////////////////////////////////

Thanks in advance
H. Avetsyan

hamazasp_avetisyan · August 18, 2011, 8:23am

Hi, thank you for reply!

For mapping I am using the following URL
host:port/my_db/mailing_index/_mapping

As you can see no "_all" specified

For searching I am using the following URL
host:port/my_db/mailing_index/_search

The argument for sort operation contains just a Boolean
condition(with
query string), limits and sorting. No "_all" specified.

I've checked the structure of index using get mapping API, everything
is OK (as I specified in argument for mapping).
So the issue still exists.

Best regards,
H.Avetisyan

On Aug 17, 4:42 pm, Shay Banon kim...@gmail.com wrote:

Two things: How do you search for the value? Do you search against the
specific field? By default, it is added to the _all field (and its the
default field being searched on). You can disable it from being added to the
_all field as well. Also, make sure the mapping you set is actually the
mapping you identified by elasticsearch, use the get mapping API to check it
out.

On Wed, Aug 17, 2011 at 12:47 PM, hamazasp.avetisyan <

hamazasp.avetis...@gmail.com> wrote:

Hi,
I'm using dynamic mapping for indexing. Above you can see PHP
structure of data.

array("mailing_index" =>
array("properties" =>
array(
"f_id" =>
array("type" => "long"),
"f_from" =>
array("type" => "string",
"index" => "analyzed", "analyzer" => "default"),
"f_subject" =>
array("type" => "string",
"index" => "not_analyzed"),
"f_body" =>
array("type" => "string",
"index" => "analyzed", "analyzer" => "default"),
"f_reply_to" =>
array("type" => "string",
"index" => "no"),
"f_type" =>
array("type" => "string",
"index" => "not_analyzed"),
"f_status" =>
array("type" => "integer",
"index" => "no"),
"f_datetime" =>
array("type" => "long",
"index" => "not_analyzed"),
"f_userid" =>
array("type" => "long",
"index" => "not_analyzed"),
)
)
)

As you can see "f_reply_to" field marked as "index" => "no". But I am
able to perform search by this field. In documentation of elastic
search we can find a line " "index:no" means that it won’t be
searchable at all". Used the 0.17.6 version of elasticsearch. Same
behavior for 0.17.0.

Maybe I'm doing something wrong, please help me to understand the
situation.

//////////////////////// config file
content //////////////////////////////////
node :
data : true
gateway :
type : fs
index :
analysis :
analyzer :
default :
type : custom
tokenizer : standard
filter : [standard, lowercase, porterStem, stop]

network.publish_host: 127.0.0.1
network.bind_host: 127.0.0.1
network.host: 127.0.0.1

node.data: true # Default

http.port: 9200 # Default

cluster.name: "TestCluster"

//////////////////////// end of config file
content ////////////////////////////////

Thanks in advance
H. Avetsyan

hamazasp_avetisyan · August 18, 2011, 8:25am

Hi, thank you for reply!

For mapping I am using the following URL
host:port/my_db/mailing_index/_mapping

As you can see no "_all" specified

For searching I am using the following URL
host:port/TestCluster/mailing_index/_search

The argument for search contains a Boolean condition(with
query string), limits and sorting. No "_all" specified.

I've checked the structure of index using get mapping API, everything
is OK (as I specified in argument for mapping).
So the issue still exists.
Best regards,
H.Avetisyan

On Aug 17, 4:42 pm, Shay Banon kim...@gmail.com wrote:

Two things: How do you search for the value? Do you search against the
specific field? By default, it is added to the _all field (and its the
default field being searched on). You can disable it from being added to the
_all field as well. Also, make sure the mapping you set is actually the
mapping you identified by elasticsearch, use the get mapping API to check it
out.

On Wed, Aug 17, 2011 at 12:47 PM, hamazasp.avetisyan <

hamazasp.avetis...@gmail.com> wrote:

Hi,
I'm using dynamic mapping for indexing. Above you can see PHP
structure of data.

array("mailing_index" =>
array("properties" =>
array(
"f_id" =>
array("type" => "long"),
"f_from" =>
array("type" => "string",
"index" => "analyzed", "analyzer" => "default"),
"f_subject" =>
array("type" => "string",
"index" => "not_analyzed"),
"f_body" =>
array("type" => "string",
"index" => "analyzed", "analyzer" => "default"),
"f_reply_to" =>
array("type" => "string",
"index" => "no"),
"f_type" =>
array("type" => "string",
"index" => "not_analyzed"),
"f_status" =>
array("type" => "integer",
"index" => "no"),
"f_datetime" =>
array("type" => "long",
"index" => "not_analyzed"),
"f_userid" =>
array("type" => "long",
"index" => "not_analyzed"),
)
)
)

As you can see "f_reply_to" field marked as "index" => "no". But I am
able to perform search by this field. In documentation of elastic
search we can find a line " "index:no" means that it won’t be
searchable at all". Used the 0.17.6 version of elasticsearch. Same
behavior for 0.17.0.

Maybe I'm doing something wrong, please help me to understand the
situation.

//////////////////////// config file
content //////////////////////////////////
node :
data : true
gateway :
type : fs
index :
analysis :
analyzer :
default :
type : custom
tokenizer : standard
filter : [standard, lowercase, porterStem, stop]

network.publish_host: 127.0.0.1
network.bind_host: 127.0.0.1
network.host: 127.0.0.1

node.data: true # Default

http.port: 9200 # Default

cluster.name: "TestCluster"

//////////////////////// end of config file
content ////////////////////////////////

Thanks in advance
H. Avetsyan

hamazasp_avetisyan · August 18, 2011, 8:27am

Hi, thank you for reply!

For mapping I am using the following URL
host:port/my_db/mailing_index/_mapping

As you can see no "_all" specified.

For searching I am using the following URL
host:port/my_db/mailing_index/_search

The argument for search operation contains a Boolean condition(with
query string), limits and sorting. No "_all" specified.

I've checked the structure of index using get mapping API, everything
is OK (as I specified in argument for mapping).

So the issue still exists.
Best regards,
H.Avetisyan

On Aug 17, 4:42 pm, Shay Banon kim...@gmail.com wrote:

Two things: How do you search for the value? Do you search against the
specific field? By default, it is added to the _all field (and its the
default field being searched on). You can disable it from being added to the
_all field as well. Also, make sure the mapping you set is actually the
mapping you identified by elasticsearch, use the get mapping API to check it
out.

On Wed, Aug 17, 2011 at 12:47 PM, hamazasp.avetisyan <

hamazasp.avetis...@gmail.com> wrote:

Hi,
I'm using dynamic mapping for indexing. Above you can see PHP
structure of data.

array("mailing_index" =>
array("properties" =>
array(
"f_id" =>
array("type" => "long"),
"f_from" =>
array("type" => "string",
"index" => "analyzed", "analyzer" => "default"),
"f_subject" =>
array("type" => "string",
"index" => "not_analyzed"),
"f_body" =>
array("type" => "string",
"index" => "analyzed", "analyzer" => "default"),
"f_reply_to" =>
array("type" => "string",
"index" => "no"),
"f_type" =>
array("type" => "string",
"index" => "not_analyzed"),
"f_status" =>
array("type" => "integer",
"index" => "no"),
"f_datetime" =>
array("type" => "long",
"index" => "not_analyzed"),
"f_userid" =>
array("type" => "long",
"index" => "not_analyzed"),
)
)
)

As you can see "f_reply_to" field marked as "index" => "no". But I am
able to perform search by this field. In documentation of elastic
search we can find a line " "index:no" means that it won’t be
searchable at all". Used the 0.17.6 version of elasticsearch. Same
behavior for 0.17.0.

Maybe I'm doing something wrong, please help me to understand the
situation.

//////////////////////// config file
content //////////////////////////////////
node :
data : true
gateway :
type : fs
index :
analysis :
analyzer :
default :
type : custom
tokenizer : standard
filter : [standard, lowercase, porterStem, stop]

network.publish_host: 127.0.0.1
network.bind_host: 127.0.0.1
network.host: 127.0.0.1

node.data: true # Default

http.port: 9200 # Default

cluster.name: "TestCluster"

//////////////////////// end of config file
content ////////////////////////////////

Thanks in advance
H. Avetsyan

kimchy · August 18, 2011, 12:09pm

What I meant is what type of query do you execute when you say it does not
work?

On Thu, Aug 18, 2011 at 11:20 AM, hamazasp.avetisyan <
hamazasp.avetisyan@gmail.com> wrote:

Hi, thank you for reply!

For mapping I am using the following URL

host:port/my_db/mailing_index/_mapping

As you can see no "_all" specified

For searching I am using the following URL
host:port/TestCluster/mailing_index/_search

The argument for sort operation contains just a Boolean condition(with
query string), limits and sorting. No "_all" specified.

I've checked the structure of index using get mapping API, everything
is OK (as I specified in argument for mapping).

So the issue still exists.

Best regards,
H.Avetisyan

On Aug 17, 4:42 pm, Shay Banon kim...@gmail.com wrote:

Two things: How do you search for the value? Do you search against the
specific field? By default, it is added to the _all field (and its the
default field being searched on). You can disable it from being added to
the
_all field as well. Also, make sure the mapping you set is actually the
mapping you identified by elasticsearch, use the get mapping API to check
it
out.

On Wed, Aug 17, 2011 at 12:47 PM, hamazasp.avetisyan <

hamazasp.avetis...@gmail.com> wrote:

Hi,
I'm using dynamic mapping for indexing. Above you can see PHP
structure of data.

array("mailing_index" =>
array("properties" =>
array(
"f_id" =>
array("type" => "long"),
"f_from" =>
array("type" => "string",
"index" => "analyzed", "analyzer" => "default"),
"f_subject" =>
array("type" => "string",
"index" => "not_analyzed"),
"f_body" =>
array("type" => "string",
"index" => "analyzed", "analyzer" => "default"),
"f_reply_to" =>
array("type" => "string",
"index" => "no"),
"f_type" =>
array("type" => "string",
"index" => "not_analyzed"),
"f_status" =>
array("type" => "integer",
"index" => "no"),
"f_datetime" =>
array("type" => "long",
"index" => "not_analyzed"),
"f_userid" =>
array("type" => "long",
"index" => "not_analyzed"),
)
)
)

As you can see "f_reply_to" field marked as "index" => "no". But I am
able to perform search by this field. In documentation of elastic
search we can find a line " "index:no" means that it won’t be
searchable at all". Used the 0.17.6 version of elasticsearch. Same
behavior for 0.17.0.

Maybe I'm doing something wrong, please help me to understand the
situation.

//////////////////////// config file
content //////////////////////////////////
node :
data : true
gateway :
type : fs
index :
analysis :
analyzer :
default :
type : custom
tokenizer : standard
filter : [standard, lowercase, porterStem, stop]

network.publish_host: 127.0.0.1
network.bind_host: 127.0.0.1
network.host: 127.0.0.1

node.data: true # Default

http.port: 9200 # Default

cluster.name: "TestCluster"

//////////////////////// end of config file
content ////////////////////////////////

Thanks in advance
H. Avetsyan

Clinton_Gormley · August 19, 2011, 9:03am

On Wed, 2011-08-17 at 14:42 +0300, Shay Banon wrote:

Two things: How do you search for the value? Do you search against the
specific field? By default, it is added to the _all field (and its the
default field being searched on). You can disable it from being added
to the _all field as well. Also, make sure the mapping you set is
actually the mapping you identified by elasticsearch, use the get
mapping API to check it out.

Note: there is an issue open to disable include_in_all when index: "no"
is specified, as it is more Do-What-I-Mean

github.com/elastic/elasticsearch

index: no should also disable include_in_all

opened 09:38AM - 02 Jul 11 UTC

closed 04:51PM - 19 Aug 11 UTC

clintongormley

>enhancement >breaking v0.18.0

``` curl -XPUT 'http://127.0.0.1:9200/test/?pretty=1' -d ' { "mappings" : { … "document" : { "properties" : { "title_cn" : { "index" : "no", "type" : "string" } } } } } ' curl -XPOST 'http://127.0.0.1:9200/test/document?pretty=1' -d ' { "title_cn" : "bar" } ' curl -XGET 'http://127.0.0.1:9200/test/_search?pretty=1' -d ' { "query" : { "field" : { "_all" : "bar" } } } ' # [Sat Jul 2 11:37:01 2011] Response: # { # "hits" : { # "hits" : [ # { # "_source" : { # "title_cn" : "bar" # }, # "_score" : 0.13561106, # "_index" : "test", # "_id" : "Zshx_UXmRVWkaHYHP3_PDw", # "_type" : "document" # } # ], # "max_score" : 0.13561106, # "total" : 1 # }, # "timed_out" : false, # "_shards" : { # "failed" : 0, # "successful" : 5, # "total" : 5 # }, # "took" : 2 # } ```

clint

On Wed, Aug 17, 2011 at 12:47 PM, hamazasp.avetisyan
hamazasp.avetisyan@gmail.com wrote:
Hi,
I'm using dynamic mapping for indexing. Above you can see PHP
structure of data.

    array("mailing_index" =>
                               array("properties" =>
                                       array(
                                       "f_id" =>
                                           array("type" =>
    "long"),
                                       "f_from" =>
                                           array("type" =>
    "string",
    "index" => "analyzed", "analyzer" => "default"),
                                       "f_subject" =>
                                           array("type" =>
    "string",
    "index" => "not_analyzed"),
                                       "f_body" =>
                                           array("type" =>
    "string",
    "index" => "analyzed", "analyzer" => "default"),
                                       "f_reply_to" =>
                                           array("type" =>
    "string",
    "index" => "no"),
                                       "f_type" =>
                                           array("type" =>
    "string",
    "index" => "not_analyzed"),
                                       "f_status" =>
                                           array("type" =>
    "integer",
    "index" => "no"),
                                       "f_datetime" =>
                                           array("type" => "long",
    "index" => "not_analyzed"),
                                       "f_userid" =>
                                           array("type" => "long",
    "index" => "not_analyzed"),
                                                   )
                                    )
                               )
    
    As you can see "f_reply_to" field marked as "index" => "no".
    But I am
    able to perform search by this field. In documentation of
    elastic
    search we can find a line " "index:no" means that it wonât be
    searchable at all". Used the 0.17.6 version of elasticsearch.
    Same
    behavior for 0.17.0.
    
    Maybe I'm doing something wrong, please help me to understand
    the
    situation.
    
    ////////////////////////   config file
    content //////////////////////////////////
    node :
       data : true
    gateway :
       type : fs
    index :
       analysis :
           analyzer :
               default :
                   type : custom
                   tokenizer : standard
                   filter : [standard, lowercase, porterStem,
    stop]
    
    
    network.publish_host:                   127.0.0.1
    network.bind_host:                      127.0.0.1
    network.host:                           127.0.0.1
    
    node.data:                              true    # Default
    
    http.port:                              9200    # Default
    
    cluster.name:                              "TestCluster"
    
    //////////////////////// end of config file
    content ////////////////////////////////
    
    Thanks in advance
    H. Avetsyan

hamazasp_avetisyan · August 22, 2011, 6:02am

Hi Shay!

Below you can see the flow that I am passing through.

curl -XDELETE 'http://localhost:9200/test'

curl -XPUT 'http://localhost:9200/test'

curl -XPUT "http://localhost:9200/test/type1/_mapping" -d '{ "type1" :
{ "properties" : { "field1" : {"type" : "string", "index" : "no"},
"field2" : {"type" : "string", "index" : "analyzed"} } } }'

curl -XPUT 'http://localhost:9200/test/type1/1' -d '{ field1: "edo1",
field2: "aaa" }'
curl -XPUT 'http://localhost:9200/test/type1/2' -d '{ field1: "edo2",
field2: "bbb" }'
curl -XPUT 'http://localhost:9200/test/type1/3' -d '{ field1: "edo3",
field2: "ccc" }'

curl -XGET 127.0.0.1:9200/test/_search -d '{"query":{"query_string":
{"query":"edo1"}}}'

The last search line returns the first document, but it has type
"filed1" that created as "index":"no". This is the actual problem.

On Aug 18, 5:09 pm, Shay Banon kim...@gmail.com wrote:

What I meant is what type of query do you execute when you say it does not
work?

On Thu, Aug 18, 2011 at 11:20 AM, hamazasp.avetisyan <

hamazasp.avetis...@gmail.com> wrote:

Hi, thank you for reply!

For mapping I am using the following URL

host:port/my_db/mailing_index/_mapping

As you can see no "_all" specified

For searching I am using the following URL
host:port/TestCluster/mailing_index/_search

The argument for sort operation contains just a Boolean condition(with
query string), limits and sorting. No "_all" specified.

I've checked the structure of index using get mapping API, everything
is OK (as I specified in argument for mapping).

So the issue still exists.

Best regards,
H.Avetisyan

On Aug 17, 4:42 pm, Shay Banon kim...@gmail.com wrote:

Two things: How do you search for the value? Do you search against the
specific field? By default, it is added to the _all field (and its the
default field being searched on). You can disable it from being added to
the
_all field as well. Also, make sure the mapping you set is actually the
mapping you identified by elasticsearch, use the get mapping API to check
it
out.

On Wed, Aug 17, 2011 at 12:47 PM, hamazasp.avetisyan <

hamazasp.avetis...@gmail.com> wrote:

Hi,
I'm using dynamic mapping for indexing. Above you can see PHP
structure of data.

array("mailing_index" =>
array("properties" =>
array(
"f_id" =>
array("type" => "long"),
"f_from" =>
array("type" => "string",
"index" => "analyzed", "analyzer" => "default"),
"f_subject" =>
array("type" => "string",
"index" => "not_analyzed"),
"f_body" =>
array("type" => "string",
"index" => "analyzed", "analyzer" => "default"),
"f_reply_to" =>
array("type" => "string",
"index" => "no"),
"f_type" =>
array("type" => "string",
"index" => "not_analyzed"),
"f_status" =>
array("type" => "integer",
"index" => "no"),
"f_datetime" =>
array("type" => "long",
"index" => "not_analyzed"),
"f_userid" =>
array("type" => "long",
"index" => "not_analyzed"),
)
)
)

As you can see "f_reply_to" field marked as "index" => "no". But I am
able to perform search by this field. In documentation of elastic
search we can find a line " "index:no" means that it won’t be
searchable at all". Used the 0.17.6 version of elasticsearch. Same
behavior for 0.17.0.

Maybe I'm doing something wrong, please help me to understand the
situation.

//////////////////////// config file
content //////////////////////////////////
node :
data : true
gateway :
type : fs
index :
analysis :
analyzer :
default :
type : custom
tokenizer : standard
filter : [standard, lowercase, porterStem, stop]

network.publish_host: 127.0.0.1
network.bind_host: 127.0.0.1
network.host: 127.0.0.1

node.data: true # Default

http.port: 9200 # Default

cluster.name: "TestCluster"

//////////////////////// end of config file
content ////////////////////////////////

Thanks in advance
H. Avetsyan

kimchy · August 22, 2011, 7:46am

Then you are searching by default on the _all field, clinton pointed out
that when setting index : "no", it still gets included in _all.

On Mon, Aug 22, 2011 at 9:02 AM, hamazasp.avetisyan <
hamazasp.avetisyan@gmail.com> wrote:

Hi Shay!

Below you can see the flow that I am passing through.

curl -XDELETE 'http://localhost:9200/test'

curl -XPUT 'http://localhost:9200/test'

curl -XPUT "http://localhost:9200/test/type1/_mapping" -d '{ "type1" :
{ "properties" : { "field1" : {"type" : "string", "index" : "no"},
"field2" : {"type" : "string", "index" : "analyzed"} } } }'

curl -XPUT 'http://localhost:9200/test/type1/1' -d '{ field1: "edo1",
field2: "aaa" }'
curl -XPUT 'http://localhost:9200/test/type1/2' -d '{ field1: "edo2",
field2: "bbb" }'
curl -XPUT 'http://localhost:9200/test/type1/3' -d '{ field1: "edo3",
field2: "ccc" }'

curl -XGET 127.0.0.1:9200/test/_search -d '{"query":{"query_string":
{"query":"edo1"}}}'

The last search line returns the first document, but it has type
"filed1" that created as "index":"no". This is the actual problem.

On Aug 18, 5:09 pm, Shay Banon kim...@gmail.com wrote:

What I meant is what type of query do you execute when you say it does
not
work?

On Thu, Aug 18, 2011 at 11:20 AM, hamazasp.avetisyan <

hamazasp.avetis...@gmail.com> wrote:

Hi, thank you for reply!

For mapping I am using the following URL

host:port/my_db/mailing_index/_mapping

As you can see no "_all" specified

For searching I am using the following URL
host:port/TestCluster/mailing_index/_search

The argument for sort operation contains just a Boolean condition(with
query string), limits and sorting. No "_all" specified.

I've checked the structure of index using get mapping API, everything
is OK (as I specified in argument for mapping).

So the issue still exists.

Best regards,
H.Avetisyan

On Aug 17, 4:42 pm, Shay Banon kim...@gmail.com wrote:

Two things: How do you search for the value? Do you search against
the
specific field? By default, it is added to the _all field (and its
the
default field being searched on). You can disable it from being added
to
the
_all field as well. Also, make sure the mapping you set is actually
the
mapping you identified by elasticsearch, use the get mapping API to
check
it
out.

On Wed, Aug 17, 2011 at 12:47 PM, hamazasp.avetisyan <

hamazasp.avetis...@gmail.com> wrote:

Hi,
I'm using dynamic mapping for indexing. Above you can see PHP
structure of data.

array("mailing_index" =>
array("properties" =>
array(
"f_id" =>
array("type" => "long"),
"f_from" =>
array("type" => "string",
"index" => "analyzed", "analyzer" => "default"),
"f_subject" =>
array("type" => "string",
"index" => "not_analyzed"),
"f_body" =>
array("type" => "string",
"index" => "analyzed", "analyzer" => "default"),
"f_reply_to" =>
array("type" => "string",
"index" => "no"),
"f_type" =>
array("type" => "string",
"index" => "not_analyzed"),
"f_status" =>
array("type" => "integer",
"index" => "no"),
"f_datetime" =>
array("type" => "long",
"index" => "not_analyzed"),
"f_userid" =>
array("type" => "long",
"index" => "not_analyzed"),
)
)
)

As you can see "f_reply_to" field marked as "index" => "no". But I
am
able to perform search by this field. In documentation of elastic
search we can find a line " "index:no" means that it won’t be
searchable at all". Used the 0.17.6 version of elasticsearch. Same
behavior for 0.17.0.

Maybe I'm doing something wrong, please help me to understand the
situation.

//////////////////////// config file
content //////////////////////////////////
node :
data : true
gateway :
type : fs
index :
analysis :
analyzer :
default :
type : custom
tokenizer : standard
filter : [standard, lowercase, porterStem, stop]

network.publish_host: 127.0.0.1
network.bind_host: 127.0.0.1
network.host: 127.0.0.1

node.data: true # Default

http.port: 9200 # Default

cluster.name: "TestCluster"

//////////////////////// end of config file
content ////////////////////////////////

Thanks in advance
H. Avetsyan

hamazasp_avetisyan · August 22, 2011, 8:44am

Thank you !! It works !!

On Aug 22, 12:46 pm, Shay Banon kim...@gmail.com wrote:

Then you are searching by default on the _all field, clinton pointed out
that when setting index : "no", it still gets included in _all.

On Mon, Aug 22, 2011 at 9:02 AM, hamazasp.avetisyan <

hamazasp.avetis...@gmail.com> wrote:

Hi Shay!

Below you can see the flow that I am passing through.

curl -XDELETE 'http://localhost:9200/test'

curl -XPUT 'http://localhost:9200/test'

curl -XPUT "http://localhost:9200/test/type1/_mapping" -d '{ "type1" :
{ "properties" : { "field1" : {"type" : "string", "index" : "no"},
"field2" : {"type" : "string", "index" : "analyzed"} } } }'

curl -XPUT 'http://localhost:9200/test/type1/1'-d '{ field1: "edo1",
field2: "aaa" }'
curl -XPUT 'http://localhost:9200/test/type1/2'-d '{ field1: "edo2",
field2: "bbb" }'
curl -XPUT 'http://localhost:9200/test/type1/3'-d '{ field1: "edo3",
field2: "ccc" }'

curl -XGET 127.0.0.1:9200/test/_search -d '{"query":{"query_string":
{"query":"edo1"}}}'

The last search line returns the first document, but it has type
"filed1" that created as "index":"no". This is the actual problem.

On Aug 18, 5:09 pm, Shay Banon kim...@gmail.com wrote:

What I meant is what type of query do you execute when you say it does
not
work?

On Thu, Aug 18, 2011 at 11:20 AM, hamazasp.avetisyan <

hamazasp.avetis...@gmail.com> wrote:

Hi, thank you for reply!

For mapping I am using the following URL

host:port/my_db/mailing_index/_mapping

As you can see no "_all" specified

For searching I am using the following URL
host:port/TestCluster/mailing_index/_search

The argument for sort operation contains just a Boolean condition(with
query string), limits and sorting. No "_all" specified.

I've checked the structure of index using get mapping API, everything
is OK (as I specified in argument for mapping).

So the issue still exists.

Best regards,
H.Avetisyan

On Aug 17, 4:42 pm, Shay Banon kim...@gmail.com wrote:

Two things: How do you search for the value? Do you search against
the
specific field? By default, it is added to the _all field (and its
the
default field being searched on). You can disable it from being added
to
the
_all field as well. Also, make sure the mapping you set is actually
the
mapping you identified by elasticsearch, use the get mapping API to
check
it
out.

On Wed, Aug 17, 2011 at 12:47 PM, hamazasp.avetisyan <

hamazasp.avetis...@gmail.com> wrote:

Hi,
I'm using dynamic mapping for indexing. Above you can see PHP
structure of data.

array("mailing_index" =>
array("properties" =>
array(
"f_id" =>
array("type" => "long"),
"f_from" =>
array("type" => "string",
"index" => "analyzed", "analyzer" => "default"),
"f_subject" =>
array("type" => "string",
"index" => "not_analyzed"),
"f_body" =>
array("type" => "string",
"index" => "analyzed", "analyzer" => "default"),
"f_reply_to" =>
array("type" => "string",
"index" => "no"),
"f_type" =>
array("type" => "string",
"index" => "not_analyzed"),
"f_status" =>
array("type" => "integer",
"index" => "no"),
"f_datetime" =>
array("type" => "long",
"index" => "not_analyzed"),
"f_userid" =>
array("type" => "long",
"index" => "not_analyzed"),
)
)
)

As you can see "f_reply_to" field marked as "index" => "no". But I
am
able to perform search by this field. In documentation of elastic
search we can find a line " "index:no" means that it won’t be
searchable at all". Used the 0.17.6 version of elasticsearch. Same
behavior for 0.17.0.

Maybe I'm doing something wrong, please help me to understand the
situation.

//////////////////////// config file
content //////////////////////////////////
node :
data : true
gateway :
type : fs
index :
analysis :
analyzer :
default :
type : custom
tokenizer : standard
filter : [standard, lowercase, porterStem, stop]

network.publish_host: 127.0.0.1
network.bind_host: 127.0.0.1
network.host: 127.0.0.1

node.data: true # Default

http.port: 9200 # Default

cluster.name: "TestCluster"

//////////////////////// end of config file
content ////////////////////////////////

Thanks in advance
H. Avetsyan