Oh, no, please.
Sorry for disturbing you so much.
I found out the DEMO thing, is in AppPostProcessor so I...
did not comment this line:
ESHelper.createIndexIfNeeded(client);
and did comment this two lines:
//fsRiverService.start(new FSRiver("myfirstriver",
SMDSearchProperties.INDEX_NAME, SMDSearchProperties.INDEX_TYPE_DOC, "Scan
tmp dir", "/tmp_es", 30L, "standard", true));
//fsRiverService.start(new FSRiver("mysecondriver",
SMDSearchProperties.INDEX_NAME, SMDSearchProperties.INDEX_TYPE_DOC, "Scan
second dir", "/tmp_es_second", 30L, "standard", false));
and this two other:
//pushSampleDoc("LICENSE");
//pushSampleDoc("NOTICE");
Now it does not add the two files.
It will not index my files either.
Now logs are set to TRACE and I'm getting some things.
=====================
it creates my river
[#|2013-07-13T09:32:22.821-0300|INFO|glassfish3.0.1|javax.enterprise.system.std.com.sun.enterprise.v3.services.impl|_ThreadID=498;_ThreadName=Thread-1;|09:32:22,821
INFO [FsRiver] [Alraune, Marlene] [fs][rivertiger] creating fs river
[rivertiger] for [/home/m/text_files/] every [5000] ms
|#]
[#|2013-07-13T09:32:23.232-0300|INFO|glassfish3.0.1|javax.enterprise.system.std.com.sun.enterprise.v3.services.impl|_ThreadID=524;_ThreadName=Thread-1;|09:32:23,232
TRACE [service] [Alraune, Marlene] [_river][0] index
[Document<stored<_source:[7b 22 6f 6b 22 3a 74 72 75 65 2c 22 6e 6f 64 65
22 3a 7b 22 69 64 22 3a 22 49 4b 76 49 68 51 57 44 52 38 61 68 52 4e 47 71
48 4f 68 6e 79 51 22 2c 22 6e 61 6d 65 22 3a 22 41 6c 72 61 75 6e 65 2c 20
4d 61 72 6c 65 6e 65 22 2c 22 74 72 61 6e 73 70 6f 72 74 5f 61 64 64 72 65
73 73 22 3a 22 69 6e 65 74 5b 2f 31 39 32 2e 31 36 38 2e 31 2e 31 34 36 3a
39 33 30 30 5d 22 7d 7d]>
indexed,omitNorms,indexOptions=DOCS_ONLY<_type:rivertiger>
stored,indexed,omitNorms<_uid:>
indexed,tokenized,omitNorms,indexOptions=DOCS_ONLYok:T
indexed,tokenizednode.id:IKvIhQWDR8ahRNGqHOhnyQ
indexed,tokenized<node.name:Alraune, Marlene>
indexed,tokenized<node.transport_address:inet[/192.168.1.146:9300]>
indexed,tokenized<_all:>>]
|#]
=====================
then some errors
[#|2013-07-13T09:32:24.129-0300|INFO|glassfish3.0.1|javax.enterprise.system.std.com.sun.enterprise.v3.services.impl|_ThreadID=499;_ThreadName=Thread-1;|09:32:24,129
TRACE [allocator] [Alraune, Marlene] No Node found to assign shard
[[docstiger][0], node[null], [R], s[UNASSIGNED]]
|#]
[#|2013-07-13T09:32:24.130-0300|INFO|glassfish3.0.1|javax.enterprise.system.std.com.sun.enterprise.v3.services.impl|_ThreadID=499;_ThreadName=Thread-1;|09:32:24,130
TRACE [allocator] [Alraune, Marlene] No Node found to assign shard
[[docstiger][1], node[null], [R], s[UNASSIGNED]]
|#]
[#|2013-07-13T09:32:24.131-0300|INFO|glassfish3.0.1|javax.enterprise.system.std.com.sun.enterprise.v3.services.impl|_ThreadID=499;_ThreadName=Thread-1;|09:32:24,131
TRACE [allocator] [Alraune, Marlene] No Node found to assign shard
[[docstiger][2], node[null], [R], s[UNASSIGNED]]
|#]
[#|2013-07-13T09:32:24.132-0300|INFO|glassfish3.0.1|javax.enterprise.system.std.com.sun.enterprise.v3.services.impl|_ThreadID=499;_ThreadName=Thread-1;|09:32:24,131
TRACE [allocator] [Alraune, Marlene] No Node found to assign shard
[[docstiger][3], node[null], [R], s[UNASSIGNED]]
|#]
[#|2013-07-13T09:32:24.132-0300|INFO|glassfish3.0.1|javax.enterprise.system.std.com.sun.enterprise.v3.services.impl|_ThreadID=499;_ThreadName=Thread-1;|09:32:24,132
TRACE [allocator] [Alraune, Marlene] No Node found to assign shard
[[docstiger][4], node[null], [R], s[UNASSIGNED]]
|#]
[#|2013-07-13T09:32:24.148-0300|INFO|glassfish3.0.1|javax.enterprise.system.std.com.sun.enterprise.v3.services.impl|_ThreadID=499;_ThreadName=Thread-1;|09:32:24,148
TRACE [allocator] [Alraune, Marlene] Assigned shard [[docstiger][0],
node[IKvIhQWDR8ahRNGqHOhnyQ], [P], s[STARTED]] to node
[IKvIhQWDR8ahRNGqHOhnyQ]
|#]
[#|2013-07-13T09:32:24.149-0300|INFO|glassfish3.0.1|javax.enterprise.system.std.com.sun.enterprise.v3.services.impl|_ThreadID=499;_ThreadName=Thread-1;|09:32:24,149
TRACE [allocator] [Alraune, Marlene] Assigned shard [[docstiger][1],
node[IKvIhQWDR8ahRNGqHOhnyQ], [P], s[STARTED]] to node
[IKvIhQWDR8ahRNGqHOhnyQ]
|#]
[#|2013-07-13T09:32:24.149-0300|INFO|glassfish3.0.1|javax.enterprise.system.std.com.sun.enterprise.v3.services.impl|_ThreadID=499;_ThreadName=Thread-1;|09:32:24,149
TRACE [allocator] [Alraune, Marlene] Assigned shard [[docstiger][2],
node[IKvIhQWDR8ahRNGqHOhnyQ], [P], s[STARTED]] to node
[IKvIhQWDR8ahRNGqHOhnyQ]
|#]
[#|2013-07-13T09:32:24.150-0300|INFO|glassfish3.0.1|javax.enterprise.system.std.com.sun.enterprise.v3.services.impl|_ThreadID=499;_ThreadName=Thread-1;|09:32:24,150
TRACE [allocator] [Alraune, Marlene] Assigned shard [[docstiger][3],
node[IKvIhQWDR8ahRNGqHOhnyQ], [P], s[STARTED]] to node
[IKvIhQWDR8ahRNGqHOhnyQ]
|#]
[#|2013-07-13T09:32:24.151-0300|INFO|glassfish3.0.1|javax.enterprise.system.std.com.sun.enterprise.v3.services.impl|_ThreadID=499;_ThreadName=Thread-1;|09:32:24,151
TRACE [allocator] [Alraune, Marlene] Assigned shard [[docstiger][4],
node[IKvIhQWDR8ahRNGqHOhnyQ], [P], s[STARTED]] to node
[IKvIhQWDR8ahRNGqHOhnyQ]
|#]
[#|2013-07-13T09:32:24.152-0300|INFO|glassfish3.0.1|javax.enterprise.system.std.com.sun.enterprise.v3.services.impl|_ThreadID=499;_ThreadName=Thread-1;|09:32:24,152
DEBUG [service] [Alraune, Marlene] processing [reroute post shard-started
([docstiger][0], node[IKvIhQWDR8ahRNGqHOhnyQ], [P], s[INITIALIZING]),
reason [after recovery from gateway]]: no change in cluster_state
|#]
[#|2013-07-13T09:32:32.972-0300|INFO|glassfish3.0.1|javax.enterprise.system.std.com.sun.enterprise.v3.services.impl|_ThreadID=523;_ThreadName=Thread-1;|09:32:32,972
DEBUG [FsRiver] [Alraune, Marlene] [fs][rivertiger] Indexing in ES _river,
rivertiger, _lastupdated
|#]
[#|2013-07-13T09:32:33.057-0300|INFO|glassfish3.0.1|javax.enterprise.system.std.com.sun.enterprise.v3.services.impl|_ThreadID=523;_ThreadName=Thread-1;|09:32:33,057
TRACE [FsRiver] [Alraune, Marlene] [fs][rivertiger] JSon indexed :
{"fs":{"feedname":"rivertiger","lastdate":"2013-07-13T12:32:23.234Z","docadded":0,"docdeleted":0}}
|#]
[#|2013-07-13T09:32:33.058-0300|INFO|glassfish3.0.1|javax.enterprise.system.std.com.sun.enterprise.v3.services.impl|_ThreadID=523;_ThreadName=Thread-1;|09:32:33,058
DEBUG [FsRiver] [Alraune, Marlene] [fs][rivertiger] ES Bulk Commit is needed
|#]
[#|2013-07-13T09:32:33.148-0300|INFO|glassfish3.0.1|javax.enterprise.system.std.com.sun.enterprise.v3.services.impl|_ThreadID=535;_ThreadName=Thread-1;|09:32:33,148
TRACE [service] [Alraune, Marlene] [_river][0] index
[Document<stored<_source:[7b 22 66 73 22 3a 7b 22 66 65 65 64 6e 61 6d 65
22 3a 22 72 69 76 65 72 74 69 67 65 72 22 2c 22 6c 61 73 74 64 61 74 65 22
3a 22 32 30 31 33 2d 30 37 2d 31 33 54 31 32 3a 33 32 3a 32 33 2e 32 33 34
5a 22 2c 22 64 6f 63 61 64 64 65 64 22 3a 30 2c 22 64 6f 63 64 65 6c 65 74
65 64 22 3a 30 7d 7d]>
indexed,omitNorms,indexOptions=DOCS_ONLY<_type:rivertiger>
stored,indexed,omitNorms<_uid:> indexed,tokenizedfs.feedname:rivertiger
indexed,omitNorms,indexOptions=DOCS_ONLYfs.lastdate:
indexed,omitNorms,indexOptions=DOCS_ONLYfs.docadded:
indexed,omitNorms,indexOptions=DOCS_ONLYfs.docdeleted:
indexed,tokenized<_all:>>]
|#]
[#|2013-07-13T09:32:33.332-0300|INFO|glassfish3.0.1|javax.enterprise.system.std.com.sun.enterprise.v3.services.impl|_ThreadID=523;_ThreadName=Thread-1;|09:32:33,332
DEBUG [FsRiver] [Alraune, Marlene] [fs][rivertiger] Fs river is going to
sleep for 5000 ms
|#]
2013/7/13 David Pilato david@pilato.fr
Weird. I thought I did answer to your question about LICENSE file but it
seems that I did not.
Sorry for that.
--
David 
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs
Le 13 juil. 2013 à 12:49, Fatima Castiglione Maldonado 发 <
castiglionemaldonado@gmail.com> a écrit :
Well... As a matter of fact, I keep all e-mails related to this job, and I
can't find not one with the words "startup" nor "demo".
But Google is an old, decaying app, not as good as Scrut+FS+Elastic so
that must not surprise us.
We should just in case consider the possibility that you may mistaken me
for another disturbing knowledge-lacking new dev.
Anyway, I wil look for it, navigating the code a bit more will sure not
hurt me and I will get to know it better.
Thanks for the info.
2013/7/13 David Pilato david@pilato.fr
I already told you that in a startup class, I inject that for demo
purpose.
There's a TODO in that class saying that you should remove it.
--
David
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs
Le 13 juil. 2013 à 11:27, Fatima Castiglione Maldonado 发 <
castiglionemaldonado@gmail.com> a écrit :
Thanks for the info.
You know what ?
Each time I redeploy the app, it will index 1 more occurrence of
"LICENSE" and "NOTICE", so this time it went from 14 to 16 docs.
It looks like it points to one of the deploy folders and reindex it, not
recognizing that it has already indexed it.
Weird, no?
2013/7/13 David Pilato david@pilato.fr
You have to modify SearchService class (as far as I remember). I think I
used a query string query there.
--
David
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs
Le 13 juil. 2013 à 11:13, Fatima Castiglione Maldonado 发 <
castiglionemaldonado@gmail.com> a écrit :
The only docs that appear in my search are "LICENSE" and "NOTICE" and
not one of the docs in
/home/m/text_files/ which is the folder I specified in the unique river
created
(I explain this so you understand what follows)
And it looks like he is quite right, search is no fuzzy at all.
If I search for "license" it will find the docs named "LICENSE", but if
I search for "licence" it finds nothing.
I understand that Elasticsearch can be a lot fuzzy in its search style,
but I do not yet understand how to control that behavior.
Are there any docs explaining that somewhere?
2013/7/13 Fatima Castiglione Maldonado 发 <castiglionemaldonado@gmail.com
Thanks for your answer.
I started looking at this because my client is complaining that the
search is not "fuzzy", that it finds things only when search words are
exact to the words in document.
So I am trying to understand how the indexing works.
2013/7/13 David Pilato david@pilato.fr
In GUI, if you don't set french language, it will use standard
(default) analyzer which is an english analyzer.
--
David
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs
Le 13 juil. 2013 à 10:18, Fatima Castiglione Maldonado 发 <
castiglionemaldonado@gmail.com> a écrit :
Hi,
I am exploring the code in ScrutMyDocs and find something I do not
truly understand.
The file named /resources/estemplate/_setting.json has this contents:
{
"index" : {
"analysis":{
"analyzer":{
"francais":{
"type":"custom",
"tokenizer":"standard",
"filter":["lowercase", "stop_francais",
"fr_stemmer", "asciifolding", "elision"]
}
},
"filter":{
"stop_francais":{
"type":"stop",
"stopwords":["french"]
},
"fr_stemmer" : {
"type" : "stemmer",
"name" : "french"
}
}
}
}
}
Does it means that it is indexing french-style?
I need to index mostly english docs.
Should I change this file?
Any suggestions are really appreciated.
Thanks in advance.
--
Fátima Castiglione Maldonado
castiglionemaldonado@gmail.com
____
,'_ |
_______|||
< ) .------.
-----------,------.-' ,-' -.
| | | ,' `.
,' | | ,' `.
| _,-' |__ / \
_,'-' `. `---.___|_____________ \
.--' -----. | _____________________ `-. ----- |
| ___| | | \ ,- \ |
| ___| |===========================((|) | |
| | | | _____________________/ `- / |
`--._ -----' | _________________,-' ----- |
`.-._ ,' __.---' | /
| `-. | \ /
`. | | `. ,'
| | | `. ,'
_____,------------------. -._ _,-' <___________________________) ------'
| _| |
`.____|
=================================
--
You received this message because you are subscribed to the Google
Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send
an email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.
--
You received this message because you are subscribed to the Google
Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send
an email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.
--
Fátima Castiglione Maldonado
castiglionemaldonado@gmail.com
____
,'_ |
_______|||
< ) .------.
-----------,------.-' ,-' -.
| | | ,' `.
,' | | ,' `.
| _,-' |__ / \
_,'-' `. `---.___|_____________ \
.--' -----. | _____________________ `-. ----- |
| ___| | | \ ,- \ |
| ___| |===========================((|) | |
| | | | _____________________/ `- / |
`--._ -----' | _________________,-' ----- |
`.-._ ,' __.---' | /
| `-. | \ /
`. | | `. ,'
| | | `. ,'
_____,------------------. -._ _,-' <___________________________) ------'
| _| |
`.____|
=================================
--
Fátima Castiglione Maldonado
castiglionemaldonado@gmail.com
____
,'_ |
_______|||
< ) .------.
-----------,------.-' ,-' -.
| | | ,' `.
,' | | ,' `.
| _,-' |__ / \
_,'-' `. `---.___|_____________ \
.--' -----. | _____________________ `-. ----- |
| ___| | | \ ,- \ |
| ___| |===========================((|) | |
| | | | _____________________/ `- / |
`--._ -----' | _________________,-' ----- |
`.-._ ,' __.---' | /
| `-. | \ /
`. | | `. ,'
| | | `. ,'
_____,------------------. -._ _,-' <___________________________) ------'
| _| |
`.____|
=================================
--
You received this message because you are subscribed to the Google
Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send
an email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.
--
You received this message because you are subscribed to the Google
Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send
an email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.
--
Fátima Castiglione Maldonado
castiglionemaldonado@gmail.com
____
,'_ |
_______|||
< ) .------.
-----------,------.-' ,-' -.
| | | ,' `.
,' | | ,' `.
| _,-' |__ / \
_,'-' `. `---.___|_____________ \
.--' -----. | _____________________ `-. ----- |
| ___| | | \ ,- \ |
| ___| |===========================((|) | |
| | | | _____________________/ `- / |
`--._ -----' | _________________,-' ----- |
`.-._ ,' __.---' | /
| `-. | \ /
`. | | `. ,'
| | | `. ,'
_____,------------------. -._ _,-' <___________________________) ------'
| _| |
`.____|
=================================
--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.
--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.
--
Fátima Castiglione Maldonado
castiglionemaldonado@gmail.com
____
,'_ |
_______|||
< ) .------.
-----------,------.-' ,-' -.
| | | ,' `.
,' | | ,' `.
| _,-' |__ / \
_,'-' `. `---.___|_____________ \
.--' -----. | _____________________ `-. ----- |
| ___| | | \ ,- \ |
| ___| |===========================((|) | |
| | | | _____________________/ `- / |
`--._ -----' | _________________,-' ----- |
`.-._ ,' __.---' | /
| `-. | \ /
`. | | `. ,'
| | | `. ,'
_____,------------------. -._ _,-' <___________________________) ------'
| _| |
`.____|
=================================
--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.
--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.
--
Fátima Castiglione Maldonado
castiglionemaldonado@gmail.com
____
,'_ |
|||
< ) .------.
-----------,------.-' ,-' -.
| | | ,' . ,' | | ,' .
| ,-' | /
,'-' . ---.|_________
.--' -----. | _____________________ -. ----- | | ___| | | \ ,- \ | | ___| |===========================((|) | | | | | | _____________________/ - / |
--._ -----' | _________________,-' ----- | .-._ ,' __.---' | /
| -. | \ / . | | . ,' | | | . ,'
_____,------------------. -._ _,-' <___________________________) ------'
| | |
`.___|
=================================
--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.
