Can't index TXT file and search text

David_Barbe · May 5, 2013, 4:28am

Hi,

I have Server with 280 Tera of logs
I want to index the .txt ,.DB ,*.pcap or *.log file.

I try to index the txt file after download plugin mapper-documment with
this command:

curl -XPUT 'http://localhost:9200/test/diag_auto/1' -d '{ "user" :
"diag_auto", "post_date" : "2013-5-5", "my_attachment" : { "_attachement" :
"/extra/log/level.txt" } }
this is not work

After I want to do simply and advanced search:

a) Search word or line in the log
I want to receive back in wiche file is displayed and also the line in the
file.

b) Search series of word example: i have this,

Line 0 = B
Line 1 = A
Line 2 = S
Line 3 = C
Line 4 = B
Line 5 = C
I send command to search the first A and only after B and C so i will have
back this : Line 1 = A, Line 4 = B, Line 5 = C

Thanks and Best regards
Barbe David

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

dadoonet · May 5, 2013, 8:19am

Hi David,

to use attachment plugin, you have to define a mapping first. Then encode your file in Base64, then send it to ES. Read https://github.com/elasticsearch/elasticsearch-mapper-attachments
Look at the FSriver code source if you need an example. https://github.com/dadoonet/fsriver

a) ok.
b) with attachment plugin, everything will be flatten. So your lines will be indexed as "B A S C B C". Note that A is a stop word and won't be indexed.

BTW, have a look at logstash and Kibana project. It should help you here.

HTH

David
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs

Le 5 mai 2013 à 06:28, David Barbe david@famillebarbe.com a écrit :

Hi,

I have Server with 280 Tera of logs
I want to index the .txt ,.DB ,*.pcap or *.log file.

I try to index the txt file after download plugin mapper-documment with this command:

curl -XPUT 'http://localhost:9200/test/diag_auto/1' -d '{ "user" : "diag_auto", "post_date" : "2013-5-5", "my_attachment" : { "_attachement" : "/extra/log/level.txt" } }
this is not work

After I want to do simply and advanced search:

a) Search word or line in the log
I want to receive back in wiche file is displayed and also the line in the file.

b) Search series of word example: i have this,
```
                            Line 0 = B
                            Line 1 = A
                            Line 2 = S
                            Line 3 = C
                            Line 4 = B
                            Line 5 = C
```
I send command to search the first A and only after B and C so i will have back this : Line 1 = A, Line 4 = B, Line 5 = C

Thanks and Best regards
Barbe David

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.