Can't index TXT file and search text

[David_Barbe]

Hi,

I have Server with 280 Tera of logs
I want to index the .txt ,.DB ,*.pcap or *.log file.

1. I try to index the txt file after download plugin mapper-documment with
   this command:

• curl -XPUT 'http://localhost:9200/test/diag_auto/1' -d '{ "user" :
  "diag_auto", "post_date" : "2013-5-5", "my_attachment" : { "_attachement" :
  "/extra/log/level.txt" } }
  this is not work

2. After I want to do simply and advanced search:

a) Search word or line in the log
I want to receive back in wiche file is displayed and also the line in the
file.

b) Search series of word example: i have this,

Line 0 = B
Line 1 = A
Line 2 = S
Line 3 = C
Line 4 = B
Line 5 = C
I send command to search the first A and only after B and C so i will have
back this : Line 1 = A, Line 4 = B, Line 5 = C

Thanks and Best regards
Barbe David

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

[dadoonet (David Pilato)]

Hi David,

1. to use attachment plugin, you have to define a mapping first. Then encode your file in Base64, then send it to ES. Read https://github.com/elasticsearch/elasticsearch-mapper-attachments
   Look at the FSriver code source if you need an example. https://github.com/dadoonet/fsriver

a) ok.
b) with attachment plugin, everything will be flatten. So your lines will be indexed as "B A S C B C". Note that A is a stop word and won't be indexed.

BTW, have a look at logstash and Kibana project. It should help you here.

HTH

David
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs

Le 5 mai 2013 à 06:28, David Barbe david@famillebarbe.com a écrit :

Hi,

I have Server with 280 Tera of logs
I want to index the .txt ,.DB ,*.pcap or *.log file.

1. I try to index the txt file after download plugin mapper-documment with this command:

• curl -XPUT 'http://localhost:9200/test/diag_auto/1' -d '{ "user" : "diag_auto", "post_date" : "2013-5-5", "my_attachment" : { "_attachement" : "/extra/log/level.txt" } }
  this is not work

2. After I want to do simply and advanced search:

   a) Search word or line in the log
   I want to receive back in wiche file is displayed and also the line in the file.

   b) Search series of word example: i have this,

                               Line 0 = B
                               Line 1 = A
                               Line 2 = S
                               Line 3 = C
                               Line 4 = B
                               Line 5 = C
   

   I send command to search the first A and only after B and C so i will have back this : Line 1 = A, Line 4 = B, Line 5 = C

Thanks and Best regards
Barbe David

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.