# Document indexing **URL:** \ **Category:** Elasticsearch\ **Created:** [May 10, 2012, 1:57pm UTC](https://discuss.elastic.co/t/document-indexing/7637 "2012-05-10T13:57:13Z")\ **Posts on this page:** 11\ **Page:** 1
**Author:** ![tullio0106](https://avatars.discourse-cdn.com/v4/letter/t/d6d6ee/32.png) [@tullio0106](https://discuss.elastic.co/u/tullio0106)\ **Post date:** [May 10, 2012, 1:57pm UTC](https://discuss.elastic.co/t/document-indexing/7637/1 "2012-05-10T13:57:13Z")
I'd like to use elasticsearch to store indexes about my documents. I've documents like .doc files or .pdf files or whatever. Is there any way/tool to index such kind of documents ? Tks Tullio ---
**Author:** ![Rafal\_Kuc\_3](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/rafal_kuc_3/32/799_2.png) [@Rafal\_Kuc\_3](https://discuss.elastic.co/u/Rafal_Kuc_3)\ **Post date:** [May 10, 2012, 2:05pm UTC](https://discuss.elastic.co/t/document-indexing/7637/2 "2012-05-10T14:05:48Z")
Hello! Take a look at [http://tika.apache.org/](http://tika.apache.org/) framework. You can extract data from files like PDF or DOC and then index that data into Elasticsearch. -- Regards, Rafał Kuć Sematext :: [http://sematext.com/](http://sematext.com/) :: Solr - Lucene - Nutch - Elasticsearch > I'd like to use elasticsearch to store indexes about my documents. > I've documents like .doc files or .pdf files or whatever. > Is there any way/tool to index such kind of documents ? > Tks > Tullio ---
**Author:** ![dadoonet](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dadoonet/32/137187_2.png) [@dadoonet](https://discuss.elastic.co/u/dadoonet)\ **Post date:** [May 10, 2012, 2:20pm UTC](https://discuss.elastic.co/t/document-indexing/7637/3 "2012-05-10T14:20:23Z")
You could also use attachment plugin which will do the Tika job for you. David 😉 Twitter : @dadoonet / @elasticsearchfr Le 10 mai 2012 à 16:05, Rafał Kuć [r.kuc@solr.pl](mailto:r.kuc@solr.pl) a écrit : > Hello! > > Take a look at [http://tika.apache.org/](http://tika.apache.org/) framework. You can extract data > from files like PDF or DOC and then index that data into > Elasticsearch. > > -- > Regards, > Rafał Kuć > Sematext :: [http://sematext.com/](http://sematext.com/) :: Solr - Lucene - Nutch - Elasticsearch > > > I'd like to use elasticsearch to store indexes about my documents. > > I've documents like .doc files or .pdf files or whatever. > > Is there any way/tool to index such kind of documents ? > > Tks > > Tullio ---
**Author:** ![tullio0106](https://avatars.discourse-cdn.com/v4/letter/t/d6d6ee/32.png) [@tullio0106](https://discuss.elastic.co/u/tullio0106)\ **Post date:** [May 10, 2012, 2:24pm UTC](https://discuss.elastic.co/t/document-indexing/7637/4 "2012-05-10T14:24:41Z")
Where can I find the attachment plugin ? Tks Tullio Il giorno giovedì 10 maggio 2012 15:57:13 UTC+2, tullio0106 ha scritto: > I'd like to use elasticsearch to store indexes about my documents. > I've documents like .doc files or .pdf files or whatever. > Is there any way/tool to index such kind of documents ? > Tks > Tullio ---
**Author:** ![dadoonet](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dadoonet/32/137187_2.png) [@dadoonet](https://discuss.elastic.co/u/dadoonet)\ **Post date:** [May 10, 2012, 2:51pm UTC](https://discuss.elastic.co/t/document-indexing/7637/5 "2012-05-10T14:51:37Z")
> **[GitHub - elastic/elasticsearch-mapper-attachments: Mapper Attachments Type...](https://github.com/elastic/elasticsearch-mapper-attachments)** > > Mapper Attachments Type plugin for Elasticsearch. Contribute to elastic/elasticsearch-mapper-attachments development by creating an account on GitHub. [https://github.com/elasticsearch/elasticsearch-mapper-attachments](https://github.com/elasticsearch/elasticsearch-mapper-attachments) [https://github.com/elasticsearch/elasticsearch-mapper-attachments](https://github.com/elasticsearch/elasticsearch-mapper-attachments) Le 10 mai 2012 à 16:24, tullio0106 [tbettinazzi@axioma.it](mailto:tbettinazzi@axioma.it) a écrit : > plugin ? > Tks > Tullio > > Il giorno giovedì 10 maggio 2012 15:57:13 UTC+2, tullio0106 ha scritto: > > > store indexes about my documents. > > I've documents like .doc files or .pdf files or whatever. > > Is there any way/tool to index such kind of documents ? > > Tks > > Tullio =?f1a0ad7a-5daa-4ff9-a3d5-f1d42f61d6fc-- > > -- > David Pilato > [http://dev.david.pilato.fr/](http://dev.david.pilato.fr/) > Twitter : @dadoonet ---
**Author:** ![Andrew\_at\_DataFeedFi](https://avatars.discourse-cdn.com/v4/letter/a/0ea827/32.png) [@Andrew\_at\_DataFeedFi](https://discuss.elastic.co/u/Andrew_at_DataFeedFi)\ **Post date:** [May 10, 2012, 3:04pm UTC](https://discuss.elastic.co/t/document-indexing/7637/6 "2012-05-10T15:04:45Z")
If you do not want to use Tika, I am sure you can also base64 encode the file and stuff it into a giant string field yourself. Maybe? I have never tried it, I think it should work. --Andrew On May 10, 8:57 am, tullio0106 [tbettina...@axioma.it](mailto:tbettina...@axioma.it) wrote: > I'd like to use elasticsearch to store indexes about my documents. > I've documents like .doc files or .pdf files or whatever. > Is there any way/tool to index such kind of documents ? > Tks > Tullio ---
**Author:** ![tullio0106](https://avatars.discourse-cdn.com/v4/letter/t/d6d6ee/32.png) [@tullio0106](https://discuss.elastic.co/u/tullio0106)\ **Post date:** [May 10, 2012, 3:20pm UTC](https://discuss.elastic.co/t/document-indexing/7637/7 "2012-05-10T15:20:03Z")
Nothing against tika, but it's quite slow (I tried with a 3 MB pdf file and the extraction time was 4 min.). Base64 encoding don't seem to me a nice idea because every string would be indexed, also escapes and meaningless string. I hoped in a internal Elasticsearch tool avoind such complexities. Tks Tullio Il giorno giovedì 10 maggio 2012 15:57:13 UTC+2, tullio0106 ha scritto: > I'd like to use elasticsearch to store indexes about my documents. > I've documents like .doc files or .pdf files or whatever. > Is there any way/tool to index such kind of documents ? > Tks > Tullio ---
**Author:** ![dadoonet](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dadoonet/32/137187_2.png) [@dadoonet](https://discuss.elastic.co/u/dadoonet)\ **Post date:** [May 10, 2012, 3:28pm UTC](https://discuss.elastic.co/t/document-indexing/7637/8 "2012-05-10T15:28:20Z")
With ES attachment plugin, I indexed more than 100 documents per second in a "small cluster", 2 nodes, 8 Gb RAM. Documents are pdf, oOo, jpeg, ... So, may I suggest you give it a try ? David. Le 10 mai 2012 à 17:20, tullio0106 [tbettinazzi@axioma.it](mailto:tbettinazzi@axioma.it) a écrit : > slow (I tried with a 3 MB pdf file and the extraction time was 4 min.). > Base64 encoding don't seem to me a nice idea because every string would be > indexed, also escapes and meaningless string. > I hoped in a internal Elasticsearch tool avoind such complexities. > Tks > Tullio > > Il giorno giovedì 10 maggio 2012 15:57:13 UTC+2, tullio0106 ha scritto: > > > store indexes about my documents. > > I've documents like .doc files or .pdf files or whatever. > > Is there any way/tool to index such kind of documents ? > > Tks > > Tullio =?f1a0ad7a-5daa-4ff9-a3d5-f1d42f61d6fc-- > > -- > David Pilato > [http://dev.david.pilato.fr/](http://dev.david.pilato.fr/) > Twitter : @dadoonet ---
**Author:** ![tullio0106](https://avatars.discourse-cdn.com/v4/letter/t/d6d6ee/32.png) [@tullio0106](https://discuss.elastic.co/u/tullio0106)\ **Post date:** [May 13, 2012, 2:49pm UTC](https://discuss.elastic.co/t/document-indexing/7637/9 "2012-05-13T14:49:33Z")
Is there any Maven repository for attachment mapper ? Where can I find it ? Tks Tullio ---
**Author:** ![kimchy](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/kimchy/32/44952_2.png) [@kimchy](https://discuss.elastic.co/u/kimchy)\ **Post date:** [May 15, 2012, 8:22pm UTC](https://discuss.elastic.co/t/document-indexing/7637/10 "2012-05-15T20:22:39Z")
Its under the same maven repo as elasticsearch main jar files. On Sun, May 13, 2012 at 5:49 PM, tullio0106 [tbettinazzi@axioma.it](mailto:tbettinazzi@axioma.it) wrote: > Is there any Maven repository for attachment mapper ? > Where can I find it ? > Tks > Tullio > > -- > View this message in context: > [http://elasticsearch-users.115913.n3.nabble.com/Document-indexing-tp3977177p3984083.html](http://elasticsearch-users.115913.n3.nabble.com/Document-indexing-tp3977177p3984083.html) > Sent from the Elasticsearch Users mailing list archive at [Nabble.com](http://Nabble.com). ---
**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\ **Post date:** [July 6, 2017, 3:28am UTC](https://discuss.elastic.co/t/document-indexing/7637/11 "2017-07-06T03:28:45Z")