Index PDF in ES

Elastic Stack Elasticsearch
1

Can i create index for pdf file?
How?

2

You'll want the ingest-attachment plugin.

You can have a look at Implementing Ingest Attachment Processor Plugin for an example which will help you I think

3

If you have PDF docs in a folder you can use FSCrawler project as well.

4

Thanks both of you guys,

Can i give path of file in ingest plugin?

5

No.

You need to push data to ingest. Ingest can not pull data from a source.

6 
PUT _ingest/pipeline/attachment
{
  "description" : "Extract attachment information",
  "processors" : [
    {
      "attachment" : {
        "field" : "path"
      }
    }
  ]
}
PUT my_index/my_type/my_id?pipeline=attachment
{
  "path": { "type":"{path.home}/data/base64.bin" }
}

Can i use path?

Is there any other plugin i can use with ingest?

7

No you can't.

But I mentioned FSCrawler project already.

8

FScrawler is not working it is not even showing any error.
Command fscrawler job_name stuck for an hour on CLI.

I am using WINDOWS 10 and fscrawler 2.2.
Please help me

9

Yes. It's because of this:

Use the latest SNAPSHOT from here: https://oss.sonatype.org/content/repositories/snapshots/fr/pilato/elasticsearch/crawler/fscrawler/2.3-SNAPSHOT/

10

Thanks, now i am able to create index in elastic search.

Can i create index for images , which are inside pdf?

11

Do you mean? OCR?

If so, this (https://github.com/dadoonet/fscrawler#ocr-integration-using-tika-and-tesseract) is supposed to work. But someone reported that it might be buggy actually:

12

I installed tesseract but when i execute any exe inside it it is not running?

13

I really don't know. I'm sorry. I need to find some spare time to play with it but never got a chance to find a couple of hours yet.

14

Thanks for helping me :slight_smile:

15

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.