Fscrawler, error 415 when using REST API for upload PDF file

Erik_Bors · October 25, 2023, 8:15pm

Trying to use the REST API service of the fscrawler. When using the POST MAN with PDF file, the app is answering with the 415 code - unsupported media type

Content-Type header is correct with application/pdf.

Using POST to the /_document?debug=true . Nothing in the log.

dadoonet · October 25, 2023, 8:54pm

I think you need to use multipart/form-data.

github.com

dadoonet/fscrawler/blob/b923f867e0d81365d2a87cc2d8ef9f4f3a4b36ab/rest/src/main/java/fr/pilato/elasticsearch/crawler/fs/rest/DocumentApi.java#L79


      
              try {
                  messageDigest = settings.getFs().getChecksum() == null ?
                          null : MessageDigest.getInstance(settings.getFs().getChecksum());
              } catch (NoSuchAlgorithmException e) {
                  throw new RuntimeException("This should never happen as we checked that previously");
              }
          }
          
          @POST
          @Produces(MediaType.APPLICATION_JSON)
          @Consumes(MediaType.MULTIPART_FORM_DATA)
          public UploadResponse addDocument(
                  @QueryParam("debug") String debug,
                  @QueryParam("simulate") String simulate,
                  @FormDataParam("id") String formId,
                  @FormDataParam("index") String formIndex,
                  @HeaderParam("id") String headerId,
                  @HeaderParam("index") String headerIndex,
                  @QueryParam("id") String queryParamId,
                  @QueryParam("index") String queryParamIndex,
                  @FormDataParam("tags") InputStream tags,

Erik_Bors · October 25, 2023, 9:01pm

Thank you. I have checked this according to the source code and changed the calling from postman. But now im getting stucked with error 500. In the log i can see just this line 2023-10-25 22:52:32 20:52:32,151 DEBUG [f.p.e.c.f.r.RestApi] uploadToDocumentService(true, null, null, null, ...)

dadoonet · October 25, 2023, 9:08pm

Could you try with curl as in the documentation? I'd like to know if this "because of" Postman and then what needs to done.

Erik_Bors · October 25, 2023, 9:25pm

with curl it is working

system · November 22, 2023, 9:26pm

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.