Howto Decode64 attachment

dukr · December 7, 2012, 5:40pm

Hi,
I would elasticserach used for indexing text files (PDF, DOC, XML), as well
as their data storage. I used the example given on the web page for saving
the file in base64 using the plugin to store/index in to elasticsearch. It
works .
When I want to get the contents of the file in its original format (eg PDF)
and get base64 string that is not properly structured (one long line). Is
there any way how to get the original file (convert back into origin MIME
type) from elasticsearch?

Thanks,
DK

--

dadoonet · December 7, 2012, 6:57pm

Exactly what we do in www.scrutmydocs.org project.
It's on Github.

That said, you are probably using mapper attachment plugin, aren't you?

So, I think that there is an issue (and I tried to fix it but did not manage to get my unit tests pass): content-type is not automaticaly set, so you have to manage it on your side.
See: https://github.com/scrutmydocs/scrutmydocs/blob/master/src/main/java/org/scrutmydocs/webapp/service/document/DocumentService.java

When sending back the attachment to the user, you have to manage it again.
See https://github.com/scrutmydocs/scrutmydocs/blob/master/src/main/java/org/scrutmydocs/webapp/servlet/DownloadServlet.java

HTH

David
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs

Le 7 déc. 2012 à 18:40, dukr dusan.krasa@gmail.com a écrit :

Hi,
I would elasticserach used for indexing text files (PDF, DOC, XML), as well as their data storage. I used the example given on the web page for saving the file in base64 using the plugin to store/index in to elasticsearch. It works .
When I want to get the contents of the file in its original format (eg PDF) and get base64 string that is not properly structured (one long line). Is there any way how to get the original file (convert back into origin MIME type) from elasticsearch?

Thanks,
DK

--

dukr · December 10, 2012, 12:31pm

Exactly the www.scrutmydocs.org looks like my project.

Yes, I used the mapper attachment plugin for first test.

Could you please give aditional info about the parameters in

github.com

scrutmydocs/scrutmydocs/blob/master/src/main/java/org/scrutmydocs/webapp/service/document/DocumentService.java

/*
 * Licensed to scrutmydocs.org (the "Author") under one
 * or more contributor license agreements.  See the NOTICE file
 * distributed with this work for additional information
 * regarding copyright ownership. Author licenses this
 * file to you under the Apache License, Version 2.0 (the
 * "License"); you may not use this file except in compliance
 * with the License.  You may obtain a copy of the License at
 *
 *    http://www.apache.org/licenses/LICENSE-2.0
 *
 * Unless required by applicable law or agreed to in writing,
 * software distributed under the License is distributed on an
 * "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
 * KIND, either express or implied.  See the License for the
 * specific language governing permissions and limitations
 * under the License.
 */

package org.scrutmydocs.webapp.service.document;

This file has been truncated. show original

("_content_type") - it's MIME-TYPE ?
("_name") -it's filename
("content") - it's base64 encoded document ?

Thanks

dk

Dne pátek, 7. prosince 2012 19:57:41 UTC+1 David Pilato napsal(a):

Exactly what we do in www.scrutmydocs.org project.
It's on Github.

That said, you are probably using mapper attachment plugin, aren't you?

So, I think that there is an issue (and I tried to fix it but did not
manage to get my unit tests pass): content-type is not automaticaly set, so
you have to manage it on your side.
See:
https://github.com/scrutmydocs/scrutmydocs/blob/master/src/main/java/org/scrutmydocs/webapp/service/document/DocumentService.java

When sending back the attachment to the user, you have to manage it again.
See
https://github.com/scrutmydocs/scrutmydocs/blob/master/src/main/java/org/scrutmydocs/webapp/servlet/DownloadServlet.java

HTH

David
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs

Le 7 déc. 2012 à 18:40, dukr <dusan...@gmail.com <javascript:>> a écrit :

Hi,
I would elasticserach used for indexing text files (PDF, DOC, XML), as
well as their data storage. I used the example given on the web page for
saving the file in base64 using the plugin to store/index in to
elasticsearch. It works .
When I want to get the contents of the file in its original format (eg
PDF) and get base64 string that is not properly structured (one long
line). Is there any way how to get the original file (convert back into
origin MIME type) from elasticsearch?

Thanks,
DK

--

--

dadoonet · December 10, 2012, 12:35pm

Yes for all questions.

--
David
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs

Le 10 déc. 2012 à 13:31, dukr dusan.krasa@gmail.com a écrit :

Exactly the www.scrutmydocs.org looks like my project.

Yes, I used the mapper attachment plugin for first test.

Could you please give aditional info about the parameters in
https://github.com/scrutmydocs/scrutmydocs/blob/master/src/main/java/org/scrutmydocs/webapp/service/document/DocumentService.java

("_content_type") - it's MIME-TYPE ?
("_name") -it's filename
("content") - it's base64 encoded document ?

Thanks

dk

Dne pátek, 7. prosince 2012 19:57:41 UTC+1 David Pilato napsal(a):
Exactly what we do in www.scrutmydocs.org project.
It's on Github.

That said, you are probably using mapper attachment plugin, aren't you?

So, I think that there is an issue (and I tried to fix it but did not manage to get my unit tests pass): content-type is not automaticaly set, so you have to manage it on your side.
See: https://github.com/scrutmydocs/scrutmydocs/blob/master/src/main/java/org/scrutmydocs/webapp/service/document/DocumentService.java

When sending back the attachment to the user, you have to manage it again.
See https://github.com/scrutmydocs/scrutmydocs/blob/master/src/main/java/org/scrutmydocs/webapp/servlet/DownloadServlet.java

HTH

David
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs

Le 7 déc. 2012 à 18:40, dukr dusan...@gmail.com a écrit :

Hi,
I would elasticserach used for indexing text files (PDF, DOC, XML), as well as their data storage. I used the example given on the web page for saving the file in base64 using the plugin to store/index in to elasticsearch. It works .
When I want to get the contents of the file in its original format (eg PDF) and get base64 string that is not properly structured (one long line). Is there any way how to get the original file (convert back into origin MIME type) from elasticsearch?

Thanks,
DK

--

--

Topic		Replies	Views
Elasticsearch - mapper attachment plugin Elasticsearch	2	465	July 5, 2017
Problems indexing attachments using attachment mapping Elasticsearch	3	1504	July 6, 2017
ElasticSearch mapper-attachments 2.2 Elasticsearch	3	814	July 5, 2017
Index file content in elasticsearch without storing the actual content in base64 Elasticsearch	2	1533	February 14, 2017
Index HTML documents Elasticsearch	4	2635	July 6, 2017

Howto Decode64 attachment

HTH

Thanks, DK

Thanks

HTH

Thanks

HTH

Thanks, DK

Related topics

Thanks,
DK

Thanks,
DK