# Compressor detection can only be called on some xcontent bytes or compressed xcontent bytes **URL:** \ **Category:** Elasticsearch\ **Created:** [January 19, 2017, 4:57pm UTC](https://discuss.elastic.co/t/compressor-detection-can-only-be-called-on-some-xcontent-bytes-or-compressed-xcontent-bytes/72194 "2017-01-19T16:57:59Z")\ **Posts on this page:** 5\ **Page:** 1
**Author:** ![sup3race](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/sup3race/32/14739_2.png) [@sup3race](https://discuss.elastic.co/u/sup3race)\ **Post date:** [January 19, 2017, 4:57pm UTC](https://discuss.elastic.co/t/compressor-detection-can-only-be-called-on-some-xcontent-bytes-or-compressed-xcontent-bytes/72194/1 "2017-01-19T16:57:59Z")
**I wrote this easy connection on python:** ``` class ElasticS(object): def __init__ (self,portI,ip): try: self.es = Elasticsearch([ip],port=portI ) print ("Connected: ", self.es.info()) except Exception as ex: print ("Error: ", ex) return None def get_elastic(self): return self.es if __name__ == ' __main__': ElasticS(portI=9200,ip='localhost') ``` **Pipeline:** ``` from elasticsearch import Elasticsearch class Pipeline(object): def __init__ (self): es = Elasticsearch() es.cat.health() body = { "description": "parse arxiv pdfs and index into ES", "processors" : [ { "attachment" : { "field": "pdf" } }, { "remove" : { "field": "pdf" } }, ] } es.index(index='_ingest', doc_type='pipeline', id='attachment', body=body) if __name__ == ' __main__': Pipeline() ``` **Insert with bulk streaming:** ``` from elasticsearch.helpers import streaming_bulk from Config.Connection import ElasticS from Config.Parse import Parse es = ElasticS(ip='localhost',portI=9200) p = Parse() for ok, result in streaming_bulk( client=es.get_elastic(), actions=p.parse_pdf(filename="QzpccHJvdmFcMTcwMS4wMDg5MC5wZGY="), index="arxiv", doc_type="arxiv", chunk_size=4, params={"pipeline": "attachment"} ): action, result = result.popitem() if not ok: print("failed to index document") else: print("Success!") ``` **I GOT THIS ERROR:** ``` [2017-01-19T17:53:14,342][DEBUG][o.e.a.i.IngestActionFilter] [node1] failed to execute pipeline [attachment] for document [arxiv/arxiv/null] org.elasticsearch.common.compress.NotXContentException: Compressor detection can only be called on some xcontent bytes or compressed xcontent bytes at org.elasticsearch.common.compress.CompressorFactory.compressor(CompressorFactory.java:57) ~[elasticsearch-5.1.1.jar:5.1.1] at org.elasticsearch.common.xcontent.XContentHelper.convertToMap(XContentHelper.java:65) ~[elasticsearch-5.1.1.jar:5.1.1] at org.elasticsearch.action.index.IndexRequest.sourceAsMap(IndexRequest.java:403) ~[elasticsearch-5.1.1.jar:5.1.1] at org.elasticsearch.ingest.PipelineExecutionService.innerExecute(PipelineExecutionService.java:164) ~[elasticsearch-5.1.1.jar:5.1.1] at org.elasticsearch.ingest.PipelineExecutionService.access$000(PipelineExecutionService.java:41) ~[elasticsearch-5.1.1.jar:5.1.1] at org.elasticsearch.ingest.PipelineExecutionService$2.doRun(PipelineExecutionService.java:88) [elasticsearch-5.1.1.jar:5.1.1] at org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:527) [elasticsearch-5.1.1.jar:5.1.1] at org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37) [elasticsearch-5.1.1.jar:5.1.1] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) [?:1.8.0_101] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) [?:1.8.0_101] at java.lang.Thread.run(Thread.java:745) [?:1.8.0_101] ``` **i'm following this guide btw:** [GUIDE](https://www.elastic.co/blog/ingesting-and-exploring-scientific-papers-using-elastic-cloud) My main goal is to insert documents on elasticsearch and work with them... i'm pretty sure im doing something wrong. thank you ---
**Author:** ![sup3race](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/sup3race/32/14739_2.png) [@sup3race](https://discuss.elastic.co/u/sup3race)\ **Post date:** [January 20, 2017, 8:48am UTC](https://discuss.elastic.co/t/compressor-detection-can-only-be-called-on-some-xcontent-bytes-or-compressed-xcontent-bytes/72194/2 "2017-01-20T08:48:03Z")
can someone help me out please ☹ ---
**Author:** ![sup3race](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/sup3race/32/14739_2.png) [@sup3race](https://discuss.elastic.co/u/sup3race)\ **Post date:** [January 20, 2017, 12:10pm UTC](https://discuss.elastic.co/t/compressor-detection-can-only-be-called-on-some-xcontent-bytes-or-compressed-xcontent-bytes/72194/3 "2017-01-20T12:10:17Z")
@dadoonet ---
**Author:** ![talevy](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/talevy/32/44896_2.png) [@talevy](https://discuss.elastic.co/u/talevy)\ **Post date:** [January 20, 2017, 8:07pm UTC](https://discuss.elastic.co/t/compressor-detection-can-only-be-called-on-some-xcontent-bytes-or-compressed-xcontent-bytes/72194/4 "2017-01-20T20:07:33Z")
Hi @sup3race, I think I am missing some context with the code, but it seems `p.parse_pdf(filename="QzpccHJvdmFcMTcwMS4wMDg5MC5wZGY=")` is to blame. however you are parsing the pdf and generating the appropriate actions objects. It seems they do not follow the appropriate json structure that is required. take a look at the example action objects found in the python docs here: [http://elasticsearch-py.readthedocs.io/en/master/helpers.html](http://elasticsearch-py.readthedocs.io/en/master/helpers.html). the pdf needs to be converted into a base64 string value in a json field. let me know if that helps! ---
**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\ **Post date:** [February 17, 2017, 8:07pm UTC](https://discuss.elastic.co/t/compressor-detection-can-only-be-called-on-some-xcontent-bytes-or-compressed-xcontent-bytes/72194/5 "2017-02-17T20:07:56Z")
This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.