# How to make unstructured data available in Hadoop for analysis with Elasticsearch?

**URL:** <https://discuss.elastic.co/t/how-to-make-unstructured-data-available-in-hadoop-for-analysis-with-elasticsearch/23032>\
**Category:** Elasticsearch\
**Created:** [April 1, 2015, 9:12am UTC](https://discuss.elastic.co/t/how-to-make-unstructured-data-available-in-hadoop-for-analysis-with-elasticsearch/23032 "2015-04-01T09:12:51Z")\
**Posts on this page:** 11\
**Page:** 1

<div class="post-metadata">

**Author:** ![omar\_ben\_salem](https://avatars.discourse-cdn.com/v4/letter/o/13edae/32.png) [@omar\_ben\_salem](https://discuss.elastic.co/u/omar_ben_salem)\
**Post date:** [April 1, 2015, 9:12am UTC](https://discuss.elastic.co/t/how-to-make-unstructured-data-available-in-hadoop-for-analysis-with-elasticsearch/23032/1 "2015-04-01T09:12:51Z")

</div>

Hi everyone,  
I'm wondering, it possible to make analytics on unstructured data with  
Elasticsearch?  
If so? how?  
Thanks,  
Omar,

--  
You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/08e7617c-9e72-40a6-a780-7f632fee6d47%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/08e7617c-9e72-40a6-a780-7f632fee6d47%40googlegroups.com).  
For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).

---

<div class="post-metadata">

**Author:** ![costin](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/costin/32/44950_2.png) [@costin](https://discuss.elastic.co/u/costin)\
**Post date:** [April 1, 2015, 9:20am UTC](https://discuss.elastic.co/t/how-to-make-unstructured-data-available-in-hadoop-for-analysis-with-elasticsearch/23032/2 "2015-04-01T09:20:03Z")

</div>

If your data is in Hadoop, you would index it in Elasticsearch (through the es-hadoop connector) and then run your  
queries against it (either from Hadoop through the same connector) or through other tools (like Kibana) outside Hadoop.

There are plenty of blog posts, documentations, presentations and videos on the topic so I recommend spending sometime  
time with them to better understand what options suite your use case.

On 4/1/15 12:12 PM, BEN SALEM Omar wrote:

> Hi everyone,  
> I'm wondering, it possible to make analytics on unstructured data with Elasticsearch?  
> If so? how?  
> Thanks,  
> Omar,
> 
> --  
> You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
> To unsubscribe from this group and stop receiving emails from it, send an email to  
> [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com) [mailto:elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
> To view this discussion on the web visit  
> [https://groups.google.com/d/msgid/elasticsearch/08e7617c-9e72-40a6-a780-7f632fee6d47%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/08e7617c-9e72-40a6-a780-7f632fee6d47%40googlegroups.com)  
> [https://groups.google.com/d/msgid/elasticsearch/08e7617c-9e72-40a6-a780-7f632fee6d47%40googlegroups.com?utm\_medium=email&utm\_source=footer](https://groups.google.com/d/msgid/elasticsearch/08e7617c-9e72-40a6-a780-7f632fee6d47%40googlegroups.com?utm_medium=email&utm_source=footer).  
> For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).  
> --  
> Costin

--  
You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/551BB843.3040206%40gmail.com](https://groups.google.com/d/msgid/elasticsearch/551BB843.3040206%40gmail.com).  
For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).

---

<div class="post-metadata">

**Author:** ![ElasticSearch\_Users\_](https://avatars.discourse-cdn.com/v4/letter/e/b4bc9f/32.png) [@ElasticSearch\_Users\_](https://discuss.elastic.co/u/ElasticSearch_Users_)\
**Post date:** [April 1, 2015, 9:33am UTC](https://discuss.elastic.co/t/how-to-make-unstructured-data-available-in-hadoop-for-analysis-with-elasticsearch/23032/3 "2015-04-01T09:33:09Z")

</div>

Hi Costin,

I've already done that and here I am using Kibana to dashboards and so on(I  
have a question for you I'll ask a little bit later)

But, my question now is how to make UNstructured data available for such  
analytics?  
Let's suppose I have images or textfile that I want to analyse? How make it  
available in a structured way in hive to do the required steps untill  
loading it into my ES cluster and perform my analytics?

The second question is , I have created some Dashboards with Kibana; now  
what I want to do, is giving my dashboards to the client I'm working  
with/for to to do his analytics without letting him see what's going on the  
ES cluster.  
What's the easiest way to do this?  
Thanks,  
ᐧ

On Wed, Apr 1, 2015 at 11:20 AM, Costin Leau [costin.leau@gmail.com](mailto:costin.leau@gmail.com) wrote:

> If your data is in Hadoop, you would index it in Elasticsearch (through  
> the es-hadoop connector) and then run your queries against it (either from  
> Hadoop through the same connector) or through other tools (like Kibana)  
> outside Hadoop.
> 
> There are plenty of blog posts, documentations, presentations and videos  
> on the topic so I recommend spending sometime time with them to better  
> understand what options suite your use case.
> 
> On 4/1/15 12:12 PM, BEN SALEM Omar wrote:
> 
> > Hi everyone,  
> > I'm wondering, it possible to make analytics on unstructured data with  
> > Elasticsearch?  
> > If so? how?  
> > Thanks,  
> > Omar,
> > 
> > --  
> > You received this message because you are subscribed to the Google Groups  
> > "elasticsearch" group.  
> > To unsubscribe from this group and stop receiving emails from it, send an  
> > email to  
> > [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com) \<mailto:elasticsearch+  
> > [unsubscribe@googlegroups.com](mailto:unsubscribe@googlegroups.com)\>.  
> > To view this discussion on the web visit  
> > [https://groups.google.com/d/msgid/elasticsearch/08e7617c-](https://groups.google.com/d/msgid/elasticsearch/08e7617c-)  
> > 9e72-40a6-a780-7f632fee6d47%[40googlegroups.com](http://40googlegroups.com)  
> > \<[https://groups.google.com/d/msgid/elasticsearch/08e7617c-](https://groups.google.com/d/msgid/elasticsearch/08e7617c-)  
> > 9e72-40a6-a780-7f632fee6d47%[40GGGROUPS CASINO – Real Slot Casino for 10,000+ Senior Players](http://40googlegroups.com?utm_medium=)  
> > email&utm\_source=footer\>.  
> > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).
> 
> --  
> Costin
> 
> --  
> You received this message because you are subscribed to a topic in the  
> Google Groups "elasticsearch" group.  
> To unsubscribe from this topic, visit [https://groups.google.com/d/](https://groups.google.com/d/)  
> topic/elasticsearch/Md6pwsOI2Dw/unsubscribe.  
> To unsubscribe from this group and all its topics, send an email to  
> [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
> To view this discussion on the web visit [https://groups.google.com/d/](https://groups.google.com/d/)  
> msgid/elasticsearch/551BB843.3040206%[40gmail.com](http://40gmail.com).  
> For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).

--  
You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/CAGgBrpwA5UF3VAyX%3D9tZMQbFxZ8BOREJyfEdiQ6G%2BSzXiqGyPg%40mail.gmail.com](https://groups.google.com/d/msgid/elasticsearch/CAGgBrpwA5UF3VAyX%3D9tZMQbFxZ8BOREJyfEdiQ6G%2BSzXiqGyPg%40mail.gmail.com).  
For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).

---

<div class="post-metadata">

**Author:** ![costin](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/costin/32/44950_2.png) [@costin](https://discuss.elastic.co/u/costin)\
**Post date:** [April 1, 2015, 9:53am UTC](https://discuss.elastic.co/t/how-to-make-unstructured-data-available-in-hadoop-for-analysis-with-elasticsearch/23032/4 "2015-04-01T09:53:21Z")

</div>

Depends on what you want to do with the data - you need some type of analyzer to interpret your data typically depending  
on what type of queries you are making  
since otherwise it's just bytes.  
Your images need to be converted into something - RGB signature, shapes, etc... Same for a text file - it in English,  
Spanish, Japanese? Is it a pdf, xls - again ES needs to understand the format and there are multiple plugins for that.  
Even if you don't know what you are looking, you need to break down the blob of bytes into 'something' that can be  
searched on.

As for Kibana, it's all JS. Some are fine with embedding it into their own app or exposing directly, some prefer more  
control and end up modifying it or putting their own controls in front that apply filtering or enforce a read-only view.  
The Kibana team is working on enhancing this even further so it's best to talk to them about specific technical issues  
which I'm afraid I can't answer.

Hope this helps,

On 4/1/15 12:33 PM, 'BEN SALEM Omar' via elasticsearch wrote:

> Hi Costin,
> 
> I've already done that and here I am using Kibana to dashboards and so on(I have a question for you I'll ask a little  
> bit later)
> 
> But, my question now is how to make UNstructured data available for such analytics?  
> Let's suppose I have images or textfile that I want to analyse? How make it available in a structured way in hive to do  
> the required steps untill loading it into my ES cluster and perform my analytics?
> 
> The second question is , I have created some Dashboards with Kibana; now what I want to do, is giving my dashboards to  
> the client I'm working with/for to to do his analytics without letting him see what's going on the ES cluster.  
> What's the easiest way to do this?  
> Thanks,  
> ᐧ
> 
> On Wed, Apr 1, 2015 at 11:20 AM, Costin Leau \<[costin.leau@gmail.com](mailto:costin.leau@gmail.com) [mailto:costin.leau@gmail.com](mailto:costin.leau@gmail.com)\> wrote:
> 
> ```
> If your data is in Hadoop, you would index it in Elasticsearch (through the es-hadoop connector) and then run your
> queries against it (either from Hadoop through the same connector) or through other tools (like Kibana) outside Hadoop.
> 
> There are plenty of blog posts, documentations, presentations and videos on the topic so I recommend spending
> sometime time with them to better understand what options suite your use case.
> 
> On 4/1/15 12:12 PM, BEN SALEM Omar wrote:
> 
> Hi everyone,
> I'm wondering, it possible to make analytics on unstructured data with Elasticsearch?
> If so? how?
> Thanks,
> Omar,
> 
> --
> You received this message because you are subscribed to the Google Groups "elasticsearch" group.
> To unsubscribe from this group and stop receiving emails from it, send an email to
> elasticsearch+unsubscribe@__googlegroups.com <mailto:elasticsearch%2Bunsubscribe@googlegroups.com>
> <mailto:elasticsearch+__unsubscribe@googlegroups.com <mailto:elasticsearch%2Bunsubscribe@googlegroups.com>>.
> To view this discussion on the web visit
> https://groups.google.com/d/ __msgid/elasticsearch/08e7617c-__ 9e72-40a6-a780-7f632fee6d47%__40googlegroups.com
> <https://groups.google.com/d/msgid/elasticsearch/08e7617c-9e72-40a6-a780-7f632fee6d47%40googlegroups.com>
> <https://groups.google.com/d/ __msgid/elasticsearch/08e7617c-__ 9e72-40a6-a780-7f632fee6d47% __40googlegroups.com?utm_medium=__ email&utm_source=footer
> <https://groups.google.com/d/msgid/elasticsearch/08e7617c-9e72-40a6-a780-7f632fee6d47%40googlegroups.com?utm_medium=email&utm_source=footer>>.
> For more options, visit https://groups.google.com/d/__optout <https://groups.google.com/d/optout>.
> 
> --
> Costin
> 
> --
> You received this message because you are subscribed to a topic in the Google Groups "elasticsearch" group.
> To unsubscribe from this topic, visit https://groups.google.com/d/ __topic/elasticsearch/__ Md6pwsOI2Dw/unsubscribe
> <https://groups.google.com/d/topic/elasticsearch/Md6pwsOI2Dw/unsubscribe>.
> To unsubscribe from this group and all its topics, send an email to elasticsearch+unsubscribe@__googlegroups.com
> <mailto:elasticsearch%2Bunsubscribe@googlegroups.com>.
> To view this discussion on the web visit
> https://groups.google.com/d/ __msgid/elasticsearch/551BB843.__ 3040206%40gmail.com
> <https://groups.google.com/d/msgid/elasticsearch/551BB843.3040206%40gmail.com>.
> For more options, visit https://groups.google.com/d/__optout <https://groups.google.com/d/optout>.
> 
> ```
> 
> --  
> You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
> To unsubscribe from this group and stop receiving emails from it, send an email to  
> [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com) [mailto:elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
> To view this discussion on the web visit  
> [https://groups.google.com/d/msgid/elasticsearch/CAGgBrpwA5UF3VAyX%3D9tZMQbFxZ8BOREJyfEdiQ6G%2BSzXiqGyPg%40mail.gmail.com](https://groups.google.com/d/msgid/elasticsearch/CAGgBrpwA5UF3VAyX%3D9tZMQbFxZ8BOREJyfEdiQ6G%2BSzXiqGyPg%40mail.gmail.com)  
> [https://groups.google.com/d/msgid/elasticsearch/CAGgBrpwA5UF3VAyX%3D9tZMQbFxZ8BOREJyfEdiQ6G%2BSzXiqGyPg%40mail.gmail.com?utm\_medium=email&utm\_source=footer](https://groups.google.com/d/msgid/elasticsearch/CAGgBrpwA5UF3VAyX%3D9tZMQbFxZ8BOREJyfEdiQ6G%2BSzXiqGyPg%40mail.gmail.com?utm_medium=email&utm_source=footer).  
> For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).

--  
Costin

--  
You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/551BC011.6030503%40gmail.com](https://groups.google.com/d/msgid/elasticsearch/551BC011.6030503%40gmail.com).  
For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).

---

<div class="post-metadata">

**Author:** ![ElasticSearch\_Users\_](https://avatars.discourse-cdn.com/v4/letter/e/b4bc9f/32.png) [@ElasticSearch\_Users\_](https://discuss.elastic.co/u/ElasticSearch_Users_)\
**Post date:** [April 1, 2015, 10:23am UTC](https://discuss.elastic.co/t/how-to-make-unstructured-data-available-in-hadoop-for-analysis-with-elasticsearch/23032/5 "2015-04-01T10:23:39Z")

</div>

Thank you for your time and help Costin !

ᐧ

On Wed, Apr 1, 2015 at 11:53 AM, Costin Leau [costin.leau@gmail.com](mailto:costin.leau@gmail.com) wrote:

> Depends on what you want to do with the data - you need some type of  
> analyzer to interpret your data typically depending on what type of queries  
> you are making  
> since otherwise it's just bytes.  
> Your images need to be converted into something - RGB signature, shapes,  
> etc... Same for a text file - it in English, Spanish, Japanese? Is it a  
> pdf, xls - again ES needs to understand the format and there are multiple  
> plugins for that. Even if you don't know what you are looking, you need to  
> break down the blob of bytes into 'something' that can be searched on.
> 
> As for Kibana, it's all JS. Some are fine with embedding it into their own  
> app or exposing directly, some prefer more control and end up modifying it  
> or putting their own controls in front that apply filtering or enforce a  
> read-only view. The Kibana team is working on enhancing this even further  
> so it's best to talk to them about specific technical issues which I'm  
> afraid I can't answer.
> 
> Hope this helps,
> 
> On 4/1/15 12:33 PM, 'BEN SALEM Omar' via elasticsearch wrote:
> 
> > Hi Costin,
> > 
> > I've already done that and here I am using Kibana to dashboards and so  
> > on(I have a question for you I'll ask a little  
> > bit later)
> > 
> > But, my question now is how to make UNstructured data available for such  
> > analytics?  
> > Let's suppose I have images or textfile that I want to analyse? How make  
> > it available in a structured way in hive to do  
> > the required steps untill loading it into my ES cluster and perform my  
> > analytics?
> > 
> > The second question is , I have created some Dashboards with Kibana; now  
> > what I want to do, is giving my dashboards to  
> > the client I'm working with/for to to do his analytics without letting  
> > him see what's going on the ES cluster.  
> > What's the easiest way to do this?  
> > Thanks,  
> > ᐧ
> > 
> > On Wed, Apr 1, 2015 at 11:20 AM, Costin Leau \<[costin.leau@gmail.com](mailto:costin.leau@gmail.com)  
> > [mailto:costin.leau@gmail.com](mailto:costin.leau@gmail.com)\> wrote:
> > 
> > ```
> > If your data is in Hadoop, you would index it in Elasticsearch
> > 
> > ```
> > 
> > (through the es-hadoop connector) and then run your  
> > queries against it (either from Hadoop through the same connector) or  
> > through other tools (like Kibana) outside Hadoop.
> > 
> > ```
> > There are plenty of blog posts, documentations, presentations and
> > 
> > ```
> > 
> > videos on the topic so I recommend spending  
> > sometime time with them to better understand what options suite your  
> > use case.
> > 
> > ```
> > On 4/1/15 12:12 PM, BEN SALEM Omar wrote:
> > 
> > Hi everyone,
> > I'm wondering, it possible to make analytics on unstructured data
> > 
> > ```
> > 
> > with Elasticsearch?  
> > If so? how?  
> > Thanks,  
> > Omar,
> > 
> > ```
> > --
> > You received this message because you are subscribed to the
> > 
> > ```
> > 
> > Google Groups "elasticsearch" group.  
> > To unsubscribe from this group and stop receiving emails from it,  
> > send an email to  
> > elasticsearch+unsubscribe@\_\_googlegroups.com \<mailto:  
> > elasticsearch%2Bunsubscribe@googlegroups.com\>  
> > \<[mailto:elasticsearch+\_\_unsubscribe@googlegroups.com](mailto:elasticsearch+__unsubscribe@googlegroups.com) \<mailto:  
> > elasticsearch%2Bunsubscribe@googlegroups.com\>\>.  
> > To view this discussion on the web visit  
> > [https://groups.google.com/d/\_\_msgid/elasticsearch/08e7617c-\_](https://groups.google.com/d/__msgid/elasticsearch/08e7617c-_)  
> > \_9e72-40a6-a780-7f632fee6d47%\_\_40googlegroups.com  
> > \<[https://groups.google.com/d/msgid/elasticsearch/08e7617c-](https://groups.google.com/d/msgid/elasticsearch/08e7617c-)  
> > 9e72-40a6-a780-7f632fee6d47%[40googlegroups.com](http://40googlegroups.com)\>  
> > \<[https://groups.google.com/d/\_\_msgid/elasticsearch/08e7617c-](https://groups.google.com/d/__msgid/elasticsearch/08e7617c-)  
> > \_\_9e72-40a6-a780-7f632fee6d47%\__[40GGGROUPS CASINO – Real Slot Casino for 10,000+ Senior Players](http://40googlegroups.com?utm)_  
> > medium=\_\_email&utm\_source=footer  
> > \<[https://groups.google.com/d/msgid/elasticsearch/08e7617c-](https://groups.google.com/d/msgid/elasticsearch/08e7617c-)  
> > 9e72-40a6-a780-7f632fee6d47%[40GGGROUPS CASINO – Real Slot Casino for 10,000+ Senior Players](http://40googlegroups.com?utm_medium=)  
> > email&utm\_source=footer\>\>.  
> > For more options, visit [https://groups.google.com/d/\_\_optout](https://groups.google.com/d/__optout) \<  
> > [https://groups.google.com/d/optout](https://groups.google.com/d/optout)\>.
> > 
> > ```
> > --
> > Costin
> > 
> > --
> > You received this message because you are subscribed to a topic in
> > 
> > ```
> > 
> > the Google Groups "elasticsearch" group.  
> > To unsubscribe from this topic, visit [https://groups.google.com/d/\_\_](https://groups.google.com/d/__)  
> > topic/elasticsearch/\_\_Md6pwsOI2Dw/unsubscribe  
> > \<[https://groups.google.com/d/topic/elasticsearch/](https://groups.google.com/d/topic/elasticsearch/)  
> > Md6pwsOI2Dw/unsubscribe\>.  
> > To unsubscribe from this group and all its topics, send an email to  
> > elasticsearch+unsubscribe@\_\_googlegroups.com  
> > [mailto:elasticsearch%2Bunsubscribe@googlegroups.com](mailto:elasticsearch%2Bunsubscribe@googlegroups.com).  
> > To view this discussion on the web visit  
> > [https://groups.google.com/d/\_\_msgid/elasticsearch/551BB843.\_](https://groups.google.com/d/__msgid/elasticsearch/551BB843._)  
> > \_3040206%[40gmail.com](http://40gmail.com)  
> > \<[https://groups.google.com/d/msgid/elasticsearch/551BB843](https://groups.google.com/d/msgid/elasticsearch/551BB843).  
> > 3040206%[40gmail.com](http://40gmail.com)\>.  
> > For more options, visit [https://groups.google.com/d/\_\_optout](https://groups.google.com/d/__optout) \<  
> > [https://groups.google.com/d/optout](https://groups.google.com/d/optout)\>.
> > 
> > --  
> > You received this message because you are subscribed to the Google Groups  
> > "elasticsearch" group.  
> > To unsubscribe from this group and stop receiving emails from it, send an  
> > email to  
> > [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com) \<mailto:elasticsearch+  
> > [unsubscribe@googlegroups.com](mailto:unsubscribe@googlegroups.com)\>.  
> > To view this discussion on the web visit  
> > [https://groups.google.com/d/msgid/elasticsearch/CAGgBrpwA5UF3VAyX%](https://groups.google.com/d/msgid/elasticsearch/CAGgBrpwA5UF3VAyX%25)  
> > 3D9tZMQbFxZ8BOREJyfEdiQ6G%2BSzXiqGyPg%[40mail.gmail.com](http://40mail.gmail.com)  
> > \<[https://groups.google.com/d/msgid/elasticsearch/CAGgBrpwA5UF3VAyX%](https://groups.google.com/d/msgid/elasticsearch/CAGgBrpwA5UF3VAyX%25)  
> > 3D9tZMQbFxZ8BOREJyfEdiQ6G%2BSzXiqGyPg%[40mail.gmail.com](http://40mail.gmail.com)?  
> > utm\_medium=email&utm\_source=footer\>.  
> > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).
> 
> --  
> Costin
> 
> --  
> You received this message because you are subscribed to a topic in the  
> Google Groups "elasticsearch" group.  
> To unsubscribe from this topic, visit [https://groups.google.com/d/](https://groups.google.com/d/)  
> topic/elasticsearch/Md6pwsOI2Dw/unsubscribe.  
> To unsubscribe from this group and all its topics, send an email to  
> [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
> To view this discussion on the web visit [https://groups.google.com/d/](https://groups.google.com/d/)  
> msgid/elasticsearch/551BC011.6030503%[40gmail.com](http://40gmail.com).
> 
> For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).

--  
You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/CAGgBrpzgoyC8DPLrgN2yJrrFa-9qtj4JGVpfRThwh%3DcUwPFTnw%40mail.gmail.com](https://groups.google.com/d/msgid/elasticsearch/CAGgBrpzgoyC8DPLrgN2yJrrFa-9qtj4JGVpfRThwh%3DcUwPFTnw%40mail.gmail.com).  
For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).

---

<div class="post-metadata">

**Author:** ![ElasticSearch\_Users\_](https://avatars.discourse-cdn.com/v4/letter/e/b4bc9f/32.png) [@ElasticSearch\_Users\_](https://discuss.elastic.co/u/ElasticSearch_Users_)\
**Post date:** [April 1, 2015, 1:42pm UTC](https://discuss.elastic.co/t/how-to-make-unstructured-data-available-in-hadoop-for-analysis-with-elasticsearch/23032/6 "2015-04-01T13:42:03Z")

</div>

Costin HELP !!

I've installed shield and tried to add an admin user, but when I do so, an  
error jumps saying that there is an error in the elif line.  
But now, if I try to run Kibana this is what happens !!! :

Help pleaaaase !!  
​  
ᐧ

On Wed, Apr 1, 2015 at 12:23 PM, BEN SALEM Omar [omar.bensalem@esprit.tn](mailto:omar.bensalem@esprit.tn)  
wrote:

> Thank you for your time and help Costin !
> 
> ᐧ
> 
> On Wed, Apr 1, 2015 at 11:53 AM, Costin Leau [costin.leau@gmail.com](mailto:costin.leau@gmail.com)  
> wrote:
> 
> > Depends on what you want to do with the data - you need some type of  
> > analyzer to interpret your data typically depending on what type of queries  
> > you are making  
> > since otherwise it's just bytes.  
> > Your images need to be converted into something - RGB signature, shapes,  
> > etc... Same for a text file - it in English, Spanish, Japanese? Is it a  
> > pdf, xls - again ES needs to understand the format and there are multiple  
> > plugins for that. Even if you don't know what you are looking, you need to  
> > break down the blob of bytes into 'something' that can be searched on.
> > 
> > As for Kibana, it's all JS. Some are fine with embedding it into their  
> > own app or exposing directly, some prefer more control and end up modifying  
> > it or putting their own controls in front that apply filtering or enforce a  
> > read-only view. The Kibana team is working on enhancing this even further  
> > so it's best to talk to them about specific technical issues which I'm  
> > afraid I can't answer.
> > 
> > Hope this helps,
> > 
> > On 4/1/15 12:33 PM, 'BEN SALEM Omar' via elasticsearch wrote:
> > 
> > > Hi Costin,
> > > 
> > > I've already done that and here I am using Kibana to dashboards and so  
> > > on(I have a question for you I'll ask a little  
> > > bit later)
> > > 
> > > But, my question now is how to make UNstructured data available for such  
> > > analytics?  
> > > Let's suppose I have images or textfile that I want to analyse? How make  
> > > it available in a structured way in hive to do  
> > > the required steps untill loading it into my ES cluster and perform my  
> > > analytics?
> > > 
> > > The second question is , I have created some Dashboards with Kibana; now  
> > > what I want to do, is giving my dashboards to  
> > > the client I'm working with/for to to do his analytics without letting  
> > > him see what's going on the ES cluster.  
> > > What's the easiest way to do this?  
> > > Thanks,  
> > > ᐧ
> > > 
> > > On Wed, Apr 1, 2015 at 11:20 AM, Costin Leau \<[costin.leau@gmail.com](mailto:costin.leau@gmail.com)  
> > > [mailto:costin.leau@gmail.com](mailto:costin.leau@gmail.com)\> wrote:
> > > 
> > > ```
> > > If your data is in Hadoop, you would index it in Elasticsearch
> > > 
> > > ```
> > > 
> > > (through the es-hadoop connector) and then run your  
> > > queries against it (either from Hadoop through the same connector)  
> > > or through other tools (like Kibana) outside Hadoop.
> > > 
> > > ```
> > > There are plenty of blog posts, documentations, presentations and
> > > 
> > > ```
> > > 
> > > videos on the topic so I recommend spending  
> > > sometime time with them to better understand what options suite your  
> > > use case.
> > > 
> > > ```
> > > On 4/1/15 12:12 PM, BEN SALEM Omar wrote:
> > > 
> > > Hi everyone,
> > > I'm wondering, it possible to make analytics on unstructured
> > > 
> > > ```
> > > 
> > > data with Elasticsearch?  
> > > If so? how?  
> > > Thanks,  
> > > Omar,
> > > 
> > > ```
> > > --
> > > You received this message because you are subscribed to the
> > > 
> > > ```
> > > 
> > > Google Groups "elasticsearch" group.  
> > > To unsubscribe from this group and stop receiving emails from  
> > > it, send an email to  
> > > elasticsearch+unsubscribe@\_\_googlegroups.com \<mailto:  
> > > elasticsearch%2Bunsubscribe@googlegroups.com\>  
> > > \<[mailto:elasticsearch+\_\_unsubscribe@googlegroups.com](mailto:elasticsearch+__unsubscribe@googlegroups.com) \<mailto:  
> > > elasticsearch%2Bunsubscribe@googlegroups.com\>\>.  
> > > To view this discussion on the web visit  
> > > [https://groups.google.com/d/\_\_msgid/elasticsearch/08e7617c-\_](https://groups.google.com/d/__msgid/elasticsearch/08e7617c-_)  
> > > \_9e72-40a6-a780-7f632fee6d47%\_\_40googlegroups.com  
> > > \<[https://groups.google.com/d/msgid/elasticsearch/08e7617c-](https://groups.google.com/d/msgid/elasticsearch/08e7617c-)  
> > > 9e72-40a6-a780-7f632fee6d47%[40googlegroups.com](http://40googlegroups.com)\>  
> > > \<[https://groups.google.com/d/\_\_msgid/elasticsearch/08e7617c-](https://groups.google.com/d/__msgid/elasticsearch/08e7617c-)  
> > > \_\_9e72-40a6-a780-7f632fee6d47%\__[40GGGROUPS CASINO – Real Slot Casino for 10,000+ Senior Players](http://40googlegroups.com?utm)_  
> > > medium=\_\_email&utm\_source=footer  
> > > \<[https://groups.google.com/d/msgid/elasticsearch/08e7617c-](https://groups.google.com/d/msgid/elasticsearch/08e7617c-)  
> > > 9e72-40a6-a780-7f632fee6d47%[40GGGROUPS CASINO – Real Slot Casino for 10,000+ Senior Players](http://40googlegroups.com?utm_medium=)  
> > > email&utm\_source=footer\>\>.  
> > > For more options, visit [https://groups.google.com/d/\_\_optout](https://groups.google.com/d/__optout) \<  
> > > [https://groups.google.com/d/optout](https://groups.google.com/d/optout)\>.
> > > 
> > > ```
> > > --
> > > Costin
> > > 
> > > --
> > > You received this message because you are subscribed to a topic in
> > > 
> > > ```
> > > 
> > > the Google Groups "elasticsearch" group.  
> > > To unsubscribe from this topic, visit [https://groups.google.com/d/\_\_](https://groups.google.com/d/__)  
> > > topic/elasticsearch/\_\_Md6pwsOI2Dw/unsubscribe  
> > > \<[https://groups.google.com/d/topic/elasticsearch/](https://groups.google.com/d/topic/elasticsearch/)  
> > > Md6pwsOI2Dw/unsubscribe\>.  
> > > To unsubscribe from this group and all its topics, send an email to  
> > > elasticsearch+unsubscribe@\_\_googlegroups.com  
> > > [mailto:elasticsearch%2Bunsubscribe@googlegroups.com](mailto:elasticsearch%2Bunsubscribe@googlegroups.com).  
> > > To view this discussion on the web visit  
> > > [https://groups.google.com/d/\_\_msgid/elasticsearch/551BB843.\_](https://groups.google.com/d/__msgid/elasticsearch/551BB843._)  
> > > \_3040206%[40gmail.com](http://40gmail.com)  
> > > \<[https://groups.google.com/d/msgid/elasticsearch/551BB843](https://groups.google.com/d/msgid/elasticsearch/551BB843).  
> > > 3040206%[40gmail.com](http://40gmail.com)\>.  
> > > For more options, visit [https://groups.google.com/d/\_\_optout](https://groups.google.com/d/__optout) \<  
> > > [https://groups.google.com/d/optout](https://groups.google.com/d/optout)\>.
> > > 
> > > --  
> > > You received this message because you are subscribed to the Google  
> > > Groups "elasticsearch" group.  
> > > To unsubscribe from this group and stop receiving emails from it, send  
> > > an email to  
> > > [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com) \<mailto:elasticsearch+  
> > > [unsubscribe@googlegroups.com](mailto:unsubscribe@googlegroups.com)\>.  
> > > To view this discussion on the web visit  
> > > [https://groups.google.com/d/msgid/elasticsearch/CAGgBrpwA5UF3VAyX%](https://groups.google.com/d/msgid/elasticsearch/CAGgBrpwA5UF3VAyX%25)  
> > > 3D9tZMQbFxZ8BOREJyfEdiQ6G%2BSzXiqGyPg%[40mail.gmail.com](http://40mail.gmail.com)  
> > > \<[https://groups.google.com/d/msgid/elasticsearch/CAGgBrpwA5UF3VAyX%](https://groups.google.com/d/msgid/elasticsearch/CAGgBrpwA5UF3VAyX%25)  
> > > 3D9tZMQbFxZ8BOREJyfEdiQ6G%2BSzXiqGyPg%[40mail.gmail.com](http://40mail.gmail.com)?  
> > > utm\_medium=email&utm\_source=footer\>.  
> > > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).
> > 
> > --  
> > Costin
> > 
> > --  
> > You received this message because you are subscribed to a topic in the  
> > Google Groups "elasticsearch" group.  
> > To unsubscribe from this topic, visit [https://groups.google.com/d/](https://groups.google.com/d/)  
> > topic/elasticsearch/Md6pwsOI2Dw/unsubscribe.  
> > To unsubscribe from this group and all its topics, send an email to  
> > [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
> > To view this discussion on the web visit [https://groups.google.com/d/](https://groups.google.com/d/)  
> > msgid/elasticsearch/551BC011.6030503%[40gmail.com](http://40gmail.com).
> > 
> > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).

--  
You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/CAGgBrpxO%2BDG9dtxzOZiKYUPzgvUioyuumfPSssDbpn4n8QFd2g%40mail.gmail.com](https://groups.google.com/d/msgid/elasticsearch/CAGgBrpxO%2BDG9dtxzOZiKYUPzgvUioyuumfPSssDbpn4n8QFd2g%40mail.gmail.com).  
For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).

---

<div class="post-metadata">

**Author:** ![ElasticSearch\_Users\_](https://avatars.discourse-cdn.com/v4/letter/e/b4bc9f/32.png) [@ElasticSearch\_Users\_](https://discuss.elastic.co/u/ElasticSearch_Users_)\
**Post date:** [April 1, 2015, 1:58pm UTC](https://discuss.elastic.co/t/how-to-make-unstructured-data-available-in-hadoop-for-analysis-with-elasticsearch/23032/7 "2015-04-01T13:58:41Z")

</div>

I've removed the shield plugin with a yum remove shield but the error still  
persist !  
ᐧ

On Wed, Apr 1, 2015 at 3:42 PM, BEN SALEM Omar [omar.bensalem@esprit.tn](mailto:omar.bensalem@esprit.tn)  
wrote:

> Costin HELP !!
> 
> I've installed shield and tried to add an admin user, but when I do so, an  
> error jumps saying that there is an error in the elif line.  
> But now, if I try to run Kibana this is what happens !!! :
> 
> Help pleaaaase !!  
> ​  
> ᐧ
> 
> On Wed, Apr 1, 2015 at 12:23 PM, BEN SALEM Omar [omar.bensalem@esprit.tn](mailto:omar.bensalem@esprit.tn)  
> wrote:
> 
> > Thank you for your time and help Costin !
> > 
> > ᐧ
> > 
> > On Wed, Apr 1, 2015 at 11:53 AM, Costin Leau [costin.leau@gmail.com](mailto:costin.leau@gmail.com)  
> > wrote:
> > 
> > > Depends on what you want to do with the data - you need some type of  
> > > analyzer to interpret your data typically depending on what type of queries  
> > > you are making  
> > > since otherwise it's just bytes.  
> > > Your images need to be converted into something - RGB signature, shapes,  
> > > etc... Same for a text file - it in English, Spanish, Japanese? Is it a  
> > > pdf, xls - again ES needs to understand the format and there are multiple  
> > > plugins for that. Even if you don't know what you are looking, you need to  
> > > break down the blob of bytes into 'something' that can be searched on.
> > > 
> > > As for Kibana, it's all JS. Some are fine with embedding it into their  
> > > own app or exposing directly, some prefer more control and end up modifying  
> > > it or putting their own controls in front that apply filtering or enforce a  
> > > read-only view. The Kibana team is working on enhancing this even further  
> > > so it's best to talk to them about specific technical issues which I'm  
> > > afraid I can't answer.
> > > 
> > > Hope this helps,
> > > 
> > > On 4/1/15 12:33 PM, 'BEN SALEM Omar' via elasticsearch wrote:
> > > 
> > > > Hi Costin,
> > > > 
> > > > I've already done that and here I am using Kibana to dashboards and so  
> > > > on(I have a question for you I'll ask a little  
> > > > bit later)
> > > > 
> > > > But, my question now is how to make UNstructured data available for  
> > > > such analytics?  
> > > > Let's suppose I have images or textfile that I want to analyse? How  
> > > > make it available in a structured way in hive to do  
> > > > the required steps untill loading it into my ES cluster and perform my  
> > > > analytics?
> > > > 
> > > > The second question is , I have created some Dashboards with Kibana;  
> > > > now what I want to do, is giving my dashboards to  
> > > > the client I'm working with/for to to do his analytics without letting  
> > > > him see what's going on the ES cluster.  
> > > > What's the easiest way to do this?  
> > > > Thanks,  
> > > > ᐧ
> > > > 
> > > > On Wed, Apr 1, 2015 at 11:20 AM, Costin Leau \<[costin.leau@gmail.com](mailto:costin.leau@gmail.com)  
> > > > [mailto:costin.leau@gmail.com](mailto:costin.leau@gmail.com)\> wrote:
> > > > 
> > > > ```
> > > > If your data is in Hadoop, you would index it in Elasticsearch
> > > > 
> > > > ```
> > > > 
> > > > (through the es-hadoop connector) and then run your  
> > > > queries against it (either from Hadoop through the same connector)  
> > > > or through other tools (like Kibana) outside Hadoop.
> > > > 
> > > > ```
> > > > There are plenty of blog posts, documentations, presentations and
> > > > 
> > > > ```
> > > > 
> > > > videos on the topic so I recommend spending  
> > > > sometime time with them to better understand what options suite  
> > > > your use case.
> > > > 
> > > > ```
> > > > On 4/1/15 12:12 PM, BEN SALEM Omar wrote:
> > > > 
> > > > Hi everyone,
> > > > I'm wondering, it possible to make analytics on unstructured
> > > > 
> > > > ```
> > > > 
> > > > data with Elasticsearch?  
> > > > If so? how?  
> > > > Thanks,  
> > > > Omar,
> > > > 
> > > > ```
> > > > --
> > > > You received this message because you are subscribed to the
> > > > 
> > > > ```
> > > > 
> > > > Google Groups "elasticsearch" group.  
> > > > To unsubscribe from this group and stop receiving emails from  
> > > > it, send an email to  
> > > > elasticsearch+unsubscribe@\_\_googlegroups.com \<mailto:  
> > > > elasticsearch%2Bunsubscribe@googlegroups.com\>  
> > > > \<[mailto:elasticsearch+\_\_unsubscribe@googlegroups.com](mailto:elasticsearch+__unsubscribe@googlegroups.com) \<mailto:  
> > > > elasticsearch%2Bunsubscribe@googlegroups.com\>\>.  
> > > > To view this discussion on the web visit  
> > > > [https://groups.google.com/d/\_\_msgid/elasticsearch/08e7617c-\_](https://groups.google.com/d/__msgid/elasticsearch/08e7617c-_)  
> > > > \_9e72-40a6-a780-7f632fee6d47%\_\_40googlegroups.com  
> > > > \<[https://groups.google.com/d/msgid/elasticsearch/08e7617c-](https://groups.google.com/d/msgid/elasticsearch/08e7617c-)  
> > > > 9e72-40a6-a780-7f632fee6d47%[40googlegroups.com](http://40googlegroups.com)\>  
> > > > \<[https://groups.google.com/d/\_\_msgid/elasticsearch/08e7617c-](https://groups.google.com/d/__msgid/elasticsearch/08e7617c-)  
> > > > \_\_9e72-40a6-a780-7f632fee6d47%\__[40GGGROUPS CASINO – Real Slot Casino for 10,000+ Senior Players](http://40googlegroups.com?utm)_  
> > > > medium=\_\_email&utm\_source=footer  
> > > > \<[https://groups.google.com/d/msgid/elasticsearch/08e7617c-](https://groups.google.com/d/msgid/elasticsearch/08e7617c-)  
> > > > 9e72-40a6-a780-7f632fee6d47%[40GGGROUPS CASINO – Real Slot Casino for 10,000+ Senior Players](http://40googlegroups.com?utm_medium=)  
> > > > email&utm\_source=footer\>\>.  
> > > > For more options, visit [https://groups.google.com/d/\_\_optout](https://groups.google.com/d/__optout) \<  
> > > > [https://groups.google.com/d/optout](https://groups.google.com/d/optout)\>.
> > > > 
> > > > ```
> > > > --
> > > > Costin
> > > > 
> > > > --
> > > > You received this message because you are subscribed to a topic in
> > > > 
> > > > ```
> > > > 
> > > > the Google Groups "elasticsearch" group.  
> > > > To unsubscribe from this topic, visit  
> > > > [https://groups.google.com/d/\_\_topic/elasticsearch/\_\_](https://groups.google.com/d/ __topic/elasticsearch/__ )  
> > > > Md6pwsOI2Dw/unsubscribe  
> > > > \<[https://groups.google.com/d/topic/elasticsearch/](https://groups.google.com/d/topic/elasticsearch/)  
> > > > Md6pwsOI2Dw/unsubscribe\>.  
> > > > To unsubscribe from this group and all its topics, send an email to  
> > > > elasticsearch+unsubscribe@\_\_googlegroups.com  
> > > > [mailto:elasticsearch%2Bunsubscribe@googlegroups.com](mailto:elasticsearch%2Bunsubscribe@googlegroups.com).  
> > > > To view this discussion on the web visit  
> > > > [https://groups.google.com/d/\_\_msgid/elasticsearch/551BB843.\_](https://groups.google.com/d/__msgid/elasticsearch/551BB843._)  
> > > > \_3040206%[40gmail.com](http://40gmail.com)  
> > > > \<[https://groups.google.com/d/msgid/elasticsearch/551BB843](https://groups.google.com/d/msgid/elasticsearch/551BB843).  
> > > > 3040206%[40gmail.com](http://40gmail.com)\>.  
> > > > For more options, visit [https://groups.google.com/d/\_\_optout](https://groups.google.com/d/__optout) \<  
> > > > [https://groups.google.com/d/optout](https://groups.google.com/d/optout)\>.
> > > > 
> > > > --  
> > > > You received this message because you are subscribed to the Google  
> > > > Groups "elasticsearch" group.  
> > > > To unsubscribe from this group and stop receiving emails from it, send  
> > > > an email to  
> > > > [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com) \<mailto:elasticsearch+  
> > > > [unsubscribe@googlegroups.com](mailto:unsubscribe@googlegroups.com)\>.  
> > > > To view this discussion on the web visit  
> > > > [https://groups.google.com/d/msgid/elasticsearch/CAGgBrpwA5UF3VAyX%](https://groups.google.com/d/msgid/elasticsearch/CAGgBrpwA5UF3VAyX%25)  
> > > > 3D9tZMQbFxZ8BOREJyfEdiQ6G%2BSzXiqGyPg%[40mail.gmail.com](http://40mail.gmail.com)  
> > > > \<[https://groups.google.com/d/msgid/elasticsearch/CAGgBrpwA5UF3VAyX%](https://groups.google.com/d/msgid/elasticsearch/CAGgBrpwA5UF3VAyX%25)  
> > > > 3D9tZMQbFxZ8BOREJyfEdiQ6G%2BSzXiqGyPg%[40mail.gmail.com](http://40mail.gmail.com)?  
> > > > utm\_medium=email&utm\_source=footer\>.  
> > > > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).
> > > 
> > > --  
> > > Costin
> > > 
> > > --  
> > > You received this message because you are subscribed to a topic in the  
> > > Google Groups "elasticsearch" group.  
> > > To unsubscribe from this topic, visit [https://groups.google.com/d/](https://groups.google.com/d/)  
> > > topic/elasticsearch/Md6pwsOI2Dw/unsubscribe.  
> > > To unsubscribe from this group and all its topics, send an email to  
> > > [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
> > > To view this discussion on the web visit [https://groups.google.com/d/](https://groups.google.com/d/)  
> > > msgid/elasticsearch/551BC011.6030503%[40gmail.com](http://40gmail.com).
> > > 
> > > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).

--  
You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/CAGgBrpwjogF0F7\_CaLoS\_QuEM4zZ1roDA%2B%3D5nxpi2GY6ESMPJA%40mail.gmail.com](https://groups.google.com/d/msgid/elasticsearch/CAGgBrpwjogF0F7_CaLoS_QuEM4zZ1roDA%2B%3D5nxpi2GY6ESMPJA%40mail.gmail.com).  
For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).

---

<div class="post-metadata">

**Author:** ![ElasticSearch\_Users\_](https://avatars.discourse-cdn.com/v4/letter/e/b4bc9f/32.png) [@ElasticSearch\_Users\_](https://discuss.elastic.co/u/ElasticSearch_Users_)\
**Post date:** [April 1, 2015, 2:56pm UTC](https://discuss.elastic.co/t/how-to-make-unstructured-data-available-in-hadoop-for-analysis-with-elasticsearch/23032/8 "2015-04-01T14:56:43Z")

</div>

I wanted to add authentication to my ES, thus I downloaded the shield :

> **[Download Shield | Security for Elasticsearch](https://www.elastic.co/downloads/shield)**
>
> Free password protection for Elasticsearch clusters and Kibana. Note: Since 5.0 onward, Shield is included in the Elastic Stack as Security.

Then I've tried to add a user to give him the admin role as it's mentionned  
here :

> **[Getting Started with Shield | Shield \[2.4\] | Elastic](https://www.elastic.co/guide/en/shield/current/getting-started.html)**

(I've added it with root, cause I start my es with root..)

But when I try to do so, an error occure saying that there is a syntax  
error in the 38 line "the elef line"  
elef[$ES\_INCLUDE] bla bla  
I've tried many time :  
bin/shield/esusers useradd omar -p omar -r admin  
bin/shield/esusers useradd esomar -p omar -r admin  
bin/shield/esusers useradd es\_omar -p omar -r admin  
bin/shield/esusers useradd ES\_omar -p omar -r admin  
bin/shield/esusers useradd omar -r admin  
bin/shield/esusers useradd esomar -r admin  
bin/shield/esusers useradd es\_omar -r admin  
bin/shield/esusers useradd ES\_omar -r admin

But the same error kept on jumping !

I said enough is enough and wanted to keep on doing wwhat I was doing,  
tried to run Kibana, and this is what happened !

I've then tried to open my ES marvel plugin, but there is now an  
authentication box

​  
I've tried ALL the combinations above, but none of them seemed to work !!

I'm really preoccupied by this note :  
To ensure that Elasticsearch can read the user and role information at  
startup, run esusers useradd as the same user you use to run Elasticsearch.  
Running the command as root or some other user will update the permissions  
for the users and users\_roles files and prevent Elasticsearch from  
accessing them.

When I try to remove the shield with the yum remove shield, it says there  
is no package to remove !  
Please HELP !!

On Wed, Apr 1, 2015 at 3:58 PM, BEN SALEM Omar [omar.bensalem@esprit.tn](mailto:omar.bensalem@esprit.tn)  
wrote:

> I've removed the shield plugin with a yum remove shield but the error  
> still persist !  
> ᐧ
> 
> On Wed, Apr 1, 2015 at 3:42 PM, BEN SALEM Omar [omar.bensalem@esprit.tn](mailto:omar.bensalem@esprit.tn)  
> wrote:
> 
> > Costin HELP !!
> > 
> > I've installed shield and tried to add an admin user, but when I do so,  
> > an error jumps saying that there is an error in the elif line.  
> > But now, if I try to run Kibana this is what happens !!! :
> > 
> > Help pleaaaase !!  
> > ​  
> > ᐧ
> > 
> > On Wed, Apr 1, 2015 at 12:23 PM, BEN SALEM Omar [omar.bensalem@esprit.tn](mailto:omar.bensalem@esprit.tn)  
> > wrote:
> > 
> > > Thank you for your time and help Costin !
> > > 
> > > ᐧ
> > > 
> > > On Wed, Apr 1, 2015 at 11:53 AM, Costin Leau [costin.leau@gmail.com](mailto:costin.leau@gmail.com)  
> > > wrote:
> > > 
> > > > Depends on what you want to do with the data - you need some type of  
> > > > analyzer to interpret your data typically depending on what type of queries  
> > > > you are making  
> > > > since otherwise it's just bytes.  
> > > > Your images need to be converted into something - RGB signature,  
> > > > shapes, etc... Same for a text file - it in English, Spanish, Japanese? Is  
> > > > it a pdf, xls - again ES needs to understand the format and there are  
> > > > multiple plugins for that. Even if you don't know what you are looking, you  
> > > > need to break down the blob of bytes into 'something' that can be searched  
> > > > on.
> > > > 
> > > > As for Kibana, it's all JS. Some are fine with embedding it into their  
> > > > own app or exposing directly, some prefer more control and end up modifying  
> > > > it or putting their own controls in front that apply filtering or enforce a  
> > > > read-only view. The Kibana team is working on enhancing this even further  
> > > > so it's best to talk to them about specific technical issues which I'm  
> > > > afraid I can't answer.
> > > > 
> > > > Hope this helps,
> > > > 
> > > > On 4/1/15 12:33 PM, 'BEN SALEM Omar' via elasticsearch wrote:
> > > > 
> > > > > Hi Costin,
> > > > > 
> > > > > I've already done that and here I am using Kibana to dashboards and so  
> > > > > on(I have a question for you I'll ask a little  
> > > > > bit later)
> > > > > 
> > > > > But, my question now is how to make UNstructured data available for  
> > > > > such analytics?  
> > > > > Let's suppose I have images or textfile that I want to analyse? How  
> > > > > make it available in a structured way in hive to do  
> > > > > the required steps untill loading it into my ES cluster and perform my  
> > > > > analytics?
> > > > > 
> > > > > The second question is , I have created some Dashboards with Kibana;  
> > > > > now what I want to do, is giving my dashboards to  
> > > > > the client I'm working with/for to to do his analytics without letting  
> > > > > him see what's going on the ES cluster.  
> > > > > What's the easiest way to do this?  
> > > > > Thanks,  
> > > > > ᐧ
> > > > > 
> > > > > On Wed, Apr 1, 2015 at 11:20 AM, Costin Leau \<[costin.leau@gmail.com](mailto:costin.leau@gmail.com)  
> > > > > [mailto:costin.leau@gmail.com](mailto:costin.leau@gmail.com)\> wrote:
> > > > > 
> > > > > ```
> > > > > If your data is in Hadoop, you would index it in Elasticsearch
> > > > > 
> > > > > ```
> > > > > 
> > > > > (through the es-hadoop connector) and then run your  
> > > > > queries against it (either from Hadoop through the same connector)  
> > > > > or through other tools (like Kibana) outside Hadoop.
> > > > > 
> > > > > ```
> > > > > There are plenty of blog posts, documentations, presentations and
> > > > > 
> > > > > ```
> > > > > 
> > > > > videos on the topic so I recommend spending  
> > > > > sometime time with them to better understand what options suite  
> > > > > your use case.
> > > > > 
> > > > > ```
> > > > > On 4/1/15 12:12 PM, BEN SALEM Omar wrote:
> > > > > 
> > > > > Hi everyone,
> > > > > I'm wondering, it possible to make analytics on unstructured
> > > > > 
> > > > > ```
> > > > > 
> > > > > data with Elasticsearch?  
> > > > > If so? how?  
> > > > > Thanks,  
> > > > > Omar,
> > > > > 
> > > > > ```
> > > > > --
> > > > > You received this message because you are subscribed to the
> > > > > 
> > > > > ```
> > > > > 
> > > > > Google Groups "elasticsearch" group.  
> > > > > To unsubscribe from this group and stop receiving emails from  
> > > > > it, send an email to  
> > > > > elasticsearch+unsubscribe@\_\_googlegroups.com \<mailto:  
> > > > > elasticsearch%2Bunsubscribe@googlegroups.com\>  
> > > > > \<[mailto:elasticsearch+\_\_unsubscribe@googlegroups.com](mailto:elasticsearch+__unsubscribe@googlegroups.com) \<mailto:  
> > > > > elasticsearch%2Bunsubscribe@googlegroups.com\>\>.  
> > > > > To view this discussion on the web visit  
> > > > > [https://groups.google.com/d/\_\_msgid/elasticsearch/08e7617c-\_](https://groups.google.com/d/__msgid/elasticsearch/08e7617c-_)  
> > > > > \_9e72-40a6-a780-7f632fee6d47%\_\_40googlegroups.com  
> > > > > \<[https://groups.google.com/d/msgid/elasticsearch/08e7617c-](https://groups.google.com/d/msgid/elasticsearch/08e7617c-)  
> > > > > 9e72-40a6-a780-7f632fee6d47%[40googlegroups.com](http://40googlegroups.com)\>  
> > > > > \<[https://groups.google.com/d/\_\_msgid/elasticsearch/08e7617c-](https://groups.google.com/d/__msgid/elasticsearch/08e7617c-)  
> > > > > \_\_9e72-40a6-a780-7f632fee6d47%\__[40GGGROUPS CASINO – Real Slot Casino for 10,000+ Senior Players](http://40googlegroups.com?utm)_  
> > > > > medium=\_\_email&utm\_source=footer  
> > > > > \<[https://groups.google.com/d/msgid/elasticsearch/08e7617c-](https://groups.google.com/d/msgid/elasticsearch/08e7617c-)  
> > > > > 9e72-40a6-a780-7f632fee6d47%[40GGGROUPS CASINO – Real Slot Casino for 10,000+ Senior Players](http://40googlegroups.com?utm_medium=)  
> > > > > email&utm\_source=footer\>\>.  
> > > > > For more options, visit [https://groups.google.com/d/\_\_optout](https://groups.google.com/d/__optout) \<  
> > > > > [https://groups.google.com/d/optout](https://groups.google.com/d/optout)\>.
> > > > > 
> > > > > ```
> > > > > --
> > > > > Costin
> > > > > 
> > > > > --
> > > > > You received this message because you are subscribed to a topic in
> > > > > 
> > > > > ```
> > > > > 
> > > > > the Google Groups "elasticsearch" group.  
> > > > > To unsubscribe from this topic, visit  
> > > > > [https://groups.google.com/d/\_\_topic/elasticsearch/\_\_](https://groups.google.com/d/ __topic/elasticsearch/__ )  
> > > > > Md6pwsOI2Dw/unsubscribe  
> > > > > \<[https://groups.google.com/d/topic/elasticsearch/](https://groups.google.com/d/topic/elasticsearch/)  
> > > > > Md6pwsOI2Dw/unsubscribe\>.  
> > > > > To unsubscribe from this group and all its topics, send an email  
> > > > > to elasticsearch+unsubscribe@\_\_googlegroups.com  
> > > > > [mailto:elasticsearch%2Bunsubscribe@googlegroups.com](mailto:elasticsearch%2Bunsubscribe@googlegroups.com).  
> > > > > To view this discussion on the web visit  
> > > > > [https://groups.google.com/d/\_\_msgid/elasticsearch/551BB843.\_](https://groups.google.com/d/__msgid/elasticsearch/551BB843._)  
> > > > > \_3040206%[40gmail.com](http://40gmail.com)  
> > > > > \<[https://groups.google.com/d/msgid/elasticsearch/551BB843](https://groups.google.com/d/msgid/elasticsearch/551BB843).  
> > > > > 3040206%[40gmail.com](http://40gmail.com)\>.  
> > > > > For more options, visit [https://groups.google.com/d/\_\_optout](https://groups.google.com/d/__optout) \<  
> > > > > [https://groups.google.com/d/optout](https://groups.google.com/d/optout)\>.
> > > > > 
> > > > > --  
> > > > > You received this message because you are subscribed to the Google  
> > > > > Groups "elasticsearch" group.  
> > > > > To unsubscribe from this group and stop receiving emails from it, send  
> > > > > an email to  
> > > > > [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com) \<mailto:elasticsearch+  
> > > > > [unsubscribe@googlegroups.com](mailto:unsubscribe@googlegroups.com)\>.  
> > > > > To view this discussion on the web visit  
> > > > > [https://groups.google.com/d/msgid/elasticsearch/CAGgBrpwA5UF3VAyX%](https://groups.google.com/d/msgid/elasticsearch/CAGgBrpwA5UF3VAyX%25)  
> > > > > 3D9tZMQbFxZ8BOREJyfEdiQ6G%2BSzXiqGyPg%[40mail.gmail.com](http://40mail.gmail.com)  
> > > > > \<[https://groups.google.com/d/msgid/elasticsearch/CAGgBrpwA5UF3VAyX%](https://groups.google.com/d/msgid/elasticsearch/CAGgBrpwA5UF3VAyX%25)  
> > > > > 3D9tZMQbFxZ8BOREJyfEdiQ6G%2BSzXiqGyPg%[40mail.gmail.com](http://40mail.gmail.com)?  
> > > > > utm\_medium=email&utm\_source=footer\>.  
> > > > > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).
> > > > 
> > > > --  
> > > > Costin
> > > > 
> > > > --  
> > > > You received this message because you are subscribed to a topic in the  
> > > > Google Groups "elasticsearch" group.  
> > > > To unsubscribe from this topic, visit [https://groups.google.com/d/](https://groups.google.com/d/)  
> > > > topic/elasticsearch/Md6pwsOI2Dw/unsubscribe.  
> > > > To unsubscribe from this group and all its topics, send an email to  
> > > > [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
> > > > To view this discussion on the web visit [https://groups.google.com/d/](https://groups.google.com/d/)  
> > > > msgid/elasticsearch/551BC011.6030503%[40gmail.com](http://40gmail.com).
> > > > 
> > > > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).

--  
You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/CAGgBrpyW%2B57pY%3D4-x%2BHjhWBD\_qeOgkZ0Me9vf%2BckygD7vX6h1w%40mail.gmail.com](https://groups.google.com/d/msgid/elasticsearch/CAGgBrpyW%2B57pY%3D4-x%2BHjhWBD_qeOgkZ0Me9vf%2BckygD7vX6h1w%40mail.gmail.com).  
For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).

---

<div class="post-metadata">

**Author:** ![ElasticSearch\_Users\_](https://avatars.discourse-cdn.com/v4/letter/e/b4bc9f/32.png) [@ElasticSearch\_Users\_](https://discuss.elastic.co/u/ElasticSearch_Users_)\
**Post date:** [April 1, 2015, 4:12pm UTC](https://discuss.elastic.co/t/how-to-make-unstructured-data-available-in-hadoop-for-analysis-with-elasticsearch/23032/9 "2015-04-01T16:12:44Z")

</div>

Another thing, my ES is running as a service  
ᐧ

On Wed, Apr 1, 2015 at 4:56 PM, BEN SALEM Omar [omar.bensalem@esprit.tn](mailto:omar.bensalem@esprit.tn)  
wrote:

> I wanted to add authentication to my ES, thus I downloaded the shield :  
> [Download Shield | Security for Elasticsearch](https://www.elastic.co/downloads/shield)
> 
> Then I've tried to add a user to give him the admin role as it's  
> mentionned here :  
> [Getting Started with Shield | Shield [2.4] | Elastic](http://www.elastic.co/guide/en/shield/current/getting-started.html)  
> (I've added it with root, cause I start my es with root..)
> 
> But when I try to do so, an error occure saying that there is a syntax  
> error in the 38 line "the elef line"  
> elef[$ES\_INCLUDE] bla bla  
> I've tried many time :  
> bin/shield/esusers useradd omar -p omar -r admin  
> bin/shield/esusers useradd esomar -p omar -r admin  
> bin/shield/esusers useradd es\_omar -p omar -r admin  
> bin/shield/esusers useradd ES\_omar -p omar -r admin  
> bin/shield/esusers useradd omar -r admin  
> bin/shield/esusers useradd esomar -r admin  
> bin/shield/esusers useradd es\_omar -r admin  
> bin/shield/esusers useradd ES\_omar -r admin
> 
> But the same error kept on jumping !
> 
> I said enough is enough and wanted to keep on doing wwhat I was doing,  
> tried to run Kibana, and this is what happened !
> 
> I've then tried to open my ES marvel plugin, but there is now an  
> authentication box
> 
> ​  
> I've tried ALL the combinations above, but none of them seemed to work !!
> 
> I'm really preoccupied by this note :  
> To ensure that Elasticsearch can read the user and role information at  
> startup, run esusers useradd as the same user you use to run  
> Elasticsearch. Running the command as root or some other user will update  
> the permissions for the users and users\_roles files and prevent  
> Elasticsearch from accessing them.
> 
> When I try to remove the shield with the yum remove shield, it says there  
> is no package to remove !  
> Please HELP !!
> 
> On Wed, Apr 1, 2015 at 3:58 PM, BEN SALEM Omar [omar.bensalem@esprit.tn](mailto:omar.bensalem@esprit.tn)  
> wrote:
> 
> > I've removed the shield plugin with a yum remove shield but the error  
> > still persist !  
> > ᐧ
> > 
> > On Wed, Apr 1, 2015 at 3:42 PM, BEN SALEM Omar [omar.bensalem@esprit.tn](mailto:omar.bensalem@esprit.tn)  
> > wrote:
> > 
> > > Costin HELP !!
> > > 
> > > I've installed shield and tried to add an admin user, but when I do so,  
> > > an error jumps saying that there is an error in the elif line.  
> > > But now, if I try to run Kibana this is what happens !!! :
> > > 
> > > Help pleaaaase !!  
> > > ​  
> > > ᐧ
> > > 
> > > On Wed, Apr 1, 2015 at 12:23 PM, BEN SALEM Omar \<omar.bensalem@esprit.tn
> > > 
> > > > wrote:
> > > 
> > > > Thank you for your time and help Costin !
> > > > 
> > > > ᐧ
> > > > 
> > > > On Wed, Apr 1, 2015 at 11:53 AM, Costin Leau [costin.leau@gmail.com](mailto:costin.leau@gmail.com)  
> > > > wrote:
> > > > 
> > > > > Depends on what you want to do with the data - you need some type of  
> > > > > analyzer to interpret your data typically depending on what type of queries  
> > > > > you are making  
> > > > > since otherwise it's just bytes.  
> > > > > Your images need to be converted into something - RGB signature,  
> > > > > shapes, etc... Same for a text file - it in English, Spanish, Japanese? Is  
> > > > > it a pdf, xls - again ES needs to understand the format and there are  
> > > > > multiple plugins for that. Even if you don't know what you are looking, you  
> > > > > need to break down the blob of bytes into 'something' that can be searched  
> > > > > on.
> > > > > 
> > > > > As for Kibana, it's all JS. Some are fine with embedding it into their  
> > > > > own app or exposing directly, some prefer more control and end up modifying  
> > > > > it or putting their own controls in front that apply filtering or enforce a  
> > > > > read-only view. The Kibana team is working on enhancing this even further  
> > > > > so it's best to talk to them about specific technical issues which I'm  
> > > > > afraid I can't answer.
> > > > > 
> > > > > Hope this helps,
> > > > > 
> > > > > On 4/1/15 12:33 PM, 'BEN SALEM Omar' via elasticsearch wrote:
> > > > > 
> > > > > > Hi Costin,
> > > > > > 
> > > > > > I've already done that and here I am using Kibana to dashboards and  
> > > > > > so on(I have a question for you I'll ask a little  
> > > > > > bit later)
> > > > > > 
> > > > > > But, my question now is how to make UNstructured data available for  
> > > > > > such analytics?  
> > > > > > Let's suppose I have images or textfile that I want to analyse? How  
> > > > > > make it available in a structured way in hive to do  
> > > > > > the required steps untill loading it into my ES cluster and perform  
> > > > > > my analytics?
> > > > > > 
> > > > > > The second question is , I have created some Dashboards with Kibana;  
> > > > > > now what I want to do, is giving my dashboards to  
> > > > > > the client I'm working with/for to to do his analytics without  
> > > > > > letting him see what's going on the ES cluster.  
> > > > > > What's the easiest way to do this?  
> > > > > > Thanks,  
> > > > > > ᐧ
> > > > > > 
> > > > > > On Wed, Apr 1, 2015 at 11:20 AM, Costin Leau \<[costin.leau@gmail.com](mailto:costin.leau@gmail.com)  
> > > > > > [mailto:costin.leau@gmail.com](mailto:costin.leau@gmail.com)\> wrote:
> > > > > > 
> > > > > > ```
> > > > > > If your data is in Hadoop, you would index it in Elasticsearch
> > > > > > 
> > > > > > ```
> > > > > > 
> > > > > > (through the es-hadoop connector) and then run your  
> > > > > > queries against it (either from Hadoop through the same  
> > > > > > connector) or through other tools (like Kibana) outside Hadoop.
> > > > > > 
> > > > > > ```
> > > > > > There are plenty of blog posts, documentations, presentations and
> > > > > > 
> > > > > > ```
> > > > > > 
> > > > > > videos on the topic so I recommend spending  
> > > > > > sometime time with them to better understand what options suite  
> > > > > > your use case.
> > > > > > 
> > > > > > ```
> > > > > > On 4/1/15 12:12 PM, BEN SALEM Omar wrote:
> > > > > > 
> > > > > > Hi everyone,
> > > > > > I'm wondering, it possible to make analytics on unstructured
> > > > > > 
> > > > > > ```
> > > > > > 
> > > > > > data with Elasticsearch?  
> > > > > > If so? how?  
> > > > > > Thanks,  
> > > > > > Omar,
> > > > > > 
> > > > > > ```
> > > > > > --
> > > > > > You received this message because you are subscribed to the
> > > > > > 
> > > > > > ```
> > > > > > 
> > > > > > Google Groups "elasticsearch" group.  
> > > > > > To unsubscribe from this group and stop receiving emails from  
> > > > > > it, send an email to  
> > > > > > elasticsearch+unsubscribe@\_\_googlegroups.com \<mailto:  
> > > > > > elasticsearch%2Bunsubscribe@googlegroups.com\>  
> > > > > > \<[mailto:elasticsearch+\_\_unsubscribe@googlegroups.com](mailto:elasticsearch+__unsubscribe@googlegroups.com) \<mailto:  
> > > > > > elasticsearch%2Bunsubscribe@googlegroups.com\>\>.  
> > > > > > To view this discussion on the web visit  
> > > > > > [https://groups.google.com/d/\_\_msgid/elasticsearch/08e7617c-\_](https://groups.google.com/d/__msgid/elasticsearch/08e7617c-_)  
> > > > > > \_9e72-40a6-a780-7f632fee6d47%\_\_40googlegroups.com  
> > > > > > \<[https://groups.google.com/d/msgid/elasticsearch/08e7617c-](https://groups.google.com/d/msgid/elasticsearch/08e7617c-)  
> > > > > > 9e72-40a6-a780-7f632fee6d47%[40googlegroups.com](http://40googlegroups.com)\>  
> > > > > > \<[https://groups.google.com/d/\_\_msgid/elasticsearch/08e7617c-](https://groups.google.com/d/__msgid/elasticsearch/08e7617c-)  
> > > > > > \_\_9e72-40a6-a780-7f632fee6d47%\__[40GGGROUPS CASINO – Real Slot Casino for 10,000+ Senior Players](http://40googlegroups.com?utm)_  
> > > > > > medium=\_\_email&utm\_source=footer  
> > > > > > \<[https://groups.google.com/d/msgid/elasticsearch/08e7617c-](https://groups.google.com/d/msgid/elasticsearch/08e7617c-)  
> > > > > > 9e72-40a6-a780-7f632fee6d47%[40GGGROUPS CASINO – Real Slot Casino for 10,000+ Senior Players](http://40googlegroups.com?utm_medium=)  
> > > > > > email&utm\_source=footer\>\>.  
> > > > > > For more options, visit [https://groups.google.com/d/\_\_optout](https://groups.google.com/d/__optout)  
> > > > > > [https://groups.google.com/d/optout](https://groups.google.com/d/optout).
> > > > > > 
> > > > > > ```
> > > > > > --
> > > > > > Costin
> > > > > > 
> > > > > > --
> > > > > > You received this message because you are subscribed to a topic
> > > > > > 
> > > > > > ```
> > > > > > 
> > > > > > in the Google Groups "elasticsearch" group.  
> > > > > > To unsubscribe from this topic, visit  
> > > > > > [https://groups.google.com/d/\_\_topic/elasticsearch/\_\_](https://groups.google.com/d/ __topic/elasticsearch/__ )  
> > > > > > Md6pwsOI2Dw/unsubscribe  
> > > > > > \<[https://groups.google.com/d/topic/elasticsearch/](https://groups.google.com/d/topic/elasticsearch/)  
> > > > > > Md6pwsOI2Dw/unsubscribe\>.  
> > > > > > To unsubscribe from this group and all its topics, send an email  
> > > > > > to elasticsearch+unsubscribe@\_\_googlegroups.com  
> > > > > > [mailto:elasticsearch%2Bunsubscribe@googlegroups.com](mailto:elasticsearch%2Bunsubscribe@googlegroups.com).  
> > > > > > To view this discussion on the web visit  
> > > > > > [https://groups.google.com/d/\_\_msgid/elasticsearch/551BB843.\_](https://groups.google.com/d/__msgid/elasticsearch/551BB843._)  
> > > > > > \_3040206%[40gmail.com](http://40gmail.com)  
> > > > > > \<[https://groups.google.com/d/msgid/elasticsearch/551BB843](https://groups.google.com/d/msgid/elasticsearch/551BB843).  
> > > > > > 3040206%[40gmail.com](http://40gmail.com)\>.  
> > > > > > For more options, visit [https://groups.google.com/d/\_\_optout](https://groups.google.com/d/__optout) \<  
> > > > > > [https://groups.google.com/d/optout](https://groups.google.com/d/optout)\>.
> > > > > > 
> > > > > > --  
> > > > > > You received this message because you are subscribed to the Google  
> > > > > > Groups "elasticsearch" group.  
> > > > > > To unsubscribe from this group and stop receiving emails from it,  
> > > > > > send an email to  
> > > > > > [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com) \<mailto:elasticsearch+  
> > > > > > [unsubscribe@googlegroups.com](mailto:unsubscribe@googlegroups.com)\>.  
> > > > > > To view this discussion on the web visit  
> > > > > > [https://groups.google.com/d/msgid/elasticsearch/CAGgBrpwA5UF3VAyX%](https://groups.google.com/d/msgid/elasticsearch/CAGgBrpwA5UF3VAyX%25)  
> > > > > > 3D9tZMQbFxZ8BOREJyfEdiQ6G%2BSzXiqGyPg%[40mail.gmail.com](http://40mail.gmail.com)  
> > > > > > \<[https://groups.google.com/d/msgid/elasticsearch/CAGgBrpwA5UF3VAyX%](https://groups.google.com/d/msgid/elasticsearch/CAGgBrpwA5UF3VAyX%25)  
> > > > > > 3D9tZMQbFxZ8BOREJyfEdiQ6G%2BSzXiqGyPg%[40mail.gmail.com](http://40mail.gmail.com)?  
> > > > > > utm\_medium=email&utm\_source=footer\>.  
> > > > > > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).
> > > > > 
> > > > > --  
> > > > > Costin
> > > > > 
> > > > > --  
> > > > > You received this message because you are subscribed to a topic in the  
> > > > > Google Groups "elasticsearch" group.  
> > > > > To unsubscribe from this topic, visit [https://groups.google.com/d/](https://groups.google.com/d/)  
> > > > > topic/elasticsearch/Md6pwsOI2Dw/unsubscribe.  
> > > > > To unsubscribe from this group and all its topics, send an email to  
> > > > > [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
> > > > > To view this discussion on the web visit [https://groups.google.com/d/](https://groups.google.com/d/)  
> > > > > msgid/elasticsearch/551BC011.6030503%[40gmail.com](http://40gmail.com).
> > > > > 
> > > > > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).

--  
You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/CAGgBrpz4EJ%2BxBgpgxQDYjfc1cbw8jKYmPSWK%2BWbS7bmEgG\_1Zw%40mail.gmail.com](https://groups.google.com/d/msgid/elasticsearch/CAGgBrpz4EJ%2BxBgpgxQDYjfc1cbw8jKYmPSWK%2BWbS7bmEgG_1Zw%40mail.gmail.com).  
For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).

---

<div class="post-metadata">

**Author:** ![ElasticSearch\_Users\_](https://avatars.discourse-cdn.com/v4/letter/e/b4bc9f/32.png) [@ElasticSearch\_Users\_](https://discuss.elastic.co/u/ElasticSearch_Users_)\
**Post date:** [April 1, 2015, 6:05pm UTC](https://discuss.elastic.co/t/how-to-make-unstructured-data-available-in-hadoop-for-analysis-with-elasticsearch/23032/10 "2015-04-01T18:05:38Z")

</div>

Ok, I've managed to solve my own problem.

First of all things, if you want to just remove the shield plugin run under  
the elasticsearch :

$ bin/plugin --remove shield

Now, to the syntax error in the elef line in the "esusers", generally, when  
there is such an error, it's related to things before that line.  
In fact there was something like this :  
$....done:  
correction :  
$....done;

Now, we could add users within shield and grunt them the desired role.

But, even if I've done it, I couldn't access to my ES cluster with the "new  
born user"; I think because my ES is running as a service and not starting  
with bin/elasticsearch, that lead to "misunderstanding."

The solution I found was to transfer the  
/usr/share/elasticsearch/config/shield under /etc/elasticsearch  
$ln -s /usr/share/elasticsearch/config/shield/ /etc/elasticsearch

And that was it !  
Hope that could be of a help for anyone else facing the same problem !

ᐧ

On Wed, Apr 1, 2015 at 6:12 PM, BEN SALEM Omar [omar.bensalem@esprit.tn](mailto:omar.bensalem@esprit.tn)  
wrote:

> Another thing, my ES is running as a service  
> ᐧ
> 
> On Wed, Apr 1, 2015 at 4:56 PM, BEN SALEM Omar [omar.bensalem@esprit.tn](mailto:omar.bensalem@esprit.tn)  
> wrote:
> 
> > I wanted to add authentication to my ES, thus I downloaded the shield :  
> > [Download Shield | Security for Elasticsearch](https://www.elastic.co/downloads/shield)
> > 
> > Then I've tried to add a user to give him the admin role as it's  
> > mentionned here :  
> > [Getting Started with Shield | Shield [2.4] | Elastic](http://www.elastic.co/guide/en/shield/current/getting-started.html)  
> > (I've added it with root, cause I start my es with root..)
> > 
> > But when I try to do so, an error occure saying that there is a syntax  
> > error in the 38 line "the elef line"  
> > elef[$ES\_INCLUDE] bla bla  
> > I've tried many time :  
> > bin/shield/esusers useradd omar -p omar -r admin  
> > bin/shield/esusers useradd esomar -p omar -r admin  
> > bin/shield/esusers useradd es\_omar -p omar -r admin  
> > bin/shield/esusers useradd ES\_omar -p omar -r admin  
> > bin/shield/esusers useradd omar -r admin  
> > bin/shield/esusers useradd esomar -r admin  
> > bin/shield/esusers useradd es\_omar -r admin  
> > bin/shield/esusers useradd ES\_omar -r admin
> > 
> > But the same error kept on jumping !
> > 
> > I said enough is enough and wanted to keep on doing wwhat I was doing,  
> > tried to run Kibana, and this is what happened !
> > 
> > I've then tried to open my ES marvel plugin, but there is now an  
> > authentication box
> > 
> > ​  
> > I've tried ALL the combinations above, but none of them seemed to work !!
> > 
> > I'm really preoccupied by this note :  
> > To ensure that Elasticsearch can read the user and role information at  
> > startup, run esusers useradd as the same user you use to run  
> > Elasticsearch. Running the command as root or some other user will update  
> > the permissions for the users and users\_roles files and prevent  
> > Elasticsearch from accessing them.
> > 
> > When I try to remove the shield with the yum remove shield, it says there  
> > is no package to remove !  
> > Please HELP !!
> > 
> > On Wed, Apr 1, 2015 at 3:58 PM, BEN SALEM Omar [omar.bensalem@esprit.tn](mailto:omar.bensalem@esprit.tn)  
> > wrote:
> > 
> > > I've removed the shield plugin with a yum remove shield but the error  
> > > still persist !  
> > > ᐧ
> > > 
> > > On Wed, Apr 1, 2015 at 3:42 PM, BEN SALEM Omar [omar.bensalem@esprit.tn](mailto:omar.bensalem@esprit.tn)  
> > > wrote:
> > > 
> > > > Costin HELP !!
> > > > 
> > > > I've installed shield and tried to add an admin user, but when I do so,  
> > > > an error jumps saying that there is an error in the elif line.  
> > > > But now, if I try to run Kibana this is what happens !!! :
> > > > 
> > > > Help pleaaaase !!  
> > > > ​  
> > > > ᐧ
> > > > 
> > > > On Wed, Apr 1, 2015 at 12:23 PM, BEN SALEM Omar \<  
> > > > omar.bensalem@esprit.tn\> wrote:
> > > > 
> > > > > Thank you for your time and help Costin !
> > > > > 
> > > > > ᐧ
> > > > > 
> > > > > On Wed, Apr 1, 2015 at 11:53 AM, Costin Leau [costin.leau@gmail.com](mailto:costin.leau@gmail.com)  
> > > > > wrote:
> > > > > 
> > > > > > Depends on what you want to do with the data - you need some type of  
> > > > > > analyzer to interpret your data typically depending on what type of queries  
> > > > > > you are making  
> > > > > > since otherwise it's just bytes.  
> > > > > > Your images need to be converted into something - RGB signature,  
> > > > > > shapes, etc... Same for a text file - it in English, Spanish, Japanese? Is  
> > > > > > it a pdf, xls - again ES needs to understand the format and there are  
> > > > > > multiple plugins for that. Even if you don't know what you are looking, you  
> > > > > > need to break down the blob of bytes into 'something' that can be searched  
> > > > > > on.
> > > > > > 
> > > > > > As for Kibana, it's all JS. Some are fine with embedding it into  
> > > > > > their own app or exposing directly, some prefer more control and end up  
> > > > > > modifying it or putting their own controls in front that apply filtering or  
> > > > > > enforce a read-only view. The Kibana team is working on enhancing this even  
> > > > > > further so it's best to talk to them about specific technical issues which  
> > > > > > I'm afraid I can't answer.
> > > > > > 
> > > > > > Hope this helps,
> > > > > > 
> > > > > > On 4/1/15 12:33 PM, 'BEN SALEM Omar' via elasticsearch wrote:
> > > > > > 
> > > > > > > Hi Costin,
> > > > > > > 
> > > > > > > I've already done that and here I am using Kibana to dashboards and  
> > > > > > > so on(I have a question for you I'll ask a little  
> > > > > > > bit later)
> > > > > > > 
> > > > > > > But, my question now is how to make UNstructured data available for  
> > > > > > > such analytics?  
> > > > > > > Let's suppose I have images or textfile that I want to analyse? How  
> > > > > > > make it available in a structured way in hive to do  
> > > > > > > the required steps untill loading it into my ES cluster and perform  
> > > > > > > my analytics?
> > > > > > > 
> > > > > > > The second question is , I have created some Dashboards with Kibana;  
> > > > > > > now what I want to do, is giving my dashboards to  
> > > > > > > the client I'm working with/for to to do his analytics without  
> > > > > > > letting him see what's going on the ES cluster.  
> > > > > > > What's the easiest way to do this?  
> > > > > > > Thanks,  
> > > > > > > ᐧ
> > > > > > > 
> > > > > > > On Wed, Apr 1, 2015 at 11:20 AM, Costin Leau \<[costin.leau@gmail.com](mailto:costin.leau@gmail.com)  
> > > > > > > [mailto:costin.leau@gmail.com](mailto:costin.leau@gmail.com)\> wrote:
> > > > > > > 
> > > > > > > ```
> > > > > > > If your data is in Hadoop, you would index it in Elasticsearch
> > > > > > > 
> > > > > > > ```
> > > > > > > 
> > > > > > > (through the es-hadoop connector) and then run your  
> > > > > > > queries against it (either from Hadoop through the same  
> > > > > > > connector) or through other tools (like Kibana) outside Hadoop.
> > > > > > > 
> > > > > > > ```
> > > > > > > There are plenty of blog posts, documentations, presentations
> > > > > > > 
> > > > > > > ```
> > > > > > > 
> > > > > > > and videos on the topic so I recommend spending  
> > > > > > > sometime time with them to better understand what options suite  
> > > > > > > your use case.
> > > > > > > 
> > > > > > > ```
> > > > > > > On 4/1/15 12:12 PM, BEN SALEM Omar wrote:
> > > > > > > 
> > > > > > > Hi everyone,
> > > > > > > I'm wondering, it possible to make analytics on unstructured
> > > > > > > 
> > > > > > > ```
> > > > > > > 
> > > > > > > data with Elasticsearch?  
> > > > > > > If so? how?  
> > > > > > > Thanks,  
> > > > > > > Omar,
> > > > > > > 
> > > > > > > ```
> > > > > > > --
> > > > > > > You received this message because you are subscribed to the
> > > > > > > 
> > > > > > > ```
> > > > > > > 
> > > > > > > Google Groups "elasticsearch" group.  
> > > > > > > To unsubscribe from this group and stop receiving emails  
> > > > > > > from it, send an email to  
> > > > > > > elasticsearch+unsubscribe@\_\_googlegroups.com \<mailto:  
> > > > > > > elasticsearch%2Bunsubscribe@googlegroups.com\>  
> > > > > > > \<[mailto:elasticsearch+\_\_unsubscribe@googlegroups.com](mailto:elasticsearch+__unsubscribe@googlegroups.com)  
> > > > > > > [mailto:elasticsearch%2Bunsubscribe@googlegroups.com](mailto:elasticsearch%2Bunsubscribe@googlegroups.com)\>.  
> > > > > > > To view this discussion on the web visit  
> > > > > > > [https://groups.google.com/d/\_\_msgid/elasticsearch/08e7617c-\_](https://groups.google.com/d/__msgid/elasticsearch/08e7617c-_)  
> > > > > > > \_9e72-40a6-a780-7f632fee6d47%\_\_40googlegroups.com  
> > > > > > > \<[https://groups.google.com/d/msgid/elasticsearch/08e7617c-](https://groups.google.com/d/msgid/elasticsearch/08e7617c-)  
> > > > > > > 9e72-40a6-a780-7f632fee6d47%[40googlegroups.com](http://40googlegroups.com)\>  
> > > > > > > \<[https://groups.google.com/d/\_\_msgid/elasticsearch/08e7617c-](https://groups.google.com/d/__msgid/elasticsearch/08e7617c-)  
> > > > > > > \_\_9e72-40a6-a780-7f632fee6d47%\__[40GGGROUPS CASINO – Real Slot Casino for 10,000+ Senior Players](http://40googlegroups.com?utm)_  
> > > > > > > medium=\_\_email&utm\_source=footer  
> > > > > > > \<[https://groups.google.com/d/msgid/elasticsearch/08e7617c-](https://groups.google.com/d/msgid/elasticsearch/08e7617c-)  
> > > > > > > 9e72-40a6-a780-7f632fee6d47%[40GGGROUPS CASINO – Real Slot Casino for 10,000+ Senior Players](http://40googlegroups.com?utm_medium=)  
> > > > > > > email&utm\_source=footer\>\>.  
> > > > > > > For more options, visit [https://groups.google.com/d/\_\_optout](https://groups.google.com/d/__optout)  
> > > > > > > [https://groups.google.com/d/optout](https://groups.google.com/d/optout).
> > > > > > > 
> > > > > > > ```
> > > > > > > --
> > > > > > > Costin
> > > > > > > 
> > > > > > > --
> > > > > > > You received this message because you are subscribed to a topic
> > > > > > > 
> > > > > > > ```
> > > > > > > 
> > > > > > > in the Google Groups "elasticsearch" group.  
> > > > > > > To unsubscribe from this topic, visit  
> > > > > > > [https://groups.google.com/d/\_\_topic/elasticsearch/\_\_](https://groups.google.com/d/ __topic/elasticsearch/__ )  
> > > > > > > Md6pwsOI2Dw/unsubscribe  
> > > > > > > \<[https://groups.google.com/d/topic/elasticsearch/](https://groups.google.com/d/topic/elasticsearch/)  
> > > > > > > Md6pwsOI2Dw/unsubscribe\>.  
> > > > > > > To unsubscribe from this group and all its topics, send an email  
> > > > > > > to elasticsearch+unsubscribe@\_\_googlegroups.com  
> > > > > > > [mailto:elasticsearch%2Bunsubscribe@googlegroups.com](mailto:elasticsearch%2Bunsubscribe@googlegroups.com).  
> > > > > > > To view this discussion on the web visit  
> > > > > > > [https://groups.google.com/d/\_\_msgid/elasticsearch/551BB843.\_](https://groups.google.com/d/__msgid/elasticsearch/551BB843._)  
> > > > > > > \_3040206%[40gmail.com](http://40gmail.com)  
> > > > > > > \<[https://groups.google.com/d/msgid/elasticsearch/551BB843](https://groups.google.com/d/msgid/elasticsearch/551BB843).  
> > > > > > > 3040206%[40gmail.com](http://40gmail.com)\>.  
> > > > > > > For more options, visit [https://groups.google.com/d/\_\_optout](https://groups.google.com/d/__optout) \<  
> > > > > > > [https://groups.google.com/d/optout](https://groups.google.com/d/optout)\>.
> > > > > > > 
> > > > > > > --  
> > > > > > > You received this message because you are subscribed to the Google  
> > > > > > > Groups "elasticsearch" group.  
> > > > > > > To unsubscribe from this group and stop receiving emails from it,  
> > > > > > > send an email to  
> > > > > > > [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com) \<mailto:elasticsearch+  
> > > > > > > [unsubscribe@googlegroups.com](mailto:unsubscribe@googlegroups.com)\>.  
> > > > > > > To view this discussion on the web visit  
> > > > > > > [https://groups.google.com/d/msgid/elasticsearch/CAGgBrpwA5UF3VAyX%](https://groups.google.com/d/msgid/elasticsearch/CAGgBrpwA5UF3VAyX%25)  
> > > > > > > 3D9tZMQbFxZ8BOREJyfEdiQ6G%2BSzXiqGyPg%[40mail.gmail.com](http://40mail.gmail.com)  
> > > > > > > \<[https://groups.google.com/d/msgid/elasticsearch/CAGgBrpwA5UF3VAyX%](https://groups.google.com/d/msgid/elasticsearch/CAGgBrpwA5UF3VAyX%25)  
> > > > > > > 3D9tZMQbFxZ8BOREJyfEdiQ6G%2BSzXiqGyPg%[40mail.gmail.com](http://40mail.gmail.com)?  
> > > > > > > utm\_medium=email&utm\_source=footer\>.  
> > > > > > > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).
> > > > > > 
> > > > > > --  
> > > > > > Costin
> > > > > > 
> > > > > > --  
> > > > > > You received this message because you are subscribed to a topic in  
> > > > > > the Google Groups "elasticsearch" group.  
> > > > > > To unsubscribe from this topic, visit [https://groups.google.com/d/](https://groups.google.com/d/)  
> > > > > > topic/elasticsearch/Md6pwsOI2Dw/unsubscribe.  
> > > > > > To unsubscribe from this group and all its topics, send an email to  
> > > > > > [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
> > > > > > To view this discussion on the web visit [https://groups.google.com/d/](https://groups.google.com/d/)  
> > > > > > msgid/elasticsearch/551BC011.6030503%[40gmail.com](http://40gmail.com).
> > > > > > 
> > > > > > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).

--  
You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/CAGgBrpwKmvVyE0DSyMQmh%2BwgG3MgExUn5Tfnhc3jCBikqx51dQ%40mail.gmail.com](https://groups.google.com/d/msgid/elasticsearch/CAGgBrpwKmvVyE0DSyMQmh%2BwgG3MgExUn5Tfnhc3jCBikqx51dQ%40mail.gmail.com).  
For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [July 6, 2017, 12:22am UTC](https://discuss.elastic.co/t/how-to-make-unstructured-data-available-in-hadoop-for-analysis-with-elasticsearch/23032/11 "2017-07-06T00:22:20Z")

</div>