How to make unstructured data available in Hadoop for analysis with Elasticsearch?

Hi everyone,
I'm wondering, it possible to make analytics on unstructured data with
Elasticsearch?
If so? how?
Thanks,
Omar,

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/08e7617c-9e72-40a6-a780-7f632fee6d47%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

If your data is in Hadoop, you would index it in Elasticsearch (through the es-hadoop connector) and then run your
queries against it (either from Hadoop through the same connector) or through other tools (like Kibana) outside Hadoop.

There are plenty of blog posts, documentations, presentations and videos on the topic so I recommend spending sometime
time with them to better understand what options suite your use case.

On 4/1/15 12:12 PM, BEN SALEM Omar wrote:

Hi everyone,
I'm wondering, it possible to make analytics on unstructured data with Elasticsearch?
If so? how?
Thanks,
Omar,

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to
elasticsearch+unsubscribe@googlegroups.com mailto:elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/08e7617c-9e72-40a6-a780-7f632fee6d47%40googlegroups.com
https://groups.google.com/d/msgid/elasticsearch/08e7617c-9e72-40a6-a780-7f632fee6d47%40googlegroups.com?utm_medium=email&utm_source=footer.
For more options, visit https://groups.google.com/d/optout.
--
Costin

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/551BB843.3040206%40gmail.com.
For more options, visit https://groups.google.com/d/optout.

Hi Costin,

I've already done that and here I am using Kibana to dashboards and so on(I
have a question for you I'll ask a little bit later)

But, my question now is how to make UNstructured data available for such
analytics?
Let's suppose I have images or textfile that I want to analyse? How make it
available in a structured way in hive to do the required steps untill
loading it into my ES cluster and perform my analytics?

The second question is , I have created some Dashboards with Kibana; now
what I want to do, is giving my dashboards to the client I'm working
with/for to to do his analytics without letting him see what's going on the
ES cluster.
What's the easiest way to do this?
Thanks,

On Wed, Apr 1, 2015 at 11:20 AM, Costin Leau costin.leau@gmail.com wrote:

If your data is in Hadoop, you would index it in Elasticsearch (through
the es-hadoop connector) and then run your queries against it (either from
Hadoop through the same connector) or through other tools (like Kibana)
outside Hadoop.

There are plenty of blog posts, documentations, presentations and videos
on the topic so I recommend spending sometime time with them to better
understand what options suite your use case.

On 4/1/15 12:12 PM, BEN SALEM Omar wrote:

Hi everyone,
I'm wondering, it possible to make analytics on unstructured data with
Elasticsearch?
If so? how?
Thanks,
Omar,

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to
elasticsearch+unsubscribe@googlegroups.com <mailto:elasticsearch+
unsubscribe@googlegroups.com>.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/08e7617c-
9e72-40a6-a780-7f632fee6d47%40googlegroups.com
<https://groups.google.com/d/msgid/elasticsearch/08e7617c-
9e72-40a6-a780-7f632fee6d47%40googlegroups.com?utm_medium=
email&utm_source=footer>.
For more options, visit https://groups.google.com/d/optout.

--
Costin

--
You received this message because you are subscribed to a topic in the
Google Groups "elasticsearch" group.
To unsubscribe from this topic, visit https://groups.google.com/d/
topic/elasticsearch/Md6pwsOI2Dw/unsubscribe.
To unsubscribe from this group and all its topics, send an email to
elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/
msgid/elasticsearch/551BB843.3040206%40gmail.com.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CAGgBrpwA5UF3VAyX%3D9tZMQbFxZ8BOREJyfEdiQ6G%2BSzXiqGyPg%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.

Depends on what you want to do with the data - you need some type of analyzer to interpret your data typically depending
on what type of queries you are making
since otherwise it's just bytes.
Your images need to be converted into something - RGB signature, shapes, etc... Same for a text file - it in English,
Spanish, Japanese? Is it a pdf, xls - again ES needs to understand the format and there are multiple plugins for that.
Even if you don't know what you are looking, you need to break down the blob of bytes into 'something' that can be
searched on.

As for Kibana, it's all JS. Some are fine with embedding it into their own app or exposing directly, some prefer more
control and end up modifying it or putting their own controls in front that apply filtering or enforce a read-only view.
The Kibana team is working on enhancing this even further so it's best to talk to them about specific technical issues
which I'm afraid I can't answer.

Hope this helps,

On 4/1/15 12:33 PM, 'BEN SALEM Omar' via elasticsearch wrote:

Hi Costin,

I've already done that and here I am using Kibana to dashboards and so on(I have a question for you I'll ask a little
bit later)

But, my question now is how to make UNstructured data available for such analytics?
Let's suppose I have images or textfile that I want to analyse? How make it available in a structured way in hive to do
the required steps untill loading it into my ES cluster and perform my analytics?

The second question is , I have created some Dashboards with Kibana; now what I want to do, is giving my dashboards to
the client I'm working with/for to to do his analytics without letting him see what's going on the ES cluster.
What's the easiest way to do this?
Thanks,

On Wed, Apr 1, 2015 at 11:20 AM, Costin Leau <costin.leau@gmail.com mailto:costin.leau@gmail.com> wrote:

If your data is in Hadoop, you would index it in Elasticsearch (through the es-hadoop connector) and then run your
queries against it (either from Hadoop through the same connector) or through other tools (like Kibana) outside Hadoop.

There are plenty of blog posts, documentations, presentations and videos on the topic so I recommend spending
sometime time with them to better understand what options suite your use case.

On 4/1/15 12:12 PM, BEN SALEM Omar wrote:

    Hi everyone,
    I'm wondering, it possible to make analytics on unstructured data with Elasticsearch?
    If so? how?
    Thanks,
    Omar,

    --
    You received this message because you are subscribed to the Google Groups "elasticsearch" group.
    To unsubscribe from this group and stop receiving emails from it, send an email to
    elasticsearch+unsubscribe@__googlegroups.com <mailto:elasticsearch%2Bunsubscribe@googlegroups.com>
    <mailto:elasticsearch+__unsubscribe@googlegroups.com <mailto:elasticsearch%2Bunsubscribe@googlegroups.com>>.
    To view this discussion on the web visit
    https://groups.google.com/d/__msgid/elasticsearch/08e7617c-__9e72-40a6-a780-7f632fee6d47%__40googlegroups.com
    <https://groups.google.com/d/msgid/elasticsearch/08e7617c-9e72-40a6-a780-7f632fee6d47%40googlegroups.com>
    <https://groups.google.com/d/__msgid/elasticsearch/08e7617c-__9e72-40a6-a780-7f632fee6d47%__40googlegroups.com?utm_medium=__email&utm_source=footer
    <https://groups.google.com/d/msgid/elasticsearch/08e7617c-9e72-40a6-a780-7f632fee6d47%40googlegroups.com?utm_medium=email&utm_source=footer>>.
    For more options, visit https://groups.google.com/d/__optout <https://groups.google.com/d/optout>.

--
Costin

--
You received this message because you are subscribed to a topic in the Google Groups "elasticsearch" group.
To unsubscribe from this topic, visit https://groups.google.com/d/__topic/elasticsearch/__Md6pwsOI2Dw/unsubscribe
<https://groups.google.com/d/topic/elasticsearch/Md6pwsOI2Dw/unsubscribe>.
To unsubscribe from this group and all its topics, send an email to elasticsearch+unsubscribe@__googlegroups.com
<mailto:elasticsearch%2Bunsubscribe@googlegroups.com>.
To view this discussion on the web visit
https://groups.google.com/d/__msgid/elasticsearch/551BB843.__3040206%40gmail.com
<https://groups.google.com/d/msgid/elasticsearch/551BB843.3040206%40gmail.com>.
For more options, visit https://groups.google.com/d/__optout <https://groups.google.com/d/optout>.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to
elasticsearch+unsubscribe@googlegroups.com mailto:elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/CAGgBrpwA5UF3VAyX%3D9tZMQbFxZ8BOREJyfEdiQ6G%2BSzXiqGyPg%40mail.gmail.com
https://groups.google.com/d/msgid/elasticsearch/CAGgBrpwA5UF3VAyX%3D9tZMQbFxZ8BOREJyfEdiQ6G%2BSzXiqGyPg%40mail.gmail.com?utm_medium=email&utm_source=footer.
For more options, visit https://groups.google.com/d/optout.

--
Costin

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/551BC011.6030503%40gmail.com.
For more options, visit https://groups.google.com/d/optout.

Thank you for your time and help Costin !

On Wed, Apr 1, 2015 at 11:53 AM, Costin Leau costin.leau@gmail.com wrote:

Depends on what you want to do with the data - you need some type of
analyzer to interpret your data typically depending on what type of queries
you are making
since otherwise it's just bytes.
Your images need to be converted into something - RGB signature, shapes,
etc... Same for a text file - it in English, Spanish, Japanese? Is it a
pdf, xls - again ES needs to understand the format and there are multiple
plugins for that. Even if you don't know what you are looking, you need to
break down the blob of bytes into 'something' that can be searched on.

As for Kibana, it's all JS. Some are fine with embedding it into their own
app or exposing directly, some prefer more control and end up modifying it
or putting their own controls in front that apply filtering or enforce a
read-only view. The Kibana team is working on enhancing this even further
so it's best to talk to them about specific technical issues which I'm
afraid I can't answer.

Hope this helps,

On 4/1/15 12:33 PM, 'BEN SALEM Omar' via elasticsearch wrote:

Hi Costin,

I've already done that and here I am using Kibana to dashboards and so
on(I have a question for you I'll ask a little
bit later)

But, my question now is how to make UNstructured data available for such
analytics?
Let's suppose I have images or textfile that I want to analyse? How make
it available in a structured way in hive to do
the required steps untill loading it into my ES cluster and perform my
analytics?

The second question is , I have created some Dashboards with Kibana; now
what I want to do, is giving my dashboards to
the client I'm working with/for to to do his analytics without letting
him see what's going on the ES cluster.
What's the easiest way to do this?
Thanks,

On Wed, Apr 1, 2015 at 11:20 AM, Costin Leau <costin.leau@gmail.com
mailto:costin.leau@gmail.com> wrote:

If your data is in Hadoop, you would index it in Elasticsearch

(through the es-hadoop connector) and then run your
queries against it (either from Hadoop through the same connector) or
through other tools (like Kibana) outside Hadoop.

There are plenty of blog posts, documentations, presentations and

videos on the topic so I recommend spending
sometime time with them to better understand what options suite your
use case.

On 4/1/15 12:12 PM, BEN SALEM Omar wrote:

    Hi everyone,
    I'm wondering, it possible to make analytics on unstructured data

with Elasticsearch?
If so? how?
Thanks,
Omar,

    --
    You received this message because you are subscribed to the

Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it,
send an email to
elasticsearch+unsubscribe@__googlegroups.com <mailto:
elasticsearch%2Bunsubscribe@googlegroups.com>
<mailto:elasticsearch+__unsubscribe@googlegroups.com <mailto:
elasticsearch%2Bunsubscribe@googlegroups.com>>.
To view this discussion on the web visit
https://groups.google.com/d/_msgid/elasticsearch/08e7617c-
_9e72-40a6-a780-7f632fee6d47%__40googlegroups.com
<https://groups.google.com/d/msgid/elasticsearch/08e7617c-
9e72-40a6-a780-7f632fee6d47%40googlegroups.com>
<https://groups.google.com/d/__msgid/elasticsearch/08e7617c-
__9e72-40a6-a780-7f632fee6d47%_40googlegroups.com?utm
medium=__email&utm_source=footer
<https://groups.google.com/d/msgid/elasticsearch/08e7617c-
9e72-40a6-a780-7f632fee6d47%40googlegroups.com?utm_medium=
email&utm_source=footer>>.
For more options, visit https://groups.google.com/d/__optout <
https://groups.google.com/d/optout>.

--
Costin

--
You received this message because you are subscribed to a topic in

the Google Groups "elasticsearch" group.
To unsubscribe from this topic, visit https://groups.google.com/d/__
topic/elasticsearch/__Md6pwsOI2Dw/unsubscribe
<https://groups.google.com/d/topic/elasticsearch/
Md6pwsOI2Dw/unsubscribe>.
To unsubscribe from this group and all its topics, send an email to
elasticsearch+unsubscribe@__googlegroups.com
mailto:elasticsearch%2Bunsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/_msgid/elasticsearch/551BB843.
_3040206%40gmail.com
<https://groups.google.com/d/msgid/elasticsearch/551BB843.
3040206%40gmail.com>.
For more options, visit https://groups.google.com/d/__optout <
https://groups.google.com/d/optout>.

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to
elasticsearch+unsubscribe@googlegroups.com <mailto:elasticsearch+
unsubscribe@googlegroups.com>.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/CAGgBrpwA5UF3VAyX%
3D9tZMQbFxZ8BOREJyfEdiQ6G%2BSzXiqGyPg%40mail.gmail.com
<https://groups.google.com/d/msgid/elasticsearch/CAGgBrpwA5UF3VAyX%
3D9tZMQbFxZ8BOREJyfEdiQ6G%2BSzXiqGyPg%40mail.gmail.com?
utm_medium=email&utm_source=footer>.
For more options, visit https://groups.google.com/d/optout.

--
Costin

--
You received this message because you are subscribed to a topic in the
Google Groups "elasticsearch" group.
To unsubscribe from this topic, visit https://groups.google.com/d/
topic/elasticsearch/Md6pwsOI2Dw/unsubscribe.
To unsubscribe from this group and all its topics, send an email to
elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/
msgid/elasticsearch/551BC011.6030503%40gmail.com.

For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CAGgBrpzgoyC8DPLrgN2yJrrFa-9qtj4JGVpfRThwh%3DcUwPFTnw%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.

Costin HELP !!

I've installed shield and tried to add an admin user, but when I do so, an
error jumps saying that there is an error in the elif line.
But now, if I try to run Kibana this is what happens !!! :

Help pleaaaase !!

On Wed, Apr 1, 2015 at 12:23 PM, BEN SALEM Omar omar.bensalem@esprit.tn
wrote:

Thank you for your time and help Costin !

On Wed, Apr 1, 2015 at 11:53 AM, Costin Leau costin.leau@gmail.com
wrote:

Depends on what you want to do with the data - you need some type of
analyzer to interpret your data typically depending on what type of queries
you are making
since otherwise it's just bytes.
Your images need to be converted into something - RGB signature, shapes,
etc... Same for a text file - it in English, Spanish, Japanese? Is it a
pdf, xls - again ES needs to understand the format and there are multiple
plugins for that. Even if you don't know what you are looking, you need to
break down the blob of bytes into 'something' that can be searched on.

As for Kibana, it's all JS. Some are fine with embedding it into their
own app or exposing directly, some prefer more control and end up modifying
it or putting their own controls in front that apply filtering or enforce a
read-only view. The Kibana team is working on enhancing this even further
so it's best to talk to them about specific technical issues which I'm
afraid I can't answer.

Hope this helps,

On 4/1/15 12:33 PM, 'BEN SALEM Omar' via elasticsearch wrote:

Hi Costin,

I've already done that and here I am using Kibana to dashboards and so
on(I have a question for you I'll ask a little
bit later)

But, my question now is how to make UNstructured data available for such
analytics?
Let's suppose I have images or textfile that I want to analyse? How make
it available in a structured way in hive to do
the required steps untill loading it into my ES cluster and perform my
analytics?

The second question is , I have created some Dashboards with Kibana; now
what I want to do, is giving my dashboards to
the client I'm working with/for to to do his analytics without letting
him see what's going on the ES cluster.
What's the easiest way to do this?
Thanks,

On Wed, Apr 1, 2015 at 11:20 AM, Costin Leau <costin.leau@gmail.com
mailto:costin.leau@gmail.com> wrote:

If your data is in Hadoop, you would index it in Elasticsearch

(through the es-hadoop connector) and then run your
queries against it (either from Hadoop through the same connector)
or through other tools (like Kibana) outside Hadoop.

There are plenty of blog posts, documentations, presentations and

videos on the topic so I recommend spending
sometime time with them to better understand what options suite your
use case.

On 4/1/15 12:12 PM, BEN SALEM Omar wrote:

    Hi everyone,
    I'm wondering, it possible to make analytics on unstructured

data with Elasticsearch?
If so? how?
Thanks,
Omar,

    --
    You received this message because you are subscribed to the

Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from
it, send an email to
elasticsearch+unsubscribe@__googlegroups.com <mailto:
elasticsearch%2Bunsubscribe@googlegroups.com>
<mailto:elasticsearch+__unsubscribe@googlegroups.com <mailto:
elasticsearch%2Bunsubscribe@googlegroups.com>>.
To view this discussion on the web visit
https://groups.google.com/d/_msgid/elasticsearch/08e7617c-
_9e72-40a6-a780-7f632fee6d47%__40googlegroups.com
<https://groups.google.com/d/msgid/elasticsearch/08e7617c-
9e72-40a6-a780-7f632fee6d47%40googlegroups.com>
<https://groups.google.com/d/__msgid/elasticsearch/08e7617c-
__9e72-40a6-a780-7f632fee6d47%_40googlegroups.com?utm
medium=__email&utm_source=footer
<https://groups.google.com/d/msgid/elasticsearch/08e7617c-
9e72-40a6-a780-7f632fee6d47%40googlegroups.com?utm_medium=
email&utm_source=footer>>.
For more options, visit https://groups.google.com/d/__optout <
https://groups.google.com/d/optout>.

--
Costin

--
You received this message because you are subscribed to a topic in

the Google Groups "elasticsearch" group.
To unsubscribe from this topic, visit https://groups.google.com/d/__
topic/elasticsearch/__Md6pwsOI2Dw/unsubscribe
<https://groups.google.com/d/topic/elasticsearch/
Md6pwsOI2Dw/unsubscribe>.
To unsubscribe from this group and all its topics, send an email to
elasticsearch+unsubscribe@__googlegroups.com
mailto:elasticsearch%2Bunsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/_msgid/elasticsearch/551BB843.
_3040206%40gmail.com
<https://groups.google.com/d/msgid/elasticsearch/551BB843.
3040206%40gmail.com>.
For more options, visit https://groups.google.com/d/__optout <
https://groups.google.com/d/optout>.

--
You received this message because you are subscribed to the Google
Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send
an email to
elasticsearch+unsubscribe@googlegroups.com <mailto:elasticsearch+
unsubscribe@googlegroups.com>.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/CAGgBrpwA5UF3VAyX%
3D9tZMQbFxZ8BOREJyfEdiQ6G%2BSzXiqGyPg%40mail.gmail.com
<https://groups.google.com/d/msgid/elasticsearch/CAGgBrpwA5UF3VAyX%
3D9tZMQbFxZ8BOREJyfEdiQ6G%2BSzXiqGyPg%40mail.gmail.com?
utm_medium=email&utm_source=footer>.
For more options, visit https://groups.google.com/d/optout.

--
Costin

--
You received this message because you are subscribed to a topic in the
Google Groups "elasticsearch" group.
To unsubscribe from this topic, visit https://groups.google.com/d/
topic/elasticsearch/Md6pwsOI2Dw/unsubscribe.
To unsubscribe from this group and all its topics, send an email to
elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/
msgid/elasticsearch/551BC011.6030503%40gmail.com.

For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CAGgBrpxO%2BDG9dtxzOZiKYUPzgvUioyuumfPSssDbpn4n8QFd2g%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.

I've removed the shield plugin with a yum remove shield but the error still
persist !

On Wed, Apr 1, 2015 at 3:42 PM, BEN SALEM Omar omar.bensalem@esprit.tn
wrote:

Costin HELP !!

I've installed shield and tried to add an admin user, but when I do so, an
error jumps saying that there is an error in the elif line.
But now, if I try to run Kibana this is what happens !!! :

Help pleaaaase !!

On Wed, Apr 1, 2015 at 12:23 PM, BEN SALEM Omar omar.bensalem@esprit.tn
wrote:

Thank you for your time and help Costin !

On Wed, Apr 1, 2015 at 11:53 AM, Costin Leau costin.leau@gmail.com
wrote:

Depends on what you want to do with the data - you need some type of
analyzer to interpret your data typically depending on what type of queries
you are making
since otherwise it's just bytes.
Your images need to be converted into something - RGB signature, shapes,
etc... Same for a text file - it in English, Spanish, Japanese? Is it a
pdf, xls - again ES needs to understand the format and there are multiple
plugins for that. Even if you don't know what you are looking, you need to
break down the blob of bytes into 'something' that can be searched on.

As for Kibana, it's all JS. Some are fine with embedding it into their
own app or exposing directly, some prefer more control and end up modifying
it or putting their own controls in front that apply filtering or enforce a
read-only view. The Kibana team is working on enhancing this even further
so it's best to talk to them about specific technical issues which I'm
afraid I can't answer.

Hope this helps,

On 4/1/15 12:33 PM, 'BEN SALEM Omar' via elasticsearch wrote:

Hi Costin,

I've already done that and here I am using Kibana to dashboards and so
on(I have a question for you I'll ask a little
bit later)

But, my question now is how to make UNstructured data available for
such analytics?
Let's suppose I have images or textfile that I want to analyse? How
make it available in a structured way in hive to do
the required steps untill loading it into my ES cluster and perform my
analytics?

The second question is , I have created some Dashboards with Kibana;
now what I want to do, is giving my dashboards to
the client I'm working with/for to to do his analytics without letting
him see what's going on the ES cluster.
What's the easiest way to do this?
Thanks,

On Wed, Apr 1, 2015 at 11:20 AM, Costin Leau <costin.leau@gmail.com
mailto:costin.leau@gmail.com> wrote:

If your data is in Hadoop, you would index it in Elasticsearch

(through the es-hadoop connector) and then run your
queries against it (either from Hadoop through the same connector)
or through other tools (like Kibana) outside Hadoop.

There are plenty of blog posts, documentations, presentations and

videos on the topic so I recommend spending
sometime time with them to better understand what options suite
your use case.

On 4/1/15 12:12 PM, BEN SALEM Omar wrote:

    Hi everyone,
    I'm wondering, it possible to make analytics on unstructured

data with Elasticsearch?
If so? how?
Thanks,
Omar,

    --
    You received this message because you are subscribed to the

Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from
it, send an email to
elasticsearch+unsubscribe@__googlegroups.com <mailto:
elasticsearch%2Bunsubscribe@googlegroups.com>
<mailto:elasticsearch+__unsubscribe@googlegroups.com <mailto:
elasticsearch%2Bunsubscribe@googlegroups.com>>.
To view this discussion on the web visit
https://groups.google.com/d/_msgid/elasticsearch/08e7617c-
_9e72-40a6-a780-7f632fee6d47%__40googlegroups.com
<https://groups.google.com/d/msgid/elasticsearch/08e7617c-
9e72-40a6-a780-7f632fee6d47%40googlegroups.com>
<https://groups.google.com/d/__msgid/elasticsearch/08e7617c-
__9e72-40a6-a780-7f632fee6d47%_40googlegroups.com?utm
medium=__email&utm_source=footer
<https://groups.google.com/d/msgid/elasticsearch/08e7617c-
9e72-40a6-a780-7f632fee6d47%40googlegroups.com?utm_medium=
email&utm_source=footer>>.
For more options, visit https://groups.google.com/d/__optout <
https://groups.google.com/d/optout>.

--
Costin

--
You received this message because you are subscribed to a topic in

the Google Groups "elasticsearch" group.
To unsubscribe from this topic, visit
https://groups.google.com/d/topic/elasticsearch/
Md6pwsOI2Dw/unsubscribe
<https://groups.google.com/d/topic/elasticsearch/
Md6pwsOI2Dw/unsubscribe>.
To unsubscribe from this group and all its topics, send an email to
elasticsearch+unsubscribe@__googlegroups.com
mailto:elasticsearch%2Bunsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/_msgid/elasticsearch/551BB843.
_3040206%40gmail.com
<https://groups.google.com/d/msgid/elasticsearch/551BB843.
3040206%40gmail.com>.
For more options, visit https://groups.google.com/d/__optout <
https://groups.google.com/d/optout>.

--
You received this message because you are subscribed to the Google
Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send
an email to
elasticsearch+unsubscribe@googlegroups.com <mailto:elasticsearch+
unsubscribe@googlegroups.com>.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/CAGgBrpwA5UF3VAyX%
3D9tZMQbFxZ8BOREJyfEdiQ6G%2BSzXiqGyPg%40mail.gmail.com
<https://groups.google.com/d/msgid/elasticsearch/CAGgBrpwA5UF3VAyX%
3D9tZMQbFxZ8BOREJyfEdiQ6G%2BSzXiqGyPg%40mail.gmail.com?
utm_medium=email&utm_source=footer>.
For more options, visit https://groups.google.com/d/optout.

--
Costin

--
You received this message because you are subscribed to a topic in the
Google Groups "elasticsearch" group.
To unsubscribe from this topic, visit https://groups.google.com/d/
topic/elasticsearch/Md6pwsOI2Dw/unsubscribe.
To unsubscribe from this group and all its topics, send an email to
elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/
msgid/elasticsearch/551BC011.6030503%40gmail.com.

For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CAGgBrpwjogF0F7_CaLoS_QuEM4zZ1roDA%2B%3D5nxpi2GY6ESMPJA%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.

I wanted to add authentication to my ES, thus I downloaded the shield :
https://www.elastic.co/downloads/shield

Then I've tried to add a user to give him the admin role as it's mentionned
here :
http://www.elastic.co/guide/en/shield/current/getting-started.html
(I've added it with root, cause I start my es with root..)

But when I try to do so, an error occure saying that there is a syntax
error in the 38 line "the elef line"
elef[$ES_INCLUDE] bla bla
I've tried many time :
bin/shield/esusers useradd omar -p omar -r admin
bin/shield/esusers useradd esomar -p omar -r admin
bin/shield/esusers useradd es_omar -p omar -r admin
bin/shield/esusers useradd ES_omar -p omar -r admin
bin/shield/esusers useradd omar -r admin
bin/shield/esusers useradd esomar -r admin
bin/shield/esusers useradd es_omar -r admin
bin/shield/esusers useradd ES_omar -r admin

But the same error kept on jumping !

I said enough is enough and wanted to keep on doing wwhat I was doing,
tried to run Kibana, and this is what happened !

I've then tried to open my ES marvel plugin, but there is now an
authentication box


I've tried ALL the combinations above, but none of them seemed to work !!

I'm really preoccupied by this note :
To ensure that Elasticsearch can read the user and role information at
startup, run esusers useradd as the same user you use to run Elasticsearch.
Running the command as root or some other user will update the permissions
for the users and users_roles files and prevent Elasticsearch from
accessing them.

When I try to remove the shield with the yum remove shield, it says there
is no package to remove !
Please HELP !!

On Wed, Apr 1, 2015 at 3:58 PM, BEN SALEM Omar omar.bensalem@esprit.tn
wrote:

I've removed the shield plugin with a yum remove shield but the error
still persist !

On Wed, Apr 1, 2015 at 3:42 PM, BEN SALEM Omar omar.bensalem@esprit.tn
wrote:

Costin HELP !!

I've installed shield and tried to add an admin user, but when I do so,
an error jumps saying that there is an error in the elif line.
But now, if I try to run Kibana this is what happens !!! :

Help pleaaaase !!

On Wed, Apr 1, 2015 at 12:23 PM, BEN SALEM Omar omar.bensalem@esprit.tn
wrote:

Thank you for your time and help Costin !

On Wed, Apr 1, 2015 at 11:53 AM, Costin Leau costin.leau@gmail.com
wrote:

Depends on what you want to do with the data - you need some type of
analyzer to interpret your data typically depending on what type of queries
you are making
since otherwise it's just bytes.
Your images need to be converted into something - RGB signature,
shapes, etc... Same for a text file - it in English, Spanish, Japanese? Is
it a pdf, xls - again ES needs to understand the format and there are
multiple plugins for that. Even if you don't know what you are looking, you
need to break down the blob of bytes into 'something' that can be searched
on.

As for Kibana, it's all JS. Some are fine with embedding it into their
own app or exposing directly, some prefer more control and end up modifying
it or putting their own controls in front that apply filtering or enforce a
read-only view. The Kibana team is working on enhancing this even further
so it's best to talk to them about specific technical issues which I'm
afraid I can't answer.

Hope this helps,

On 4/1/15 12:33 PM, 'BEN SALEM Omar' via elasticsearch wrote:

Hi Costin,

I've already done that and here I am using Kibana to dashboards and so
on(I have a question for you I'll ask a little
bit later)

But, my question now is how to make UNstructured data available for
such analytics?
Let's suppose I have images or textfile that I want to analyse? How
make it available in a structured way in hive to do
the required steps untill loading it into my ES cluster and perform my
analytics?

The second question is , I have created some Dashboards with Kibana;
now what I want to do, is giving my dashboards to
the client I'm working with/for to to do his analytics without letting
him see what's going on the ES cluster.
What's the easiest way to do this?
Thanks,

On Wed, Apr 1, 2015 at 11:20 AM, Costin Leau <costin.leau@gmail.com
mailto:costin.leau@gmail.com> wrote:

If your data is in Hadoop, you would index it in Elasticsearch

(through the es-hadoop connector) and then run your
queries against it (either from Hadoop through the same connector)
or through other tools (like Kibana) outside Hadoop.

There are plenty of blog posts, documentations, presentations and

videos on the topic so I recommend spending
sometime time with them to better understand what options suite
your use case.

On 4/1/15 12:12 PM, BEN SALEM Omar wrote:

    Hi everyone,
    I'm wondering, it possible to make analytics on unstructured

data with Elasticsearch?
If so? how?
Thanks,
Omar,

    --
    You received this message because you are subscribed to the

Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from
it, send an email to
elasticsearch+unsubscribe@__googlegroups.com <mailto:
elasticsearch%2Bunsubscribe@googlegroups.com>
<mailto:elasticsearch+__unsubscribe@googlegroups.com <mailto:
elasticsearch%2Bunsubscribe@googlegroups.com>>.
To view this discussion on the web visit
https://groups.google.com/d/_msgid/elasticsearch/08e7617c-
_9e72-40a6-a780-7f632fee6d47%__40googlegroups.com
<https://groups.google.com/d/msgid/elasticsearch/08e7617c-
9e72-40a6-a780-7f632fee6d47%40googlegroups.com>
<https://groups.google.com/d/__msgid/elasticsearch/08e7617c-
__9e72-40a6-a780-7f632fee6d47%_40googlegroups.com?utm
medium=__email&utm_source=footer
<https://groups.google.com/d/msgid/elasticsearch/08e7617c-
9e72-40a6-a780-7f632fee6d47%40googlegroups.com?utm_medium=
email&utm_source=footer>>.
For more options, visit https://groups.google.com/d/__optout <
https://groups.google.com/d/optout>.

--
Costin

--
You received this message because you are subscribed to a topic in

the Google Groups "elasticsearch" group.
To unsubscribe from this topic, visit
https://groups.google.com/d/topic/elasticsearch/
Md6pwsOI2Dw/unsubscribe
<https://groups.google.com/d/topic/elasticsearch/
Md6pwsOI2Dw/unsubscribe>.
To unsubscribe from this group and all its topics, send an email
to elasticsearch+unsubscribe@__googlegroups.com
mailto:elasticsearch%2Bunsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/_msgid/elasticsearch/551BB843.
_3040206%40gmail.com
<https://groups.google.com/d/msgid/elasticsearch/551BB843.
3040206%40gmail.com>.
For more options, visit https://groups.google.com/d/__optout <
https://groups.google.com/d/optout>.

--
You received this message because you are subscribed to the Google
Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send
an email to
elasticsearch+unsubscribe@googlegroups.com <mailto:elasticsearch+
unsubscribe@googlegroups.com>.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/CAGgBrpwA5UF3VAyX%
3D9tZMQbFxZ8BOREJyfEdiQ6G%2BSzXiqGyPg%40mail.gmail.com
<https://groups.google.com/d/msgid/elasticsearch/CAGgBrpwA5UF3VAyX%
3D9tZMQbFxZ8BOREJyfEdiQ6G%2BSzXiqGyPg%40mail.gmail.com?
utm_medium=email&utm_source=footer>.
For more options, visit https://groups.google.com/d/optout.

--
Costin

--
You received this message because you are subscribed to a topic in the
Google Groups "elasticsearch" group.
To unsubscribe from this topic, visit https://groups.google.com/d/
topic/elasticsearch/Md6pwsOI2Dw/unsubscribe.
To unsubscribe from this group and all its topics, send an email to
elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/
msgid/elasticsearch/551BC011.6030503%40gmail.com.

For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CAGgBrpyW%2B57pY%3D4-x%2BHjhWBD_qeOgkZ0Me9vf%2BckygD7vX6h1w%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.

Another thing, my ES is running as a service

On Wed, Apr 1, 2015 at 4:56 PM, BEN SALEM Omar omar.bensalem@esprit.tn
wrote:

I wanted to add authentication to my ES, thus I downloaded the shield :
https://www.elastic.co/downloads/shield

Then I've tried to add a user to give him the admin role as it's
mentionned here :
http://www.elastic.co/guide/en/shield/current/getting-started.html
(I've added it with root, cause I start my es with root..)

But when I try to do so, an error occure saying that there is a syntax
error in the 38 line "the elef line"
elef[$ES_INCLUDE] bla bla
I've tried many time :
bin/shield/esusers useradd omar -p omar -r admin
bin/shield/esusers useradd esomar -p omar -r admin
bin/shield/esusers useradd es_omar -p omar -r admin
bin/shield/esusers useradd ES_omar -p omar -r admin
bin/shield/esusers useradd omar -r admin
bin/shield/esusers useradd esomar -r admin
bin/shield/esusers useradd es_omar -r admin
bin/shield/esusers useradd ES_omar -r admin

But the same error kept on jumping !

I said enough is enough and wanted to keep on doing wwhat I was doing,
tried to run Kibana, and this is what happened !

I've then tried to open my ES marvel plugin, but there is now an
authentication box


I've tried ALL the combinations above, but none of them seemed to work !!

I'm really preoccupied by this note :
To ensure that Elasticsearch can read the user and role information at
startup, run esusers useradd as the same user you use to run
Elasticsearch. Running the command as root or some other user will update
the permissions for the users and users_roles files and prevent
Elasticsearch from accessing them.

When I try to remove the shield with the yum remove shield, it says there
is no package to remove !
Please HELP !!

On Wed, Apr 1, 2015 at 3:58 PM, BEN SALEM Omar omar.bensalem@esprit.tn
wrote:

I've removed the shield plugin with a yum remove shield but the error
still persist !

On Wed, Apr 1, 2015 at 3:42 PM, BEN SALEM Omar omar.bensalem@esprit.tn
wrote:

Costin HELP !!

I've installed shield and tried to add an admin user, but when I do so,
an error jumps saying that there is an error in the elif line.
But now, if I try to run Kibana this is what happens !!! :

Help pleaaaase !!

On Wed, Apr 1, 2015 at 12:23 PM, BEN SALEM Omar <omar.bensalem@esprit.tn

wrote:

Thank you for your time and help Costin !

On Wed, Apr 1, 2015 at 11:53 AM, Costin Leau costin.leau@gmail.com
wrote:

Depends on what you want to do with the data - you need some type of
analyzer to interpret your data typically depending on what type of queries
you are making
since otherwise it's just bytes.
Your images need to be converted into something - RGB signature,
shapes, etc... Same for a text file - it in English, Spanish, Japanese? Is
it a pdf, xls - again ES needs to understand the format and there are
multiple plugins for that. Even if you don't know what you are looking, you
need to break down the blob of bytes into 'something' that can be searched
on.

As for Kibana, it's all JS. Some are fine with embedding it into their
own app or exposing directly, some prefer more control and end up modifying
it or putting their own controls in front that apply filtering or enforce a
read-only view. The Kibana team is working on enhancing this even further
so it's best to talk to them about specific technical issues which I'm
afraid I can't answer.

Hope this helps,

On 4/1/15 12:33 PM, 'BEN SALEM Omar' via elasticsearch wrote:

Hi Costin,

I've already done that and here I am using Kibana to dashboards and
so on(I have a question for you I'll ask a little
bit later)

But, my question now is how to make UNstructured data available for
such analytics?
Let's suppose I have images or textfile that I want to analyse? How
make it available in a structured way in hive to do
the required steps untill loading it into my ES cluster and perform
my analytics?

The second question is , I have created some Dashboards with Kibana;
now what I want to do, is giving my dashboards to
the client I'm working with/for to to do his analytics without
letting him see what's going on the ES cluster.
What's the easiest way to do this?
Thanks,

On Wed, Apr 1, 2015 at 11:20 AM, Costin Leau <costin.leau@gmail.com
mailto:costin.leau@gmail.com> wrote:

If your data is in Hadoop, you would index it in Elasticsearch

(through the es-hadoop connector) and then run your
queries against it (either from Hadoop through the same
connector) or through other tools (like Kibana) outside Hadoop.

There are plenty of blog posts, documentations, presentations and

videos on the topic so I recommend spending
sometime time with them to better understand what options suite
your use case.

On 4/1/15 12:12 PM, BEN SALEM Omar wrote:

    Hi everyone,
    I'm wondering, it possible to make analytics on unstructured

data with Elasticsearch?
If so? how?
Thanks,
Omar,

    --
    You received this message because you are subscribed to the

Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from
it, send an email to
elasticsearch+unsubscribe@__googlegroups.com <mailto:
elasticsearch%2Bunsubscribe@googlegroups.com>
<mailto:elasticsearch+__unsubscribe@googlegroups.com <mailto:
elasticsearch%2Bunsubscribe@googlegroups.com>>.
To view this discussion on the web visit
https://groups.google.com/d/_msgid/elasticsearch/08e7617c-
_9e72-40a6-a780-7f632fee6d47%__40googlegroups.com
<https://groups.google.com/d/msgid/elasticsearch/08e7617c-
9e72-40a6-a780-7f632fee6d47%40googlegroups.com>
<https://groups.google.com/d/__msgid/elasticsearch/08e7617c-
__9e72-40a6-a780-7f632fee6d47%_40googlegroups.com?utm
medium=__email&utm_source=footer
<https://groups.google.com/d/msgid/elasticsearch/08e7617c-
9e72-40a6-a780-7f632fee6d47%40googlegroups.com?utm_medium=
email&utm_source=footer>>.
For more options, visit https://groups.google.com/d/__optout
https://groups.google.com/d/optout.

--
Costin

--
You received this message because you are subscribed to a topic

in the Google Groups "elasticsearch" group.
To unsubscribe from this topic, visit
https://groups.google.com/d/topic/elasticsearch/
Md6pwsOI2Dw/unsubscribe
<https://groups.google.com/d/topic/elasticsearch/
Md6pwsOI2Dw/unsubscribe>.
To unsubscribe from this group and all its topics, send an email
to elasticsearch+unsubscribe@__googlegroups.com
mailto:elasticsearch%2Bunsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/_msgid/elasticsearch/551BB843.
_3040206%40gmail.com
<https://groups.google.com/d/msgid/elasticsearch/551BB843.
3040206%40gmail.com>.
For more options, visit https://groups.google.com/d/__optout <
https://groups.google.com/d/optout>.

--
You received this message because you are subscribed to the Google
Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it,
send an email to
elasticsearch+unsubscribe@googlegroups.com <mailto:elasticsearch+
unsubscribe@googlegroups.com>.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/CAGgBrpwA5UF3VAyX%
3D9tZMQbFxZ8BOREJyfEdiQ6G%2BSzXiqGyPg%40mail.gmail.com
<https://groups.google.com/d/msgid/elasticsearch/CAGgBrpwA5UF3VAyX%
3D9tZMQbFxZ8BOREJyfEdiQ6G%2BSzXiqGyPg%40mail.gmail.com?
utm_medium=email&utm_source=footer>.
For more options, visit https://groups.google.com/d/optout.

--
Costin

--
You received this message because you are subscribed to a topic in the
Google Groups "elasticsearch" group.
To unsubscribe from this topic, visit https://groups.google.com/d/
topic/elasticsearch/Md6pwsOI2Dw/unsubscribe.
To unsubscribe from this group and all its topics, send an email to
elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/
msgid/elasticsearch/551BC011.6030503%40gmail.com.

For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CAGgBrpz4EJ%2BxBgpgxQDYjfc1cbw8jKYmPSWK%2BWbS7bmEgG_1Zw%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.

Ok, I've managed to solve my own problem.

First of all things, if you want to just remove the shield plugin run under
the elasticsearch :

$ bin/plugin --remove shield

Now, to the syntax error in the elef line in the "esusers", generally, when
there is such an error, it's related to things before that line.
In fact there was something like this :
$....done:
correction :
$....done;

Now, we could add users within shield and grunt them the desired role.

But, even if I've done it, I couldn't access to my ES cluster with the "new
born user"; I think because my ES is running as a service and not starting
with bin/elasticsearch, that lead to "misunderstanding."

The solution I found was to transfer the
/usr/share/elasticsearch/config/shield under /etc/elasticsearch
$ln -s /usr/share/elasticsearch/config/shield/ /etc/elasticsearch

And that was it !
Hope that could be of a help for anyone else facing the same problem !

On Wed, Apr 1, 2015 at 6:12 PM, BEN SALEM Omar omar.bensalem@esprit.tn
wrote:

Another thing, my ES is running as a service

On Wed, Apr 1, 2015 at 4:56 PM, BEN SALEM Omar omar.bensalem@esprit.tn
wrote:

I wanted to add authentication to my ES, thus I downloaded the shield :
https://www.elastic.co/downloads/shield

Then I've tried to add a user to give him the admin role as it's
mentionned here :
http://www.elastic.co/guide/en/shield/current/getting-started.html
(I've added it with root, cause I start my es with root..)

But when I try to do so, an error occure saying that there is a syntax
error in the 38 line "the elef line"
elef[$ES_INCLUDE] bla bla
I've tried many time :
bin/shield/esusers useradd omar -p omar -r admin
bin/shield/esusers useradd esomar -p omar -r admin
bin/shield/esusers useradd es_omar -p omar -r admin
bin/shield/esusers useradd ES_omar -p omar -r admin
bin/shield/esusers useradd omar -r admin
bin/shield/esusers useradd esomar -r admin
bin/shield/esusers useradd es_omar -r admin
bin/shield/esusers useradd ES_omar -r admin

But the same error kept on jumping !

I said enough is enough and wanted to keep on doing wwhat I was doing,
tried to run Kibana, and this is what happened !

I've then tried to open my ES marvel plugin, but there is now an
authentication box


I've tried ALL the combinations above, but none of them seemed to work !!

I'm really preoccupied by this note :
To ensure that Elasticsearch can read the user and role information at
startup, run esusers useradd as the same user you use to run
Elasticsearch. Running the command as root or some other user will update
the permissions for the users and users_roles files and prevent
Elasticsearch from accessing them.

When I try to remove the shield with the yum remove shield, it says there
is no package to remove !
Please HELP !!

On Wed, Apr 1, 2015 at 3:58 PM, BEN SALEM Omar omar.bensalem@esprit.tn
wrote:

I've removed the shield plugin with a yum remove shield but the error
still persist !

On Wed, Apr 1, 2015 at 3:42 PM, BEN SALEM Omar omar.bensalem@esprit.tn
wrote:

Costin HELP !!

I've installed shield and tried to add an admin user, but when I do so,
an error jumps saying that there is an error in the elif line.
But now, if I try to run Kibana this is what happens !!! :

Help pleaaaase !!

On Wed, Apr 1, 2015 at 12:23 PM, BEN SALEM Omar <
omar.bensalem@esprit.tn> wrote:

Thank you for your time and help Costin !

On Wed, Apr 1, 2015 at 11:53 AM, Costin Leau costin.leau@gmail.com
wrote:

Depends on what you want to do with the data - you need some type of
analyzer to interpret your data typically depending on what type of queries
you are making
since otherwise it's just bytes.
Your images need to be converted into something - RGB signature,
shapes, etc... Same for a text file - it in English, Spanish, Japanese? Is
it a pdf, xls - again ES needs to understand the format and there are
multiple plugins for that. Even if you don't know what you are looking, you
need to break down the blob of bytes into 'something' that can be searched
on.

As for Kibana, it's all JS. Some are fine with embedding it into
their own app or exposing directly, some prefer more control and end up
modifying it or putting their own controls in front that apply filtering or
enforce a read-only view. The Kibana team is working on enhancing this even
further so it's best to talk to them about specific technical issues which
I'm afraid I can't answer.

Hope this helps,

On 4/1/15 12:33 PM, 'BEN SALEM Omar' via elasticsearch wrote:

Hi Costin,

I've already done that and here I am using Kibana to dashboards and
so on(I have a question for you I'll ask a little
bit later)

But, my question now is how to make UNstructured data available for
such analytics?
Let's suppose I have images or textfile that I want to analyse? How
make it available in a structured way in hive to do
the required steps untill loading it into my ES cluster and perform
my analytics?

The second question is , I have created some Dashboards with Kibana;
now what I want to do, is giving my dashboards to
the client I'm working with/for to to do his analytics without
letting him see what's going on the ES cluster.
What's the easiest way to do this?
Thanks,

On Wed, Apr 1, 2015 at 11:20 AM, Costin Leau <costin.leau@gmail.com
mailto:costin.leau@gmail.com> wrote:

If your data is in Hadoop, you would index it in Elasticsearch

(through the es-hadoop connector) and then run your
queries against it (either from Hadoop through the same
connector) or through other tools (like Kibana) outside Hadoop.

There are plenty of blog posts, documentations, presentations

and videos on the topic so I recommend spending
sometime time with them to better understand what options suite
your use case.

On 4/1/15 12:12 PM, BEN SALEM Omar wrote:

    Hi everyone,
    I'm wondering, it possible to make analytics on unstructured

data with Elasticsearch?
If so? how?
Thanks,
Omar,

    --
    You received this message because you are subscribed to the

Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails
from it, send an email to
elasticsearch+unsubscribe@__googlegroups.com <mailto:
elasticsearch%2Bunsubscribe@googlegroups.com>
<mailto:elasticsearch+__unsubscribe@googlegroups.com
mailto:elasticsearch%2Bunsubscribe@googlegroups.com>.
To view this discussion on the web visit
https://groups.google.com/d/_msgid/elasticsearch/08e7617c-
_9e72-40a6-a780-7f632fee6d47%__40googlegroups.com
<https://groups.google.com/d/msgid/elasticsearch/08e7617c-
9e72-40a6-a780-7f632fee6d47%40googlegroups.com>
<https://groups.google.com/d/__msgid/elasticsearch/08e7617c-
__9e72-40a6-a780-7f632fee6d47%_40googlegroups.com?utm
medium=__email&utm_source=footer
<https://groups.google.com/d/msgid/elasticsearch/08e7617c-
9e72-40a6-a780-7f632fee6d47%40googlegroups.com?utm_medium=
email&utm_source=footer>>.
For more options, visit https://groups.google.com/d/__optout
https://groups.google.com/d/optout.

--
Costin

--
You received this message because you are subscribed to a topic

in the Google Groups "elasticsearch" group.
To unsubscribe from this topic, visit
https://groups.google.com/d/topic/elasticsearch/
Md6pwsOI2Dw/unsubscribe
<https://groups.google.com/d/topic/elasticsearch/
Md6pwsOI2Dw/unsubscribe>.
To unsubscribe from this group and all its topics, send an email
to elasticsearch+unsubscribe@__googlegroups.com
mailto:elasticsearch%2Bunsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/_msgid/elasticsearch/551BB843.
_3040206%40gmail.com
<https://groups.google.com/d/msgid/elasticsearch/551BB843.
3040206%40gmail.com>.
For more options, visit https://groups.google.com/d/__optout <
https://groups.google.com/d/optout>.

--
You received this message because you are subscribed to the Google
Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it,
send an email to
elasticsearch+unsubscribe@googlegroups.com <mailto:elasticsearch+
unsubscribe@googlegroups.com>.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/CAGgBrpwA5UF3VAyX%
3D9tZMQbFxZ8BOREJyfEdiQ6G%2BSzXiqGyPg%40mail.gmail.com
<https://groups.google.com/d/msgid/elasticsearch/CAGgBrpwA5UF3VAyX%
3D9tZMQbFxZ8BOREJyfEdiQ6G%2BSzXiqGyPg%40mail.gmail.com?
utm_medium=email&utm_source=footer>.
For more options, visit https://groups.google.com/d/optout.

--
Costin

--
You received this message because you are subscribed to a topic in
the Google Groups "elasticsearch" group.
To unsubscribe from this topic, visit https://groups.google.com/d/
topic/elasticsearch/Md6pwsOI2Dw/unsubscribe.
To unsubscribe from this group and all its topics, send an email to
elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/
msgid/elasticsearch/551BC011.6030503%40gmail.com.

For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CAGgBrpwKmvVyE0DSyMQmh%2BwgG3MgExUn5Tfnhc3jCBikqx51dQ%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.