My search use case and Elastic Serach (ES)


(Superstring) #1

Greetings ES,

Interesting to learn about ES, I have looked into Lucene and Solr and
have Solr in mind for my use case. My app is well defined with objects
and configurations. There are many configurations and they can be
loaded into a cache in the app from Solr on an external server (or may
be ES). Where ever possible the configuration format is JSON but in
some cases they are XML, for instance for SVG files that provide
swappable glyphs for the app. Does ES also index/query XML?

Another question I wrestled with Solr on was if to embed Solr in each
local client/the app or only have it run on an external server.
Presently, there is the Solr instance on a server then apps only cache
queried data which is received as JSON or XML into a local cache. The
cache has maps dedicated to de/serialize different configuration types
for the different aspects of the app.

The main data in my search engine will be configurations not the usual
search engine text. Configurations in my app are essentially business
rules and data, as a multimedia app there will be thousands available
and more constantly published. They are like a form of plugin that can
be extended by users to make the generic objects in the app behave in
very diverse ways, a la dependency injection. What is the best search
engine to use? My app also uses the JXTA P2P API which is all about
distributed search, are there are ties to ES here?

Great to see more going on in this exciting area!

Superstring


(Karussell) #2

What is your question? :slight_smile:

Try ElasticSearch to get a better understanding what is different to
Solr:

What is the best search engine to use?

ElasticSearch? :wink:

On 11 Feb., 08:03, Superstring superstring.me...@gmail.com wrote:

Greetings ES,

Interesting to learn about ES, I have looked into Lucene and Solr and
have Solr in mind for my use case. My app is well defined with objects
and configurations. There are many configurations and they can be
loaded into a cache in the app from Solr on an external server (or may
be ES). Where ever possible the configuration format is JSON but in
some cases they are XML, for instance for SVG files that provide
swappable glyphs for the app. Does ES also index/query XML?

Another question I wrestled with Solr on was if to embed Solr in each
local client/the app or only have it run on an external server.
Presently, there is the Solr instance on a server then apps only cache
queried data which is received as JSON or XML into a local cache. The
cache has maps dedicated to de/serialize different configuration types
for the different aspects of the app.

The main data in my search engine will be configurations not the usual
search engine text. Configurations in my app are essentially business
rules and data, as a multimedia app there will be thousands available
and more constantly published. They are like a form of plugin that can
be extended by users to make the generic objects in the app behave in
very diverse ways, a la dependency injection. What is the best search
engine to use? My app also uses the JXTA P2P API which is all about
distributed search, are there are ties to ES here?

Great to see more going on in this exciting area!

Superstring


(Superstring) #3

1 - Does ES also index/query XML?

2 - Another question I wrestled with Solr on was if to embed Solr in
each local client/the app or only have it run on an external server.
Can ES be embedded on the client side?

3 - What is the best search engine to use? FOR my described use case,
see above.

4 - My app also uses the JXTA P2P API which is all about distributed
search, are there are ties to ES here?

5 - Does ES de/serialize JSON as well?

On Feb 11, 9:02 am, Karussell tableyourt...@googlemail.com wrote:

What is your question? :slight_smile:

Try ElasticSearch to get a better understanding what is different to
Solr:

http://karussell.wordpress.com/2011/02/07/get-started-with-elasticsea...

What is the best search engine to use?

ElasticSearch? :wink:

On 11 Feb., 08:03, Superstring superstring.me...@gmail.com wrote:

Greetings ES,

Interesting to learn about ES, I have looked into Lucene and Solr and
have Solr in mind for my use case. My app is well defined with objects
and configurations. There are many configurations and they can be
loaded into a cache in the app from Solr on an external server (or may
be ES). Where ever possible the configuration format is JSON but in
some cases they are XML, for instance for SVG files that provide
swappable glyphs for the app. Does ES also index/query XML?

Another question I wrestled with Solr on was if to embed Solr in each
local client/the app or only have it run on an external server.
Presently, there is the Solr instance on a server then apps only cache
queried data which is received as JSON or XML into a local cache. The
cache has maps dedicated to de/serialize different configuration types
for the different aspects of the app.

The main data in my search engine will be configurations not the usual
search engine text. Configurations in my app are essentially business
rules and data, as a multimedia app there will be thousands available
and more constantly published. They are like a form of plugin that can
be extended by users to make the generic objects in the app behave in
very diverse ways, a la dependency injection. What is the best search
engine to use? My app also uses the JXTA P2P API which is all about
distributed search, are there are ties to ES here?

Great to see more going on in this exciting area!

Superstring


(Karussell) #4

hmmh, I think you should try it out. it will take you 10 minutes ...

that being said: ES only supports json and yes, you can embed ES into
your application IMHO:
start the node in background and then get the client node.client

3 - What is the best search engine to use? FOR my described use case,

no one can answer this correctly. you should evaluate both, if not a
pure lucene approach too.

the big advantage of ES is that you can add nodes to scale ... nothing
that you need for an embeded app IMO ...

but ES is also more real time at the moment ...

5 - Does ES de/serialize JSON as well?

what do you mean with this? you can put the whole document in the
index (as json) and get it back as json, yes.

Regards,
Peter.

On 11 Feb., 17:11, Superstring superstring.me...@gmail.com wrote:

1 - Does ES also index/query XML?

2 - Another question I wrestled with Solr on was if to embed Solr in
each local client/the app or only have it run on an external server.
Can ES be embedded on the client side?

3 - What is the best search engine to use? FOR my described use case,
see above.

4 - My app also uses the JXTA P2P API which is all about distributed
search, are there are ties to ES here?

5 - Does ES de/serialize JSON as well?

On Feb 11, 9:02 am, Karussell tableyourt...@googlemail.com wrote:

What is your question? :slight_smile:

Try ElasticSearch to get a better understanding what is different to
Solr:

http://karussell.wordpress.com/2011/02/07/get-started-with-elasticsea...

What is the best search engine to use?

ElasticSearch? :wink:

On 11 Feb., 08:03, Superstring superstring.me...@gmail.com wrote:

Greetings ES,

Interesting to learn about ES, I have looked into Lucene and Solr and
have Solr in mind for my use case. My app is well defined with objects
and configurations. There are many configurations and they can be
loaded into a cache in the app from Solr on an external server (or may
be ES). Where ever possible the configuration format is JSON but in
some cases they are XML, for instance for SVG files that provide
swappable glyphs for the app. Does ES also index/query XML?

Another question I wrestled with Solr on was if to embed Solr in each
local client/the app or only have it run on an external server.
Presently, there is the Solr instance on a server then apps only cache
queried data which is received as JSON or XML into a local cache. The
cache has maps dedicated to de/serialize different configuration types
for the different aspects of the app.

The main data in my search engine will be configurations not the usual
search engine text. Configurations in my app are essentially business
rules and data, as a multimedia app there will be thousands available
and more constantly published. They are like a form of plugin that can
be extended by users to make the generic objects in the app behave in
very diverse ways, a la dependency injection. What is the best search
engine to use? My app also uses the JXTA P2P API which is all about
distributed search, are there are ties to ES here?

Great to see more going on in this exciting area!

Superstring


(system) #5