ElasticSearch on Heroku

Jonas_Grimfelt · November 23, 2011, 8:50am

I've been using ElasticSearch for a while now, really cannot live without
it now when I got used. So far running on EC2 but since Heroku released
support for Java (Cedar stack), I wonder if anyone had any luck getting ES
running on there? I spent an hour trying but since I'm not from the Java
world I have real trouble understand Maven - or launching ElasticSearch
without binary "properly" - enough to get it to work. It was more like an
experiment for me, so I'll just use own EC2 setup - but it would be
interesting to see if it's even possible.

Would be greatful for any details, thanks in advice.

Karussell1 · November 23, 2011, 10:26am

No experience with Heroku here ... But if you need to build ES via
Maven you can have a look into:

github.com/elastic/elasticsearch

Mavenization to support development in NetBeans IDE

elastic:master ← karussell:master

opened 05:27PM - 12 Nov 11 UTC

karussell

+381 -1

Hi Shay, I've struggled a bit with git but now I have hopefully the correctly c…hanged files to compile and test ElasticSearch from within NetBeans as there is no working gradle plugin available. Please ignore all the commits :) just have a look in the changed files. If depencencies changed, all the pom's can be automatically regenerated via gradlew and the script pkg/mavenize.sh Important: I had to move 2 config files originally placed under java now under resources (to be maven compatible) - does this affect your build? What I didn't understand: why is sigar not included in the gradle deps? Regards, Peter.

And here is how you would start it via Java:

github.com

karussell/Jetwick/blob/master/src/main/java/de/jetwick/es/ElasticNode.java

/*
 *  Copyright 2010 Peter Karich jetwick_@_pannous_._info
 * 
 *  Licensed under the Apache License, Version 2.0 (the "License");
 *  you may not use this file except in compliance with the License.
 *  You may obtain a copy of the License at
 *
 *       http://www.apache.org/licenses/LICENSE-2.0
 * 
 *  Unless required by applicable law or agreed to in writing, software
 *  distributed under the License is distributed on an "AS IS" BASIS,
 *  WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
 *  See the License for the specific language governing permissions and
 *  limitations under the License.
 */
package de.jetwick.es;

import org.elasticsearch.node.NodeBuilder;
import org.elasticsearch.common.settings.ImmutableSettings.Builder;
import java.io.File;

This file has been truncated. show original

or you could even create a war file:
http://elasticsearch-users.115913.n3.nabble.com/Wares-Plugin-Deploying-elasticsearch-as-a-servlet-td3358703.html

Peter.

On 23 Nov., 09:50, Jonas Grimfelt gri...@gmail.com wrote:

I've been using Elasticsearch for a while now, really cannot live without
it now when I got used. So far running on EC2 but since Heroku released
support for Java (Cedar stack), I wonder if anyone had any luck getting ES
running on there? I spent an hour trying but since I'm not from the Java
world I have real trouble understand Maven - or launching Elasticsearch
without binary "properly" - enough to get it to work. It was more like an
experiment for me, so I'll just use own EC2 setup - but it would be
interesting to see if it's even possible.

Would be greatful for any details, thanks in advice.

Jonas_Grimfelt · November 23, 2011, 12:04pm

Thanks Karusell, looks like this would bring me a bit further in fact. Will
have a look at them next experimental session and get back with status if I
get anywhere with it.

Peter_Berkenbosch · November 23, 2011, 12:33pm

You still need disk space .. Heroku is a read only system.. only available are databases and a volatile tmp dir.. I don;t think it will work.

--
Peter Berkenbosch
Sent with Sparrow (http://www.sparrowmailapp.com/?sig)

On Wednesday, November 23, 2011( w47 ) at 1:04 PM, Jonas Grimfelt wrote:

Thanks Karusell, looks like this would bring me a bit further in fact. Will have a look at them next experimental session and get back with status if I get anywhere with it.

Jonas_Grimfelt · November 24, 2011, 3:21pm

Was thinking about using the Amazon S3 gateway.

http://www.elasticsearch.org/guide/reference/modules/gateway/s3.html

Peter_Berkenbosch · November 24, 2011, 3:35pm

Ah.. that sounds like a really cool solution..

--
Peter Berkenbosch
Sent with Sparrow (http://www.sparrowmailapp.com/?sig)

On Thursday, November 24, 2011( w47 ) at 4:21 PM, Jonas Grimfelt wrote:

Was thinking about using the Amazon S3 gateway.

Elasticsearch Platform — Find real-time answers at scale | Elastic

James_Cook_3 · November 26, 2011, 7:00am

Keep in mind that write access to S3 from an outside network (non-EC2) is
relatively very slow. I'm not sure what the direct performance issues are
on ES's S3 gateway, but there is probably some kind of performance hit or a
delay on writes.

Jonas_Grimfelt · December 4, 2011, 8:44pm

Heroku runs EC2 so that should not be an issue if S3 region is respected.