That directory is being created automatically every time I start
elasticsearch.
[root@254020-web1 programs]# service elasticsearch stop
Stopping elasticsearch: [ OK ]
[root@254020-web1 programs]# ls
elasticsearch-1.2.1
[root@254020-web1 programs]# rm -rf *
[root@254020-web1 programs]# ls
[root@254020-web1 programs]# service elasticsearch start
Starting elasticsearch: [ OK ]
[root@254020-web1 programs]# ls
[root@254020-web1 programs]# tail /var/log/elasticsearch/elasticsearch.log
at
sun.nio.fs.UnixFileSystemProvider.newFileChannel(UnixFileSystemProvider.java:176)
at java.nio.channels.FileChannel.open(FileChannel.java:287)
at java.nio.channels.FileChannel.open(FileChannel.java:334)
at org.apache.lucene.store.MMapDirectory.openInput(MMapDirectory.java:193)
at
org.apache.lucene.store.FilterDirectory.openInput(FilterDirectory.java:80)
at org.elasticsearch.index.store.Store.openInputRaw(Store.java:319)
at
org.elasticsearch.indices.recovery.RecoverySource$1$1.run(RecoverySource.java:189)
... 3 more
[2014-06-12 02:48:40,299][WARN ][cluster.action.shard ] [Doctor
Faustus] [blurays][2] sending failed shard for [blurays][2],
node[Vf24wKzHSNuEXJCL-rEFDQ], [R], s[INITIALIZING], indexUUID
[z6lXF3L0S1KwwNZUUaiKsw], reason [Failed to start shard, message
[RecoveryFailedException[[blurays][2]: Recovery failed from
[Stilt-Man][mxmoAlTaTkClmfpImcpb1A][254020-web1.8coupons.com][inet[/
192.168.100.218:9301]] into [Doctor Faustus][Vf24wKzHSNuEXJCL-rEFDQ][
254020-web1.8coupons.com][inet[/192.168.100.218:9300]]]; nested:
RemoteTransportException[[Stilt-Man][inet[/192.168.100.218:9301]][index/shard/recovery/startRecovery]];
nested: RecoveryEngineException[[blurays][2] Phase[1] Execution failed];
nested: RecoverFilesRecoveryException[[blurays][2] Failed to transfer [4]
files with total size of [6.6kb]]; nested:
NoSuchFileException[/home/programs/elasticsearch-1.2.1/data/elasticsearch/nodes/1/indices/blurays/2/index/_
0.si]; ]]
[2014-06-12 02:48:40,299][WARN ][cluster.action.shard ] [Doctor
Faustus] [blurays][3] sending failed shard for [blurays][3],
node[Vf24wKzHSNuEXJCL-rEFDQ], [R], s[INITIALIZING], indexUUID
[z6lXF3L0S1KwwNZUUaiKsw], reason [Failed to start shard, message
[RecoveryFailedException[[blurays][3]: Recovery failed from
[Stilt-Man][mxmoAlTaTkClmfpImcpb1A][254020-web1.8coupons.com][inet[/
192.168.100.218:9301]] into [Doctor Faustus][Vf24wKzHSNuEXJCL-rEFDQ][
254020-web1.8coupons.com][inet[/192.168.100.218:9300]]]; nested:
RemoteTransportException[[Stilt-Man][inet[/192.168.100.218:9301]][index/shard/recovery/startRecovery]];
nested: RecoveryEngineException[[blurays][3] Phase[1] Execution failed];
nested: RecoverFilesRecoveryException[[blurays][3] Failed to transfer [1]
files with total size of [71b]]; nested:
NoSuchFileException[/home/programs/elasticsearch-1.2.1/data/elasticsearch/nodes/1/indices/blurays/3/index/segments_1];
]]
[root@254020-web1 programs]# ls
elasticsearch-1.2.1
[root@254020-web1 programs]#
On Thu, Jun 12, 2014 at 9:36 AM, Mark Walkom markw@campaignmonitor.com
wrote:
Why does it mention this path /home/programs/elasticsearch-1.2.1/
data/elasticsearch/nodes/1/indices/blurays/3/index/segments_1
Regards,
Mark Walkom
Infrastructure Engineer
Campaign Monitor
email: markw@campaignmonitor.com
web: www.campaignmonitor.com
On 12 June 2014 16:33, Sebastian Okser sokser@gmail.com wrote:
I don't see data, but I see it searching for the shards in the log files.
Other functionality regarding the JDBC rivers don't seem to be working
either in 1.2.1, but its extremely hard to debug those issues when my log
files are constantly being filled with the following every minute or so.
[root@254020-web1 home]# tail /var/log/elasticsearch/elasticsearch.log
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at
sun.nio.fs.UnixFileSystemProvider.newFileChannel(UnixFileSystemProvider.java:176)
at java.nio.channels.FileChannel.open(FileChannel.java:287)
at java.nio.channels.FileChannel.open(FileChannel.java:334)
at org.apache.lucene.store.MMapDirectory.openInput(MMapDirectory.java:193)
at
org.apache.lucene.store.FilterDirectory.openInput(FilterDirectory.java:80)
at org.elasticsearch.index.store.Store.openInputRaw(Store.java:319)
at
org.elasticsearch.indices.recovery.RecoverySource$1$1.run(RecoverySource.java:189)
... 3 more
[2014-06-12 02:30:01,513][WARN ][cluster.action.shard ] [Metalhead]
[blurays][3] sending failed shard for [blurays][3],
node[UqeMw_y7RN-FQ3tuBNEdng], [R], s[INITIALIZING], indexUUID
[z6lXF3L0S1KwwNZUUaiKsw], reason [Failed to start shard, message
[RecoveryFailedException[[blurays][3]: Recovery failed from
[Stilt-Man][mxmoAlTaTkClmfpImcpb1A][254020-web1.8coupons.com][inet[/
192.168.100.218:9301]] into [Metalhead][UqeMw_y7RN-FQ3tuBNEdng][
254020-web1.8coupons.com][inet[/192.168.100.218:9300]]]; nested:
RemoteTransportException[[Stilt-Man][inet[/192.168.100.218:9301]][index/shard/recovery/startRecovery]];
nested: RecoveryEngineException[[blurays][3] Phase[1] Execution failed];
nested: RecoverFilesRecoveryException[[blurays][3] Failed to transfer [1]
files with total size of [71b]]; nested:
NoSuchFileException[/home/programs/elasticsearch-1.2.1/data/elasticsearch/nodes/1/indices/blurays/3/index/segments_1];
]]
[root@254020-web1 home]#
On Thu, Jun 12, 2014 at 9:27 AM, Mark Walkom markw@campaignmonitor.com
wrote:
Just to clarify, is it just the directory that appears again at
/var/lib/elasticsearch/elasticsearch/nodes/0/indices, or are you saying
the indexed data in the shards is reappearing as well?
Regards,
Mark Walkom
Infrastructure Engineer
Campaign Monitor
email: markw@campaignmonitor.com
web: www.campaignmonitor.com
On 12 June 2014 16:24, Sebastian Okser sokser@gmail.com wrote:
Neither have data directories. I also deleted all files I could find
located at /var/lib/elasticsearch including
/var/lib/elasticsearch/elasticsearch/nodes/0/indices, /etc/elasticsearch,
their parent directories and every other directory I could find. I then
again reinstalled and the data again appears at
/var/lib/elasticsearch/elasticsearch/nodes/0/indices.
[root@254020-web1 home]# ls /usr/local/share/elasticsearch
ls: /usr/local/share/elasticsearch: No such file or directory
[root@254020-web1 home]# ls /usr/share/elasticsearch/
LICENSE.txt NOTICE.txt README.textile bin lib plugins
On Thu, Jun 12, 2014 at 9:12 AM, Mark Walkom <markw@campaignmonitor.com
wrote:
You may have a data directory under /usr/local/share/elasticsearch, or
under /usr/share/elasticsearch, if it's there and you don't want the data,
delete them.
Regards,
Mark Walkom
Infrastructure Engineer
Campaign Monitor
email: markw@campaignmonitor.com
web: www.campaignmonitor.com
On 12 June 2014 16:10, Sebastian Okser sokser@gmail.com wrote:
I should add that I have also tried uninstalling the RPM and
reinstalling it. I used rpm -e elasticsearch-1.2.1 for the uninstall.
On Thu, Jun 12, 2014 at 9:09 AM, Sebastian Okser sokser@gmail.com
wrote:
I originally installed it with:
cd ~
wget https://github.com/downloads/elasticsearch/elasticsearch/elasticsearch-0.19.9.tar.gz -O elasticsearch.tar.gz
tar -xf elasticsearch.tar.gz
rm elasticsearch.tar.gz
mv elasticsearch-* elasticsearch
sudo mv elasticsearch /usr/local/share
curl -L http://github.com/elasticsearch/elasticsearch-servicewrapper/tarball/master | tar -xz
mv servicewrapper/service /usr/local/share/elasticsearch/bin/
rm -Rf servicewrapper
sudo /usr/local/share/elasticsearch/bin/service/elasticsearch install
sudo /etc/init.d/elasticsearch start
I then deleted all of these directories using rm -rf as specified in
past messages. I then reinstalled it using an RPM using:
rpm -Uvh elasticsearch-1.2.1.noarch.rpm
It seems to me that there must be some hidden place where it is
storing all of the settings. Thanks!
On Thu, Jun 12, 2014 at 9:04 AM, Mark Walkom <
markw@campaignmonitor.com> wrote:
Is it a single node cluster?
Howe are you installing things; deb, rpm, zip?
How are you uninstalling it?
Exact commands for the above will be helpful 
Regards,
Mark Walkom
Infrastructure Engineer
Campaign Monitor
email: markw@campaignmonitor.com
web: www.campaignmonitor.com
On 12 June 2014 16:00, Sebastian Okser sokser@gmail.com wrote:
I should add that I want to do a 100% clean install it keeps
trying to initiate a recovery which is creating problems.
On Thu, Jun 12, 2014 at 8:42 AM, Sebastian Okser <sokser@gmail.com
wrote:
I tried deleting the directories an reinstalling but somehow it
keeps loading in my old environment even when I try to rm -rf the
directories after shutting down the server? Where is elasticsearch hiding
these files?
On Wed, Jun 11, 2014 at 7:41 PM, Ivan Brusic ivan@brusic.com
wrote:
Regarding your problem, are you perhaps running into the fact
that dynamic scripts are now disabled by default since 1.2?
Elasticsearch Platform — Find real-time answers at scale | Elastic
In terms of deleting the existing version, it all depends on how
you installed Elasticsearch. If you did not override the defaults for the
various directories, you can just delete the directory.
Elasticsearch Platform — Find real-time answers at scale | Elastic
--
Ivan
On Wed, Jun 11, 2014 at 12:51 AM, John sokser@gmail.com wrote:
I recently upgraded to elasticsearch 1.2.1 and have since seen
most of my scripts stop working. Nothing seems to work properly and I think
I may have messed up during the upgrade. How can I properly delete
elasticsearch and all associated data so I can reinstall it from scratch
(all data, indices, etc removed).
--
You received this message because you are subscribed to the
Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from
it, send an email to elasticsearch+unsubscribe@googlegroups.com
.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/b7ca9761-05e7-4e24-b287-f98bbaeb4713%40googlegroups.com
https://groups.google.com/d/msgid/elasticsearch/b7ca9761-05e7-4e24-b287-f98bbaeb4713%40googlegroups.com?utm_medium=email&utm_source=footer
.
For more options, visit https://groups.google.com/d/optout.
--
You received this message because you are subscribed to a topic
in the Google Groups "elasticsearch" group.
To unsubscribe from this topic, visit
https://groups.google.com/d/topic/elasticsearch/6YzVfTg-4ng/unsubscribe
.
To unsubscribe from this group and all its topics, send an email
to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/CALY%3DcQAkb1XiEK7umZReNyPiQ-uE3YGhReUivPOdKcSbz81VuA%40mail.gmail.com
https://groups.google.com/d/msgid/elasticsearch/CALY%3DcQAkb1XiEK7umZReNyPiQ-uE3YGhReUivPOdKcSbz81VuA%40mail.gmail.com?utm_medium=email&utm_source=footer
.
For more options, visit https://groups.google.com/d/optout.
--
You received this message because you are subscribed to the Google
Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it,
send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/CAPrW28-9O%2B_gomzyDymGEPpsL%2B--que7AhQr3sUODEGOZuPC6w%40mail.gmail.com
https://groups.google.com/d/msgid/elasticsearch/CAPrW28-9O%2B_gomzyDymGEPpsL%2B--que7AhQr3sUODEGOZuPC6w%40mail.gmail.com?utm_medium=email&utm_source=footer
.
For more options, visit https://groups.google.com/d/optout.
--
You received this message because you are subscribed to a topic in
the Google Groups "elasticsearch" group.
To unsubscribe from this topic, visit
https://groups.google.com/d/topic/elasticsearch/6YzVfTg-4ng/unsubscribe
.
To unsubscribe from this group and all its topics, send an email to
elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/CAEM624ZfPSOc7GGteX6SYv03n5i5UTV9zHaTC%3D5WDBEDd0MGWQ%40mail.gmail.com
https://groups.google.com/d/msgid/elasticsearch/CAEM624ZfPSOc7GGteX6SYv03n5i5UTV9zHaTC%3D5WDBEDd0MGWQ%40mail.gmail.com?utm_medium=email&utm_source=footer
.
For more options, visit https://groups.google.com/d/optout.
--
You received this message because you are subscribed to the Google
Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it,
send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/CAPrW28_DNmoQJ5KonPMgnwH6QJ1eZvT6j4gXHUkgCa4_iBTUBA%40mail.gmail.com
https://groups.google.com/d/msgid/elasticsearch/CAPrW28_DNmoQJ5KonPMgnwH6QJ1eZvT6j4gXHUkgCa4_iBTUBA%40mail.gmail.com?utm_medium=email&utm_source=footer
.
For more options, visit https://groups.google.com/d/optout.
--
You received this message because you are subscribed to a topic in the
Google Groups "elasticsearch" group.
To unsubscribe from this topic, visit
https://groups.google.com/d/topic/elasticsearch/6YzVfTg-4ng/unsubscribe
.
To unsubscribe from this group and all its topics, send an email to
elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/CAEM624Yk2KN95ErhTy9gX-ZTJWpfwo7YYDvGmA72ceTm_QrNAQ%40mail.gmail.com
https://groups.google.com/d/msgid/elasticsearch/CAEM624Yk2KN95ErhTy9gX-ZTJWpfwo7YYDvGmA72ceTm_QrNAQ%40mail.gmail.com?utm_medium=email&utm_source=footer
.
For more options, visit https://groups.google.com/d/optout.
--
You received this message because you are subscribed to the Google
Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send
an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/CAPrW28-HT8BBkA8ZkkZgcKit7rsk5NBBuZXtJmN3G4PhhvY5Aw%40mail.gmail.com
https://groups.google.com/d/msgid/elasticsearch/CAPrW28-HT8BBkA8ZkkZgcKit7rsk5NBBuZXtJmN3G4PhhvY5Aw%40mail.gmail.com?utm_medium=email&utm_source=footer
.
For more options, visit https://groups.google.com/d/optout.
--
You received this message because you are subscribed to a topic in the
Google Groups "elasticsearch" group.
To unsubscribe from this topic, visit
https://groups.google.com/d/topic/elasticsearch/6YzVfTg-4ng/unsubscribe.
To unsubscribe from this group and all its topics, send an email to
elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/CAEM624aY%3D_FJAh-FhSJRSTKPAB_6brdMhnSzQBRwaJWQe56dpA%40mail.gmail.com
https://groups.google.com/d/msgid/elasticsearch/CAEM624aY%3D_FJAh-FhSJRSTKPAB_6brdMhnSzQBRwaJWQe56dpA%40mail.gmail.com?utm_medium=email&utm_source=footer
.
For more options, visit https://groups.google.com/d/optout.
--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/CAPrW289L4z8kT01N4kPX4Gs0Y1PO9%2Bp88VMP_QP-3Ppiawd2wQ%40mail.gmail.com
https://groups.google.com/d/msgid/elasticsearch/CAPrW289L4z8kT01N4kPX4Gs0Y1PO9%2Bp88VMP_QP-3Ppiawd2wQ%40mail.gmail.com?utm_medium=email&utm_source=footer
.
For more options, visit https://groups.google.com/d/optout.
--
You received this message because you are subscribed to a topic in the
Google Groups "elasticsearch" group.
To unsubscribe from this topic, visit
https://groups.google.com/d/topic/elasticsearch/6YzVfTg-4ng/unsubscribe.
To unsubscribe from this group and all its topics, send an email to
elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/CAEM624ZuysNAkgb5ynMPG%3DhwJDiBaz35y8TBHvPOJ2mUDWHBvQ%40mail.gmail.com
https://groups.google.com/d/msgid/elasticsearch/CAEM624ZuysNAkgb5ynMPG%3DhwJDiBaz35y8TBHvPOJ2mUDWHBvQ%40mail.gmail.com?utm_medium=email&utm_source=footer
.
For more options, visit https://groups.google.com/d/optout.
--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CAPrW2899OWfMFYsAHzyhYo6uP%3DHjXS5HmBmnwGu7QpLhEwY5XA%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.