Elasticsearch puppet module's problem

Elastic Stack Elasticsearch
1

Dear support,

I'm trying to setup Es using this module -


For sake of testing I spin up a new VM and try to apply default module on it

node somenode{
include elasticsearch
}

It ends up with rpm package installed but absent service

Info: Applying configuration version '1429537010'
Notice: /Stage[main]/Elasticsearch::Package/Package[elasticsearch]/ensure:
created
Info: Computing checksum on file /etc/init.d/elasticsearch
Info: FileBucket got a duplicate file {md5}cbd974e711b257c941dddca3aef79e46
Info: /Stage[main]/Elasticsearch::Config/File[/etc/init.d/elasticsearch]:
Filebucketed /etc/init.d/elasticsearch to puppet with sum
cbd974e711b257c941dddca3aef79e46
Notice:
/Stage[main]/Elasticsearch::Config/File[/etc/init.d/elasticsearch]/ensure:
removed
Info: Computing checksum on file
/usr/lib/systemd/system/elasticsearch.service
Info: FileBucket got a duplicate file {md5}649153421e86836314671510160c3798
Notice:
/Stage[main]/Elasticsearch::Config/File[/usr/lib/systemd/system/elasticsearch.service]/ensure:
removed
Notice:
/Stage[main]/Elasticsearch::Config/File[/usr/share/elasticsearch/lib/spatial4j-0.4.1.jar]/owner:
owner changed 'root' to 'elasticsearch'
Notice:
/Stage[main]/Elasticsearch::Config/File[/usr/share/elasticsearch/lib/spatial4j-0.4.1.jar]/group:
group changed 'root' to 'elasticsearch'
Notice:
/Stage[main]/Elasticsearch::Config/File[/usr/share/elasticsearch/lib/asm-4.1.jar]/owner:
owner changed 'root' to 'elasticsearch'
Notice:
/Stage[main]/Elasticsearch::Config/File[/usr/share/elasticsearch/lib/asm-4.1.jar]/group:
group changed 'root' to 'elasticsearch'
Notice:
/Stage[main]/Elasticsearch::Config/File[/usr/share/elasticsearch/lib/lucene-join-4.10.4.jar]/owner:
owner changed 'root' to 'elasticsearch'
Notice:
/Stage[main]/Elasticsearch::Config/File[/usr/share/elasticsearch/lib/lucene-join-4.10.4.jar]/group:
group changed 'root' to 'elasticsearch'

...

Info: Computing checksum on file /etc/elasticsearch/elasticsearch.yml
Info: FileBucket got a duplicate file {md5}08a09998560b7b786eca1e594b004ddc
Info:
/Stage[main]/Elasticsearch::Config/File[/etc/elasticsearch/elasticsearch.yml]:
Filebucketed /etc/elasticsearch/elasticsearch.yml to puppet with sum
08a09998560b7b786eca1e594b004ddc
Notice:
/Stage[main]/Elasticsearch::Config/File[/etc/elasticsearch/elasticsearch.yml]/ensure:
removed
Info: Computing checksum on file /etc/elasticsearch/logging.yml
Info: FileBucket got a duplicate file {md5}c0d21de98dc9a6015943dc47f2aa18f5
Info:
/Stage[main]/Elasticsearch::Config/File[/etc/elasticsearch/logging.yml]:
Filebucketed /etc/elasticsearch/logging.yml to puppet with sum
c0d21de98dc9a6015943dc47f2aa18f5
Notice:
/Stage[main]/Elasticsearch::Config/File[/etc/elasticsearch/logging.yml]/ensure:
removed
Notice:
/Stage[main]/Elasticsearch::Config/File[/usr/share/elasticsearch/lib/jna-4.1.0.jar]/owner:
owner changed 'root' to 'elasticsearch'
Notice:
/Stage[main]/Elasticsearch::Config/File[/usr/share/elasticsearch/lib/jna-4.1.0.jar]/group:
group changed 'root' to 'elasticsearch'
Notice: Finished catalog run in 43.57 seconds

Also I noticed that module doesn't handle repository in default state, so I
need to include variables
elasticsearch::manage_repo: true
elasticsearch::repo_version: "1.5"

So what am I doing wrong ?

Regards
Sergey

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/d6e9bd4d-fbb1-44e7-82c1-f44705c8d61e%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

2

Hi,

So any advice what should I pass to configure service? It seems configs are
removed by module itself which is odd.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/9bd5667b-e2fc-4d77-94d2-2dd142a34b4c%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

3

Update

When I commented this part of config.pp the service and configs appeared on
host

/* # Removal of files that are provided with the package which we don't
use
file { '/etc/init.d/elasticsearch':
ensure => 'absent'
}
file { '/usr/lib/systemd/system/elasticsearch.service':
ensure => 'absent'
}

file { "${elasticsearch::params::defaults_location}/elasticsearch":
  ensure => 'absent'
}

file { '/etc/elasticsearch/elasticsearch.yml':
  ensure => 'absent'
}
file { '/etc/elasticsearch/logging.yml':
  ensure => 'absent'
}

*/

I'm a bit confused how this should work at all...

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/81473097-7423-472f-8438-cf9c76e4e813%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

4

The module works with the notion of an instance
https://github.com/elastic/puppet-elasticsearch/blob/master/README.md#instances
and when you setup an instance it creates
/etc/init.d/elasticsearch-$instancename

On 22 April 2015 at 17:42, Sergey Zemlyanoy s.zemlyanoy@gmail.com wrote:

Update

When I commented this part of config.pp the service and configs appeared
on host

/* # Removal of files that are provided with the package which we don't
use
file { '/etc/init.d/elasticsearch':
ensure => 'absent'
}
file { '/usr/lib/systemd/system/elasticsearch.service':
ensure => 'absent'
}

file { "${elasticsearch::params::defaults_location}/elasticsearch":
  ensure => 'absent'
}

file { '/etc/elasticsearch/elasticsearch.yml':
  ensure => 'absent'
}
file { '/etc/elasticsearch/logging.yml':
  ensure => 'absent'
}

*/

I'm a bit confused how this should work at all...

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/81473097-7423-472f-8438-cf9c76e4e813%40googlegroups.com
https://groups.google.com/d/msgid/elasticsearch/81473097-7423-472f-8438-cf9c76e4e813%40googlegroups.com?utm_medium=email&utm_source=footer
.

For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CAEYi1X9ZmtZRNtLoiTL7j3td0%2BkEHGM7Pvk%3Da-MSjPH8ffoobw%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.

5

Thanks for advice! It works

BTW as I see there is no purge handling for instance, right? So it's not
enough just to remove instance name from hiera, I need to pass ensure =>
absent explicitly

Thanks
Sergey

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/9b2e9fa4-b85b-40df-a9a8-a195c5dcb2eb%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

6

And guys,

how can I increase heap size using this module? I don't see how to control
parameter ES_HEAP_SIZE located in init script rather then distribute full
init script by puppet

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/76ebd44a-441b-45d0-afaf-51347d9ee7bc%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

7

You don't want to set that in the init script, use the init_defaults hash
instead.

On 29 April 2015 at 00:09, Sergey Zemlyanoy s.zemlyanoy@gmail.com wrote:

And guys,

how can I increase heap size using this module? I don't see how to
control parameter ES_HEAP_SIZE located in init script rather then
distribute full init script by puppet

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/76ebd44a-441b-45d0-afaf-51347d9ee7bc%40googlegroups.com
https://groups.google.com/d/msgid/elasticsearch/76ebd44a-441b-45d0-afaf-51347d9ee7bc%40googlegroups.com?utm_medium=email&utm_source=footer
.

For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CAEYi1X8xNNAO%3D-83AiCpy%3D61eO96Y4faP6oTeXwO56UEZTt2ug%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.

8

Yep that works for me fine! Thanks

What about instance purge? It seems retain non managed instances on server

Sergey

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/6faf253a-8bce-477e-8692-439071bcbf12%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.