I am new to ELK and I am looking to setup a CentOS server with 500GB of disk space. I found the data structure on the site but I don't see anything on how the file system should be partitioned before I install. I'm assuming I need most of the space for the data partition? Do I need to adjust my partitions?
Assuming you're planning on configuring ES data directory to be somewhere under /var/data this partitioning looks reasonable. You'll want ample space for logs (a couple of gigabytes at least) which you also have.
On a side note, I think your partitioning is a bit excessive. It's e.g. not obvious why /opt/IBM and /opt/IBM/ITM need to be different partitions.
It seems you are on RHEL 6 and confuse directories with volume groups / partitions.
Just use the default partition scheme with two volume groups for / and /home, beside the system partitions for /boot and /dev/shm
Having 30G assigned to root volume for OS upgrades, I run Elasticsearch with Elasticsearch user es in /home/es using the rest of the disk space of a 1.6T RAID1 array. There is no need to set up extra volume groups or partitions for /opt, /tmp, /usr/local, /var, /opt/IBM, /opt/IBM/ITM, /var/data, or /var/log - this will make admin life much more complicated.
Will it cause me a lot of pain later to configure the data store under /var/data? I see now on this page that the default data store when installing from rpm would be /var/lib/elasticsearch. I would like to be able to upgrade easily later when the time comes so it seems like using default paths would probably be best for that. Should I just move the space from /var/data to /var/lib?
Will it cause me a lot of pain later to configure the data store under /var/data?
I don't know the specifics of the RPM package and whether a package upgrade changes /etc/sysconfig/elasticsearch, but it probably doesn't. That's where you'll configure the data directory. So no, changing the data location shouldn't result in any problems.
Apache, Apache Lucene, Apache Hadoop, Hadoop, HDFS and the yellow elephant
logo are trademarks of the
Apache Software Foundation
in the United States and/or other countries.