Hello,
Hope this letter finds you well.
Could you please help me with a question that i have. My question is about the generation of several segment files are incremented on a Node.
I used elastic 6.8.12 and I have the infrastructure replicated in two nodes (node A, node B).
Now the size of nodes are:
Node A:
/usr/share/Elasticsearch/data/backups/snap_repo/indices
12 GB
Node B:
/usr/share/Elasticsearch/data/backups/snap_repo/indices
223 GB
the size of backup in node B is bigger than node A but both nodes should be the same size o similar.
I revides the files. Why it is generated several segment files __** in node B, but no in node A?. This is the reason for the different size between nodes.
Please find a short exemple below, in general the number of files are very big.
Node B:
/usr/share/Elasticsearch/data/backups/snap_repo
-rw-rw-r-- 1 Elasticsearch Elasticsearch 12K Dec 15 22:50 meta-GtSrbA44STaweZjEH5On9w.dat
-rw-rw-r-- 1 Elasticsearch Elasticsearch 900 Dec 15 23:25 snap-GtSrbA44STaweZjEH5On9w.dat
-rw-rw-r-- 1 Elasticsearch Elasticsearch 24K Dec 15 23:25 index-1260
-rw-rw-r-- 1 Elasticsearch Elasticsearch 23K Dec 15 23:25 index-1261
-rw-rw-r-- 1 Elasticsearch Elasticsearch 8 Dec 15 23:25 index.latest
-rw-rw-r-- 1 Elasticsearch Elasticsearch 29 Mar 11 2020 incompatible-snapshots
drwxrwxr-x 28 Elasticsearch Elasticsearch 4.0K Aug 11 21:55 indices
/usr/share/Elasticsearch/data/backups/snap_repo/indices
drwxrwxr-x 3 Elasticsearch Elasticsearch 4.0K Dec 15 23:25 oMof6-HiT9WqlyrHgCcSog
drwxrwxr-x 3 Elasticsearch Elasticsearch 4.0K Dec 15 23:25 iVeUwp81RVaY0OEKxJMWog
drwxrwxr-x 3 Elasticsearch Elasticsearch 4.0K Dec 15 23:25 hnt-tkcER8iAW_6TsEmhOg
drwxrwxr-x 3 Elasticsearch Elasticsearch 4.0K Dec 15 23:25 CrScXiJLSN2u6n_lsFK4pg
drwxrwxr-x 7 Elasticsearch Elasticsearch 4.0K Dec 15 23:25 ydFossuQTASNIQoFgcUo2w
/usr/share/Elasticsearch/data/backups/snap_repo/indices/oMof6-HiT9WqlyrHgCcSog
-rw-rw-r-- 1 Elasticsearch Elasticsearch 1.4K Dec 13 22:50 meta-D8Ux12cqRPmrygR_MFYnew.dat
-rw-rw-r-- 1 Elasticsearch Elasticsearch 1.4K Dec 14 22:50 meta-O679iA7XRGmXeiydvYFDBQ.dat
-rw-rw-r-- 1 Elasticsearch Elasticsearch 1.4K Dec 15 22:50 meta-GtSrbA44STaweZjEH5On9w.dat
drwxrwxr-x 2 Elasticsearch Elasticsearch 16K Dec 15 23:25 0 --> Shard 0
In Shard /0
/usr/share/Elasticsearch/data/backups/snap_repo/indices/oMof6-HiT9WqlyrHgCcSog/0
-rw-rw-r-- 1 Elasticsearch Elasticsearch 331 Dec 13 23:14 __7ntQ7hRdQ8OtbtSOOyMAwQ ????
-rw-rw-r-- 1 Elasticsearch Elasticsearch 6.5K Dec 13 23:14 __y5QKJx3jS4-4KbrGQwUP0g ????
-rw-rw-r-- 1 Elasticsearch Elasticsearch 366 Dec 13 23:14 __mQr7yci9TraSyl2bo_NtZw ????
-rw-rw-r-- 1 Elasticsearch Elasticsearch 384 Dec 13 23:14 __VNnl_uv2S0-bTmxqrRtCow ????
-rw-rw-r-- 1 Elasticsearch Elasticsearch 1.3K Dec 13 23:14 snap-D8Ux12cqRPmrygR_MFYnew.dat
-rw-rw-r-- 1 Elasticsearch Elasticsearch 331 Dec 14 23:36 __owHfLo9sTsG3CRZsEccUUA ????
-rw-rw-r-- 1 Elasticsearch Elasticsearch 6.5K Dec 14 23:36 __6zoFdfnCQ3iBZLnRdA7LjQ ????
-rw-rw-r-- 1 Elasticsearch Elasticsearch 366 Dec 14 23:36 __jojncs8XSnGSS80Eb1b8Vw ????
-rw-rw-r-- 1 Elasticsearch Elasticsearch 384 Dec 14 23:36 __qTHPjOvuRHOIec86yJ467w ????
-rw-rw-r-- 1 Elasticsearch Elasticsearch 1.3K Dec 14 23:36 snap-O679iA7XRGmXeiydvYFDBQ.dat
-rw-rw-r-- 1 Elasticsearch Elasticsearch 366 Dec 15 23:24 __j0uwN2DVTUOzQzROUXEcfQ ????
-rw-rw-r-- 1 Elasticsearch Elasticsearch 384 Dec 15 23:24 __3CmrEzsPQUaweYiLyZJ_xg ????
-rw-rw-r-- 1 Elasticsearch Elasticsearch 331 Dec 15 23:24 __1g7ORrhERQ-XO7-1ylEozQ ????
-rw-rw-r-- 1 Elasticsearch Elasticsearch 6.5K Dec 15 23:24 __sjydYk1KSK6a34ELGhT96A ????
-rw-rw-r-- 1 Elasticsearch Elasticsearch 1.3K Dec 15 23:24 snap-GtSrbA44STaweZjEH5On9w.dat
drwxrwxr-x 3 Elasticsearch Elasticsearch 4.0K Dec 15 23:25 ..
-rw-rw-r-- 1 Elasticsearch Elasticsearch 34K Dec 15 23:25 index-460
drwxrwxr-x 2 Elasticsearch Elasticsearch 16K Dec 15 23:25 .
In node A, inside shard 0, the files __** are not generated, only the file 'snap-*****.data'
usr/share/Elasticsearch/data/backups/snap_repo/indices/oMof6-HiT9WqlyrHgCcSog/0
-rw-rw-r-- 1 Elasticsearch Elasticsearch 1.3K Dec 13 23:14 snap-D8Ux12cqRPmrygR_MFYnew.dat
-rw-rw-r-- 1 Elasticsearch Elasticsearch 1.3K Dec 14 23:36 snap-O679iA7XRGmXeiydvYFDBQ.dat
-rw-rw-r-- 1 Elasticsearch Elasticsearch 1.3K Dec 15 23:24 snap-GtSrbA44STaweZjEH5On9w.dat
Looking forward for your reply.
Thank you for your time.
