Create n register repository for snapshots in elasticsearch

Elastic Stack Elasticsearch
1

Hi I have successfully created a repository for snapshots -

{
"my_fs_backup" : {
"type" : "fs",
"settings" : {
"compress" : "true",
"chunk_size" : "10m",
"location" : "/mount/backups/my_backup"
}
}
}

While checking flow for the same , i found this -

write fd=175(/mount/backups/my_backup/tests-lmIg4vpAQcmbNX9g7k630w/master.dat-temp)
write res=22 data=lmIg4vpAQcmbNX9g7k630w

Can anyone suggest what exactly is happening here , is it verifying the blob container created ??

2

Please format your code, logs or configuration files using </> icon as explained in this guide and not the citation button. It will make your post more readable.

is it verifying the blob container created ??

yes. The master node writes this file. All other data nodes are making sure they can read it.

1 Like
3

Thanks David for the information . Please confirm my understanding stated below -

Is this is where the data nodes access it ???
11865 11:18:04.693719497 1 java (18817) > write fd=175(<f>/mount/backups/my_backup/tests-lmIg4vpAQcmbNX9g7k630w/data-r_92eAj3T_yeM_hektIGaA.dat) size=22 11866 11:18:04.693729718 1 java (18817) < write res=22 data=lmIg4vpAQcmbNX9g7k630w

and here the master node verifies the blob container
10724 11:18:04.652241228 1 java (18817) < lstat res=0 path=/mount/backups/my_backup/tests-lmIg4vpAQcmbNX9g7k630w 10725 11:18:04.652251423 1 java (18817) > access mode=0(F_OK) 10726 11:18:04.652253456 1 java (18817) < access res=-2(ENOENT) name=/mount/backups/my_backup/tests-lmIg4vpAQcmbNX9g7k630w/master.dat-temp 10727 11:18:04.652307470 1 java (18817) > open 10728 11:18:04.652458262 1 java (18817) < open fd=175(<f>/mount/backups/my_backup/tests-lmIg4vpAQcmbNX9g7k630w/master.dat-temp) name=/mount/backups/my_backup/tests-lmIg4vpAQcmbNX9g7k630w/master.dat-temp flags=38(O_EXCL|O_CREAT|O_WRONLY) mode=0666 10729 11:18:04.652505467 1 java (18817) > write fd=175(<f>/mount/backups/my_backup/tests-lmIg4vpAQcmbNX9g7k630w/master.dat-temp) size=22 10730 11:18:04.652514168 1 java (18817) < write res=22 data=lmIg4vpAQcmbNX9g7k630w 10731 11:18:04.652523403 1 java (18817) > close fd=175(<f>/mount/backups/my_backup/tests-lmIg4vpAQcmbNX9g7k630w/master.dat-temp) 10732 11:18:04.652523940 1 java (18817) < close res=0

Thanks,
Roshni

4

need user shard file. as nfs ...

5

what ???

6

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.