EntitlementBootstrap failure preventing startup: AttachNotSupportedException: Unable to open socket file

Another dump of info (using for pid in $(pgrep java); do strace -tt -ff -p $pid -o /tmp/strace-$pid &done)… Summary is I didn’t find a lot of useful information (to me), but maybe something will stick out to someone else.

Searching for "attach" in the strace output, my take away is it seem like both environments actually fail to readlink the attach_pid file (they both return -1) which is strange but if that's how it behaves in a working system then maybe this is not a problem. See [1]

Searching for the container's directory on which the volume is mounted (In this case /usr/local/mydir/myapp/logs, which is a dummy path I substituted to hide some pii), I didn't find anything particularly useful. I see that a sub-dir has S_ISGID set on the working environment that the problematic environment doesn’t have, but that doesn't really pertain to execution privileges, it pertains to what permissions a newly created file/dir has. See [2]

Searching for "java_pid" in the strace output, I didn't find anything interesting. It looks like the failing site never finds the /proc/303/root/tmp/.java_pid303 file, whereas on the working site a /proc/290/root/tmp/.java_pid290 file is found and eventually a connect call is invoked against it and then the file is deleted. See [3]

[1] “attach” search results

Failing system (looks like part of the way down, those writes are the stack trace that's printed out)

	18:03:05.778196 openat(AT_FDCWD, "/proc/303/cwd/.attach_pid303", O_RDWR|O_CREAT|O_EXCL, 0666) = 44                                
	18:03:05.784629 readlink("/usr/local/mydir/myapp/logs/myapp/.attach_pid303", 0x7f6eaabc1a30, 1023) = -1 EINVAL (Invalid argu ment)                                                                                                                             
	18:03:05.790869 write(1, "\tat sun.tools.attach.VirtualMach"..., 94) = 94                                                         
	18:03:05.790969 write(1, "\tat sun.tools.attach.AttachProvi"..., 108) = 108                                                       
	18:03:05.791072 write(1, "\tat com.sun.tools.attach.Virtual"..., 91) = 91                                                         
	18:03:05.785024 stat(".attach_pid303", {st_mode=S_IFREG|0644, st_size=0, ...}) = 0      

Working system

	17:47:48.890508 openat(AT_FDCWD, "/proc/290/cwd/.attach_pid290", O_RDWR|O_CREAT|O_EXCL, 0666) = 44                               
	17:47:48.891237 readlink("/usr/local/mydir/myapp/logs/myapp/.attach_pid290", 0x7f3a94feba30, 1023) = -1 EINVAL (Invalid argu ment)                                                                                                                             
	17:47:48.991963 unlink("/usr/local/mydir/myapp/logs/myapp/.attach_pid290") = 0                                           

[2] “/usr/local/mydir/myapp/logs” search results, which is the container path of the mount

Failing system

	18:02:55.658113 mkdir("/usr/local/mydir/myapplogs/myapp", 0777) = -1 EEXIST (File exists)                                  
		18:02:55.660160 statx(AT_FDCWD, "/usr/local/mydir/myapplogs/myapp", AT_STATX_SYNC_AS_STAT, STATX_TYPE|STATX_MODE, {stx_mask =STATX_BASIC_STATS|STATX_MNT_ID, stx_attributes=0, stx_mode=S_IFDIR|0777, stx_size=6144, ...}) = 0                                
		18:02:55.676975 chdir("/usr/local/mydir/myapplogs/myapp") = 0                                                              
		18:02:55.684193 getcwd("/usr/local/mydir/myapplogs/myapp", 4096) = 40                                                      
		18:02:56.471725 getcwd("/usr/local/mydir/myapplogs/myapp", 4096) = 40                                                      
		18:02:56.525819 getcwd("/usr/local/mydir/myapplogs/myapp", 4097) = 40                                                      
		18:02:58.690712 readlink("/usr/local/mydir/myapplogs", 0x7f6eaabc1380, 1023) = -1 EINVAL (Invalid argument)                        
		18:02:58.690767 readlink("/usr/local/mydir/myapplogs/myapp", 0x7f6eaabc1380, 1023) = -1 EINVAL (Invalid argument)          
		18:02:58.690827 readlink("/usr/local/mydir/myapplogs/myapp/myapp.log", 0x7f6eaabc1380, 1023) = -1 EINVAL (Invalid a rgument)                                                                                                                          
		18:02:58.692573 stat("/usr/local/mydir/myapplogs/myapp", {st_mode=S_IFDIR|0777, st_size=6144, ...}) = 0                    
		18:02:58.692858 mkdir("/usr/local/mydir/myapplogs/myapp", 0777) = -1 EEXIST (File exists)                                  
		18:02:58.694318 statx(AT_FDCWD, "/usr/local/mydir/myapplogs/myapp", AT_STATX_SYNC_AS_STAT, STATX_TYPE|STATX_MODE, {stx_mask =STATX_BASIC_STATS|STATX_MNT_ID, stx_attributes=0, stx_mode=S_IFDIR|0777, stx_size=6144, ...}) = 0                                
		18:02:58.694389 openat(AT_FDCWD, "/usr/local/mydir/myapplogs/myapp/myapp.log", O_RDWR|O_CREAT|O_EXCL, 0666) = -1 EE XIST (File exists)                                                                                                                
		18:02:58.695094 stat("/usr/local/mydir/myapplogs/myapp/myapp.log", {st_mode=S_IFREG|0777, st_size=1110110, ...}) = 0                                                                                                                                 
		18:02:58.695165 openat(AT_FDCWD, "/usr/local/mydir/myapplogs/myapp/myapp.log", O_WRONLY|O_CREAT|O_APPEND, 0666) = 4 6                                                                                                                                 
		18:02:58.695925 stat("/usr/local/mydir/myapplogs/myapp/myapp.log", {st_mode=S_IFREG|0777, st_size=1110110, ...}) = 0                                                                                                                                 
		18:02:58.696009 access("/usr/local/mydir/myapplogs/myapp/myapp.log", F_OK) = 0                                     
		18:02:58.696077 statx(AT_FDCWD, "/usr/local/mydir/myapplogs/myapp/myapp.log", AT_STATX_SYNC_AS_STAT, STATX_ALL, {st x_mask=STATX_BASIC_STATS|STATX_MNT_ID, stx_attributes=0, stx_mode=S_IFREG|0777, stx_size=1110110, ...}) = 0                       
		18:02:58.696722 stat("/usr/local/mydir/myapplogs/myapp/myapp.log", {st_mode=S_IFREG|0777, st_size=1110110, ...}) = 0                                                                                                                                 
		18:02:58.696774 stat("/usr/local/mydir/myapplogs/myapp/myapp.log", {st_mode=S_IFREG|0777, st_size=1110110, ...}) = 0                                                                                                                                 
		18:02:58.757571 readlink("/usr/local/mydir/myapplogs", 0x7f6eaabc1380, 1023) = -1 EINVAL (Invalid argument)
		18:02:58.757623 readlink("/usr/local/mydir/myapplogs/myapp", 0x7f6eaabc1380, 1023) = -1 EINVAL (Invalid argument)
		18:02:58.757675 readlink("/usr/local/mydir/myapplogs/myapp/myapp_index_search_slowlog.log", 0x7f6eaabc1380, 1023) = -1 EINVAL (Invalid argument)
		18:02:58.759336 stat("/usr/local/mydir/myapplogs/myapp", {st_mode=S_IFDIR|0777, st_size=6144, ...}) = 0
		18:02:58.759426 mkdir("/usr/local/mydir/myapplogs/myapp", 0777) = -1 EEXIST (File exists)
		18:02:58.760202 statx(AT_FDCWD, "/usr/local/mydir/myapplogs/myapp", AT_STATX_SYNC_AS_STAT, STATX_TYPE|STATX_MODE, {stx_mask =STATX_BASIC_STATS|STATX_MNT_ID, stx_attributes=0, stx_mode=S_IFDIR|0777, stx_size=6144, ...}) = 0
		18:02:58.760264 openat(AT_FDCWD, "/usr/local/mydir/myapplogs/myapp/myapp_index_search_slowlog.log", O_RDWR|O_CREAT| O_EXCL, 0666) = -1 EEXIST (File exists)
		18:02:58.760928 stat("/usr/local/mydir/myapplogs/myapp/myapp_index_search_slowlog.log", {st_mode=S_IFREG|0777, st_s ize=0, ...}) = 0
		18:02:58.760997 openat(AT_FDCWD, "/usr/local/mydir/myapplogs/myapp/myapp_index_search_slowlog.log", O_WRONLY|O_CREA T|O_APPEND, 0666) = 47
		18:02:58.761749 stat("/usr/local/mydir/myapplogs/myapp/myapp_index_search_slowlog.log", {st_mode=S_IFREG|0777, st_s ize=0, ...}) = 0
		18:02:58.761820 access("/usr/local/mydir/myapplogs/myapp/myapp_index_search_slowlog.log", F_OK) = 0
		18:02:58.761884 statx(AT_FDCWD, "/usr/local/mydir/myapplogs/myapp/myapp_index_search_slowlog.log", AT_STATX_SYNC_AS _STAT, STATX_ALL, {stx_mask=STATX_BASIC_STATS|STATX_MNT_ID, stx_attributes=0, stx_mode=S_IFREG|0777, stx_size=0, ...}) = 0
		18:02:58.761968 stat("/usr/local/mydir/myapplogs/myapp/myapp_index_search_slowlog.log", {st_mode=S_IFREG|0777, st_s ize=0, ...}) = 0
		18:02:58.762025 stat("/usr/local/mydir/myapplogs/myapp/myapp_index_search_slowlog.log", {st_mode=S_IFREG|0777, st_s ize=0, ...}) = 0
		18:02:58.764647 readlink("/usr/local/mydir/myapplogs", 0x7f6eaabc1380, 1023) = -1 EINVAL (Invalid argument)
		18:02:58.764681 readlink("/usr/local/mydir/myapplogs/myapp", 0x7f6eaabc1380, 1023) = -1 EINVAL (Invalid argument)
		18:02:58.764728 readlink("/usr/local/mydir/myapplogs/myapp/myapp_index_indexing_slowlog.log", 0x7f6eaabc1380, 1023) = -1 EINVAL (Invalid argument)
		18:02:58.766352 stat("/usr/local/mydir/myapplogs/myapp", {st_mode=S_IFDIR|0777, st_size=6144, ...}) = 0
		18:02:58.766425 mkdir("/usr/local/mydir/myapplogs/myapp", 0777) = -1 EEXIST (File exists)
		18:02:58.767221 statx(AT_FDCWD, "/usr/local/mydir/myapplogs/myapp", AT_STATX_SYNC_AS_STAT, STATX_TYPE|STATX_MODE, {stx_mask =STATX_BASIC_STATS|STATX_MNT_ID, stx_attributes=0, stx_mode=S_IFDIR|0777, stx_size=6144, ...}) = 0
		18:02:58.767294 openat(AT_FDCWD, "/usr/local/mydir/myapplogs/myapp/myapp_index_indexing_slowlog.log", O_RDWR|O_CREA T|O_EXCL, 0666) = -1 EEXIST (File exists)
		18:02:58.768103 stat("/usr/local/mydir/myapplogs/myapp/myapp_index_indexing_slowlog.log", {st_mode=S_IFREG|0777, st _size=0, ...}) = 0
		18:02:58.768167 openat(AT_FDCWD, "/usr/local/mydir/myapplogs/myapp/myapp_index_indexing_slowlog.log", O_WRONLY|O_CR EAT|O_APPEND, 0666) = 48
		18:02:58.768940 stat("/usr/local/mydir/myapplogs/myapp/myapp_index_indexing_slowlog.log", {st_mode=S_IFREG|0777, st _size=0, ...}) = 0
		18:02:58.769005 access("/usr/local/mydir/myapplogs/myapp/myapp_index_indexing_slowlog.log", F_OK) = 0
		18:02:58.769063 statx(AT_FDCWD, "/usr/local/mydir/myapplogs/myapp/myapp_index_indexing_slowlog.log", AT_STATX_SYNC_ AS_STAT, STATX_ALL, {stx_mask=STATX_BASIC_STATS|STATX_MNT_ID, stx_attributes=0, stx_mode=S_IFREG|0777, stx_size=0, ...}) = 0
		18:02:58.769136 stat("/usr/local/mydir/myapplogs/myapp/myapp_index_indexing_slowlog.log", {st_mode=S_IFREG|0777, st _size=0, ...}) = 0
		18:02:58.769188 stat("/usr/local/mydir/myapplogs/myapp/myapp_index_indexing_slowlog.log", {st_mode=S_IFREG|0777, st _size=0, ...}) = 0
		18:03:05.784206 readlink("/proc/303/cwd", "/usr/local/mydir/myapplogs/search"..., 1023) = 39
		18:03:05.784510 readlink("/usr/local/mydir/myapplogs", 0x7f6eaabc1a30, 1023) = -1 EINVAL (Invalid argument)
		18:03:05.784570 readlink("/usr/local/mydir/myapplogs/myapp", 0x7f6eaabc1a30, 1023) = -1 EINVAL (Invalid argument)
		18:03:05.784629 readlink("/usr/local/mydir/myapplogs/myapp/.attach_pid303", 0x7f6eaabc1a30, 1023) = -1 EINVAL (Invalid argu ment)
	
	
	Working system
	
		17:47:38.970577 mkdir("/usr/local/mydir/myapp/logs/myapp", 0777) = -1 EEXIST (File exists)                                  
		17:47:38.970693 statx(AT_FDCWD, "/usr/local/mydir/myapp/logs/myapp", AT_STATX_SYNC_AS_STAT, STATX_TYPE|STATX_MODE, {stx_mask =STATX_BASIC_STATS|STATX_MNT_ID, stx_attributes=0, stx_mode=S_IFDIR|S_ISGID|0775, stx_size=4096, ...}) = 0                        
		17:47:38.987399 chdir("/usr/local/mydir/myapp/logs/myapp") = 0                                                              
		17:47:38.995145 getcwd("/usr/local/mydir/myapp/logs/myapp", 4096) = 40                                                      
		17:47:39.807473 getcwd("/usr/local/mydir/myapp/logs/myapp", 4096) = 40                                                      
		17:47:39.868324 getcwd("/usr/local/mydir/myapp/logs/myapp", 4097) = 40                                                      
		17:47:42.158019 readlink("/usr/local/mydir/myapp/logs", 0x7f3a94feb380, 1023) = -1 EINVAL (Invalid argument)                        
		17:47:42.158079 readlink("/usr/local/mydir/myapp/logs/myapp", 0x7f3a94feb380, 1023) = -1 EINVAL (Invalid argument)          
		17:47:42.158145 readlink("/usr/local/mydir/myapp/logs/myapp/myapp.log", 0x7f3a94feb380, 1023) = -1 EINVAL (Invalid a rgument)                                                                                                                          
		17:47:42.158238 stat("/usr/local/mydir/myapp/logs/myapp", {st_mode=S_IFDIR|S_ISGID|0775, st_size=4096, ...}) = 0            
		17:47:42.158555 mkdir("/usr/local/mydir/myapp/logs/myapp", 0777) = -1 EEXIST (File exists)                                  
		17:47:42.158700 statx(AT_FDCWD, "/usr/local/mydir/myapp/logs/myapp", AT_STATX_SYNC_AS_STAT, STATX_TYPE|STATX_MODE, {stx_mask =STATX_BASIC_STATS|STATX_MNT_ID, stx_attributes=0, stx_mode=S_IFDIR|S_ISGID|0775, stx_size=4096, ...}) = 0                        
		17:47:42.158779 openat(AT_FDCWD, "/usr/local/mydir/myapp/logs/myapp/myapp.log", O_RDWR|O_CREAT|O_EXCL, 0666) = -1 EE XIST (File exists)                                                                                                                
		17:47:42.158919 stat("/usr/local/mydir/myapp/logs/myapp/myapp.log", {st_mode=S_IFREG|0664, st_size=709226, ...}) = 0
		17:47:42.158999 openat(AT_FDCWD, "/usr/local/mydir/myapp/logs/myapp/myapp.log", O_WRONLY|O_CREAT|O_APPEND, 0666) = 46                                                                                                                                 
		17:47:42.159115 stat("/usr/local/mydir/myapp/logs/myapp/myapp.log", {st_mode=S_IFREG|0664, st_size=709226, ...}) = 0
		17:47:42.159205 access("/usr/local/mydir/myapp/logs/myapp/myapp.log", F_OK) = 0                                     
		17:47:42.159288 statx(AT_FDCWD, "/usr/local/mydir/myapp/logs/myapp/myapp.log", AT_STATX_SYNC_AS_STAT, STATX_ALL, {st x_mask=STATX_ALL|STATX_MNT_ID, stx_attributes=0, stx_mode=S_IFREG|0664, stx_size=709226, ...}) = 0                                
		17:47:42.160091 stat("/usr/local/mydir/myapp/logs/myapp/myapp.log", {st_mode=S_IFREG|0664, st_size=709226, ...}) = 0
		17:47:42.160162 stat("/usr/local/mydir/myapp/logs/myapp/myapp.log", {st_mode=S_IFREG|0664, st_size=709226, ...}) = 0
		17:47:42.170320 readlink("/usr/local/mydir/myapp/logs", 0x7f3a94feb380, 1023) = -1 EINVAL (Invalid argument)                        
		17:47:42.170377 readlink("/usr/local/mydir/myapp/logs/myapp", 0x7f3a94feb380, 1023) = -1 EINVAL (Invalid argument)          
		17:47:42.170423 readlink("/usr/local/mydir/myapp/logs/myapp/myapp_index_search_slowlog.log", 0x7f3a94feb380, 1023) = -1 EINVAL (Invalid argument)                                                                                                     
		17:47:42.170483 stat("/usr/local/mydir/myapp/logs/myapp", {st_mode=S_IFDIR|S_ISGID|0775, st_size=4096, ...}) = 0            
		17:47:42.170557 mkdir("/usr/local/mydir/myapp/logs/myapp", 0777) = -1 EEXIST (File exists)                                  
		17:47:42.170638 statx(AT_FDCWD, "/usr/local/mydir/myapp/logs/myapp", AT_STATX_SYNC_AS_STAT, STATX_TYPE|STATX_MODE, {stx_mask =STATX_BASIC_STATS|STATX_MNT_ID, stx_attributes=0, stx_mode=S_IFDIR|S_ISGID|0775, stx_size=4096, ...}) = 0
		17:47:42.170684 openat(AT_FDCWD, "/usr/local/mydir/myapp/logs/myapp/myapp_index_search_slowlog.log", O_RDWR|O_CREAT|O_EXCL, 0666) = -1 EEXIST (File exists)
		17:47:42.170757 stat("/usr/local/mydir/myapp/logs/myapp/myapp_index_search_slowlog.log", {st_mode=S_IFREG|0664, st_size=0, ...}) = 0
		17:47:42.170821 openat(AT_FDCWD, "/usr/local/mydir/myapp/logs/myapp/myapp_index_search_slowlog.log", O_WRONLY|O_CREAT|O_APPEND, 0666) = 47
		17:47:42.170917 stat("/usr/local/mydir/myapp/logs/myapp/myapp_index_search_slowlog.log", {st_mode=S_IFREG|0664, st_size=0, ...}) = 0
		17:47:42.170987 access("/usr/local/mydir/myapp/logs/myapp/myapp_index_search_slowlog.log", F_OK) = 0
		17:47:42.171032 statx(AT_FDCWD, "/usr/local/mydir/myapp/logs/myapp/myapp_index_search_slowlog.log", AT_STATX_SYNC_AS_STAT, STATX_ALL, {stx_mask=STATX_ALL|STATX_MNT_ID, stx_attributes=0, stx_mode=S_IFREG|0664, stx_size=0, ...}) = 0
		17:47:42.171102 stat("/usr/local/mydir/myapp/logs/myapp/myapp_index_search_slowlog.log", {st_mode=S_IFREG|0664, st_size=0, ...}) = 0
		17:47:42.171153 stat("/usr/local/mydir/myapp/logs/myapp/myapp_index_search_slowlog.log", {st_mode=S_IFREG|0664, st_size=0, ...}) = 0
		17:47:42.173128 readlink("/usr/local/mydir/myapp/logs", 0x7f3a94feb380, 1023) = -1 EINVAL (Invalid argument)
		17:47:42.173177 readlink("/usr/local/mydir/myapp/logs/myapp", 0x7f3a94feb380, 1023) = -1 EINVAL (Invalid argument)
		17:47:42.173219 readlink("/usr/local/mydir/myapp/logs/myapp/myapp_index_indexing_slowlog.log", 0x7f3a94feb380, 1023) = -1 EINVAL (Invalid argument)
		17:47:42.173263 stat("/usr/local/mydir/myapp/logs/myapp", {st_mode=S_IFDIR|S_ISGID|0775, st_size=4096, ...}) = 0
		17:47:42.173328 mkdir("/usr/local/mydir/myapp/logs/myapp", 0777) = -1 EEXIST (File exists)
		17:47:42.173418 statx(AT_FDCWD, "/usr/local/mydir/myapp/logs/myapp", AT_STATX_SYNC_AS_STAT, STATX_TYPE|STATX_MODE, {stx_mask=STATX_BASIC_STATS|STATX_MNT_ID, stx_attributes=0, stx_mode=S_IFDIR|S_ISGID|0775, stx_size=4096, ...}) = 0
		17:47:42.173465 openat(AT_FDCWD, "/usr/local/mydir/myapp/logs/myapp/myapp_index_indexing_slowlog.log", O_RDWR|O_CREAT|O_EXCL, 0666) = -1 EEXIST (File exists)
		17:47:42.173538 stat("/usr/local/mydir/myapp/logs/myapp/myapp_index_indexing_slowlog.log", {st_mode=S_IFREG|0664, st_size=1824, ...}) = 0
		17:47:42.173603 openat(AT_FDCWD, "/usr/local/mydir/myapp/logs/myapp/myapp_index_indexing_slowlog.log", O_WRONLY|O_CREAT|O_APPEND, 0666) = 48
		17:47:42.173688 stat("/usr/local/mydir/myapp/logs/myapp/myapp_index_indexing_slowlog.log", {st_mode=S_IFREG|0664, st_size=1824, ...}) = 0
		17:47:42.173755 access("/usr/local/mydir/myapp/logs/myapp/myapp_index_indexing_slowlog.log", F_OK) = 0
		17:47:42.173806 statx(AT_FDCWD, "/usr/local/mydir/myapp/logs/myapp/myapp_index_indexing_slowlog.log", AT_STATX_SYNC_AS_STAT, STATX_ALL, {stx_mask=STATX_ALL|STATX_MNT_ID, stx_attributes=0, stx_mode=S_IFREG|0664, stx_size=1824, ...}) = 0
		17:47:42.173904 stat("/usr/local/mydir/myapp/logs/myapp/myapp_index_indexing_slowlog.log", {st_mode=S_IFREG|0664, st_size=1824, ...}) = 0
		17:47:42.173956 stat("/usr/local/mydir/myapp/logs/myapp/myapp_index_indexing_slowlog.log", {st_mode=S_IFREG|0664, st_size=1824, ...}) = 0
		17:47:48.890851 readlink("/proc/290/cwd", "/usr/local/mydir/myapp/logs/search"..., 1023) = 39
		17:47:48.891139 readlink("/usr/local/mydir/myapp/logs", 0x7f3a94feba30, 1023) = -1 EINVAL (Invalid argument)
		17:47:48.891188 readlink("/usr/local/mydir/myapp/logs/myapp", 0x7f3a94feba30, 1023) = -1 EINVAL (Invalid argument)
		17:47:48.891237 readlink("/usr/local/mydir/myapp/logs/myapp/.attach_pid290", 0x7f3a94feba30, 1023) = -1 EINVAL (Invalid argument)
		17:47:48.991963 unlink("/usr/local/mydir/myapp/logs/myapp/.attach_pid290") = 0
		17:47:49.570007 access("/usr/local/mydir/myapp/logs/myapp", F_OK) = 0
		17:47:49.570332 readlink("/usr/local/mydir/myapp/logs", 0x7f3a94febfc0, 1023) = -1 EINVAL (Invalid argument)
		17:47:49.570382 readlink("/usr/local/mydir/myapp/logs/myapp", 0x7f3a94febfc0, 1023) = -1 EINVAL (Invalid argument)
		17:48:12.177462 access("/usr/local/mydir/myapp/logs/myapp", F_OK) = 0
		17:48:12.177791 readlink("/usr/local/mydir/myapp/logs", 0x7f3a438f7fb0, 1023) = -1 EINVAL (Invalid argument)
		17:48:12.177841 readlink("/usr/local/mydir/myapp/logs/myapp", 0x7f3a438f7fb0, 1023) = -1 EINVAL (Invalid argument)

[3] “java_pid” search results

Failing system

	18:02:53.373407 stat("/tmp/.java_pid189", 0x7fb95f1c2a10) = -1 ENOENT (No such file or directory)                                 
	18:02:55.458332 stat("/tmp/.java_pid276", 0x7f6bca835a10) = -1 ENOENT (No such file or directory)                                 
	18:02:56.480801 stat("/tmp/.java_pid303", 0x7f6eaabc4a10) = -1 ENOENT (No such file or directory)                                 
	18:03:05.777122 stat("/proc/303/root/tmp/.java_pid303", 0x7f6eaabc4300) = -1 ENOENT (No such file or directory)                   
	18:03:05.887211 stat("/proc/303/root/tmp/.java_pid303", 0x7f6eaabc4300) = -1 ENOENT (No such file or directory)                   
	18:03:06.087517 stat("/proc/303/root/tmp/.java_pid303", 0x7f6eaabc4300) = -1 ENOENT (No such file or directory)                   
	18:03:06.387764 stat("/proc/303/root/tmp/.java_pid303", 0x7f6eaabc4300) = -1 ENOENT (No such file or directory)                   
	18:03:06.788024 stat("/proc/303/root/tmp/.java_pid303", 0x7f6eaabc4300) = -1 ENOENT (No such file or directory)
	<truncated, ENOENT recorded for 10 seconds>
	
Working system

	17:47:36.857735 stat("/tmp/.java_pid191", 0x7fbd6b77ea10) = -1 ENOENT (No such file or directory)
	17:47:38.790335 stat("/tmp/.java_pid263", 0x7ff7849efa10) = -1 ENOENT (No such file or directory)
	17:47:39.817403 stat("/tmp/.java_pid290", 0x7f3a94feea10) = -1 ENOENT (No such file or directory)
	17:47:48.889487 stat("/proc/290/root/tmp/.java_pid290", 0x7f3a94fee300) = -1 ENOENT (No such file or directory)
	17:47:48.991781 stat("/proc/290/root/tmp/.java_pid290", {st_mode=S_IFSOCK|0600, st_size=0, ...}) = 0
	17:47:48.991886 stat("/proc/290/root/tmp/.java_pid290", {st_mode=S_IFSOCK|0600, st_size=0, ...}) = 0
	17:47:48.992212 stat("/proc/290/root/tmp/.java_pid290", {st_mode=S_IFSOCK|0600, st_size=0, ...}) = 0
	17:47:48.992374 connect(54, {sa_family=AF_UNIX, sun_path="/proc/290/root/tmp/.java_pid290"}, 110) = 0
	17:47:48.992902 connect(54, {sa_family=AF_UNIX, sun_path="/proc/290/root/tmp/.java_pid290"}, 110) = 0
	17:47:48.893425 unlink("/tmp/.java_pid290.tmp") = -1 ENOENT (No such file or directory)
	17:47:48.893501 bind(44, {sa_family=AF_UNIX, sun_path="/tmp/.java_pid290.tmp"}, 110) = 0
	17:47:48.893625 chmod("/tmp/.java_pid290.tmp", 0600) = 0
	17:47:48.893773 chown("/tmp/.java_pid290.tmp", 500, 500) = 0
	17:47:48.893826 rename("/tmp/.java_pid290.tmp", "/tmp/.java_pid290") = 0