Elasticsearch server crashing


(Abhishek Jajoria) #1

My Es server keeps getting crashes .I get the following error file in my
bin folder please tell me what does this error means and why it is occuring?

An unexpected error has been detected by Java Runtime Environment:

EXCEPTION_ACCESS_VIOLATION (0xc0000005) at pc=0x6d8729a2, pid=3528,

tid=3168

Java VM: Java HotSpot(TM) Client VM (1.6.0_02-b06 mixed mode)

Problematic frame:

V [jvm.dll+0x29a2]

If you would like to submit a bug report, please visit:

http://java.sun.com/webapps/bugreport/crash.jsp

--------------- T H R E A D ---------------

Current thread (0x002aa000): GCTaskThread [id=3168]

siginfo: ExceptionCode=0xc0000005, reading address 0x00000050

Registers:
EAX=0x00000000, EBX=0x02a2fcb8, ECX=0x436ca290, EDX=0x436ca290
ESP=0x02a2f964, EBP=0x0455e7cc, ESI=0x03512460, EDI=0x00000005
EIP=0x6d8729a2, EFLAGS=0x00010246

Top of Stack: (sp=0x02a2f964)
0x02a2f964: 03512460 03512460 6d918ab3 436ca290
0x02a2f974: 0455e854 0455e7cc 00002796 0455e78c
0x02a2f984: 6d9b7147 0455e7cc 02a2f9a8 0455bbc0
0x02a2f994: 02a2fcb8 03499960 6d9c1c3a 0455bbc0
0x02a2f9a4: 02a2fcb8 0455e78c 00000032 02a2fd50
0x02a2f9b4: 436ce278 002ac5c0 00000014 02a23756
0x02a2f9c4: 6d9c1cec 00000af0 02a2fcf0 0352dc90
0x02a2f9d4: 223136f4 00000005 6d91896c 03499960

Instructions: (pc=0x6d8729a2)
0x6d872992: c1 e8 02 25 fe ff ff 3f c2 04 00 8b 02 56 8b ca
0x6d8729a2: ff 50 50 5e c2 04 00 cc cc cc cc cc cc cc 8b 44

Stack: [0x00000000,0x00000000), sp=0x02a2f964, free space=43198k
Native frames: (J=compiled Java code, j=interpreted, Vv=VM code, C=native
code)
V [jvm.dll+0x29a2]

--------------- P R O C E S S ---------------

Java Threads: ( => current thread )
0x49764800 JavaThread "elasticsearch[search]-pool-5-thread-296" daemon
[_thread_blocked, id=7616]
0x4af4dc00 JavaThread "elasticsearch[search]-pool-5-thread-295" daemon
[_thread_blocked, id=432]
0x49731000 JavaThread "New I/O worker #12" daemon [_thread_blocked,
id=6764]
0x4b019800 JavaThread "elasticsearch[search]-pool-5-thread-293" daemon
[_thread_blocked, id=7480]
0x4b348400 JavaThread "elasticsearch[search]-pool-5-thread-292" daemon
[_thread_blocked, id=7860]
0x499f3400 JavaThread "elasticsearch[search]-pool-5-thread-291" daemon
[_thread_blocked, id=5392]
0x4983d000 JavaThread "elasticsearch[search]-pool-5-thread-290" daemon
[_thread_blocked, id=5224]
0x4aea7400 JavaThread "elasticsearch[search]-pool-5-thread-288" daemon
[_thread_blocked, id=6428]
0x49ca5000 JavaThread "elasticsearch[generic]-pool-1-thread-29" daemon
[_thread_blocked, id=4552]
0x49ce0400 JavaThread "elasticsearch[search]-pool-5-thread-274" daemon
[_thread_blocked, id=6616]
0x49792800 JavaThread "elasticsearch[search]-pool-5-thread-272" daemon
[_thread_blocked, id=5352]
0x4af24800 JavaThread "elasticsearch[search]-pool-5-thread-270" daemon
[_thread_blocked, id=5612]
0x499f2000 JavaThread "New I/O worker #10" daemon [_thread_blocked,
id=4504]
0x49cbdc00 JavaThread "elasticsearch[search]-pool-5-thread-223" daemon
[_thread_blocked, id=5840]
0x002a6800 JavaThread "DestroyJavaVM" [_thread_blocked, id=4160]
0x49682800 JavaThread "es[keepAlive]" [_thread_blocked, id=5748]
0x46d2b800 JavaThread "New I/O server boss #2 ([id: 0x00f942c4,
/0.0.0.0:9200])" daemon [_thread_blocked, id=4496]
0x49bb8800 JavaThread
"elasticsearch[raftaar]riverClusterService#updateTask-pool-15-thread-1"
daemon [_thread_blocked, id=2500]
0x49b07000 JavaThread "New I/O worker #1" daemon [_thread_blocked,
id=3180]
0x4983b800 JavaThread "New I/O worker #8" daemon [_thread_blocked,
id=1976]
0x49bbb800 JavaThread "New I/O worker #7" daemon [_thread_blocked,
id=2532]
0x49833400 JavaThread "New I/O worker #4" daemon [_thread_blocked,
id=5760]
0x4985f400 JavaThread "New I/O worker #6" daemon [_thread_blocked,
id=3688]
0x49baf400 JavaThread "New I/O worker #5" daemon [_thread_blocked,
id=5808]
0x49bb0400 JavaThread
"elasticsearch[raftaar]clusterService#updateTask-pool-16-thread-1" daemon
[_thread_blocked, id=4348]
0x49bb9400 JavaThread "New I/O worker #3" daemon [_thread_blocked,
id=5004]
0x49bb7000 JavaThread "New I/O worker #2" daemon [_thread_blocked,
id=3040]
0x49b67400 JavaThread "New I/O server boss #1 ([id: 0x010c29fe,
/0.0.0.0:9300])" daemon [_thread_blocked, id=3400]
0x49b83800 JavaThread "elasticsearch[raftaar][ttl_expire]" daemon
[_thread_blocked, id=5628]
0x49b52000 JavaThread
"elasticsearch[raftaar][scheduler]-pool-13-thread-1" daemon
[_thread_blocked, id=4556]
0x49b0f800 JavaThread "elasticsearch[raftaar][timer]" daemon
[_thread_blocked, id=5860]
0x49677400 JavaThread "Low Memory Detector" daemon [_thread_blocked,
id=5300]
0x49672800 JavaThread "CompilerThread0" daemon [_thread_blocked, id=1204]
0x49671400 JavaThread "Attach Listener" daemon [_thread_blocked, id=5084]
0x49670400 JavaThread "Signal Dispatcher" daemon [_thread_blocked,
id=5968]
0x46d5f400 JavaThread "Surrogate Locker Thread (CMS)" daemon
[_thread_blocked, id=5252]
0x46d47c00 JavaThread "Finalizer" daemon [_thread_blocked, id=5896]
0x46d43800 JavaThread "Reference Handler" daemon [_thread_blocked,
id=5172]

Other Threads:
0x46d40800 VMThread [id=4548]
0x49678800 WatcherThread [id=1536]

VM state:at safepoint (normal execution)

VM Mutex/Monitor currently owned by a thread: ([mutex/lock_event])
[0x002a5468/0x000006fc] Threads_lock - owner thread: 0x46d40800
[0x002a5638/0x000006b4] Heap_lock - owner thread: 0x4af4dc00

Heap
par new generation total 28288K, used 28286K [0x02a30000, 0x048e0000,
0x04a30000)
eden space 25152K, 100% used [0x02a30000, 0x042c0000, 0x042c0000)
from space 3136K, 99% used [0x045d0000, 0x048df8d0, 0x048e0000)
to space 3136K, 100% used [0x042c0000, 0x045d0000, 0x045d0000)
concurrent mark-sweep generation total 904468K, used 653834K [0x04a30000,
0x3bd75000, 0x42a30000)
concurrent-mark-sweep perm gen total 42596K, used 25532K [0x42a30000,
0x453c9000, 0x46a30000)

Dynamic libraries:
0x00400000 - 0x00423000 C:\Program Files\Java\jdk1.6.0_02\bin\java.exe
0x7c900000 - 0x7c9af000 C:\WINDOWS\system32\ntdll.dll
0x7c800000 - 0x7c8f6000 C:\WINDOWS\system32\kernel32.dll
0x77dd0000 - 0x77e6b000 C:\WINDOWS\system32\ADVAPI32.dll
0x77e70000 - 0x77f02000 C:\WINDOWS\system32\RPCRT4.dll
0x77fe0000 - 0x77ff1000 C:\WINDOWS\system32\Secur32.dll
0x7c340000 - 0x7c396000 C:\Program
Files\Java\jdk1.6.0_02\jre\bin\msvcr71.dll
0x6d870000 - 0x6dab9000 C:\Program
Files\Java\jdk1.6.0_02\jre\bin\client\jvm.dll
0x7e410000 - 0x7e4a1000 C:\WINDOWS\system32\USER32.dll
0x77f10000 - 0x77f59000 C:\WINDOWS\system32\GDI32.dll
0x76b40000 - 0x76b6d000 C:\WINDOWS\system32\WINMM.dll
0x76390000 - 0x763ad000 C:\WINDOWS\system32\IMM32.DLL
0x5dac0000 - 0x5dac8000 C:\WINDOWS\system32\rdpsnd.dll
0x76360000 - 0x76370000 C:\WINDOWS\system32\WINSTA.dll
0x5b860000 - 0x5b8b5000 C:\WINDOWS\system32\NETAPI32.dll
0x77c10000 - 0x77c68000 C:\WINDOWS\system32\msvcrt.dll
0x76bf0000 - 0x76bfb000 C:\WINDOWS\system32\PSAPI.DLL
0x6d3c0000 - 0x6d3c8000 C:\Program Files\Java\jdk1.6.0_02\jre\bin\hpi.dll
0x6d820000 - 0x6d82c000 C:\Program Files\Java\jdk1.6.0_02\jre\bin\verify.dll
0x6d460000 - 0x6d47f000 C:\Program Files\Java\jdk1.6.0_02\jre\bin\java.dll
0x6d860000 - 0x6d86f000 C:\Program Files\Java\jdk1.6.0_02\jre\bin\zip.dll
0x6d610000 - 0x6d619000 C:\Program
Files\Java\jdk1.6.0_02\jre\bin\management.dll
0x6d620000 - 0x6d633000 C:\Program Files\Java\jdk1.6.0_02\jre\bin\net.dll
0x71ab0000 - 0x71ac7000 C:\WINDOWS\system32\WS2_32.dll
0x71aa0000 - 0x71aa8000 C:\WINDOWS\system32\WS2HELP.dll
0x71a50000 - 0x71a8f000 C:\WINDOWS\System32\mswsock.dll
0x76f20000 - 0x76f47000 C:\WINDOWS\system32\DNSAPI.dll
0x76fb0000 - 0x76fb8000 C:\WINDOWS\System32\winrnr.dll
0x76f60000 - 0x76f8c000 C:\WINDOWS\system32\WLDAP32.dll
0x76fc0000 - 0x76fc6000 C:\WINDOWS\system32\rasadhlp.dll
0x6d640000 - 0x6d649000 C:\Program Files\Java\jdk1.6.0_02\jre\bin\nio.dll
0x49e60000 - 0x49eab000 D:\elasticsearch\lib\sigar\sigar-x86-winnt.dll
0x74000000 - 0x74056000 C:\WINDOWS\system32\pdh.dll
0x763b0000 - 0x763f9000 C:\WINDOWS\system32\comdlg32.dll
0x5d090000 - 0x5d12a000 C:\WINDOWS\system32\COMCTL32.dll
0x7c9c0000 - 0x7d1d7000 C:\WINDOWS\system32\SHELL32.dll
0x77f60000 - 0x77fd6000 C:\WINDOWS\system32\SHLWAPI.dll
0x77a80000 - 0x77b15000 C:\WINDOWS\system32\CRYPT32.dll
0x77b20000 - 0x77b32000 C:\WINDOWS\system32\MSASN1.dll
0x74320000 - 0x7435d000 C:\WINDOWS\system32\ODBC32.dll
0x711a0000 - 0x711a6000 C:\WINDOWS\system32\odbcbcp.dll
0x77c00000 - 0x77c08000 C:\WINDOWS\system32\VERSION.dll
0x774e0000 - 0x7761d000 C:\WINDOWS\system32\ole32.dll
0x77120000 - 0x771ab000 C:\WINDOWS\system32\OLEAUT32.dll
0x773d0000 - 0x774d3000
C:\WINDOWS\WinSxS\x86_Microsoft.Windows.Common-Controls_6595b64144ccf1df_6.0.2600.5512_x-ww_35d4ce83\comctl32.dll
0x49f30000 - 0x49f47000 C:\WINDOWS\system32\odbcint.dll
0x5e760000 - 0x5e76a000 C:\WINDOWS\system32\perfos.dll
0x5e750000 - 0x5e75d000 C:\WINDOWS\system32\perfproc.dll
0x76d60000 - 0x76d79000 C:\WINDOWS\system32\iphlpapi.dll
0x76d40000 - 0x76d58000 C:\WINDOWS\system32\MPRAPI.dll
0x77cc0000 - 0x77cf2000 C:\WINDOWS\system32\ACTIVEDS.dll
0x76e10000 - 0x76e35000 C:\WINDOWS\system32\adsldpc.dll
0x76b20000 - 0x76b31000 C:\WINDOWS\system32\ATL.DLL
0x76e80000 - 0x76e8e000 C:\WINDOWS\system32\rtutils.dll
0x71bf0000 - 0x71c03000 C:\WINDOWS\system32\SAMLIB.dll
0x77920000 - 0x77a13000 C:\WINDOWS\system32\SETUPAPI.dll
0x71b20000 - 0x71b32000 C:\WINDOWS\system32\mpr.dll
0x5e790000 - 0x5e799000 C:\WINDOWS\system32\perfdisk.dll
0x662b0000 - 0x66308000 C:\WINDOWS\system32\hnetcfg.dll
0x71a90000 - 0x71a98000 C:\WINDOWS\System32\wshtcpip.dll
0x68000000 - 0x68036000 C:\WINDOWS\system32\rsaenh.dll
0x769c0000 - 0x76a74000 C:\WINDOWS\system32\USERENV.dll

VM Arguments:
jvm_args: -Xms256m -Xmx1g -Xss256k -XX:+UseParNewGC -XX:+UseConcMarkSweepGC
-XX:CMSInitiatingOccupancyFraction=75 -XX:+UseCMSInitiatingOccupancyOnly
-XX:+HeapDumpOnOutOfMemoryError -Delasticsearch -Des-foreground=yes
-Des.path.home=D:\elasticsearch
java_command: org.elasticsearch.bootstrap.ElasticSearch
Launcher Type: SUN_STANDARD

Environment Variables:
JAVA_HOME=C:\Program Files\Java\jdk1.6.0_02
PATH=C:\WINDOWS\system32;C:\WINDOWS;C:\WINDOWS\System32\Wbem;;C:\Program
Files\Microsoft SQL Server\80\Tools\Binn;C:\Program Files\Microsoft SQL
Server\90\Tools\binn;C:\Program Files\Java\jdk1.6.0_02\bin;;
USERNAME=raftaar
OS=Windows_NT
PROCESSOR_IDENTIFIER=x86 Family 6 Model 23 Stepping 10, GenuineIntel

--------------- S Y S T E M ---------------

OS: Windows XP Build 2600 Service Pack 3

CPU:total 2 (2 cores per cpu, 1 threads per core) family 6 model 7 stepping
10, cmov, cx8, fxsr, mmx, sse, sse2, sse3, ssse3

Memory: 4k page, physical 2087020k(677356k free), swap 4025324k(2293636k
free)

vm_info: Java HotSpot(TM) Client VM (1.6.0_02-b06) for windows-x86, built
on Jul 12 2007 01:16:14 by "java_re" with unknown MS VC++:1310


(Ivan Brusic) #2

I would upgrade your version of Java without hesitation. Your version
is five years old at this point. Even if you don't want to upgrade to
Java 7, you should at least upgrade to the latest release of Java 6. I
no longer recall the timeline of GC parameters, but ElasticSearch is
definitely pushing the boundaries of GC.

--
Ivan

On Wed, Jul 18, 2012 at 4:22 AM, jajoria abhishek
jajoria.abhishek@gmail.com wrote:

My Es server keeps getting crashes .I get the following error file in my bin
folder please tell me what does this error means and why it is occuring?

An unexpected error has been detected by Java Runtime Environment:

EXCEPTION_ACCESS_VIOLATION (0xc0000005) at pc=0x6d8729a2, pid=3528,

tid=3168

Java VM: Java HotSpot(TM) Client VM (1.6.0_02-b06 mixed mode)

Problematic frame:

V [jvm.dll+0x29a2]

If you would like to submit a bug report, please visit:

http://java.sun.com/webapps/bugreport/crash.jsp

--------------- T H R E A D ---------------

Current thread (0x002aa000): GCTaskThread [id=3168]

siginfo: ExceptionCode=0xc0000005, reading address 0x00000050

Registers:
EAX=0x00000000, EBX=0x02a2fcb8, ECX=0x436ca290, EDX=0x436ca290
ESP=0x02a2f964, EBP=0x0455e7cc, ESI=0x03512460, EDI=0x00000005
EIP=0x6d8729a2, EFLAGS=0x00010246

Top of Stack: (sp=0x02a2f964)
0x02a2f964: 03512460 03512460 6d918ab3 436ca290
0x02a2f974: 0455e854 0455e7cc 00002796 0455e78c
0x02a2f984: 6d9b7147 0455e7cc 02a2f9a8 0455bbc0
0x02a2f994: 02a2fcb8 03499960 6d9c1c3a 0455bbc0
0x02a2f9a4: 02a2fcb8 0455e78c 00000032 02a2fd50
0x02a2f9b4: 436ce278 002ac5c0 00000014 02a23756
0x02a2f9c4: 6d9c1cec 00000af0 02a2fcf0 0352dc90
0x02a2f9d4: 223136f4 00000005 6d91896c 03499960

Instructions: (pc=0x6d8729a2)
0x6d872992: c1 e8 02 25 fe ff ff 3f c2 04 00 8b 02 56 8b ca
0x6d8729a2: ff 50 50 5e c2 04 00 cc cc cc cc cc cc cc 8b 44

Stack: [0x00000000,0x00000000), sp=0x02a2f964, free space=43198k
Native frames: (J=compiled Java code, j=interpreted, Vv=VM code, C=native
code)
V [jvm.dll+0x29a2]

--------------- P R O C E S S ---------------

Java Threads: ( => current thread )
0x49764800 JavaThread "elasticsearch[search]-pool-5-thread-296" daemon
[_thread_blocked, id=7616]
0x4af4dc00 JavaThread "elasticsearch[search]-pool-5-thread-295" daemon
[_thread_blocked, id=432]
0x49731000 JavaThread "New I/O worker #12" daemon [_thread_blocked,
id=6764]
0x4b019800 JavaThread "elasticsearch[search]-pool-5-thread-293" daemon
[_thread_blocked, id=7480]
0x4b348400 JavaThread "elasticsearch[search]-pool-5-thread-292" daemon
[_thread_blocked, id=7860]
0x499f3400 JavaThread "elasticsearch[search]-pool-5-thread-291" daemon
[_thread_blocked, id=5392]
0x4983d000 JavaThread "elasticsearch[search]-pool-5-thread-290" daemon
[_thread_blocked, id=5224]
0x4aea7400 JavaThread "elasticsearch[search]-pool-5-thread-288" daemon
[_thread_blocked, id=6428]
0x49ca5000 JavaThread "elasticsearch[generic]-pool-1-thread-29" daemon
[_thread_blocked, id=4552]
0x49ce0400 JavaThread "elasticsearch[search]-pool-5-thread-274" daemon
[_thread_blocked, id=6616]
0x49792800 JavaThread "elasticsearch[search]-pool-5-thread-272" daemon
[_thread_blocked, id=5352]
0x4af24800 JavaThread "elasticsearch[search]-pool-5-thread-270" daemon
[_thread_blocked, id=5612]
0x499f2000 JavaThread "New I/O worker #10" daemon [_thread_blocked,
id=4504]
0x49cbdc00 JavaThread "elasticsearch[search]-pool-5-thread-223" daemon
[_thread_blocked, id=5840]
0x002a6800 JavaThread "DestroyJavaVM" [_thread_blocked, id=4160]
0x49682800 JavaThread "es[keepAlive]" [_thread_blocked, id=5748]
0x46d2b800 JavaThread "New I/O server boss #2 ([id: 0x00f942c4,
/0.0.0.0:9200])" daemon [_thread_blocked, id=4496]
0x49bb8800 JavaThread
"elasticsearch[raftaar]riverClusterService#updateTask-pool-15-thread-1"
daemon [_thread_blocked, id=2500]
0x49b07000 JavaThread "New I/O worker #1" daemon [_thread_blocked,
id=3180]
0x4983b800 JavaThread "New I/O worker #8" daemon [_thread_blocked,
id=1976]
0x49bbb800 JavaThread "New I/O worker #7" daemon [_thread_blocked,
id=2532]
0x49833400 JavaThread "New I/O worker #4" daemon [_thread_blocked,
id=5760]
0x4985f400 JavaThread "New I/O worker #6" daemon [_thread_blocked,
id=3688]
0x49baf400 JavaThread "New I/O worker #5" daemon [_thread_blocked,
id=5808]
0x49bb0400 JavaThread
"elasticsearch[raftaar]clusterService#updateTask-pool-16-thread-1" daemon
[_thread_blocked, id=4348]
0x49bb9400 JavaThread "New I/O worker #3" daemon [_thread_blocked,
id=5004]
0x49bb7000 JavaThread "New I/O worker #2" daemon [_thread_blocked,
id=3040]
0x49b67400 JavaThread "New I/O server boss #1 ([id: 0x010c29fe,
/0.0.0.0:9300])" daemon [_thread_blocked, id=3400]
0x49b83800 JavaThread "elasticsearch[raftaar][ttl_expire]" daemon
[_thread_blocked, id=5628]
0x49b52000 JavaThread "elasticsearch[raftaar][scheduler]-pool-13-thread-1"
daemon [_thread_blocked, id=4556]
0x49b0f800 JavaThread "elasticsearch[raftaar][timer]" daemon
[_thread_blocked, id=5860]
0x49677400 JavaThread "Low Memory Detector" daemon [_thread_blocked,
id=5300]
0x49672800 JavaThread "CompilerThread0" daemon [_thread_blocked, id=1204]
0x49671400 JavaThread "Attach Listener" daemon [_thread_blocked, id=5084]
0x49670400 JavaThread "Signal Dispatcher" daemon [_thread_blocked,
id=5968]
0x46d5f400 JavaThread "Surrogate Locker Thread (CMS)" daemon
[_thread_blocked, id=5252]
0x46d47c00 JavaThread "Finalizer" daemon [_thread_blocked, id=5896]
0x46d43800 JavaThread "Reference Handler" daemon [_thread_blocked,
id=5172]

Other Threads:
0x46d40800 VMThread [id=4548]
0x49678800 WatcherThread [id=1536]

VM state:at safepoint (normal execution)

VM Mutex/Monitor currently owned by a thread: ([mutex/lock_event])
[0x002a5468/0x000006fc] Threads_lock - owner thread: 0x46d40800
[0x002a5638/0x000006b4] Heap_lock - owner thread: 0x4af4dc00

Heap
par new generation total 28288K, used 28286K [0x02a30000, 0x048e0000,
0x04a30000)
eden space 25152K, 100% used [0x02a30000, 0x042c0000, 0x042c0000)
from space 3136K, 99% used [0x045d0000, 0x048df8d0, 0x048e0000)
to space 3136K, 100% used [0x042c0000, 0x045d0000, 0x045d0000)
concurrent mark-sweep generation total 904468K, used 653834K [0x04a30000,
0x3bd75000, 0x42a30000)
concurrent-mark-sweep perm gen total 42596K, used 25532K [0x42a30000,
0x453c9000, 0x46a30000)

Dynamic libraries:
0x00400000 - 0x00423000 C:\Program Files\Java\jdk1.6.0_02\bin\java.exe
0x7c900000 - 0x7c9af000 C:\WINDOWS\system32\ntdll.dll
0x7c800000 - 0x7c8f6000 C:\WINDOWS\system32\kernel32.dll
0x77dd0000 - 0x77e6b000 C:\WINDOWS\system32\ADVAPI32.dll
0x77e70000 - 0x77f02000 C:\WINDOWS\system32\RPCRT4.dll
0x77fe0000 - 0x77ff1000 C:\WINDOWS\system32\Secur32.dll
0x7c340000 - 0x7c396000 C:\Program
Files\Java\jdk1.6.0_02\jre\bin\msvcr71.dll
0x6d870000 - 0x6dab9000 C:\Program
Files\Java\jdk1.6.0_02\jre\bin\client\jvm.dll
0x7e410000 - 0x7e4a1000 C:\WINDOWS\system32\USER32.dll
0x77f10000 - 0x77f59000 C:\WINDOWS\system32\GDI32.dll
0x76b40000 - 0x76b6d000 C:\WINDOWS\system32\WINMM.dll
0x76390000 - 0x763ad000 C:\WINDOWS\system32\IMM32.DLL
0x5dac0000 - 0x5dac8000 C:\WINDOWS\system32\rdpsnd.dll
0x76360000 - 0x76370000 C:\WINDOWS\system32\WINSTA.dll
0x5b860000 - 0x5b8b5000 C:\WINDOWS\system32\NETAPI32.dll
0x77c10000 - 0x77c68000 C:\WINDOWS\system32\msvcrt.dll
0x76bf0000 - 0x76bfb000 C:\WINDOWS\system32\PSAPI.DLL
0x6d3c0000 - 0x6d3c8000 C:\Program Files\Java\jdk1.6.0_02\jre\bin\hpi.dll
0x6d820000 - 0x6d82c000 C:\Program Files\Java\jdk1.6.0_02\jre\bin\verify.dll
0x6d460000 - 0x6d47f000 C:\Program Files\Java\jdk1.6.0_02\jre\bin\java.dll
0x6d860000 - 0x6d86f000 C:\Program Files\Java\jdk1.6.0_02\jre\bin\zip.dll
0x6d610000 - 0x6d619000 C:\Program
Files\Java\jdk1.6.0_02\jre\bin\management.dll
0x6d620000 - 0x6d633000 C:\Program Files\Java\jdk1.6.0_02\jre\bin\net.dll
0x71ab0000 - 0x71ac7000 C:\WINDOWS\system32\WS2_32.dll
0x71aa0000 - 0x71aa8000 C:\WINDOWS\system32\WS2HELP.dll
0x71a50000 - 0x71a8f000 C:\WINDOWS\System32\mswsock.dll
0x76f20000 - 0x76f47000 C:\WINDOWS\system32\DNSAPI.dll
0x76fb0000 - 0x76fb8000 C:\WINDOWS\System32\winrnr.dll
0x76f60000 - 0x76f8c000 C:\WINDOWS\system32\WLDAP32.dll
0x76fc0000 - 0x76fc6000 C:\WINDOWS\system32\rasadhlp.dll
0x6d640000 - 0x6d649000 C:\Program Files\Java\jdk1.6.0_02\jre\bin\nio.dll
0x49e60000 - 0x49eab000 D:\elasticsearch\lib\sigar\sigar-x86-winnt.dll
0x74000000 - 0x74056000 C:\WINDOWS\system32\pdh.dll
0x763b0000 - 0x763f9000 C:\WINDOWS\system32\comdlg32.dll
0x5d090000 - 0x5d12a000 C:\WINDOWS\system32\COMCTL32.dll
0x7c9c0000 - 0x7d1d7000 C:\WINDOWS\system32\SHELL32.dll
0x77f60000 - 0x77fd6000 C:\WINDOWS\system32\SHLWAPI.dll
0x77a80000 - 0x77b15000 C:\WINDOWS\system32\CRYPT32.dll
0x77b20000 - 0x77b32000 C:\WINDOWS\system32\MSASN1.dll
0x74320000 - 0x7435d000 C:\WINDOWS\system32\ODBC32.dll
0x711a0000 - 0x711a6000 C:\WINDOWS\system32\odbcbcp.dll
0x77c00000 - 0x77c08000 C:\WINDOWS\system32\VERSION.dll
0x774e0000 - 0x7761d000 C:\WINDOWS\system32\ole32.dll
0x77120000 - 0x771ab000 C:\WINDOWS\system32\OLEAUT32.dll
0x773d0000 - 0x774d3000
C:\WINDOWS\WinSxS\x86_Microsoft.Windows.Common-Controls_6595b64144ccf1df_6.0.2600.5512_x-ww_35d4ce83\comctl32.dll
0x49f30000 - 0x49f47000 C:\WINDOWS\system32\odbcint.dll
0x5e760000 - 0x5e76a000 C:\WINDOWS\system32\perfos.dll
0x5e750000 - 0x5e75d000 C:\WINDOWS\system32\perfproc.dll
0x76d60000 - 0x76d79000 C:\WINDOWS\system32\iphlpapi.dll
0x76d40000 - 0x76d58000 C:\WINDOWS\system32\MPRAPI.dll
0x77cc0000 - 0x77cf2000 C:\WINDOWS\system32\ACTIVEDS.dll
0x76e10000 - 0x76e35000 C:\WINDOWS\system32\adsldpc.dll
0x76b20000 - 0x76b31000 C:\WINDOWS\system32\ATL.DLL
0x76e80000 - 0x76e8e000 C:\WINDOWS\system32\rtutils.dll
0x71bf0000 - 0x71c03000 C:\WINDOWS\system32\SAMLIB.dll
0x77920000 - 0x77a13000 C:\WINDOWS\system32\SETUPAPI.dll
0x71b20000 - 0x71b32000 C:\WINDOWS\system32\mpr.dll
0x5e790000 - 0x5e799000 C:\WINDOWS\system32\perfdisk.dll
0x662b0000 - 0x66308000 C:\WINDOWS\system32\hnetcfg.dll
0x71a90000 - 0x71a98000 C:\WINDOWS\System32\wshtcpip.dll
0x68000000 - 0x68036000 C:\WINDOWS\system32\rsaenh.dll
0x769c0000 - 0x76a74000 C:\WINDOWS\system32\USERENV.dll

VM Arguments:
jvm_args: -Xms256m -Xmx1g -Xss256k -XX:+UseParNewGC -XX:+UseConcMarkSweepGC
-XX:CMSInitiatingOccupancyFraction=75 -XX:+UseCMSInitiatingOccupancyOnly
-XX:+HeapDumpOnOutOfMemoryError -Delasticsearch -Des-foreground=yes
-Des.path.home=D:\elasticsearch
java_command: org.elasticsearch.bootstrap.ElasticSearch
Launcher Type: SUN_STANDARD

Environment Variables:
JAVA_HOME=C:\Program Files\Java\jdk1.6.0_02
PATH=C:\WINDOWS\system32;C:\WINDOWS;C:\WINDOWS\System32\Wbem;;C:\Program
Files\Microsoft SQL Server\80\Tools\Binn;C:\Program Files\Microsoft SQL
Server\90\Tools\binn;C:\Program Files\Java\jdk1.6.0_02\bin;;
USERNAME=raftaar
OS=Windows_NT
PROCESSOR_IDENTIFIER=x86 Family 6 Model 23 Stepping 10, GenuineIntel

--------------- S Y S T E M ---------------

OS: Windows XP Build 2600 Service Pack 3

CPU:total 2 (2 cores per cpu, 1 threads per core) family 6 model 7 stepping
10, cmov, cx8, fxsr, mmx, sse, sse2, sse3, ssse3

Memory: 4k page, physical 2087020k(677356k free), swap 4025324k(2293636k
free)

vm_info: Java HotSpot(TM) Client VM (1.6.0_02-b06) for windows-x86, built on
Jul 12 2007 01:16:14 by "java_re" with unknown MS VC++:1310


(Abhishek Jajoria) #3

Is it good to run Elasticsearch 0.19.3 with java version 7?

On Fri, Jul 20, 2012 at 12:21 AM, Ivan Brusic ivan@brusic.com wrote:

I would upgrade your version of Java without hesitation. Your version
is five years old at this point. Even if you don't want to upgrade to
Java 7, you should at least upgrade to the latest release of Java 6. I
no longer recall the timeline of GC parameters, but ElasticSearch is
definitely pushing the boundaries of GC.

--
Ivan

On Wed, Jul 18, 2012 at 4:22 AM, jajoria abhishek
jajoria.abhishek@gmail.com wrote:

My Es server keeps getting crashes .I get the following error file in my
bin
folder please tell me what does this error means and why it is occuring?

An unexpected error has been detected by Java Runtime Environment:

EXCEPTION_ACCESS_VIOLATION (0xc0000005) at pc=0x6d8729a2, pid=3528,

tid=3168

Java VM: Java HotSpot(TM) Client VM (1.6.0_02-b06 mixed mode)

Problematic frame:

V [jvm.dll+0x29a2]

If you would like to submit a bug report, please visit:

http://java.sun.com/webapps/bugreport/crash.jsp

--------------- T H R E A D ---------------

Current thread (0x002aa000): GCTaskThread [id=3168]

siginfo: ExceptionCode=0xc0000005, reading address 0x00000050

Registers:
EAX=0x00000000, EBX=0x02a2fcb8, ECX=0x436ca290, EDX=0x436ca290
ESP=0x02a2f964, EBP=0x0455e7cc, ESI=0x03512460, EDI=0x00000005
EIP=0x6d8729a2, EFLAGS=0x00010246

Top of Stack: (sp=0x02a2f964)
0x02a2f964: 03512460 03512460 6d918ab3 436ca290
0x02a2f974: 0455e854 0455e7cc 00002796 0455e78c
0x02a2f984: 6d9b7147 0455e7cc 02a2f9a8 0455bbc0
0x02a2f994: 02a2fcb8 03499960 6d9c1c3a 0455bbc0
0x02a2f9a4: 02a2fcb8 0455e78c 00000032 02a2fd50
0x02a2f9b4: 436ce278 002ac5c0 00000014 02a23756
0x02a2f9c4: 6d9c1cec 00000af0 02a2fcf0 0352dc90
0x02a2f9d4: 223136f4 00000005 6d91896c 03499960

Instructions: (pc=0x6d8729a2)
0x6d872992: c1 e8 02 25 fe ff ff 3f c2 04 00 8b 02 56 8b ca
0x6d8729a2: ff 50 50 5e c2 04 00 cc cc cc cc cc cc cc 8b 44

Stack: [0x00000000,0x00000000), sp=0x02a2f964, free space=43198k
Native frames: (J=compiled Java code, j=interpreted, Vv=VM code, C=native
code)
V [jvm.dll+0x29a2]

--------------- P R O C E S S ---------------

Java Threads: ( => current thread )
0x49764800 JavaThread "elasticsearch[search]-pool-5-thread-296" daemon
[_thread_blocked, id=7616]
0x4af4dc00 JavaThread "elasticsearch[search]-pool-5-thread-295" daemon
[_thread_blocked, id=432]
0x49731000 JavaThread "New I/O worker #12" daemon [_thread_blocked,
id=6764]
0x4b019800 JavaThread "elasticsearch[search]-pool-5-thread-293" daemon
[_thread_blocked, id=7480]
0x4b348400 JavaThread "elasticsearch[search]-pool-5-thread-292" daemon
[_thread_blocked, id=7860]
0x499f3400 JavaThread "elasticsearch[search]-pool-5-thread-291" daemon
[_thread_blocked, id=5392]
0x4983d000 JavaThread "elasticsearch[search]-pool-5-thread-290" daemon
[_thread_blocked, id=5224]
0x4aea7400 JavaThread "elasticsearch[search]-pool-5-thread-288" daemon
[_thread_blocked, id=6428]
0x49ca5000 JavaThread "elasticsearch[generic]-pool-1-thread-29" daemon
[_thread_blocked, id=4552]
0x49ce0400 JavaThread "elasticsearch[search]-pool-5-thread-274" daemon
[_thread_blocked, id=6616]
0x49792800 JavaThread "elasticsearch[search]-pool-5-thread-272" daemon
[_thread_blocked, id=5352]
0x4af24800 JavaThread "elasticsearch[search]-pool-5-thread-270" daemon
[_thread_blocked, id=5612]
0x499f2000 JavaThread "New I/O worker #10" daemon [_thread_blocked,
id=4504]
0x49cbdc00 JavaThread "elasticsearch[search]-pool-5-thread-223" daemon
[_thread_blocked, id=5840]
0x002a6800 JavaThread "DestroyJavaVM" [_thread_blocked, id=4160]
0x49682800 JavaThread "es[keepAlive]" [_thread_blocked, id=5748]
0x46d2b800 JavaThread "New I/O server boss #2 ([id: 0x00f942c4,
/0.0.0.0:9200])" daemon [_thread_blocked, id=4496]
0x49bb8800 JavaThread
"elasticsearch[raftaar]riverClusterService#updateTask-pool-15-thread-1"
daemon [_thread_blocked, id=2500]
0x49b07000 JavaThread "New I/O worker #1" daemon [_thread_blocked,
id=3180]
0x4983b800 JavaThread "New I/O worker #8" daemon [_thread_blocked,
id=1976]
0x49bbb800 JavaThread "New I/O worker #7" daemon [_thread_blocked,
id=2532]
0x49833400 JavaThread "New I/O worker #4" daemon [_thread_blocked,
id=5760]
0x4985f400 JavaThread "New I/O worker #6" daemon [_thread_blocked,
id=3688]
0x49baf400 JavaThread "New I/O worker #5" daemon [_thread_blocked,
id=5808]
0x49bb0400 JavaThread
"elasticsearch[raftaar]clusterService#updateTask-pool-16-thread-1" daemon
[_thread_blocked, id=4348]
0x49bb9400 JavaThread "New I/O worker #3" daemon [_thread_blocked,
id=5004]
0x49bb7000 JavaThread "New I/O worker #2" daemon [_thread_blocked,
id=3040]
0x49b67400 JavaThread "New I/O server boss #1 ([id: 0x010c29fe,
/0.0.0.0:9300])" daemon [_thread_blocked, id=3400]
0x49b83800 JavaThread "elasticsearch[raftaar][ttl_expire]" daemon
[_thread_blocked, id=5628]
0x49b52000 JavaThread
"elasticsearch[raftaar][scheduler]-pool-13-thread-1"
daemon [_thread_blocked, id=4556]
0x49b0f800 JavaThread "elasticsearch[raftaar][timer]" daemon
[_thread_blocked, id=5860]
0x49677400 JavaThread "Low Memory Detector" daemon [_thread_blocked,
id=5300]
0x49672800 JavaThread "CompilerThread0" daemon [_thread_blocked,
id=1204]
0x49671400 JavaThread "Attach Listener" daemon [_thread_blocked,
id=5084]
0x49670400 JavaThread "Signal Dispatcher" daemon [_thread_blocked,
id=5968]
0x46d5f400 JavaThread "Surrogate Locker Thread (CMS)" daemon
[_thread_blocked, id=5252]
0x46d47c00 JavaThread "Finalizer" daemon [_thread_blocked, id=5896]
0x46d43800 JavaThread "Reference Handler" daemon [_thread_blocked,
id=5172]

Other Threads:
0x46d40800 VMThread [id=4548]
0x49678800 WatcherThread [id=1536]

VM state:at safepoint (normal execution)

VM Mutex/Monitor currently owned by a thread: ([mutex/lock_event])
[0x002a5468/0x000006fc] Threads_lock - owner thread: 0x46d40800
[0x002a5638/0x000006b4] Heap_lock - owner thread: 0x4af4dc00

Heap
par new generation total 28288K, used 28286K [0x02a30000, 0x048e0000,
0x04a30000)
eden space 25152K, 100% used [0x02a30000, 0x042c0000, 0x042c0000)
from space 3136K, 99% used [0x045d0000, 0x048df8d0, 0x048e0000)
to space 3136K, 100% used [0x042c0000, 0x045d0000, 0x045d0000)
concurrent mark-sweep generation total 904468K, used 653834K
[0x04a30000,
0x3bd75000, 0x42a30000)
concurrent-mark-sweep perm gen total 42596K, used 25532K [0x42a30000,
0x453c9000, 0x46a30000)

Dynamic libraries:
0x00400000 - 0x00423000 C:\Program Files\Java\jdk1.6.0_02\bin\java.exe
0x7c900000 - 0x7c9af000 C:\WINDOWS\system32\ntdll.dll
0x7c800000 - 0x7c8f6000 C:\WINDOWS\system32\kernel32.dll
0x77dd0000 - 0x77e6b000 C:\WINDOWS\system32\ADVAPI32.dll
0x77e70000 - 0x77f02000 C:\WINDOWS\system32\RPCRT4.dll
0x77fe0000 - 0x77ff1000 C:\WINDOWS\system32\Secur32.dll
0x7c340000 - 0x7c396000 C:\Program
Files\Java\jdk1.6.0_02\jre\bin\msvcr71.dll
0x6d870000 - 0x6dab9000 C:\Program
Files\Java\jdk1.6.0_02\jre\bin\client\jvm.dll
0x7e410000 - 0x7e4a1000 C:\WINDOWS\system32\USER32.dll
0x77f10000 - 0x77f59000 C:\WINDOWS\system32\GDI32.dll
0x76b40000 - 0x76b6d000 C:\WINDOWS\system32\WINMM.dll
0x76390000 - 0x763ad000 C:\WINDOWS\system32\IMM32.DLL
0x5dac0000 - 0x5dac8000 C:\WINDOWS\system32\rdpsnd.dll
0x76360000 - 0x76370000 C:\WINDOWS\system32\WINSTA.dll
0x5b860000 - 0x5b8b5000 C:\WINDOWS\system32\NETAPI32.dll
0x77c10000 - 0x77c68000 C:\WINDOWS\system32\msvcrt.dll
0x76bf0000 - 0x76bfb000 C:\WINDOWS\system32\PSAPI.DLL
0x6d3c0000 - 0x6d3c8000 C:\Program Files\Java\jdk1.6.0_02\jre\bin\hpi.dll
0x6d820000 - 0x6d82c000 C:\Program
Files\Java\jdk1.6.0_02\jre\bin\verify.dll
0x6d460000 - 0x6d47f000 C:\Program
Files\Java\jdk1.6.0_02\jre\bin\java.dll
0x6d860000 - 0x6d86f000 C:\Program Files\Java\jdk1.6.0_02\jre\bin\zip.dll
0x6d610000 - 0x6d619000 C:\Program
Files\Java\jdk1.6.0_02\jre\bin\management.dll
0x6d620000 - 0x6d633000 C:\Program Files\Java\jdk1.6.0_02\jre\bin\net.dll
0x71ab0000 - 0x71ac7000 C:\WINDOWS\system32\WS2_32.dll
0x71aa0000 - 0x71aa8000 C:\WINDOWS\system32\WS2HELP.dll
0x71a50000 - 0x71a8f000 C:\WINDOWS\System32\mswsock.dll
0x76f20000 - 0x76f47000 C:\WINDOWS\system32\DNSAPI.dll
0x76fb0000 - 0x76fb8000 C:\WINDOWS\System32\winrnr.dll
0x76f60000 - 0x76f8c000 C:\WINDOWS\system32\WLDAP32.dll
0x76fc0000 - 0x76fc6000 C:\WINDOWS\system32\rasadhlp.dll
0x6d640000 - 0x6d649000 C:\Program Files\Java\jdk1.6.0_02\jre\bin\nio.dll
0x49e60000 - 0x49eab000 D:\elasticsearch\lib\sigar\sigar-x86-winnt.dll
0x74000000 - 0x74056000 C:\WINDOWS\system32\pdh.dll
0x763b0000 - 0x763f9000 C:\WINDOWS\system32\comdlg32.dll
0x5d090000 - 0x5d12a000 C:\WINDOWS\system32\COMCTL32.dll
0x7c9c0000 - 0x7d1d7000 C:\WINDOWS\system32\SHELL32.dll
0x77f60000 - 0x77fd6000 C:\WINDOWS\system32\SHLWAPI.dll
0x77a80000 - 0x77b15000 C:\WINDOWS\system32\CRYPT32.dll
0x77b20000 - 0x77b32000 C:\WINDOWS\system32\MSASN1.dll
0x74320000 - 0x7435d000 C:\WINDOWS\system32\ODBC32.dll
0x711a0000 - 0x711a6000 C:\WINDOWS\system32\odbcbcp.dll
0x77c00000 - 0x77c08000 C:\WINDOWS\system32\VERSION.dll
0x774e0000 - 0x7761d000 C:\WINDOWS\system32\ole32.dll
0x77120000 - 0x771ab000 C:\WINDOWS\system32\OLEAUT32.dll
0x773d0000 - 0x774d3000

C:\WINDOWS\WinSxS\x86_Microsoft.Windows.Common-Controls_6595b64144ccf1df_6.0.2600.5512_x-ww_35d4ce83\comctl32.dll

0x49f30000 - 0x49f47000 C:\WINDOWS\system32\odbcint.dll
0x5e760000 - 0x5e76a000 C:\WINDOWS\system32\perfos.dll
0x5e750000 - 0x5e75d000 C:\WINDOWS\system32\perfproc.dll
0x76d60000 - 0x76d79000 C:\WINDOWS\system32\iphlpapi.dll
0x76d40000 - 0x76d58000 C:\WINDOWS\system32\MPRAPI.dll
0x77cc0000 - 0x77cf2000 C:\WINDOWS\system32\ACTIVEDS.dll
0x76e10000 - 0x76e35000 C:\WINDOWS\system32\adsldpc.dll
0x76b20000 - 0x76b31000 C:\WINDOWS\system32\ATL.DLL
0x76e80000 - 0x76e8e000 C:\WINDOWS\system32\rtutils.dll
0x71bf0000 - 0x71c03000 C:\WINDOWS\system32\SAMLIB.dll
0x77920000 - 0x77a13000 C:\WINDOWS\system32\SETUPAPI.dll
0x71b20000 - 0x71b32000 C:\WINDOWS\system32\mpr.dll
0x5e790000 - 0x5e799000 C:\WINDOWS\system32\perfdisk.dll
0x662b0000 - 0x66308000 C:\WINDOWS\system32\hnetcfg.dll
0x71a90000 - 0x71a98000 C:\WINDOWS\System32\wshtcpip.dll
0x68000000 - 0x68036000 C:\WINDOWS\system32\rsaenh.dll
0x769c0000 - 0x76a74000 C:\WINDOWS\system32\USERENV.dll

VM Arguments:
jvm_args: -Xms256m -Xmx1g -Xss256k -XX:+UseParNewGC
-XX:+UseConcMarkSweepGC
-XX:CMSInitiatingOccupancyFraction=75 -XX:+UseCMSInitiatingOccupancyOnly
-XX:+HeapDumpOnOutOfMemoryError -Delasticsearch -Des-foreground=yes
-Des.path.home=D:\elasticsearch
java_command: org.elasticsearch.bootstrap.ElasticSearch
Launcher Type: SUN_STANDARD

Environment Variables:
JAVA_HOME=C:\Program Files\Java\jdk1.6.0_02
PATH=C:\WINDOWS\system32;C:\WINDOWS;C:\WINDOWS\System32\Wbem;;C:\Program
Files\Microsoft SQL Server\80\Tools\Binn;C:\Program Files\Microsoft SQL
Server\90\Tools\binn;C:\Program Files\Java\jdk1.6.0_02\bin;;
USERNAME=raftaar
OS=Windows_NT
PROCESSOR_IDENTIFIER=x86 Family 6 Model 23 Stepping 10, GenuineIntel

--------------- S Y S T E M ---------------

OS: Windows XP Build 2600 Service Pack 3

CPU:total 2 (2 cores per cpu, 1 threads per core) family 6 model 7
stepping
10, cmov, cx8, fxsr, mmx, sse, sse2, sse3, ssse3

Memory: 4k page, physical 2087020k(677356k free), swap 4025324k(2293636k
free)

vm_info: Java HotSpot(TM) Client VM (1.6.0_02-b06) for windows-x86,
built on
Jul 12 2007 01:16:14 by "java_re" with unknown MS VC++:1310


(system) #4