Elasticsearch crashing Java Runtime Environment

Tried debugging this issue myself not sure whats up.

Just crashes when not running or doing anything at random time.

elastic version 7.9.2

H/W path              Device          Class          Description
================================================================
                                      system         To Be Filled By O.E.M. (To Be Filled By O.E.M.)
/0                                    bus            X470D4U2-2T
/0/0                                  memory         64KiB BIOS
/0/11                                 memory         64GiB System Memory
/0/11/0                               memory         16GiB DIMM DDR4 Synchronous Unbuffered (Unregistered) 2666 M
/0/11/1                               memory         16GiB DIMM DDR4 Synchronous Unbuffered (Unregistered) 2666 M
/0/11/2                               memory         16GiB DIMM DDR4 Synchronous Unbuffered (Unregistered) 2666 M
/0/11/3                               memory         16GiB DIMM DDR4 Synchronous Unbuffered (Unregistered) 2666 M
/0/14                                 memory         384KiB L1 cache
/0/15                                 memory         3MiB L2 cache
/0/16                                 memory         32MiB L3 cache
/0/17                                 processor      AMD Ryzen 5 3600X 6-Core Processor
/0/100                                bridge         Starship/Matisse Root Complex
/0/100/0.2                            generic        Starship/Matisse IOMMU
/0/100/1.1                            bridge         Starship/Matisse GPP Bridge
/0/100/1.1/0          enp1s0f0        network        Ethernet Controller 10G X550T
/0/100/1.1/0.1        enp1s0f1        network        Ethernet Controller 10G X550T
/0/100/1.3                            bridge         Starship/Matisse GPP Bridge
/0/100/1.3/0                          bus            Advanced Micro Devices, Inc. [AMD]
/0/100/1.3/0/0        usb1            bus            xHCI Host Controller
/0/100/1.3/0/1        usb2            bus            xHCI Host Controller
/0/100/1.3/0.1                        storage        400 Series Chipset SATA Controller
/0/100/1.3/0.2                        bridge         400 Series Chipset PCIe Bridge
/0/100/1.3/0.2/0                      bridge         400 Series Chipset PCIe Port
/0/100/1.3/0.2/0/0                    bridge         AST1150 PCI-to-PCI Bridge
/0/100/1.3/0.2/0/0/0                  display        ASPEED Graphics Family
/0/100/1.3/0.2/1                      bridge         400 Series Chipset PCIe Port
/0/100/1.3/0.2/2                      bridge         400 Series Chipset PCIe Port
/0/100/1.3/0.2/3                      bridge         400 Series Chipset PCIe Port
/0/100/1.3/0.2/4                      bridge         400 Series Chipset PCIe Port
/0/100/1.3/0.2/8                      bridge         400 Series Chipset PCIe Port
/0/100/3.1                            bridge         Starship/Matisse GPP Bridge
/0/100/3.1/0          /dev/nvme0      storage        WDC CL SN720 SDAQNTW-512G-2000
/0/100/3.1/0/1        /dev/nvme0n1    disk           512GB NVMe disk
/0/100/3.1/0/1/1      /dev/nvme0n1p1  volume         510MiB Windows FAT volume
/0/100/3.1/0/1/2      /dev/nvme0n1p2  volume         475GiB RAID partition
/0/100/3.1/0/1/3      /dev/nvme0n1p3  volume         510MiB Linux swap volume
/0/100/3.1/0/1/4      /dev/nvme0n1p4  volume         1023KiB EFI partition
/0/100/3.2                            bridge         Starship/Matisse GPP Bridge
/0/100/3.2/0          /dev/nvme1      storage        WDC CL SN720 SDAQNTW-512G-2000
/0/100/3.2/0/1        /dev/nvme1n1    disk           512GB NVMe disk
/0/100/3.2/0/1/1      /dev/nvme1n1p1  volume         510MiB Windows FAT volume
/0/100/3.2/0/1/2      /dev/nvme1n1p2  volume         475GiB RAID partition
/0/100/3.2/0/1/3      /dev/nvme1n1p3  volume         510MiB Linux swap volume

The error im seeing is

#
# A fatal error has been detected by the Java Runtime Environment:
#
#  SIGSEGV (0xb) at pc=0x00007fcb72941cc5, pid=1057, tid=1593
#
# JRE version: OpenJDK Runtime Environment AdoptOpenJDK (15.0+36) (build 15+36)
# Java VM: OpenJDK 64-Bit Server VM AdoptOpenJDK (15+36, mixed mode, sharing, tiered, compressed oops, g1 gc, linux-amd64)
# Problematic frame:
# V  [libjvm.so+0x7b2cc5]  IndexSet::IndexSet(IndexSet*)+0xc5
#
# Core dump will be written. Default location: Core dumps may be processed with "/usr/lib/systemd/systemd-coredump %P %u %g %s %t %c %h" (or dumping to /usr/share/elasticsearch/core.1057)
#
# If you would like to submit a bug report, please visit:
#   https://github.com/AdoptOpenJDK/openjdk-support/issues
#

---------------  S U M M A R Y ------------

Command Line: -Xshare:auto -Des.networkaddress.cache.ttl=60 -Des.networkaddress.cache.negative.ttl=10 -XX:+AlwaysPreTouch -Xss1m -Djava.awt.headless=true -Dfile.encoding=UTF-8 -Djna.nosys=true -XX:-OmitStackTraceInFastThrow -XX:+ShowCodeDetailsInExceptionMessages -Dio.netty.noUnsafe=true -Dio.netty.noKeySetOptimization=true -Dio.netty.recycler.maxCapacityPerThread=0 -Dio.netty.allocator.numDirectArenas=0 -Dlog4j.shutdownHookEnabled=false -Dlog4j2.disable.jmx=true -Djava.locale.providers=SPI,COMPAT -Xms8g -Xmx8g -XX:+UseG1GC -XX:G1ReservePercent=25 -XX:InitiatingHeapOccupancyPercent=30 -Djava.io.tmpdir=/tmp/elasticsearch-6541259074566740209 -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=/var/lib/elasticsearch -XX:ErrorFile=/var/log/elasticsearch/hs_err_pid%p.log -Xlog:gc*,gc+age=trace,safepoint:file=/var/log/elasticsearch/gc.log:utctime,pid,tags:filecount=32,filesize=64m -XX:MaxDirectMemorySize=4294967296 -Des.path.home=/usr/share/elasticsearch -Des.path.conf=/etc/elasticsearch2 -Des.distribution.flavor=default -Des.distribution.type=rpm -Des.bundled_jdk=true org.elasticsearch.bootstrap.Elasticsearch -p /var/run/elasticsearch2/elasticsearch2.pid

Host: AMD Ryzen 5 3600X 6-Core Processor, 12 cores, 62G, Fedora release 32 (Thirty Two)
Time: Fri Oct  2 17:37:12 2020 UTC elapsed time: 9596.016703 seconds (0d 2h 39m 56s)

---------------  T H R E A D  ---------------

Current thread (0x00007fcb6ca4d6c0):  JavaThread "C2 CompilerThread0" daemon [_thread_in_native, id=1593, stack(0x00007fcb30f81000,0x00007fcb31082000)]


Current CompileTask:
C2:9596016 22785   !   4       org.apache.lucene.codecs.lucene60.Lucene60FieldInfosFormat::write (354 bytes)

Stack: [0x00007fcb30f81000,0x00007fcb31082000],  sp=0x00007fcb3107d4e0,  free space=1009k
Native frames: (J=compiled Java code, A=aot compiled Java code, j=interpreted, Vv=VM code, C=native code)
V  [libjvm.so+0x7b2cc5]  IndexSet::IndexSet(IndexSet*)+0xc5
V  [libjvm.so+0x7a8875]  PhaseChaitin::build_ifg_physical(ResourceArea*)+0xc5
V  [libjvm.so+0x4c784a]  PhaseChaitin::Register_Allocate()+0x72a
V  [libjvm.so+0x56395f]  Compile::Code_Gen()+0x28f
V  [libjvm.so+0x566558]  Compile::Compile(ciEnv*, ciMethod*, int, bool, bool, bool, DirectiveSet*)+0xb08
V  [libjvm.so+0x49d8ec]  C2Compiler::compile_method(ciEnv*, ciMethod*, int, DirectiveSet*)+0xac
V  [libjvm.so+0x5707bc]  CompileBroker::invoke_compiler_on_method(CompileTask*)+0xeec
V  [libjvm.so+0x5715a8]  CompileBroker::compiler_thread_loop()+0x5b8
V  [libjvm.so+0xe551da]  JavaThread::thread_main_inner()+0x1da
V  [libjvm.so+0xe59e0f]  Thread::call_run()+0xff
V  [libjvm.so+0xbcd577]  thread_native_entry(Thread*)+0xe7


siginfo: si_signo: 11 (SIGSEGV), si_code: 2 (SEGV_ACCERR), si_addr: 0x00007fcb01069378

Register to memory mapping:

RAX=0x00007fcaf9069340 points into unknown readable memory: 0x00007fcaf9068d60 | 60 8d 06 f9 ca 7f 00 00
RBX=0x00007fcaf9068d40 points into unknown readable memory: 0x0000000000000000 | 00 00 00 00 00 00 00 00
RCX=0x0000000001000007 is an unknown value
RDX=0x0 is NULL
RSP=0x00007fcb3107d4e0 is pointing into the stack for thread: 0x00007fcb6ca4d6c0
RBP=0x00007fcb3107d530 is pointing into the stack for thread: 0x00007fcb6ca4d6c0
RSI=0x00007fcb6ca4ec80 points into unknown readable memory: 0x0000000000000003 | 03 00 00 00 00 00 00 00
RDI=0x0000000000000002 is an unknown value
R8 =0x00007fcb31080070 is pointing into the stack for thread: 0x00007fcb6ca4d6c0
R9 =0x00007fcb6ca4ec80 points into unknown readable memory: 0x0000000000000003 | 03 00 00 00 00 00 00 00
R10=0x00007fcb7368aa00: <offset 0x00000000014fba00> in /usr/share/elasticsearch/jdk/lib/server/libjvm.so at 0x00007fcb7218f000
R11=0x0 is NULL
R12=0x0000000000000008 is an unknown value
R13=0x00007fcaf952e8a0 points into unknown readable memory: 0x0000000000000000 | 00 00 00 00 00 00 00 00
R14=0x00007fcaf83dd0f0 points into unknown readable memory: 0x0000002200000012 | 12 00 00 00 22 00 00 00
R15=0x00007fcb3107d6c0 is pointing into the stack for thread: 0x00007fcb6ca4d6c0


Registers:
RAX=0x00007fcaf9069340, RBX=0x00007fcaf9068d40, RCX=0x0000000001000007, RDX=0x0000000000000000
RSP=0x00007fcb3107d4e0, RBP=0x00007fcb3107d530, RSI=0x00007fcb6ca4ec80, RDI=0x0000000000000002
R8 =0x00007fcb31080070, R9 =0x00007fcb6ca4ec80, R10=0x00007fcb7368aa00, R11=0x0000000000000000
R12=0x0000000000000008, R13=0x00007fcaf952e8a0, R14=0x00007fcaf83dd0f0, R15=0x00007fcb3107d6c0
RIP=0x00007fcb72941cc5, EFLAGS=0x0000000000010202, CSGSFS=0x002b000000000033, ERR=0x0000000000000006
  TRAPNO=0x000000000000000e

Top of Stack: (sp=0x00007fcb3107d4e0)
0x00007fcb3107d4e0:   0000000000000000 00007fcaf9932cf0
0x00007fcb3107d4f0:   00007fcb7368aa00 0000000000000007
0x00007fcb3107d500:   00007fcaf882c858 0000000000000000
0x00007fcb3107d510:   0000000000000000 00007fcaf882c608 

Instructions: (pc=0x00007fcb72941cc5)
0x00007fcb72941bc5:   30 08 00 00 49 89 55 00 48 8b 00 48 8b 80 f0 04
0x00007fcb72941bd5:   00 00 48 8b 80 80 00 00 00 4c 89 a8 30 08 00 00
0x00007fcb72941be5:   49 8b 44 24 08 48 89 0c d8 48 83 c4 08 5b 41 5c
0x00007fcb72941bf5:   41 5d 5d c3 90 66 0f 1f 44 00 00 55 48 89 e5 41
0x00007fcb72941c05:   57 41 56 41 55 41 54 49 89 ff 53 49 89 f6 48 83
0x00007fcb72941c15:   ec 28 8b 06 89 07 8b 46 04 89 47 04 8b 9e 90 00
0x00007fcb72941c25:   00 00 83 fb 10 89 9f 90 00 00 00 0f 87 7a 01 00
0x00007fcb72941c35:   00 48 8d 47 10 48 89 47 08 85 db 0f 84 b5 00 00
0x00007fcb72941c45:   00 45 31 e4 4c 8d 15 b0 8d d4 00 e9 7d 00 00 00
0x00007fcb72941c55:   0f 1f 00 4c 89 55 c0 48 89 4d c8 66 48 8d 3d 88
0x00007fcb72941c65:   92 cd 00 66 66 48 e8 a0 af a5 ff 48 8b 4d c8 4c
0x00007fcb72941c75:   8b 55 c0 48 8b 00 48 8b 80 f0 04 00 00 4c 8b 80
0x00007fcb72941c85:   80 00 00 00 49 8b 98 30 08 00 00 48 85 db 74 7b
0x00007fcb72941c95:   48 8b 03 66 0f ef c0 41 83 c4 01 49 89 80 30 08
0x00007fcb72941ca5:   00 00 0f 11 03 0f 11 43 10 f3 41 0f 6f 45 00 0f
0x00007fcb72941cb5:   11 03 f3 41 0f 6f 45 10 0f 11 43 10 49 8b 47 08
0x00007fcb72941cc5:   48 89 1c c8 45 39 a7 90 00 00 00 76 29 49 8b 46
0x00007fcb72941cd5:   08 44 89 e1 4c 8b 2c c8 4d 39 d5 0f 85 72 ff ff
0x00007fcb72941ce5:   ff 49 8b 47 08 41 83 c4 01 4c 89 14 c8 45 39 a7
0x00007fcb72941cf5:   90 00 00 00 77 d7 48 83 c4 28 5b 41 5c 41 5d 41
0x00007fcb72941d05:   5e 41 5f 5d c3 66 0f 1f 44 00 00 4d 8b 98 28 08
0x00007fcb72941d15:   00 00 49 8b 43 18 48 3d 9f f9 ff ff 76 38 48 8d
0x00007fcb72941d25:   15 16 49 7b 00 4c 89 df be 60 06 00 00 4c 89 55
0x00007fcb72941d35:   b0 48 89 4d b8 4c 89 45 c0 4c 89 5d c8 e8 a9 ce
0x00007fcb72941d45:   b9 ff 4c 8b 5d c8 4c 8b 55 b0 48 8b 4d b8 4c 8b
0x00007fcb72941d55:   45 c0 49 8b 43 18 48 8d 90 60 06 00 00 49 3b 53
0x00007fcb72941d65:   20 0f 87 a0 00 00 00 49 89 53 18 48 8d 70 20 48
0x00007fcb72941d75:   83 e6 e0 48 8d 96 40 06 00 00 48 89 f0 66 0f 1f
0x00007fcb72941d85:   44 00 00 48 89 18 48 89 c3 48 83 c0 20 48 39 d0
0x00007fcb72941d95:   75 f1 48 8d 9e 20 06 00 00 49 89 98 30 08 00 00
0x00007fcb72941da5:   e9 eb fe ff ff 66 0f 1f 44 00 00 66 48 8d 3d 38
0x00007fcb72941db5:   91 cd 00 66 66 48 e8 50 ae a5 ff 48 c1 e3 03 48 


Stack slot to memory mapping:
stack at sp + 0 slots: 0x0 is NULL
stack at sp + 1 slots: 0x00007fcaf9932cf0 points into unknown readable memory: 0x0000000000000000 | 00 00 00 00 00 00 00 00
stack at sp + 2 slots: 0x00007fcb7368aa00: <offset 0x00000000014fba00> in /usr/share/elasticsearch/jdk/lib/server/libjvm.so at 0x00007fcb7218f000
stack at sp + 3 slots: 0x0000000000000007 is an unknown value
stack at sp + 4 slots: 0x00007fcaf882c858 points into unknown readable memory: 0x000000000000000c | 0c 00 00 00 00 00 00 00
stack at sp + 5 slots: 0x0 is NULL
stack at sp + 6 slots: 0x0 is NULL
stack at sp + 7 slots: 0x00007fcaf882c608 points into unknown readable memory: 0x00007fcb73580350 | 50 03 58 73 cb 7f 00 00

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.