Lotus.BlueGeek.fr :: More on JVM crashing Domino

Category domino jvm crash
Hi all,

i'm back on my long problem about the JVM crashing the server (http://lotus.bluegeek.fr/web/bluegeek.nsf/d6plinks/BMAI-7PDE76)

I decided to reinstall windows server 2003 R2 +SP2 and then domino 8.5.1 +LP FR.

so i retested to enable JVM and boot domino and...crash !

as always: few informations on the nsd log, but one time i got this:

############################################################ ### FATAL THREAD 1/9 [ nhttp: 0734: 0744] ### FP=0x0013a300, PC=0x0826ffff, SP=0x00187390 ### stkbase=00190000, total stksize=1048576, used stksize=35952 ### EAX=0x10068550, EBX=0x00000025, ECX=0x5a208005, EDX=0x10068550 ### ESI=0x0815002d, EDI=0x1016d15c, CS=0x0000001b, SS=0x00000023 ### DS=0x00000023, ES=0x00000023, FS=0x0000003b, GS=0x00000000 Flags=0x00210282 Exception code: c0000005 (ACCESS_VIOLATION) ############################################################ ############################################################ ### PASS 2 : FATAL THREAD with STACK FRAMES 1/9 [ nhttp: 0734: 0744] ### FP=0013a300, PC=0826ffff, SP=00187390 ### stkbase=00190000, total stksize=1048576, used stksize=35952 Exception code: c0000005 (ACCESS_VIOLATION) ############################################################

Ok, an access violation, but where, with which software ?

Even IBM support does not found.

so i googled all taht again to find that my server (dedibox V1) run on a Via C7 processor with padlock.

I found something interesting when i've tried to start the server with the controller and the java console.

the server did not start, but three new files appeared in the data diretory.

One of this file (javacore.xxxxxxx....txt) contain that:

2XHCPUS Processors -
3XHCPUARCH Architecture : x86
3XHNUMCPUS How Many : 1
3XHNUMASUP NUMA is either not supported or has been disabled by user

what is NUMA ?

well, google answer me that is the Non Uniform Memory Access and that is a part of AMD multi core processors.
Nothing to do with me as the C7 has one core.

digging more deeply, i ended to find that: http://www-01.ibm.com/support/docview.wss?uid=swg21267793

where the article talk about the fact that on some hardware where numa is enabled, domino could crash and that we need to enable the /usepmtimer on the boot.ini of windows to use the he Windows operating system to use the PM_TIMER, rather than the Time Stamp Counter.

I was just wondering what's the impact on my domino server date if i try this option ?

Comments

1 - JVM crashing on nhttp can normally mean an agent or java code in a design element is related.

The most common cause is the improper use of recycle(). Bu this is not a given without further analysis.

I would have to see the whole crash stack to even take a guess at what might be the issue.

This is the TN on generating the related logs.

{ Link }

Then search for:

".Mapped To: PThread [ nhttp: 0734: 0744]"
(change the numbers to the stack that is failing).

This can tell you normally what the database and agent/form was being accessed at the time of the crash.

That in conjunction of the crash stack can point sometimes to the exact area of the code. Most of the time it is putting in debug statements though.

Posted by Simon O'Doherty At 03:03:42 On 21/11/2009 | - Website - |

2 - Hi

I have been running small Domino servers on Via C7 proccessors for years. At some point I tried to upgrade to release 8 and the installer would always crash (Linux) or the HTTP task would immediately crash the server (Windows).

To make a long story short, Domino 8.x.x (even 7.0.4 it seems) does NOT run on a Via C7 processor.

brds
Jesper Kiaer
{ Link }

Have a look at my entry in notes 8 forum

{ Link }

Posted by Jesper Kiær At 14:16:11 On 21/11/2009 | - Website - |

3 - IBM level 2 does not found where can be the problem.

They send the baby to an upper level.

Here, i tested to copy the domino installation to my own computer (XP on core2duo).

when i started domino, all went fine.

So the processor problem may be real.

Like when you switch from xp to vista, you need a new computer, now, when you upgrade your domino, you need a new server ?

Posted by benoît At 16:42:04 On 24/11/2009 | - Website - |

4 - The problem is still here.

The support did some tries on the server (thanks VNC) but found nothing.

they tested a 8.5.1 FR domino with just 1GB memory like my server and it was running fine.

they said that the Via C7 is a supported processor and that it does work with domino.

So i tested the hardware once more and everything is fine (memory ok, hard drive ok,...)

So no solution to this problem at all.

Posted by benoît At 13:44:32 On 25/01/2010 | - Website - |

5 - Ok, funny try last week:

i installed a vmware server 2 on this computer, then installed a test windows 2003 server and a domino 8.5.1 fr on it.

the guest system was only 512 MB ram but run afterall.

the funny part is that the domino crashed as soon as i enable JVM and launched http.

even a fresh domino installation crashed.

I send the vm image to ibm support but they will use it on a real esx server i imagine, so it will run well.

next step: obtain more budget to change the server.

Posted by benoit At 00:20:23 On 03/02/2010 | - Website - |

6 - Hi all.

The server is now running well on a vmware server. (ubuntu + vmware +2003 server +domino)

a pretty ugly configuration that is working well (a bit slow...)

more details on an upcoming post.

Posted by benoit At 00:37:22 On 23/03/2010 | - Website - |