weblogic.platform.SunVM

Terracotta Project Issue Tracker | Sandeep Nare | 7 years ago
  1. 0

    Hi, We are using Quartz 1.6.1 on Weblogic 10 MP1 on Windows Server 2003. Quartz runs fine for certain time and then all of a sudden stops triggering any job. We are using Quartz in Cluster mode and the pattern is same on all Instances. Below is the thread dump taken from one of the instance. The same application runs on both Windows 2003 as well as Solaris 10. We are not facing any issue in Solaris 10. Appreciate any quick help as this issue is affecting the availability of the Application in Production. Also all my Weblogic threads are just idle waiting for Requests which will happen only after Quartz job gets fired. Full thread dump Java HotSpot(TM) Server VM (1.5.0_11-b03 mixed mode): "[ACTIVE] ExecuteThread: '10' for queue: 'weblogic.kernel.Default (self-tuning)'" daemon prio=6 tid=0x580c41b8 nid=0xab4 in Object.wait() [0x5f1af000..0x5f1afb1c] at java.lang.Object.wait(Native Method) - waiting on <0x152f6330> (a weblogic.work.ExecuteThread) at java.lang.Object.wait(Object.java:474) at weblogic.work.ExecuteThread.waitForRequest(ExecuteThread.java:156) - locked <0x152f6330> (a weblogic.work.ExecuteThread) at weblogic.work.ExecuteThread.run(ExecuteThread.java:177) "[ACTIVE] ExecuteThread: '9' for queue: 'weblogic.kernel.Default (self-tuning)'" daemon prio=6 tid=0x595f2bd8 nid=0x4a4 in Object.wait() [0x5f12f000..0x5f12fb9c] at java.lang.Object.wait(Native Method) - waiting on <0x157666c8> (a weblogic.work.ExecuteThread) at java.lang.Object.wait(Object.java:474) at weblogic.work.ExecuteThread.waitForRequest(ExecuteThread.java:156) - locked <0x157666c8> (a weblogic.work.ExecuteThread) at weblogic.work.ExecuteThread.run(ExecuteThread.java:177) "[ACTIVE] ExecuteThread: '8' for queue: 'weblogic.kernel.Default (self-tuning)'" daemon prio=6 tid=0x5fbee938 nid=0x5cc in Object.wait() [0x5f0af000..0x5f0afc1c] at java.lang.Object.wait(Native Method) - waiting on <0x15acc998> (a weblogic.work.ExecuteThread) at java.lang.Object.wait(Object.java:474) at weblogic.work.ExecuteThread.waitForRequest(ExecuteThread.java:156) - locked <0x15acc998> (a weblogic.work.ExecuteThread) at weblogic.work.ExecuteThread.run(ExecuteThread.java:177) "[ACTIVE] ExecuteThread: '7' for queue: 'weblogic.kernel.Default (self-tuning)'" daemon prio=6 tid=0x5976dda0 nid=0xe00 waiting on condition [0x5cc2f000..0x5cc2fc9c] at java.lang.Thread.sleep(Native Method) at weblogic.cluster.singleton.MigratableServerService.getSingletonMasterRemote(MigratableServerService.java:216) at weblogic.cluster.singleton.MigratableServerService.getSingletonMasterRemote(MigratableServerService.java:194) at weblogic.cluster.singleton.SingletonServicesBatchManager.timerExpired(SingletonServicesBatchManager.java:87) at weblogic.timers.internal.TimerImpl.run(TimerImpl.java:273) at weblogic.work.SelfTuningWorkManagerImpl$WorkAdapterImpl.run(SelfTuningWorkManagerImpl.java:464) at weblogic.work.ExecuteThread.execute(ExecuteThread.java:200) at weblogic.work.ExecuteThread.run(ExecuteThread.java:172) "Java2D Disposer" daemon prio=10 tid=0x580f6c80 nid=0xd50 in Object.wait() [0x5ccef000..0x5ccefa1c] at java.lang.Object.wait(Native Method) - waiting on <0x184d4d80> (a java.lang.ref.ReferenceQueue$Lock) at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:116) - locked <0x184d4d80> (a java.lang.ref.ReferenceQueue$Lock) at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:132) at sun.java2d.Disposer.run(Disposer.java:125) at java.lang.Thread.run(Thread.java:595) "AWT-Windows" daemon prio=6 tid=0x5a3b1438 nid=0xba4 runnable [0x5cc6f000..0x5cc6fa9c] at sun.awt.windows.WToolkit.eventLoop(Native Method) at sun.awt.windows.WToolkit.run(WToolkit.java:269) at java.lang.Thread.run(Thread.java:595) "QuartzScheduler_DbdocClusScheduler-fraitasp83991266467697529_MisfireHandler" prio=6 tid=0x58d2bfa8 nid=0xfbc waiting on condition [0x5c9af000..0x5c9afc1c] at java.lang.Thread.sleep(Native Method) at org.quartz.impl.jdbcjobstore.JobStoreSupport$MisfireHandler.run(JobStoreSupport.java:3878) "QuartzScheduler_DbdocClusScheduler-fraitasp83991266467697529_ClusterManager" prio=8 tid=0x5849bd80 nid=0xbf0 waiting on condition [0x5c92f000..0x5c92fb9c] at java.lang.Thread.sleep(Native Method) at org.quartz.impl.jdbcjobstore.JobStoreSupport$ClusterManager.run(JobStoreSupport.java:3793) "[STANDBY] ExecuteThread: '6' for queue: 'weblogic.kernel.Default (self-tuning)'" daemon prio=6 tid=0x58ec3958 nid=0x594 in Object.wait() [0x5c8af000..0x5c8afc9c] at java.lang.Object.wait(Native Method) - waiting on <0x16950b70> (a weblogic.work.ExecuteThread) at java.lang.Object.wait(Object.java:474) at weblogic.work.ExecuteThread.waitForRequest(ExecuteThread.java:156) - locked <0x16950b70> (a weblogic.work.ExecuteThread) at weblogic.work.ExecuteThread.run(ExecuteThread.java:177) "DbdocClusScheduler_QuartzSchedulerThread" prio=6 tid=0x57fac750 nid=0xe3c in Object.wait() [0x5c82f000..0x5c82fa1c] at java.lang.Object.wait(Native Method) - waiting on <0x169e1788> (a java.lang.Object) at org.quartz.core.QuartzSchedulerThread.run(QuartzSchedulerThread.java:432) - locked <0x169e1788> (a java.lang.Object) "DbdocClusScheduler_Worker-25" prio=6 tid=0x58182408 nid=0x6cc in Object.wait() [0x5c7af000..0x5c7afd9c] at java.lang.Object.wait(Native Method) - waiting on <0x168be980> (a org.quartz.simpl.SimpleThreadPool$WorkerThread) at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:519) - locked <0x168be980> (a org.quartz.simpl.SimpleThreadPool$WorkerThread) "DbdocClusScheduler_Worker-24" prio=6 tid=0x58682870 nid=0x119c in Object.wait() [0x5c72f000..0x5c72fb1c] at java.lang.Object.wait(Native Method) - waiting on <0x168c1640> (a org.quartz.simpl.SimpleThreadPool$WorkerThread) at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:519) - locked <0x168c1640> (a org.quartz.simpl.SimpleThreadPool$WorkerThread) "DbdocClusScheduler_Worker-23" prio=6 tid=0x5fc83e78 nid=0x11fc in Object.wait() [0x5c6af000..0x5c6afa1c] at java.lang.Object.wait(Native Method) - waiting on <0x168be9f0> (a org.quartz.simpl.SimpleThreadPool$WorkerThread) at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:519) - locked <0x168be9f0> (a org.quartz.simpl.SimpleThreadPool$WorkerThread) "DbdocClusScheduler_Worker-22" prio=6 tid=0x580e33f8 nid=0xc88 in Object.wait() [0x5c62f000..0x5c62fb9c] at java.lang.Object.wait(Native Method) - waiting on <0x168c16b0> (a org.quartz.simpl.SimpleThreadPool$WorkerThread) at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:519) - locked <0x168c16b0> (a org.quartz.simpl.SimpleThreadPool$WorkerThread) "DbdocClusScheduler_Worker-21" prio=6 tid=0x584f4de8 nid=0x98 in Object.wait() [0x5c5af000..0x5c5afa9c] at java.lang.Object.wait(Native Method) - waiting on <0x168bea60> (a org.quartz.simpl.SimpleThreadPool$WorkerThread) at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:519) - locked <0x168bea60> (a org.quartz.simpl.SimpleThreadPool$WorkerThread) "DbdocClusScheduler_Worker-20" prio=6 tid=0x564579a0 nid=0x1d0 in Object.wait() [0x5c52f000..0x5c52fc1c] at java.lang.Object.wait(Native Method) - waiting on <0x168c1720> (a org.quartz.simpl.SimpleThreadPool$WorkerThread) at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:519) - locked <0x168c1720> (a org.quartz.simpl.SimpleThreadPool$WorkerThread) "DbdocClusScheduler_Worker-19" prio=6 tid=0x58150480 nid=0x12c4 in Object.wait() [0x5c4af000..0x5c4afb1c] at java.lang.Object.wait(Native Method) - waiting on <0x168bead0> (a org.quartz.simpl.SimpleThreadPool$WorkerThread) at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:519) - locked <0x168bead0> (a org.quartz.simpl.SimpleThreadPool$WorkerThread) "DbdocClusScheduler_Worker-18" prio=6 tid=0x59d1de00 nid=0x98c in Object.wait() [0x5c42f000..0x5c42fc9c] at java.lang.Object.wait(Native Method) - waiting on <0x168c1790> (a org.quartz.simpl.SimpleThreadPool$WorkerThread) at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:519) - locked <0x168c1790> (a org.quartz.simpl.SimpleThreadPool$WorkerThread) "DbdocClusScheduler_Worker-17" prio=6 tid=0x59997408 nid=0xf78 in Object.wait() [0x5c3af000..0x5c3afb9c] at java.lang.Object.wait(Native Method) - waiting on <0x168beb40> (a org.quartz.simpl.SimpleThreadPool$WorkerThread) at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:519) - locked <0x168beb40> (a org.quartz.simpl.SimpleThreadPool$WorkerThread) "DbdocClusScheduler_Worker-16" prio=6 tid=0x5944bad0 nid=0x7ec in Object.wait() [0x5c32f000..0x5c32fd1c] at java.lang.Object.wait(Native Method) - waiting on <0x168c1800> (a org.quartz.simpl.SimpleThreadPool$WorkerThread) at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:519) - locked <0x168c1800> (a org.quartz.simpl.SimpleThreadPool$WorkerThread) "DbdocClusScheduler_Worker-15" prio=6 tid=0x582da408 nid=0x610 in Object.wait() [0x5c2af000..0x5c2afc1c] at java.lang.Object.wait(Native Method) - waiting on <0x168bebb0> (a org.quartz.simpl.SimpleThreadPool$WorkerThread) at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:519) - locked <0x168bebb0> (a org.quartz.simpl.SimpleThreadPool$WorkerThread) "DbdocClusScheduler_Worker-14" prio=6 tid=0x58590e38 nid=0xb80 in Object.wait() [0x5c22f000..0x5c22fd9c] at java.lang.Object.wait(Native Method) - waiting on <0x168c1870> (a org.quartz.simpl.SimpleThreadPool$WorkerThread) at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:519) - locked <0x168c1870> (a org.quartz.simpl.SimpleThreadPool$WorkerThread) "DbdocClusScheduler_Worker-13" prio=6 tid=0x59036ae0 nid=0x11d4 in Object.wait() [0x5c1af000..0x5c1afc9c] at java.lang.Object.wait(Native Method) - waiting on <0x168bec20> (a org.quartz.simpl.SimpleThreadPool$WorkerThread) at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:519) - locked <0x168bec20> (a org.quartz.simpl.SimpleThreadPool$WorkerThread) "DbdocClusScheduler_Worker-12" prio=6 tid=0x5fb44960 nid=0xc38 in Object.wait() [0x5c12f000..0x5c12fa1c] at java.lang.Object.wait(Native Method) - waiting on <0x168c18e0> (a org.quartz.simpl.SimpleThreadPool$WorkerThread) at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:519) - locked <0x168c18e0> (a org.quartz.simpl.SimpleThreadPool$WorkerThread) "DbdocClusScheduler_Worker-11" prio=6 tid=0x59625408 nid=0x1184 in Object.wait() [0x5c0af000..0x5c0afd1c] at java.lang.Object.wait(Native Method) - waiting on <0x168bec90> (a org.quartz.simpl.SimpleThreadPool$WorkerThread) at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:519) - locked <0x168bec90> (a org.quartz.simpl.SimpleThreadPool$WorkerThread) "DbdocClusScheduler_Worker-10" prio=6 tid=0x5999f408 nid=0x1304 in Object.wait() [0x5c02f000..0x5c02fa9c] at java.lang.Object.wait(Native Method) - waiting on <0x168c1950> (a org.quartz.simpl.SimpleThreadPool$WorkerThread) at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:519) - locked <0x168c1950> (a org.quartz.simpl.SimpleThreadPool$WorkerThread) "DbdocClusScheduler_Worker-9" prio=6 tid=0x59431b80 nid=0xf8 in Object.wait() [0x5bfaf000..0x5bfafd9c] at java.lang.Object.wait(Native Method) - waiting on <0x168bed00> (a org.quartz.simpl.SimpleThreadPool$WorkerThread) at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:519) - locked <0x168bed00> (a org.quartz.simpl.SimpleThreadPool$WorkerThread) "DbdocClusScheduler_Worker-8" prio=6 tid=0x59ebd008 nid=0x1238 in Object.wait() [0x5bf2f000..0x5bf2fc1c] at java.lang.Object.wait(Native Method) - waiting on <0x168c19c0> (a org.quartz.simpl.SimpleThreadPool$WorkerThread) at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:519) - locked <0x168c19c0> (a org.quartz.simpl.SimpleThreadPool$WorkerThread) "DbdocClusScheduler_Worker-7" prio=6 tid=0x57d7b938 nid=0x7c4 in Object.wait() [0x5beaf000..0x5beafd1c] at java.lang.Object.wait(Native Method) - waiting on <0x168bed70> (a org.quartz.simpl.SimpleThreadPool$WorkerThread) at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:519) - locked <0x168bed70> (a org.quartz.simpl.SimpleThreadPool$WorkerThread) "DbdocClusScheduler_Worker-6" prio=6 tid=0x59689dd0 nid=0x1298 in Object.wait() [0x5be2f000..0x5be2fc9c] at java.lang.Object.wait(Native Method) - waiting on <0x168c1a30> (a org.quartz.simpl.SimpleThreadPool$WorkerThread) at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:519) - locked <0x168c1a30> (a org.quartz.simpl.SimpleThreadPool$WorkerThread) "DbdocClusScheduler_Worker-5" prio=6 tid=0x598a4008 nid=0xe1c in Object.wait() [0x5bdaf000..0x5bdafa9c] at java.lang.Object.wait(Native Method) - waiting on <0x168bede0> (a org.quartz.simpl.SimpleThreadPool$WorkerThread) at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:519) - locked <0x168bede0> (a org.quartz.simpl.SimpleThreadPool$WorkerThread) "DbdocClusScheduler_Worker-4" prio=6 tid=0x5a575e40 nid=0xf0c in Object.wait() [0x5bd2f000..0x5bd2fd1c] at java.lang.Object.wait(Native Method) - waiting on <0x168c1aa0> (a org.quartz.simpl.SimpleThreadPool$WorkerThread) at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:519) - locked <0x168c1aa0> (a org.quartz.simpl.SimpleThreadPool$WorkerThread) "DbdocClusScheduler_Worker-3" prio=6 tid=0x59e75e78 nid=0x13bc in Object.wait() [0x5bcaf000..0x5bcafb1c] at java.lang.Object.wait(Native Method) - waiting on <0x168bee50> (a org.quartz.simpl.SimpleThreadPool$WorkerThread) at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:519) - locked <0x168bee50> (a org.quartz.simpl.SimpleThreadPool$WorkerThread) "DbdocClusScheduler_Worker-2" prio=6 tid=0x59338e78 nid=0xf34 in Object.wait() [0x5bc2f000..0x5bc2fd9c] at java.lang.Object.wait(Native Method) - waiting on <0x168c1b10> (a org.quartz.simpl.SimpleThreadPool$WorkerThread) at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:519) - locked <0x168c1b10> (a org.quartz.simpl.SimpleThreadPool$WorkerThread) "DbdocClusScheduler_Worker-1" prio=6 tid=0x57e1fe08 nid=0x738 in Object.wait() [0x5bb2f000..0x5bb2fb9c] at java.lang.Object.wait(Native Method) - waiting on <0x168beec0> (a org.quartz.simpl.SimpleThreadPool$WorkerThread) at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:519) - locked <0x168beec0> (a org.quartz.simpl.SimpleThreadPool$WorkerThread) "[ACTIVE] ExecuteThread: '5' for queue: 'weblogic.kernel.Default (self-tuning)'" daemon prio=6 tid=0x57f9cdb8 nid=0x1318 in Object.wait() [0x5baaf000..0x5baafa1c] at java.lang.Object.wait(Native Method) - waiting on <0x161bccb0> (a weblogic.work.ExecuteThread) at java.lang.Object.wait(Object.java:474) at weblogic.work.ExecuteThread.waitForRequest(ExecuteThread.java:156) - locked <0x161bccb0> (a weblogic.work.ExecuteThread) at weblogic.work.ExecuteThread.run(ExecuteThread.java:177) "DynamicListenThread[Default]" daemon prio=10 tid=0x5828be28 nid=0xc74 runnable [0x5ba2f000..0x5ba2fa9c] at java.net.PlainSocketImpl.socketAccept(Native Method) at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:384) - locked <0x15ed6ac0> (a java.net.SocksSocketImpl) at java.net.ServerSocket.implAccept(ServerSocket.java:450) at java.net.ServerSocket.accept(ServerSocket.java:421) at weblogic.socket.WeblogicServerSocket.accept(WeblogicServerSocket.java:38) at weblogic.server.channels.DynamicListenThread$SocketAccepter.accept(DynamicListenThread.java:523) at weblogic.server.channels.DynamicListenThread$SocketAccepter.access$200(DynamicListenThread.java:420) at weblogic.server.channels.DynamicListenThread.run(DynamicListenThread.java:166) at java.lang.Thread.run(Thread.java:595) "weblogic.GCMonitor" daemon prio=6 tid=0x58d02d88 nid=0x10e0 in Object.wait() [0x5b9af000..0x5b9afb1c] at java.lang.Object.wait(Native Method) - waiting on <0x16202db8> (a java.lang.ref.ReferenceQueue$Lock) at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:116) - locked <0x16202db8> (a java.lang.ref.ReferenceQueue$Lock) at weblogic.platform.GCMonitorThread.waitForNotification(GCMonitorThread.java:88) at weblogic.platform.GCMonitorThread.run(GCMonitorThread.java:64) "weblogic.cluster.MessageReceiver" daemon prio=6 tid=0x595c1008 nid=0x103c runnable [0x5bb6f000..0x5bb6fb9c] at java.net.PlainDatagramSocketImpl.receive0(Native Method) - locked <0x161da5b8> (a java.net.PlainDatagramSocketImpl) at java.net.PlainDatagramSocketImpl.receive(PlainDatagramSocketImpl.java:136) - locked <0x161da5b8> (a java.net.PlainDatagramSocketImpl) at java.net.DatagramSocket.receive(DatagramSocket.java:712) - locked <0x0de7d7b8> (a java.net.DatagramPacket) - locked <0x16202538> (a java.net.MulticastSocket) at weblogic.cluster.MulticastFragmentSocket.receive(MulticastFragmentSocket.java:211) at weblogic.cluster.FragmentSocketWrapper.receive(FragmentSocketWrapper.java:98) at weblogic.cluster.MulticastManager.run(MulticastManager.java:405) at java.lang.Thread.run(Thread.java:595) "LDAPConnThread-0 ldap://10.228.146.7:7320" daemon prio=6 tid=0x58413008 nid=0x11dc runnable [0x5b92f000..0x5b92fc1c] at java.net.SocketInputStream.socketRead0(Native Method) at java.net.SocketInputStream.read(SocketInputStream.java:129) at java.io.BufferedInputStream.fill(BufferedInputStream.java:218) at java.io.BufferedInputStream.read(BufferedInputStream.java:235) - locked <0x1539bd40> (a java.io.BufferedInputStream) at netscape.ldap.ber.stream.BERElement.getElement(Unknown Source) at netscape.ldap.LDAPConnThread.run(Unknown Source) at java.lang.Thread.run(Thread.java:595) "Thread-12" daemon prio=6 tid=0x572a1780 nid=0xc64 waiting on condition [0x5b7ef000..0x5b7efc9c] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:118) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1767) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:359) at weblogic.utils.concurrent.JDK15ConcurrentBlockingQueue.take(JDK15ConcurrentBlockingQueue.java:89) at weblogic.store.internal.PersistentStoreImpl.getOutstandingWork(PersistentStoreImpl.java:562) at weblogic.store.internal.PersistentStoreImpl.run(PersistentStoreImpl.java:610) at weblogic.store.internal.PersistentStoreImpl$2.run(PersistentStoreImpl.java:378) "[STANDBY] ExecuteThread: '4' for queue: 'weblogic.kernel.Default (self-tuning)'" daemon prio=6 tid=0x59c68e48 nid=0xef4 in Object.wait() [0x5b76f000..0x5b76fd1c] at java.lang.Object.wait(Native Method) - waiting on <0x147bae70> (a weblogic.work.ExecuteThread) at java.lang.Object.wait(Object.java:474) at weblogic.work.ExecuteThread.waitForRequest(ExecuteThread.java:156) - locked <0x147bae70> (a weblogic.work.ExecuteThread) at weblogic.work.ExecuteThread.run(ExecuteThread.java:177) "[ACTIVE] ExecuteThread: '3' for queue: 'weblogic.kernel.Default (self-tuning)'" daemon prio=6 tid=0x57d0faf0 nid=0xcd0 runnable [0x5b6ef000..0x5b6efa1c] at weblogic.platform.SunVM.threadDump0(Native Method) - waiting to lock <0x1495c068> (a weblogic.platform.SunVM) at weblogic.platform.SunVM.threadDump(SunVM.java:94) at weblogic.common.internal.AdminProxy.execute(AdminProxy.java:204) at weblogic.t3.srvr.ClientRequest$1.run(ClientContext.java:711) at weblogic.security.acl.internal.AuthenticatedSubject.doAs(AuthenticatedSubject.java:363) at weblogic.security.service.SecurityManager.runAs(Unknown Source) at weblogic.t3.srvr.ClientRequest.run(ClientContext.java:708) at weblogic.work.SelfTuningWorkManagerImpl$WorkAdapterImpl.run(SelfTuningWorkManagerImpl.java:464) at weblogic.work.ExecuteThread.execute(ExecuteThread.java:200) at weblogic.work.ExecuteThread.run(ExecuteThread.java:172) "[ACTIVE] ExecuteThread: '2' for queue: 'weblogic.kernel.Default (self-tuning)'" daemon prio=6 tid=0x58c27170 nid=0x844 in Object.wait() [0x5b66f000..0x5b66fd9c] at java.lang.Object.wait(Native Method) - waiting on <0x147bb260> (a weblogic.work.ExecuteThread) at java.lang.Object.wait(Object.java:474) at weblogic.work.ExecuteThread.waitForRequest(ExecuteThread.java:156) - locked <0x147bb260> (a weblogic.work.ExecuteThread) at weblogic.work.ExecuteThread.run(ExecuteThread.java:177) "Thread-11" daemon prio=6 tid=0x5a321e08 nid=0x128c waiting on condition [0x5b8af000..0x5b8afa9c] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:118) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1767) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:359) at weblogic.utils.concurrent.JDK15ConcurrentBlockingQueue.take(JDK15ConcurrentBlockingQueue.java:89) at weblogic.store.internal.PersistentStoreImpl.getOutstandingWork(PersistentStoreImpl.java:562) at weblogic.store.internal.PersistentStoreImpl.run(PersistentStoreImpl.java:610) at weblogic.store.internal.PersistentStoreImpl$2.run(PersistentStoreImpl.java:378) "DoSManager" daemon prio=6 tid=0x59c69d38 nid=0x13e0 waiting on condition [0x5b34f000..0x5b34fb1c] at java.lang.Thread.sleep(Native Method) at com.octetstring.vde.DoSManager.run(DoSManager.java:433) "VDE Transaction Processor Thread" daemon prio=2 tid=0x59376ad0 nid=0xff4 in Object.wait() [0x5b24f000..0x5b24fc1c] at java.lang.Object.wait(Native Method) - waiting on <0x14059ad8> (a com.octetstring.vde.backend.standard.TransactionProcessor) at java.lang.Object.wait(Object.java:474) at com.octetstring.vde.backend.standard.TransactionProcessor.waitChange(TransactionProcessor.java:367) - locked <0x14059ad8> (a com.octetstring.vde.backend.standard.TransactionProcessor) at com.octetstring.vde.backend.standard.TransactionProcessor.run(TransactionProcessor.java:212) "ExecuteThread: '2' for queue: 'weblogic.socket.Muxer'" daemon prio=6 tid=0x58bcfde0 nid=0x1168 runnable [0x5b1cf000..0x5b1cfc9c] at weblogic.socket.NTSocketMuxer.getIoCompletionResult(Native Method) at weblogic.socket.NTSocketMuxer.processSockets(NTSocketMuxer.java:81) at weblogic.socket.SocketReaderRequest.run(SocketReaderRequest.java:29) at weblogic.socket.SocketReaderRequest.execute(SocketReaderRequest.java:42) at weblogic.kernel.ExecuteThread.execute(ExecuteThread.java:145) at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:117) "ExecuteThread: '1' for queue: 'weblogic.socket.Muxer'" daemon prio=6 tid=0x58edbbf0 nid=0x1230 runnable [0x5b14f000..0x5b14fd1c] at weblogic.socket.NTSocketMuxer.getIoCompletionResult(Native Method) at weblogic.socket.NTSocketMuxer.processSockets(NTSocketMuxer.java:81) at weblogic.socket.SocketReaderRequest.run(SocketReaderRequest.java:29) at weblogic.socket.SocketReaderRequest.execute(SocketReaderRequest.java:42) at weblogic.kernel.ExecuteThread.execute(ExecuteThread.java:145) at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:117) "ExecuteThread: '0' for queue: 'weblogic.socket.Muxer'" daemon prio=6 tid=0x596ab3c0 nid=0x1144 runnable [0x5b0cf000..0x5b0cfd9c] at weblogic.socket.NTSocketMuxer.getIoCompletionResult(Native Method) at weblogic.socket.NTSocketMuxer.processSockets(NTSocketMuxer.java:81) at weblogic.socket.SocketReaderRequest.run(SocketReaderRequest.java:29) at weblogic.socket.SocketReaderRequest.execute(SocketReaderRequest.java:42) at weblogic.kernel.ExecuteThread.execute(ExecuteThread.java:145) at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:117) "[STANDBY] ExecuteThread: '1' for queue: 'weblogic.kernel.Default (self-tuning)'" daemon prio=6 tid=0x58f4de28 nid=0x13c8 in Object.wait() [0x5b04f000..0x5b04fa1c] at java.lang.Object.wait(Native Method) - waiting on <0x13d60600> (a weblogic.work.ExecuteThread) at java.lang.Object.wait(Object.java:474) at weblogic.work.ExecuteThread.waitForRequest(ExecuteThread.java:156) - locked <0x13d60600> (a weblogic.work.ExecuteThread) at weblogic.work.ExecuteThread.run(ExecuteThread.java:177) "Thread-7" daemon prio=6 tid=0x57e22ce0 nid=0xec8 waiting on condition [0x5afcf000..0x5afcfa9c] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:118) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1767) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:359) at weblogic.utils.concurrent.JDK15ConcurrentBlockingQueue.take(JDK15ConcurrentBlockingQueue.java:89) at weblogic.store.internal.PersistentStoreImpl.getOutstandingWork(PersistentStoreImpl.java:562) at weblogic.store.internal.PersistentStoreImpl.run(PersistentStoreImpl.java:610) at weblogic.store.internal.PersistentStoreImpl$2.run(PersistentStoreImpl.java:378) "weblogic.timers.TimerThread" daemon prio=10 tid=0x564e1568 nid=0x7c0 in Object.wait() [0x5abff000..0x5abffb1c] at java.lang.Object.wait(Native Method) - waiting on <0x13a81140> (a weblogic.timers.internal.TimerThread) at weblogic.timers.internal.TimerThread$Thread.run(TimerThread.java:265) - locked <0x13a81140> (a weblogic.timers.internal.TimerThread) "weblogic.time.TimeEventGenerator" daemon prio=10 tid=0x57e5f0f0 nid=0x11c0 in Object.wait() [0x5ab7f000..0x5ab7fb9c] at java.lang.Object.wait(Native Method) - waiting on <0x140b7d48> (a weblogic.time.common.internal.TimeTable) at weblogic.time.common.internal.TimeTable.snooze(TimeTable.java:286) - locked <0x140b7d48> (a weblogic.time.common.internal.TimeTable) at weblogic.time.common.internal.TimeEventGenerator.run(TimeEventGenerator.java:117) at java.lang.Thread.run(Thread.java:595) "[ACTIVE] ExecuteThread: '0' for queue: 'weblogic.kernel.Default (self-tuning)'" daemon prio=6 tid=0x59576d60 nid=0x1100 in Object.wait() [0x5ad4f000..0x5ad4fc1c] at java.lang.Object.wait(Native Method) - waiting on <0x13d607f8> (a weblogic.work.ExecuteThread) at java.lang.Object.wait(Object.java:474) at weblogic.work.ExecuteThread.waitForRequest(ExecuteThread.java:156) - locked <0x13d607f8> (a weblogic.work.ExecuteThread) at weblogic.work.ExecuteThread.run(ExecuteThread.java:177) "Timer-1" daemon prio=6 tid=0x5937ed88 nid=0xa0c in Object.wait() [0x5accf000..0x5accfc9c] at java.lang.Object.wait(Native Method) - waiting on <0x141833a0> (a java.util.TaskQueue) at java.util.TimerThread.mainLoop(Timer.java:509) - locked <0x141833a0> (a java.util.TaskQueue) at java.util.TimerThread.run(Timer.java:462) "Timer-0" daemon prio=6 tid=0x57f90698 nid=0x9e4 in Object.wait() [0x56d9f000..0x56d9fd1c] at java.lang.Object.wait(Native Method) - waiting on <0x141833e0> (a java.util.TaskQueue) at java.util.TimerThread.mainLoop(Timer.java:509) - locked <0x141833e0> (a java.util.TaskQueue) at java.util.TimerThread.run(Timer.java:462) Thanks & Regards, Sandeep Nare

    Terracotta Project Issue Tracker | 7 years ago | Sandeep Nare
    weblogic.platform.SunVM

    Root Cause Analysis

    1. weblogic.platform.SunVM

      No message provided

      at weblogic.platform.SunVM.threadDump()
    2. weblogic.platform
      SunVM.threadDump
      1. weblogic.platform.SunVM.threadDump(SunVM.java:94)
      1 frame
    3. weblogic.common.internal
      AdminProxy.execute
      1. weblogic.common.internal.AdminProxy.execute(AdminProxy.java:204)
      1 frame
    4. weblogic.t3.srvr
      ClientRequest$1.run
      1. weblogic.t3.srvr.ClientRequest$1.run(ClientContext.java:711)
      1 frame
    5. weblogic.security.acl
      AuthenticatedSubject.doAs
      1. weblogic.security.acl.internal.AuthenticatedSubject.doAs(AuthenticatedSubject.java:363)
      1 frame
    6. weblogic.security.service
      SecurityManager.runAs
      1. weblogic.security.service.SecurityManager.runAs(Unknown Source)
      1 frame
    7. weblogic.t3.srvr
      ClientRequest.run
      1. weblogic.t3.srvr.ClientRequest.run(ClientContext.java:708)
      1 frame
    8. weblogic.work
      ExecuteThread.run
      1. weblogic.work.SelfTuningWorkManagerImpl$WorkAdapterImpl.run(SelfTuningWorkManagerImpl.java:464)
      2. weblogic.work.ExecuteThread.execute(ExecuteThread.java:200)
      3. weblogic.work.ExecuteThread.run(ExecuteThread.java:172)
      3 frames