Jenkins JIRA | Oleg Nenashev | 3 years ago
  1. 0

    Jenkins had stopped responding to browser requests for Jenkins pages and I think it may be caused by the recent upgrade to Throttle Concurrent Builds 1.8.1 Requests were getting blocked waiting on 0x00000004181e4520 {code} "Handling GET /jenkins/ : RequestHandlerThread[#171]" daemon prio=10 tid=0x00000000168ee800 nid=0x193b waiting for monitor entry [0x000000004335b000] java.lang.Thread.State: BLOCKED (on object monitor) at hudson.model.Queue.getItems( - waiting to lock <0x00000004181e4520> (a hudson.model.Queue) at hudson.model.Queue$CachedItemList.get( at hudson.model.Queue.getApproximateItemsQuickly( at hudson.model.View.getApproximateQueueItemsQuickly( at sun.reflect.GeneratedMethodAccessor355.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke( {code} This seems to be waiting on Throttle Concurrent Builds code. Further dumps after 10 minutes, 20 minutes and 30 minutes showed this same stack trace. {code} "Thread-126" daemon prio=10 tid=0x00002aaae0529800 nid=0x1785 runnable [0x0000000046590000] java.lang.Thread.State: RUNNABLE at java.util.WeakHashMap$HashIterator.hasNext( at java.util.AbstractCollection.toArray( at java.util.ArrayList.<init>( at hudson.plugins.throttleconcurrents.ThrottleJobProperty.getCategoryProjects( - locked <0x000000041a79b778> (a java.util.HashMap) at hudson.plugins.throttleconcurrents.ThrottleQueueTaskDispatcher.canRun( at hudson.plugins.throttleconcurrents.ThrottleQueueTaskDispatcher.canRun( at hudson.model.Queue.isBuildBlocked( at hudson.model.Queue.maintain( - locked <0x00000004181e4520> (a hudson.model.Queue) at hudson.model.Queue$ at hudson.model.Queue$ at jenkins.util.AtmostOneTaskExecutor$ at at hudson.remoting.AtmostOneThreadExecutor$ at Locked ownable synchronizers: - None {code} CPU usage was at ~100% for this thread for the 30 minutes that I was watching it before I restarted Jenkins. (6021 = 0x1785) {code} PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND 6021 rcbuild_ 35 10 18.0g 6.2g 32m R 99.7 19.7 30:45.97 java {code} I have rolled back to Throttle Concurrent Builds 1.8 for now. Still learning how to investigate thread dumps but please let me know if there is anything I can do to help.

    Jenkins JIRA | 3 years ago | Geoff Cummings
  2. Speed up your debug routine!

    Automated exception search integrated into your IDE

Root Cause Analysis

  1. hudson.model.Queue

    No message provided

    at hudson.model.Queue$CachedItemList.get()
  2. Hudson
    1. hudson.model.Queue$CachedItemList.get(
    2. hudson.model.Queue.getApproximateItemsQuickly(
    3. hudson.model.View.getApproximateQueueItemsQuickly(
    3 frames
  3. Java RT
    1. sun.reflect.GeneratedMethodAccessor248.invoke(Unknown Source)
    1 frame