azkaban.scheduler.ScheduleManager

JIRA | Wayne Zhu | 5 years ago
  1. 0

    The issue is verified via google group discussion. (http://groups.google.com/group/azkaban-dev/browse_thread/thread/e2783795c40f0f4f) Found one Java-level deadlock: ============================= "http-8080-30": waiting to lock monitor 0x00002aab142789c0 (object 0x00002aaab4f2f750, a azkaban.scheduler.ScheduleManager), which is held by "http-8080-4" "http-8080-4": waiting to lock monitor 0x0000000052992370 (object 0x00002aaab4ddaa28, a azkaban.scheduler.ScheduleManager$ScheduleRunner), which is held by "Thread-3" "Thread-3": waiting to lock monitor 0x00002aab142789c0 (object 0x00002aaab4f2f750, a azkaban.scheduler.ScheduleManager), which is held by "http-8080-4" Java stack information for the threads listed above: =================================================== "http-8080-30": at azkaban.scheduler.ScheduleManager.getSchedule(ScheduleManager.java:72) - waiting to lock <0x00002aaab4f2f750> (a azkaban.scheduler.ScheduleManager) at azkaban.web.pages.IndexServlet.doGet(IndexServlet.java:80) at javax.servlet.http.HttpServlet.service(HttpServlet.java:617) at javax.servlet.http.HttpServlet.service(HttpServlet.java:717) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:290) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206) at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233) at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191) at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127) at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102) at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109) at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:298) at org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:859) at org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:588) at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:489) at java.lang.Thread.run(Thread.java:619) "http-8080-4": at azkaban.scheduler.ScheduleManager$ScheduleRunner.getSchedule(ScheduleManager.java:179) - waiting to lock <0x00002aaab4ddaa28> (a azkaban.scheduler.ScheduleManager$ScheduleRunner) at azkaban.scheduler.ScheduleManager.getSchedule(ScheduleManager.java:72) - locked <0x00002aaab4f2f750> (a azkaban.scheduler.ScheduleManager) at azkaban.web.pages.IndexServlet.doGet(IndexServlet.java:80) at javax.servlet.http.HttpServlet.service(HttpServlet.java:617) at javax.servlet.http.HttpServlet.service(HttpServlet.java:717) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:290) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206) at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233) at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191) at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127) at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102) at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109) at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:298) at org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:859) at org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:588) at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:489) at java.lang.Thread.run(Thread.java:619) "Thread-3": at azkaban.scheduler.ScheduleManager.getSchedule(ScheduleManager.java:72) - waiting to lock <0x00002aaab4f2f750> (a azkaban.scheduler.ScheduleManager) at azkaban.scheduler.ScheduleManager.saveSchedule(ScheduleManager.java:147) at azkaban.scheduler.ScheduleManager.access$300(ScheduleManager.java:29) at azkaban.scheduler.ScheduleManager$ScheduleRunner.run(ScheduleManager.java:236) - locked <0x00002aaab4ddaa28> (a azkaban.scheduler.ScheduleManager$ScheduleRunner) Found 1 deadlock.

    JIRA | 5 years ago | Wayne Zhu
    azkaban.scheduler.ScheduleManager

    Root Cause Analysis

    1. azkaban.scheduler.ScheduleManager

      No message provided

      at azkaban.web.pages.IndexServlet.doGet()
    2. azkaban.web.pages
      IndexServlet.doGet
      1. azkaban.web.pages.IndexServlet.doGet(IndexServlet.java:80)
      1 frame
    3. JavaServlet
      HttpServlet.service
      1. javax.servlet.http.HttpServlet.service(HttpServlet.java:617)
      2. javax.servlet.http.HttpServlet.service(HttpServlet.java:717)
      2 frames
    4. Glassfish Core
      CoyoteAdapter.service
      1. org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:290)
      2. org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
      3. org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233)
      4. org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191)
      5. org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127)
      6. org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102)
      7. org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109)
      8. org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:298)
      8 frames
    5. Grizzly HTTP
      JIoEndpoint$Worker.run
      1. org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:859)
      2. org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:588)
      3. org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:489)
      3 frames
    6. Java RT
      Thread.run
      1. java.lang.Thread.run(Thread.java:619)
      1 frame