com.sleepycat.util.RuntimeExceptionWrapper: (JE 3.2.44) Can't open a cursor Database state can't be DbState.CLOSED must be DbState.OPEN

JIRA | Paul Jack | 9 years ago
tip
Click on the to mark the solution that helps you, Samebug will learn from it.
As a community member, you’ll be rewarded for you help.
  1. 0

    Running a largish crawl (10K seeds) using basic-seed-sites for a few seconds, then hit "Terminate". ToeThreads continue to process while final reports are generated: Nov 15, 2007 7:04:42 PM org.archive.modules.fetcher.FetchHTTP innerProcess INFO: GET http://www.ciia.org/robots.txt 200 411 text/plain Nov 15, 2007 7:04:42 PM org.archive.modules.fetcher.FetchHTTP innerProcess INFO: GET http://www.warchild.ca/robots.txt 404 1315 text/html Nov 15, 2007 7:04:42 PM org.archive.crawler.framework.StatisticsTracker writeReportFile INFO: wrote report: /home/pjack/Projects/builds_heritrix/jobs/active-basic_seed_sites-20071115190415/./frontier-report.txt Nov 15, 2007 7:04:42 PM org.archive.modules.fetcher.FetchHTTP innerProcess INFO: GET http://www.economia.cl/robots.txt 404 398 text/html; charset=iso-8859-1 Also the ToeThreads continue to process URIs even after everything is shut down: Nov 15, 2007 7:04:43 PM org.archive.modules.fetcher.FetchHTTP innerProcess INFO: GET http://www.presidencia.gub.uy/robots.txt 404 4184 text/html Nov 15, 2007 7:04:43 PM org.archive.crawler.framework.ToeThread run SEVERE: Fatal exception in ToeThread #9: http://www.minag.gob.pe/robots.txt com.sleepycat.util.RuntimeExceptionWrapper: (JE 3.2.44) Can't open a cursor Database state can't be DbState.CLOSED must be DbState.OPEN at com.sleepycat.collections.StoredContainer.convertException(StoredContainer.java:447) at com.sleepycat.collections.StoredCollection.getFirstOrLast(StoredCollection.java:550) at com.sleepycat.collections.StoredSortedKeySet.last(StoredSortedKeySet.java:106) at org.archive.settings.file.PrefixFinder.last(PrefixFinder.java:91) at org.archive.settings.file.PrefixFinder.find(PrefixFinder.java:63) at org.archive.settings.file.FileSheetManager.findConfig(FileSheetManager.java:499) at org.archive.crawler.datamodel.CrawlURI.setStateProvider(CrawlURI.java:1509) at org.archive.crawler.framework.ToeThread.processCrawlUri(ToeThread.java:294) at org.archive.crawler.framework.ToeThread.run(ToeThread.java:152) All outstanding ToeThreads should finish before CrawlController.completeStop() fires.

    JIRA | 9 years ago | Paul Jack
    com.sleepycat.util.RuntimeExceptionWrapper: (JE 3.2.44) Can't open a cursor Database state can't be DbState.CLOSED must be DbState.OPEN
  2. 0

    Running a largish crawl (10K seeds) using basic-seed-sites for a few seconds, then hit "Terminate". ToeThreads continue to process while final reports are generated: Nov 15, 2007 7:04:42 PM org.archive.modules.fetcher.FetchHTTP innerProcess INFO: GET http://www.ciia.org/robots.txt 200 411 text/plain Nov 15, 2007 7:04:42 PM org.archive.modules.fetcher.FetchHTTP innerProcess INFO: GET http://www.warchild.ca/robots.txt 404 1315 text/html Nov 15, 2007 7:04:42 PM org.archive.crawler.framework.StatisticsTracker writeReportFile INFO: wrote report: /home/pjack/Projects/builds_heritrix/jobs/active-basic_seed_sites-20071115190415/./frontier-report.txt Nov 15, 2007 7:04:42 PM org.archive.modules.fetcher.FetchHTTP innerProcess INFO: GET http://www.economia.cl/robots.txt 404 398 text/html; charset=iso-8859-1 Also the ToeThreads continue to process URIs even after everything is shut down: Nov 15, 2007 7:04:43 PM org.archive.modules.fetcher.FetchHTTP innerProcess INFO: GET http://www.presidencia.gub.uy/robots.txt 404 4184 text/html Nov 15, 2007 7:04:43 PM org.archive.crawler.framework.ToeThread run SEVERE: Fatal exception in ToeThread #9: http://www.minag.gob.pe/robots.txt com.sleepycat.util.RuntimeExceptionWrapper: (JE 3.2.44) Can't open a cursor Database state can't be DbState.CLOSED must be DbState.OPEN at com.sleepycat.collections.StoredContainer.convertException(StoredContainer.java:447) at com.sleepycat.collections.StoredCollection.getFirstOrLast(StoredCollection.java:550) at com.sleepycat.collections.StoredSortedKeySet.last(StoredSortedKeySet.java:106) at org.archive.settings.file.PrefixFinder.last(PrefixFinder.java:91) at org.archive.settings.file.PrefixFinder.find(PrefixFinder.java:63) at org.archive.settings.file.FileSheetManager.findConfig(FileSheetManager.java:499) at org.archive.crawler.datamodel.CrawlURI.setStateProvider(CrawlURI.java:1509) at org.archive.crawler.framework.ToeThread.processCrawlUri(ToeThread.java:294) at org.archive.crawler.framework.ToeThread.run(ToeThread.java:152) All outstanding ToeThreads should finish before CrawlController.completeStop() fires.

    JIRA | 9 years ago | Paul Jack
    com.sleepycat.util.RuntimeExceptionWrapper: (JE 3.2.44) Can't open a cursor Database state can't be DbState.CLOSED must be DbState.OPEN

    Root Cause Analysis

    1. com.sleepycat.util.RuntimeExceptionWrapper

      (JE 3.2.44) Can't open a cursor Database state can't be DbState.CLOSED must be DbState.OPEN

      at com.sleepycat.collections.StoredContainer.convertException()
    2. Berkeley DB Java Edition
      StoredSortedKeySet.last
      1. com.sleepycat.collections.StoredContainer.convertException(StoredContainer.java:447)
      2. com.sleepycat.collections.StoredCollection.getFirstOrLast(StoredCollection.java:550)
      3. com.sleepycat.collections.StoredSortedKeySet.last(StoredSortedKeySet.java:106)
      3 frames
    3. org.archive.settings
      FileSheetManager.findConfig
      1. org.archive.settings.file.PrefixFinder.last(PrefixFinder.java:91)
      2. org.archive.settings.file.PrefixFinder.find(PrefixFinder.java:63)
      3. org.archive.settings.file.FileSheetManager.findConfig(FileSheetManager.java:499)
      3 frames
    4. org.archive.crawler
      ToeThread.run
      1. org.archive.crawler.datamodel.CrawlURI.setStateProvider(CrawlURI.java:1509)
      2. org.archive.crawler.framework.ToeThread.processCrawlUri(ToeThread.java:294)
      3. org.archive.crawler.framework.ToeThread.run(ToeThread.java:152)
      3 frames