com.sleepycat.je.DatabaseException: (JE 3.2.44) bdb queue cap missing: OperationStatus.NOTFOUND com,xavvy,

JIRA | Gordon Mohr | 9 years ago
  1. 0

    After having a small crawl finish (though with some errors; see below), I tried to 'copy' that completed job to a new runnable job. Hitting 'launch' on that job gave the following exception preventing the crawl from starting: Sep 28, 2007 9:06:39 PM org.archive.crawler.frontier.AbstractFrontier loadSeeds INFO: beginning Sep 28, 2007 9:06:39 PM org.archive.crawler.frontier.BdbWorkQueue peekItem SEVERE: peekItem failure; retrying com.sleepycat.je.DatabaseException: (JE 3.2.44) bdb queue cap missing: OperationStatus.NOTFOUND com,xavvy, at org.archive.crawler.frontier.BdbMultipleWorkQueues.getNextNearestItem(BdbMultipleWorkQueues.java:298) at org.archive.crawler.frontier.BdbMultipleWorkQueues.get(BdbMultipleWorkQueues.java:253) at org.archive.crawler.frontier.BdbWorkQueue.peekItem(BdbWorkQueue.java:107) at org.archive.crawler.frontier.WorkQueue.peek(WorkQueue.java:135) at org.archive.crawler.frontier.WorkQueueFrontier.replenishSessionBalance(WorkQueueFrontier.java:646) at org.archive.crawler.frontier.WorkQueueFrontier.sendToQueue(WorkQueueFrontier.java:373) at org.archive.crawler.frontier.WorkQueueFrontier.receive(WorkQueueFrontier.java:341) at org.archive.crawler.util.SetBasedUriUniqFilter.add(SetBasedUriUniqFilter.java:93) at org.archive.crawler.frontier.WorkQueueFrontier.schedule(WorkQueueFrontier.java:325) at org.archive.crawler.frontier.AbstractFrontier.loadSeeds(AbstractFrontier.java:567) at org.archive.crawler.frontier.WorkQueueFrontier.initialTasks(WorkQueueFrontier.java:238) at org.archive.crawler.frontier.BdbFrontier.initialTasks(BdbFrontier.java:207) at org.archive.settings.path.PathChanger.initIfNecessary(PathChanger.java:174) at org.archive.settings.path.PathChanger.changeLoudly(PathChanger.java:138) at org.archive.settings.path.PathChanger.change(PathChanger.java:112) at org.archive.settings.path.PathChanger.change(PathChanger.java:99) at org.archive.settings.file.FileSheetManager.loadSingleSheet(FileSheetManager.java:644) at org.archive.settings.file.FileSheetManager.reload(FileSheetManager.java:383) at org.archive.settings.file.FileSheetManager.<init>(FileSheetManager.java:298) at org.archive.crawler.framework.CrawlJobManagerImpl$JobLauncher.doLaunch(CrawlJobManagerImpl.java:687) at org.archive.crawler.framework.CrawlJobManagerImpl$JobLauncher.run(CrawlJobManagerImpl.java:698) It appears some lingering state from the previous crawl is causing the problem. Just in case it's relevant, the previous crawl exhibited the bug HER-1286, and had the alerts (which might account for incomplete cleanup): Sep 28, 2007 8:50:50 PM org.archive.crawler.framework.ToeThread recoverableProblem SEVERE: Problem java.lang.NullPointerException occured when trying to process 'http://xavvy.com/gordon-mohr-gojomo-emboss-portrait.jpg' at step ABOUT_TO_BEGIN_PROCESSOR in WArchiver (in thread 'ToeThread #3: http://xavvy.com/gordon-mohr-gojomo-emboss-portrait.jpg'; in processor 'WArchiver') java.lang.NullPointerException at org.archive.crawler.writer.ExperimentalWARCWriterProcessor.write(ExperimentalWARCWriterProcessor.java:214) at org.archive.crawler.writer.ExperimentalWARCWriterProcessor.innerProcessResult(ExperimentalWARCWriterProcessor.java:198) at org.archive.modules.Processor.process(Processor.java:118) at org.archive.crawler.framework.ToeThread.processCrawlUri(ToeThread.java:297) at org.archive.crawler.framework.ToeThread.run(ToeThread.java:152) Sep 28, 2007 8:51:00 PM org.archive.settings.SheetManager closeModules SEVERE: Could not close org.archive.crawler.writer.ExperimentalWARCWriterProcessor@1e292edb (in thread 'ToeThread #3: ') java.lang.NullPointerException at org.archive.crawler.framework.WriterPoolProcessor.close(WriterPoolProcessor.java:446) at org.archive.settings.SheetManager.closeModules(SheetManager.java:377) at org.archive.crawler.framework.CrawlController.completeStop(CrawlController.java:570) at org.archive.crawler.framework.CrawlController.toeEnded(CrawlController.java:996) at org.archive.crawler.framework.ToeThread.run(ToeThread.java:187)

    JIRA | 9 years ago | Gordon Mohr
    com.sleepycat.je.DatabaseException: (JE 3.2.44) bdb queue cap missing: OperationStatus.NOTFOUND com,xavvy,
  2. 0

    After having a small crawl finish (though with some errors; see below), I tried to 'copy' that completed job to a new runnable job. Hitting 'launch' on that job gave the following exception preventing the crawl from starting: Sep 28, 2007 9:06:39 PM org.archive.crawler.frontier.AbstractFrontier loadSeeds INFO: beginning Sep 28, 2007 9:06:39 PM org.archive.crawler.frontier.BdbWorkQueue peekItem SEVERE: peekItem failure; retrying com.sleepycat.je.DatabaseException: (JE 3.2.44) bdb queue cap missing: OperationStatus.NOTFOUND com,xavvy, at org.archive.crawler.frontier.BdbMultipleWorkQueues.getNextNearestItem(BdbMultipleWorkQueues.java:298) at org.archive.crawler.frontier.BdbMultipleWorkQueues.get(BdbMultipleWorkQueues.java:253) at org.archive.crawler.frontier.BdbWorkQueue.peekItem(BdbWorkQueue.java:107) at org.archive.crawler.frontier.WorkQueue.peek(WorkQueue.java:135) at org.archive.crawler.frontier.WorkQueueFrontier.replenishSessionBalance(WorkQueueFrontier.java:646) at org.archive.crawler.frontier.WorkQueueFrontier.sendToQueue(WorkQueueFrontier.java:373) at org.archive.crawler.frontier.WorkQueueFrontier.receive(WorkQueueFrontier.java:341) at org.archive.crawler.util.SetBasedUriUniqFilter.add(SetBasedUriUniqFilter.java:93) at org.archive.crawler.frontier.WorkQueueFrontier.schedule(WorkQueueFrontier.java:325) at org.archive.crawler.frontier.AbstractFrontier.loadSeeds(AbstractFrontier.java:567) at org.archive.crawler.frontier.WorkQueueFrontier.initialTasks(WorkQueueFrontier.java:238) at org.archive.crawler.frontier.BdbFrontier.initialTasks(BdbFrontier.java:207) at org.archive.settings.path.PathChanger.initIfNecessary(PathChanger.java:174) at org.archive.settings.path.PathChanger.changeLoudly(PathChanger.java:138) at org.archive.settings.path.PathChanger.change(PathChanger.java:112) at org.archive.settings.path.PathChanger.change(PathChanger.java:99) at org.archive.settings.file.FileSheetManager.loadSingleSheet(FileSheetManager.java:644) at org.archive.settings.file.FileSheetManager.reload(FileSheetManager.java:383) at org.archive.settings.file.FileSheetManager.<init>(FileSheetManager.java:298) at org.archive.crawler.framework.CrawlJobManagerImpl$JobLauncher.doLaunch(CrawlJobManagerImpl.java:687) at org.archive.crawler.framework.CrawlJobManagerImpl$JobLauncher.run(CrawlJobManagerImpl.java:698) It appears some lingering state from the previous crawl is causing the problem. Just in case it's relevant, the previous crawl exhibited the bug HER-1286, and had the alerts (which might account for incomplete cleanup): Sep 28, 2007 8:50:50 PM org.archive.crawler.framework.ToeThread recoverableProblem SEVERE: Problem java.lang.NullPointerException occured when trying to process 'http://xavvy.com/gordon-mohr-gojomo-emboss-portrait.jpg' at step ABOUT_TO_BEGIN_PROCESSOR in WArchiver (in thread 'ToeThread #3: http://xavvy.com/gordon-mohr-gojomo-emboss-portrait.jpg'; in processor 'WArchiver') java.lang.NullPointerException at org.archive.crawler.writer.ExperimentalWARCWriterProcessor.write(ExperimentalWARCWriterProcessor.java:214) at org.archive.crawler.writer.ExperimentalWARCWriterProcessor.innerProcessResult(ExperimentalWARCWriterProcessor.java:198) at org.archive.modules.Processor.process(Processor.java:118) at org.archive.crawler.framework.ToeThread.processCrawlUri(ToeThread.java:297) at org.archive.crawler.framework.ToeThread.run(ToeThread.java:152) Sep 28, 2007 8:51:00 PM org.archive.settings.SheetManager closeModules SEVERE: Could not close org.archive.crawler.writer.ExperimentalWARCWriterProcessor@1e292edb (in thread 'ToeThread #3: ') java.lang.NullPointerException at org.archive.crawler.framework.WriterPoolProcessor.close(WriterPoolProcessor.java:446) at org.archive.settings.SheetManager.closeModules(SheetManager.java:377) at org.archive.crawler.framework.CrawlController.completeStop(CrawlController.java:570) at org.archive.crawler.framework.CrawlController.toeEnded(CrawlController.java:996) at org.archive.crawler.framework.ToeThread.run(ToeThread.java:187)

    JIRA | 9 years ago | Gordon Mohr
    com.sleepycat.je.DatabaseException: (JE 3.2.44) bdb queue cap missing: OperationStatus.NOTFOUND com,xavvy,
  3. 0

    com.sleepycat.je.DatabaseException: (JE 3.3.87) Failed to delete unique key: OperationStatus.NOTFOUND

    YouTrack | 7 years ago
    java.lang.RuntimeException: com.sleepycat.je.DatabaseException: (JE 3.3.87) Failed to delete unique key: OperationStatus.NOTFOUND
  4. Speed up your debug routine!

    Automated exception search integrated into your IDE

  5. 0

    Cursor.put and Transactions

    Oracle Community | 9 years ago | 44953
    com.sleepycat.je.DatabaseException: (JE 3.2.44) A transaction was not supplied when opening this cursor: put
  6. 0

    (JE 3.2.44) Couldn't open file

    Oracle Community | 9 years ago | 536712
    com.sleepycat.je.DatabaseException: (JE 3.2.44) fetchTarge t of 0x1d3/0x472b30 parent IN=32738188 lastFullVersion=0x1d3/0x479cdc parent.getDirty()=true state=2 com.s leepycat.je.log.LogFileNotFoundException: (JE 3.2.44) 0x1d3/0x472b30 (JE 3.2.44) Couldn't open file db/000 001d3.jdb: db/000001d3.jdb (No such file or directory) com.sleepycat.je.DatabaseException: (JE 3.2.44) fetchTarget of 0x1d3/0x472b30 parent IN=32738188 lastFullV ersion=0x1d3/0x479cdc parent.getDirty()=true state=2 com.sleepycat.je.log.LogFileNotFoundException: (JE 3. 2.44) 0x1d3/0x472b30 (JE 3.2.44) Couldn't open file db/000001d3.jdb: db/000001d3.jdb (No such file or dire ctory)

    Not finding the right solution?
    Take a tour to get the most out of Samebug.

    Tired of useless tips?

    Automated exception search integrated into your IDE

    Root Cause Analysis

    1. com.sleepycat.je.DatabaseException

      (JE 3.2.44) bdb queue cap missing: OperationStatus.NOTFOUND com,xavvy,

      at org.archive.crawler.frontier.BdbMultipleWorkQueues.getNextNearestItem()
    2. org.archive.crawler
      BdbFrontier.initialTasks
      1. org.archive.crawler.frontier.BdbMultipleWorkQueues.getNextNearestItem(BdbMultipleWorkQueues.java:298)
      2. org.archive.crawler.frontier.BdbMultipleWorkQueues.get(BdbMultipleWorkQueues.java:253)
      3. org.archive.crawler.frontier.BdbWorkQueue.peekItem(BdbWorkQueue.java:107)
      4. org.archive.crawler.frontier.WorkQueue.peek(WorkQueue.java:135)
      5. org.archive.crawler.frontier.WorkQueueFrontier.replenishSessionBalance(WorkQueueFrontier.java:646)
      6. org.archive.crawler.frontier.WorkQueueFrontier.sendToQueue(WorkQueueFrontier.java:373)
      7. org.archive.crawler.frontier.WorkQueueFrontier.receive(WorkQueueFrontier.java:341)
      8. org.archive.crawler.util.SetBasedUriUniqFilter.add(SetBasedUriUniqFilter.java:93)
      9. org.archive.crawler.frontier.WorkQueueFrontier.schedule(WorkQueueFrontier.java:325)
      10. org.archive.crawler.frontier.AbstractFrontier.loadSeeds(AbstractFrontier.java:567)
      11. org.archive.crawler.frontier.WorkQueueFrontier.initialTasks(WorkQueueFrontier.java:238)
      12. org.archive.crawler.frontier.BdbFrontier.initialTasks(BdbFrontier.java:207)
      12 frames
    3. org.archive.settings
      FileSheetManager.<init>
      1. org.archive.settings.path.PathChanger.initIfNecessary(PathChanger.java:174)
      2. org.archive.settings.path.PathChanger.changeLoudly(PathChanger.java:138)
      3. org.archive.settings.path.PathChanger.change(PathChanger.java:112)
      4. org.archive.settings.path.PathChanger.change(PathChanger.java:99)
      5. org.archive.settings.file.FileSheetManager.loadSingleSheet(FileSheetManager.java:644)
      6. org.archive.settings.file.FileSheetManager.reload(FileSheetManager.java:383)
      7. org.archive.settings.file.FileSheetManager.<init>(FileSheetManager.java:298)
      7 frames
    4. org.archive.crawler
      CrawlJobManagerImpl$JobLauncher.run
      1. org.archive.crawler.framework.CrawlJobManagerImpl$JobLauncher.doLaunch(CrawlJobManagerImpl.java:687)
      2. org.archive.crawler.framework.CrawlJobManagerImpl$JobLauncher.run(CrawlJobManagerImpl.java:698)
      2 frames