java.lang.NullPointerException

JIRA | Gordon Mohr | 10 years ago
tip
Do you know that we can give you better hits? Get more relevant results from Samebug’s stack trace search.
  1. 0

    After having a small crawl finish (though with some errors; see below), I tried to 'copy' that completed job to a new runnable job. Hitting 'launch' on that job gave the following exception preventing the crawl from starting: Sep 28, 2007 9:06:39 PM org.archive.crawler.frontier.AbstractFrontier loadSeeds INFO: beginning Sep 28, 2007 9:06:39 PM org.archive.crawler.frontier.BdbWorkQueue peekItem SEVERE: peekItem failure; retrying com.sleepycat.je.DatabaseException: (JE 3.2.44) bdb queue cap missing: OperationStatus.NOTFOUND com,xavvy, at org.archive.crawler.frontier.BdbMultipleWorkQueues.getNextNearestItem(BdbMultipleWorkQueues.java:298) at org.archive.crawler.frontier.BdbMultipleWorkQueues.get(BdbMultipleWorkQueues.java:253) at org.archive.crawler.frontier.BdbWorkQueue.peekItem(BdbWorkQueue.java:107) at org.archive.crawler.frontier.WorkQueue.peek(WorkQueue.java:135) at org.archive.crawler.frontier.WorkQueueFrontier.replenishSessionBalance(WorkQueueFrontier.java:646) at org.archive.crawler.frontier.WorkQueueFrontier.sendToQueue(WorkQueueFrontier.java:373) at org.archive.crawler.frontier.WorkQueueFrontier.receive(WorkQueueFrontier.java:341) at org.archive.crawler.util.SetBasedUriUniqFilter.add(SetBasedUriUniqFilter.java:93) at org.archive.crawler.frontier.WorkQueueFrontier.schedule(WorkQueueFrontier.java:325) at org.archive.crawler.frontier.AbstractFrontier.loadSeeds(AbstractFrontier.java:567) at org.archive.crawler.frontier.WorkQueueFrontier.initialTasks(WorkQueueFrontier.java:238) at org.archive.crawler.frontier.BdbFrontier.initialTasks(BdbFrontier.java:207) at org.archive.settings.path.PathChanger.initIfNecessary(PathChanger.java:174) at org.archive.settings.path.PathChanger.changeLoudly(PathChanger.java:138) at org.archive.settings.path.PathChanger.change(PathChanger.java:112) at org.archive.settings.path.PathChanger.change(PathChanger.java:99) at org.archive.settings.file.FileSheetManager.loadSingleSheet(FileSheetManager.java:644) at org.archive.settings.file.FileSheetManager.reload(FileSheetManager.java:383) at org.archive.settings.file.FileSheetManager.<init>(FileSheetManager.java:298) at org.archive.crawler.framework.CrawlJobManagerImpl$JobLauncher.doLaunch(CrawlJobManagerImpl.java:687) at org.archive.crawler.framework.CrawlJobManagerImpl$JobLauncher.run(CrawlJobManagerImpl.java:698) It appears some lingering state from the previous crawl is causing the problem. Just in case it's relevant, the previous crawl exhibited the bug HER-1286, and had the alerts (which might account for incomplete cleanup): Sep 28, 2007 8:50:50 PM org.archive.crawler.framework.ToeThread recoverableProblem SEVERE: Problem java.lang.NullPointerException occured when trying to process 'http://xavvy.com/gordon-mohr-gojomo-emboss-portrait.jpg' at step ABOUT_TO_BEGIN_PROCESSOR in WArchiver (in thread 'ToeThread #3: http://xavvy.com/gordon-mohr-gojomo-emboss-portrait.jpg'; in processor 'WArchiver') java.lang.NullPointerException at org.archive.crawler.writer.ExperimentalWARCWriterProcessor.write(ExperimentalWARCWriterProcessor.java:214) at org.archive.crawler.writer.ExperimentalWARCWriterProcessor.innerProcessResult(ExperimentalWARCWriterProcessor.java:198) at org.archive.modules.Processor.process(Processor.java:118) at org.archive.crawler.framework.ToeThread.processCrawlUri(ToeThread.java:297) at org.archive.crawler.framework.ToeThread.run(ToeThread.java:152) Sep 28, 2007 8:51:00 PM org.archive.settings.SheetManager closeModules SEVERE: Could not close org.archive.crawler.writer.ExperimentalWARCWriterProcessor@1e292edb (in thread 'ToeThread #3: ') java.lang.NullPointerException at org.archive.crawler.framework.WriterPoolProcessor.close(WriterPoolProcessor.java:446) at org.archive.settings.SheetManager.closeModules(SheetManager.java:377) at org.archive.crawler.framework.CrawlController.completeStop(CrawlController.java:570) at org.archive.crawler.framework.CrawlController.toeEnded(CrawlController.java:996) at org.archive.crawler.framework.ToeThread.run(ToeThread.java:187)

    JIRA | 10 years ago | Gordon Mohr
    java.lang.NullPointerException
  2. Speed up your debug routine!

    Automated exception search integrated into your IDE

  3. 0

    After having a small crawl finish (though with some errors; see below), I tried to 'copy' that completed job to a new runnable job. Hitting 'launch' on that job gave the following exception preventing the crawl from starting: Sep 28, 2007 9:06:39 PM org.archive.crawler.frontier.AbstractFrontier loadSeeds INFO: beginning Sep 28, 2007 9:06:39 PM org.archive.crawler.frontier.BdbWorkQueue peekItem SEVERE: peekItem failure; retrying com.sleepycat.je.DatabaseException: (JE 3.2.44) bdb queue cap missing: OperationStatus.NOTFOUND com,xavvy, at org.archive.crawler.frontier.BdbMultipleWorkQueues.getNextNearestItem(BdbMultipleWorkQueues.java:298) at org.archive.crawler.frontier.BdbMultipleWorkQueues.get(BdbMultipleWorkQueues.java:253) at org.archive.crawler.frontier.BdbWorkQueue.peekItem(BdbWorkQueue.java:107) at org.archive.crawler.frontier.WorkQueue.peek(WorkQueue.java:135) at org.archive.crawler.frontier.WorkQueueFrontier.replenishSessionBalance(WorkQueueFrontier.java:646) at org.archive.crawler.frontier.WorkQueueFrontier.sendToQueue(WorkQueueFrontier.java:373) at org.archive.crawler.frontier.WorkQueueFrontier.receive(WorkQueueFrontier.java:341) at org.archive.crawler.util.SetBasedUriUniqFilter.add(SetBasedUriUniqFilter.java:93) at org.archive.crawler.frontier.WorkQueueFrontier.schedule(WorkQueueFrontier.java:325) at org.archive.crawler.frontier.AbstractFrontier.loadSeeds(AbstractFrontier.java:567) at org.archive.crawler.frontier.WorkQueueFrontier.initialTasks(WorkQueueFrontier.java:238) at org.archive.crawler.frontier.BdbFrontier.initialTasks(BdbFrontier.java:207) at org.archive.settings.path.PathChanger.initIfNecessary(PathChanger.java:174) at org.archive.settings.path.PathChanger.changeLoudly(PathChanger.java:138) at org.archive.settings.path.PathChanger.change(PathChanger.java:112) at org.archive.settings.path.PathChanger.change(PathChanger.java:99) at org.archive.settings.file.FileSheetManager.loadSingleSheet(FileSheetManager.java:644) at org.archive.settings.file.FileSheetManager.reload(FileSheetManager.java:383) at org.archive.settings.file.FileSheetManager.<init>(FileSheetManager.java:298) at org.archive.crawler.framework.CrawlJobManagerImpl$JobLauncher.doLaunch(CrawlJobManagerImpl.java:687) at org.archive.crawler.framework.CrawlJobManagerImpl$JobLauncher.run(CrawlJobManagerImpl.java:698) It appears some lingering state from the previous crawl is causing the problem. Just in case it's relevant, the previous crawl exhibited the bug HER-1286, and had the alerts (which might account for incomplete cleanup): Sep 28, 2007 8:50:50 PM org.archive.crawler.framework.ToeThread recoverableProblem SEVERE: Problem java.lang.NullPointerException occured when trying to process 'http://xavvy.com/gordon-mohr-gojomo-emboss-portrait.jpg' at step ABOUT_TO_BEGIN_PROCESSOR in WArchiver (in thread 'ToeThread #3: http://xavvy.com/gordon-mohr-gojomo-emboss-portrait.jpg'; in processor 'WArchiver') java.lang.NullPointerException at org.archive.crawler.writer.ExperimentalWARCWriterProcessor.write(ExperimentalWARCWriterProcessor.java:214) at org.archive.crawler.writer.ExperimentalWARCWriterProcessor.innerProcessResult(ExperimentalWARCWriterProcessor.java:198) at org.archive.modules.Processor.process(Processor.java:118) at org.archive.crawler.framework.ToeThread.processCrawlUri(ToeThread.java:297) at org.archive.crawler.framework.ToeThread.run(ToeThread.java:152) Sep 28, 2007 8:51:00 PM org.archive.settings.SheetManager closeModules SEVERE: Could not close org.archive.crawler.writer.ExperimentalWARCWriterProcessor@1e292edb (in thread 'ToeThread #3: ') java.lang.NullPointerException at org.archive.crawler.framework.WriterPoolProcessor.close(WriterPoolProcessor.java:446) at org.archive.settings.SheetManager.closeModules(SheetManager.java:377) at org.archive.crawler.framework.CrawlController.completeStop(CrawlController.java:570) at org.archive.crawler.framework.CrawlController.toeEnded(CrawlController.java:996) at org.archive.crawler.framework.ToeThread.run(ToeThread.java:187)

    JIRA | 10 years ago | Gordon Mohr
    java.lang.NullPointerException
  4. 0

    The following exception stack occurred when terminating a small test crawl via the web UI. A subsequent crawl terminated normally on same settings. com.sleepycat.util.RuntimeExceptionWrapper: (JE 3.2.23) Can't open a cursor Database state can't be DbState.CLOSED must be DbState.OPEN at com.sleepycat.collections.StoredContainer.convertException(StoredContainer.java:447) at com.sleepycat.collections.BlockIterator.hasNext(BlockIterator.java:380) at org.apache.commons.httpclient.cookie.CookieSpecBase.match(CookieSpecBase.java:607) at org.apache.commons.httpclient.HttpMethodBase.addCookieRequestHeader(HttpMethodBase.java:1193) at org.apache.commons.httpclient.HttpMethodBase.addRequestHeaders(HttpMethodBase.java:1327) at org.apache.commons.httpclient.HttpMethodBase.writeRequestHeaders(HttpMethodBase.java:2056) at org.apache.commons.httpclient.HttpMethodBase.writeRequest(HttpMethodBase.java:1939) at org.apache.commons.httpclient.HttpMethodBase.execute(HttpMethodBase.java:1000) at org.archive.httpclient.HttpRecorderGetMethod.execute(HttpRecorderGetMethod.java:116) at org.apache.commons.httpclient.HttpMethodDirector.executeWithRetry(HttpMethodDirector.java:397) at org.apache.commons.httpclient.HttpMethodDirector.executeMethod(HttpMethodDirector.java:170) at org.apache.commons.httpclient.HttpClient.executeMethod(HttpClient.java:396) at org.apache.commons.httpclient.HttpClient.executeMethod(HttpClient.java:346) at org.archive.crawler.fetcher.FetchHTTP.innerProcess(FetchHTTP.java:500) at org.archive.crawler.framework.Processor.process(Processor.java:112) at org.archive.crawler.framework.ToeThread.processCrawlUri(ToeThread.java:302) at org.archive.crawler.framework.ToeThread.run(ToeThread.java:151) Caused by: com.sleepycat.je.DatabaseException: (JE 3.2.23) Can't open a cursor Database state can't be DbState.CLOSED must be DbState.OPEN at com.sleepycat.je.Database.checkRequiredDbState(Database.java:1069) at com.sleepycat.je.Database.openCursor(Database.java:359) at com.sleepycat.collections.CurrentTransaction.openCursor(CurrentTransaction.java:364) at com.sleepycat.collections.MyRangeCursor.openCursor(MyRangeCursor.java:53) at com.sleepycat.collections.MyRangeCursor.<init>(MyRangeCursor.java:30) at com.sleepycat.collections.DataCursor.init(DataCursor.java:171) at com.sleepycat.collections.DataCursor.<init>(DataCursor.java:59) at com.sleepycat.collections.BlockIterator.hasNext(BlockIterator.java:299) ... 15 more 07/05/2007 21:02:25 +0000 SEVERE org.archive.crawler.framework.ToeThread recoverableProblem Problem com.sleepycat.util.RuntimeExceptionWrapper: (JE 3.2.23) Can't open a cursor Database state can't be DbState.CLOSED must be DbState.OPEN occured when trying to process 'http://www.landsbokasafn.is/Apps/WebObjects/HI.woa/wa/header_logo_neg.gif' at step ABOUT_TO_BEGIN_PROCESSOR in HTTP com.sleepycat.util.RuntimeExceptionWrapper: (JE 3.2.23) Can't open a cursor Database state can't be DbState.CLOSED must be DbState.OPEN at com.sleepycat.collections.StoredContainer.convertException(StoredContainer.java:447) at com.sleepycat.collections.BlockIterator.hasNext(BlockIterator.java:380) at org.apache.commons.httpclient.cookie.CookieSpecBase.match(CookieSpecBase.java:607) at org.apache.commons.httpclient.HttpMethodBase.addCookieRequestHeader(HttpMethodBase.java:1193) at org.apache.commons.httpclient.HttpMethodBase.addRequestHeaders(HttpMethodBase.java:1327) at org.apache.commons.httpclient.HttpMethodBase.writeRequestHeaders(HttpMethodBase.java:2056) at org.apache.commons.httpclient.HttpMethodBase.writeRequest(HttpMethodBase.java:1939) at org.apache.commons.httpclient.HttpMethodBase.execute(HttpMethodBase.java:1000) at org.archive.httpclient.HttpRecorderGetMethod.execute(HttpRecorderGetMethod.java:116) at org.apache.commons.httpclient.HttpMethodDirector.executeWithRetry(HttpMethodDirector.java:397) at org.apache.commons.httpclient.HttpMethodDirector.executeMethod(HttpMethodDirector.java:170) at org.apache.commons.httpclient.HttpClient.executeMethod(HttpClient.java:396) at org.apache.commons.httpclient.HttpClient.executeMethod(HttpClient.java:346) at org.archive.crawler.fetcher.FetchHTTP.innerProcess(FetchHTTP.java:500) at org.archive.crawler.framework.Processor.process(Processor.java:112) at org.archive.crawler.framework.ToeThread.processCrawlUri(ToeThread.java:302) at org.archive.crawler.framework.ToeThread.run(ToeThread.java:151) Caused by: com.sleepycat.je.DatabaseException: (JE 3.2.23) Can't open a cursor Database state can't be DbState.CLOSED must be DbState.OPEN at com.sleepycat.je.Database.checkRequiredDbState(Database.java:1069) at com.sleepycat.je.Database.openCursor(Database.java:359) at com.sleepycat.collections.CurrentTransaction.openCursor(CurrentTransaction.java:364) at com.sleepycat.collections.MyRangeCursor.openCursor(MyRangeCursor.java:53) at com.sleepycat.collections.MyRangeCursor.<init>(MyRangeCursor.java:30) at com.sleepycat.collections.DataCursor.init(DataCursor.java:171) at com.sleepycat.collections.DataCursor.<init>(DataCursor.java:59) at com.sleepycat.collections.BlockIterator.hasNext(BlockIterator.java:299) ... 15 more 07/05/2007 21:02:25 +0000 SEVERE org.archive.crawler.framework.ToeThread run Fatal exception in ToeThread #29: http://www.landsbokasafn.is/Apps/WebObjects/HI.woa/wa/header_logo_neg.gif java.lang.NullPointerException at org.archive.crawler.framework.ToeThread.run(ToeThread.java:157)

    JIRA | 10 years ago | Kristinn SigurĂ°sson
    java.lang.NullPointerException

    Not finding the right solution?
    Take a tour to get the most out of Samebug.

    Tired of useless tips?

    Automated exception search integrated into your IDE

    Root Cause Analysis

    1. java.lang.NullPointerException

      No message provided

      at org.archive.crawler.writer.ExperimentalWARCWriterProcessor.write()
    2. org.archive.crawler
      ExperimentalWARCWriterProcessor.innerProcessResult
      1. org.archive.crawler.writer.ExperimentalWARCWriterProcessor.write(ExperimentalWARCWriterProcessor.java:214)
      2. org.archive.crawler.writer.ExperimentalWARCWriterProcessor.innerProcessResult(ExperimentalWARCWriterProcessor.java:198)
      2 frames
    3. org.archive.modules
      Processor.process
      1. org.archive.modules.Processor.process(Processor.java:118)
      1 frame
    4. org.archive.crawler
      ToeThread.run
      1. org.archive.crawler.framework.ToeThread.processCrawlUri(ToeThread.java:297)
      2. org.archive.crawler.framework.ToeThread.run(ToeThread.java:152)
      2 frames