/crawl/heritrix/heritrix-0.6.0/jobs/crs-20040427190708335/disk/scratch/bphc (Too many open files)

JIRA | Michael Stack | 10 years ago
  1. 0

    I happen to have a seed list of nearly 1024 entries. Not totally surprisingly, Heritrix behaves a little oddly with that many seeds. First, crawls with either 0.6.0 or the latest CVS build fail because too many files are opened almost immediately, and then neither socket operations nor file logging are able to proceed. A typical exception: /crawl/heritrix/heritrix-0.6.0/jobs/crs-20040427190708335/disk/scratch/bphc (Too many open files) at Method) at<init>( at<init>( at<init>( at va:67) at org.archive.util.DiskQueue.<init>( at org.archive.util.DiskBackedQueue.<init>( at org.archive.crawler.basic.KeyedQueue.<init>( at org.archive.crawler.basic.Frontier.keyedQueueFor( at org.archive.crawler.basic.Frontier.scheduleForRetry( at org.archive.crawler.basic.Frontier.finished( at org.archive.crawler.framework.ToeThread.processCrawlUri( at You can get past that by allowing a larger number of open files for the process (which requires running Heritrix with root privilege), as in: # (ulimit -n 4096; JAVA_OPTS=-Xmx320 bin/heritrix -p 9876)

    JIRA | 10 years ago | Michael Stack /crawl/heritrix/heritrix-0.6.0/jobs/crs-20040427190708335/disk/scratch/bphc (Too many open files)
  2. 0

    FileNotFoundException during saving of PDF file

    GitHub | 5 years ago | mbastian C:\****\Untilted.pdf (Le processus ne peut pas accéder au fichier car ce fichier est utilisé par un autre processus)
  3. 0

    Marker Issues

    GitHub | 4 years ago | TheSeize plugins/dynmap/web/tiles/_markers_/ (No such file or directory)
  4. Speed up your debug routine!

    Automated exception search integrated into your IDE

  5. 0

    Trouble with deploying Sonatype Nexus to Tomcat6 on Gentoo (log4j)

    Stack Overflow | 6 years ago | John /dev/null/sonatype-work/nexus/conf/ (Not a directory)
  6. 0

    Embedded Jetty | Page number 3 | PC E-World | 2 years ago /jetty-pkg/target/work/webapp/LICENSE (No such file or directory)

  1. MoYapro 2 times, last 5 days ago
  2. tererecool 2 times, last 1 month ago
  3. pbabcsany 6 times, last 1 month ago
  4. davidvanlaatum 4 times, last 1 month ago
  5. bpbhat77 38 times, last 2 months ago
18 more registered users
77 unregistered visitors
Not finding the right solution?
Take a tour to get the most out of Samebug.

Tired of useless tips?

Automated exception search integrated into your IDE

Root Cause Analysis


    /crawl/heritrix/heritrix-0.6.0/jobs/crs-20040427190708335/disk/scratch/bphc (Too many open files)

  2. Java RT
    1. Method)
    3 frames
  3. webarchive-commons
    3. org.archive.util.DiskQueue.<init>(
    4. org.archive.util.DiskBackedQueue.<init>(
    4 frames
  4. org.archive.crawler
    1. org.archive.crawler.basic.KeyedQueue.<init>(
    2. org.archive.crawler.basic.Frontier.keyedQueueFor(
    3. org.archive.crawler.basic.Frontier.scheduleForRetry(
    4. org.archive.crawler.basic.Frontier.finished(
    5. org.archive.crawler.framework.ToeThread.processCrawlUri(
    6 frames