java.lang.RuntimeException: java.io.IOException: Cannot run program "java" (in directory "/opt/Azkaban/jobs"): java.io.IOException: error=24, Too many open files

JIRA | benjamin wang | 5 years ago
  1. 0

    Two jobs were scheduled as below, job 1: type=java job.class=RunClass classpath=/tmp/benjamin/javaclass,/opt/Azkaban/java/bin/azkaban-common-0.10.jar The source code of RunClass.java is as below, import java.util.Properties; import azkaban.common.utils.Props; public class RunClass { public RunClass(String name, Properties props){} public RunClass(String name, Props props){} public void run() throws Exception { System.out.println("Hello, this is java job with run function."); } public double getProgress() throws Exception { return 0.0; } public void cancel() throws Exception{} } job 2: type=command command=./mainjob.run working.dir=/tmp/benjamin/scripts mainjob.run is a very simple script. jobs.schedule is as below, {"schedule": [ { "id": "runclass", "ignoreDependency": false, "recurrence": "1m", "time": "2011-11-15.05.30.00.000", "timezone": "Etc/GMT" }, { "id": "mainscript", "ignoreDependency": false, "recurrence": "1m", "time": "2011-11-15.05.30.00.000", "timezone": "Etc/GMT" } ]} When i started Azkaban, all works OK, both of the job succeeded every time been invoked. But about two hours later, both of the jobs failed, and i also can't connnect to the web page by Firefox. When i restart Azkaban, both of them run successfully again, and i can connect to the web page by Firefox. The following is the error log got from the web page. 14-11-2011 12:57:00 GMT runclass INFO - HADOOP_HOME not set, using default hadoop config. 14-11-2011 12:57:00 GMT runclass INFO - 1 commands to execute. 14-11-2011 12:57:00 GMT runclass INFO - Executing command: java -Xms64M -Xmx256M -cp /tmp/benjamin/javaclass:/opt/Azkaban/java/bin/azkaban-common-0.10.jar:/opt/Azkaban_01.00/java/bin/azkaban-0.10.jar:/opt/Azkaban_01.00/lib/log4j-1.2.15.jar azkaban.jobs.builtin.JavaJobRunnerMain 14-11-2011 12:57:00 GMT runclass ERROR - Fatal error occurred while running job 'runclass': java.lang.RuntimeException: java.io.IOException: Cannot run program "java" (in directory "/opt/Azkaban/jobs"): java.io.IOException: error=24, Too many open files at azkaban.jobs.builtin.ProcessJob.run(ProcessJob.java:78) at azkaban.app.LoggingJob.run(LoggingJob.java:93) at azkaban.flow.IndividualJobExecutableFlow$1.run(IndividualJobExecutableFlow.java:171) at java.lang.Thread.run(Unknown Source) Caused by: java.io.IOException: Cannot run program "java" (in directory "/opt/Azkaban/jobs"): java.io.IOException: error=24, Too many open files at java.lang.ProcessBuilder.start(Unknown Source) at azkaban.jobs.builtin.ProcessJob.run(ProcessJob.java:75) ... 3 more Caused by: java.io.IOException: java.io.IOException: error=24, Too many open files at java.lang.UNIXProcess.<init>(Unknown Source) at java.lang.ProcessImpl.start(Unknown Source) ... 5 more Please feel free to contact me at benjamin_wang@yahoo.cn. or +86 10 6476 1469.

    JIRA | 5 years ago | benjamin wang
    java.lang.RuntimeException: java.io.IOException: Cannot run program "java" (in directory "/opt/Azkaban/jobs"): java.io.IOException: error=24, Too many open files
  2. 0

    Two jobs were scheduled as below, job 1: type=java job.class=RunClass classpath=/tmp/benjamin/javaclass,/opt/Azkaban/java/bin/azkaban-common-0.10.jar The source code of RunClass.java is as below, import java.util.Properties; import azkaban.common.utils.Props; public class RunClass { public RunClass(String name, Properties props){} public RunClass(String name, Props props){} public void run() throws Exception { System.out.println("Hello, this is java job with run function."); } public double getProgress() throws Exception { return 0.0; } public void cancel() throws Exception{} } job 2: type=command command=./mainjob.run working.dir=/tmp/benjamin/scripts mainjob.run is a very simple script. jobs.schedule is as below, {"schedule": [ { "id": "runclass", "ignoreDependency": false, "recurrence": "1m", "time": "2011-11-15.05.30.00.000", "timezone": "Etc/GMT" }, { "id": "mainscript", "ignoreDependency": false, "recurrence": "1m", "time": "2011-11-15.05.30.00.000", "timezone": "Etc/GMT" } ]} When i started Azkaban, all works OK, both of the job succeeded every time been invoked. But about two hours later, both of the jobs failed, and i also can't connnect to the web page by Firefox. When i restart Azkaban, both of them run successfully again, and i can connect to the web page by Firefox. The following is the error log got from the web page. 14-11-2011 12:57:00 GMT runclass INFO - HADOOP_HOME not set, using default hadoop config. 14-11-2011 12:57:00 GMT runclass INFO - 1 commands to execute. 14-11-2011 12:57:00 GMT runclass INFO - Executing command: java -Xms64M -Xmx256M -cp /tmp/benjamin/javaclass:/opt/Azkaban/java/bin/azkaban-common-0.10.jar:/opt/Azkaban_01.00/java/bin/azkaban-0.10.jar:/opt/Azkaban_01.00/lib/log4j-1.2.15.jar azkaban.jobs.builtin.JavaJobRunnerMain 14-11-2011 12:57:00 GMT runclass ERROR - Fatal error occurred while running job 'runclass': java.lang.RuntimeException: java.io.IOException: Cannot run program "java" (in directory "/opt/Azkaban/jobs"): java.io.IOException: error=24, Too many open files at azkaban.jobs.builtin.ProcessJob.run(ProcessJob.java:78) at azkaban.app.LoggingJob.run(LoggingJob.java:93) at azkaban.flow.IndividualJobExecutableFlow$1.run(IndividualJobExecutableFlow.java:171) at java.lang.Thread.run(Unknown Source) Caused by: java.io.IOException: Cannot run program "java" (in directory "/opt/Azkaban/jobs"): java.io.IOException: error=24, Too many open files at java.lang.ProcessBuilder.start(Unknown Source) at azkaban.jobs.builtin.ProcessJob.run(ProcessJob.java:75) ... 3 more Caused by: java.io.IOException: java.io.IOException: error=24, Too many open files at java.lang.UNIXProcess.<init>(Unknown Source) at java.lang.ProcessImpl.start(Unknown Source) ... 5 more Please feel free to contact me at benjamin_wang@yahoo.cn. or +86 10 6476 1469.

    JIRA | 5 years ago | benjamin wang
    java.lang.RuntimeException: java.io.IOException: Cannot run program "java" (in directory "/opt/Azkaban/jobs"): java.io.IOException: error=24, Too many open files
  3. 0

    Too many open files when using perforce (Bugzilla #18227)

    GitHub | 4 years ago | vladak
    java.io.IOException: Cannot run program "p4" (in directory "/x/search/opengrok/stage1/source/ContentSuite_8.0-cefix/appsvcs-ui/src/jsp/serviceprovider/role/images"): java.io.IOException: error=24, Too ma ny open files
  4. Speed up your debug routine!

    Automated exception search integrated into your IDE

  5. 0

    [JENKINS-1921] Too many open files - Jenkins JIRA

    jenkins-ci.org | 7 months ago
    java.io.IOException: error=24, Too many open files
  6. 0

    [JENKINS-8244] "Too Many Open files", Git and SSH slave - Jenkins JIRA

    jenkins-ci.org | 1 year ago
    java.io.IOException: error=24, Too many open files

  1. eti22 1 times, last 1 month ago
  2. asdasd 24 times, last 3 months ago
  3. rexgreenza 8 times, last 3 months ago
  4. Benj-AD 1 times, last 4 months ago
  5. Akshay 4 times, last 6 months ago
95 unregistered visitors
Not finding the right solution?
Take a tour to get the most out of Samebug.

Tired of useless tips?

Automated exception search integrated into your IDE

Root Cause Analysis

  1. java.io.IOException

    java.io.IOException: error=24, Too many open files

    at java.lang.UNIXProcess.<init>()
  2. Java RT
    ProcessBuilder.start
    1. java.lang.UNIXProcess.<init>(Unknown Source)
    2. java.lang.ProcessImpl.start(Unknown Source)
    3. java.lang.ProcessBuilder.start(Unknown Source)
    3 frames
  3. azkaban.jobs.builtin
    ProcessJob.run
    1. azkaban.jobs.builtin.ProcessJob.run(ProcessJob.java:75)
    1 frame
  4. azkaban.app
    LoggingJob.run
    1. azkaban.app.LoggingJob.run(LoggingJob.java:93)
    1 frame
  5. Azkaban
    IndividualJobExecutableFlow$1.run
    1. azkaban.flow.IndividualJobExecutableFlow$1.run(IndividualJobExecutableFlow.java:171)
    1 frame
  6. Java RT
    Thread.run
    1. java.lang.Thread.run(Unknown Source)
    1 frame