java.lang.reflect.InvocationTargetException

GitHub | brucehoff | 4 months ago
tip
Do you know that we can give you better hits? Get more relevant results from Samebug’s stack trace search.
  1. 0

    bm08: stderr: write /usr/lib/nvidia-367/libnvidia-compiler.so.367.57: no space left on device

    GitHub | 4 months ago | brucehoff
    java.lang.Exception: Submission ID: 7894062 Unable to pull image docker.synapse.org/syn7890435/dm-ls-train-dl@sha256:35fff23a1bc1e2ad79cd7e21ebd8c643630cb4b24b47ad6dbca515cdd2be3b6b after 6 try(ies).
  2. 0

    Two agents were able to assign a team to a server slot

    GitHub | 6 months ago | brucehoff
    java.lang.Exception: Submission ID: 7435455 Expected zero or one row (slot) for team 3346508 but found 2
  3. 0

    bm09 cannot start any containers

    GitHub | 3 months ago | brucehoff
    java.lang.Exception: Submission ID: 8058451 {"message":"containerd: container did not start before the specified timeout"}
  4. Speed up your debug routine!

    Automated exception search integrated into your IDE

    Not finding the right solution?
    Take a tour to get the most out of Samebug.

    Tired of useless tips?

    Automated exception search integrated into your IDE

    Root Cause Analysis

    1. com.github.dockerjava.api.exception.DockerClientException

      Could not pull image: failed to register layer: ApplyLayer exit status 1 stdout: stderr: write /usr/lib/nvidia-367/libnvidia-compiler.so.367.57: no space left on device

      at com.github.dockerjava.core.command.PullImageResultCallback.awaitSuccess()
    2. docker-java
      PullImageResultCallback.awaitSuccess
      1. com.github.dockerjava.core.command.PullImageResultCallback.awaitSuccess(PullImageResultCallback.java:50)
      1 frame
    3. org.sagebionetworks
      ChallengeDockerAgent.main
      1. org.sagebionetworks.DockerUtils.pullImageWithRetry(DockerUtils.java:220)
      2. org.sagebionetworks.DockerUtils.createContainer(DockerUtils.java:251)
      3. org.sagebionetworks.DockerUtils.createModelContainer(DockerUtils.java:199)
      4. org.sagebionetworks.Training.startTraining(Training.java:464)
      5. org.sagebionetworks.Training.startPreprocessAndTrainSubmission(Training.java:365)
      6. org.sagebionetworks.Training.createOrUpdateTrainingJobIntern(Training.java:188)
      7. org.sagebionetworks.Training.createOrUpdateTrainingJob(Training.java:157)
      8. org.sagebionetworks.ChallengeDockerAgent.execute(ChallengeDockerAgent.java:219)
      9. org.sagebionetworks.ChallengeDockerAgent.main(ChallengeDockerAgent.java:86)
      9 frames
    4. Java RT
      Method.invoke
      1. sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
      2. sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
      3. sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
      4. java.lang.reflect.Method.invoke(Method.java:606)
      4 frames
    5. org.codehaus.mojo
      ExecJavaMojo$1.run
      1. org.codehaus.mojo.exec.ExecJavaMojo$1.run(ExecJavaMojo.java:297)
      1 frame
    6. Java RT
      Thread.run
      1. java.lang.Thread.run(Thread.java:745)
      1 frame