java.lang.IllegalStateException: MemcpyAsync H2H failed: [839371888] -> [38700713984]

GitHub | Jydago | 5 months ago
  1. 0

    GitHub comment 1822#232371459

    GitHub | 5 months ago | Jydago
    java.lang.IllegalStateException: MemcpyAsync H2H failed: [839371888] -> [38700713984]
  2. 0

    Error 74 when running DL4J using GPU

    GitHub | 5 months ago | Jydago
    java.lang.IllegalStateException: MemcpyAsync H2H failed: [843817088] -> [38700707840]
  3. 0

    Cannot use gpu with aws ami

    GitHub | 6 months ago | davireis
    java.lang.IllegalStateException: MemcpyAsync failed
  4. Speed up your debug routine!

    Automated exception search integrated into your IDE

  5. 0

    Error running MultiGPULenetMnistExample on Azure NV24

    GitHub | 3 months ago | wmeddie
    java.lang.IllegalStateException: MemcpyAsync H2H failed: [140394272981392] -> [8883763712]
  6. 0

    Cuda MemcpyAsync failed

    GitHub | 3 months ago | Jajawah
    java.lang.IllegalStateException: MemcpyAsync failed: AllocationShape(offset=0, length=256, stride=1, elementSize=8, dataType=DOUBLE)

    Not finding the right solution?
    Take a tour to get the most out of Samebug.

    Tired of useless tips?

    Automated exception search integrated into your IDE

    Root Cause Analysis

    1. java.lang.IllegalStateException

      MemcpyAsync H2H failed: [839371888] -> [38700713984]

      at org.nd4j.jita.handler.impl.CudaZeroHandler.memcpyAsync()
    2. org.nd4j.jita
      AtomicAllocator.memcpyAsync
      1. org.nd4j.jita.handler.impl.CudaZeroHandler.memcpyAsync(CudaZeroHandler.java:510)
      2. org.nd4j.jita.allocator.impl.AtomicAllocator.memcpyAsync(AtomicAllocator.java:774)
      2 frames
    3. org.nd4j.linalg
      CudaDataBufferFactory.createInt
      1. org.nd4j.linalg.jcublas.buffer.BaseCudaDataBuffer.set(BaseCudaDataBuffer.java:296)
      2. org.nd4j.linalg.jcublas.buffer.BaseCudaDataBuffer.setData(BaseCudaDataBuffer.java:366)
      3. org.nd4j.linalg.jcublas.buffer.CudaIntDataBuffer.<init>(CudaIntDataBuffer.java:74)
      4. org.nd4j.linalg.jcublas.buffer.factory.CudaDataBufferFactory.createInt(CudaDataBufferFactory.java:266)
      4 frames
    4. nd4j-api
      Nd4j.createBuffer
      1. org.nd4j.linalg.factory.Nd4j.createBuffer(Nd4j.java:1164)
      1 frame
    5. org.nd4j.linalg
      Shape.createShapeInformation
      1. org.nd4j.linalg.api.shape.Shape.createShapeInformation(Shape.java:1742)
      1 frame
    6. nd4j-api
      BaseShapeInfoProvider.createShapeInformation
      1. org.nd4j.linalg.api.ndarray.BaseShapeInfoProvider.createShapeInformation(BaseShapeInfoProvider.java:12)
      1 frame
    7. org.nd4j.jita
      ProtectedCudaShapeInfoProvider.createShapeInformation
      1. org.nd4j.jita.constant.ProtectedCudaShapeInfoProvider.createShapeInformation(ProtectedCudaShapeInfoProvider.java:52)
      1 frame
    8. org.nd4j.linalg
      CachedShapeInfoProvider.createShapeInformation
      1. org.nd4j.linalg.jcublas.CachedShapeInfoProvider.createShapeInformation(CachedShapeInfoProvider.java:41)
      1 frame
    9. nd4j-api
      BaseNDArray.<init>
      1. org.nd4j.linalg.api.ndarray.BaseNDArray.<init>(BaseNDArray.java:149)
      1 frame
    10. org.nd4j.linalg
      JCublasNDArrayFactory.create
      1. org.nd4j.linalg.jcublas.JCublasNDArray.<init>(JCublasNDArray.java:341)
      2. org.nd4j.linalg.jcublas.JCublasNDArrayFactory.create(JCublasNDArrayFactory.java:233)
      2 frames
    11. nd4j-api
      BaseNDArray.permute
      1. org.nd4j.linalg.factory.Nd4j.create(Nd4j.java:3612)
      2. org.nd4j.linalg.api.ndarray.BaseNDArray.create(BaseNDArray.java:1732)
      3. org.nd4j.linalg.api.ndarray.BaseNDArray.permute(BaseNDArray.java:4213)
      3 frames
    12. org.deeplearning4j.nn
      MultiLayerNetwork.computeGradientAndScore
      1. org.deeplearning4j.nn.layers.convolution.ConvolutionLayer.preOutput(ConvolutionLayer.java:224)
      2. org.deeplearning4j.nn.layers.convolution.ConvolutionLayer.activate(ConvolutionLayer.java:252)
      3. org.deeplearning4j.nn.layers.BaseLayer.activate(BaseLayer.java:390)
      4. org.deeplearning4j.nn.multilayer.MultiLayerNetwork.activationFromPrevLayer(MultiLayerNetwork.java:553)
      5. org.deeplearning4j.nn.multilayer.MultiLayerNetwork.feedForwardToLayer(MultiLayerNetwork.java:676)
      6. org.deeplearning4j.nn.multilayer.MultiLayerNetwork.computeGradientAndScore(MultiLayerNetwork.java:1793)
      6 frames
    13. org.deeplearning4j.optimize
      Solver.optimize
      1. org.deeplearning4j.optimize.solvers.BaseOptimizer.gradientAndScore(BaseOptimizer.java:152)
      2. org.deeplearning4j.optimize.solvers.StochasticGradientDescent.optimize(StochasticGradientDescent.java:56)
      3. org.deeplearning4j.optimize.Solver.optimize(Solver.java:51)
      3 frames
    14. org.deeplearning4j.nn
      MultiLayerNetwork.fit
      1. org.deeplearning4j.nn.multilayer.MultiLayerNetwork.fit(MultiLayerNetwork.java:1431)
      2. org.deeplearning4j.nn.multilayer.MultiLayerNetwork.fit(MultiLayerNetwork.java:1468)
      2 frames
    15. NeuralNetworkBuilder.Model
      ModelTrainer$$anonfun$trainModelLocally$1.apply
      1. NeuralNetworkBuilder.Model.ModelTrainer$$anonfun$trainModelLocally$1.apply(ModelTrainer.scala:91)
      2. NeuralNetworkBuilder.Model.ModelTrainer$$anonfun$trainModelLocally$1.apply(ModelTrainer.scala:82)
      2 frames
    16. Scala
      Range.foreach
      1. scala.collection.immutable.Range.foreach(Range.scala:166)
      1 frame
    17. NeuralNetworkBuilder.Model
      ModelTrainer.trainModelLocally
      1. NeuralNetworkBuilder.Model.ModelTrainer.trainModelLocally(ModelTrainer.scala:82)
      1 frame
    18. CNNs.Laptop
      testHotspots.main
      1. CNNs.Laptop.testHotspots$.main(testHotspots.scala:77)
      2. CNNs.Laptop.testHotspots.main(testHotspots.scala)
      2 frames
    19. Java RT
      Method.invoke
      1. sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
      2. sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
      3. sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
      4. java.lang.reflect.Method.invoke(Method.java:497)
      4 frames
    20. IDEA
      AppMain.main
      1. com.intellij.rt.execution.application.AppMain.main(AppMain.java:144)
      1 frame