org.apache.drill.common.exceptions.UserException: RESOURCE ERROR: One or more nodes ran out of memory while executing the query. [Error Id: 3323fd1c-4b78-42a7-b311-23ee73c7d550 ]

drill-dev | Khurram Faraaz (JIRA) | 1 year ago
tip
Your exception is missing from the Samebug knowledge base.
Here are the best solutions we found on the Internet.
Click on the to mark the helpful solution and get rewards for you help.
  1. 0

    [jira] [Created] (DRILL-4243) CTAS with partition by, results in Out Of Memory

    drill-dev | 1 year ago | Khurram Faraaz (JIRA)
    org.apache.drill.common.exceptions.UserException: RESOURCE ERROR: One or more nodes ran out of memory while executing the query. [Error Id: 3323fd1c-4b78-42a7-b311-23ee73c7d550 ]

    Root Cause Analysis

    1. org.apache.drill.exec.exception.OutOfMemoryException

      Unable to allocate sv2, and not enough batchGroups to spill

      at org.apache.drill.exec.physical.impl.xsort.ExternalSortBatch.newSV2()
    2. org.apache.drill
      FragmentExecutor$1.run
      1. org.apache.drill.exec.physical.impl.xsort.ExternalSortBatch.newSV2(ExternalSortBatch.java:620)[drill-java-exec-1.5.0-SNAPSHOT.jar:1.5.0-SNAPSHOT]
      2. org.apache.drill.exec.physical.impl.xsort.ExternalSortBatch.innerNext(ExternalSortBatch.java:352)[drill-java-exec-1.5.0-SNAPSHOT.jar:1.5.0-SNAPSHOT]
      3. org.apache.drill.exec.record.AbstractRecordBatch.next(AbstractRecordBatch.java:162)[drill-java-exec-1.5.0-SNAPSHOT.jar:1.5.0-SNAPSHOT]
      4. org.apache.drill.exec.record.AbstractRecordBatch.next(AbstractRecordBatch.java:119)[drill-java-exec-1.5.0-SNAPSHOT.jar:1.5.0-SNAPSHOT]
      5. org.apache.drill.exec.record.AbstractRecordBatch.next(AbstractRecordBatch.java:109)[drill-java-exec-1.5.0-SNAPSHOT.jar:1.5.0-SNAPSHOT]
      6. org.apache.drill.exec.record.AbstractSingleRecordBatch.innerNext(AbstractSingleRecordBatch.java:51)[drill-java-exec-1.5.0-SNAPSHOT.jar:1.5.0-SNAPSHOT]
      7. org.apache.drill.exec.physical.impl.svremover.RemovingRecordBatch.innerNext(RemovingRecordBatch.java:94)[drill-java-exec-1.5.0-SNAPSHOT.jar:1.5.0-SNAPSHOT]
      8. org.apache.drill.exec.record.AbstractRecordBatch.next(AbstractRecordBatch.java:162)[drill-java-exec-1.5.0-SNAPSHOT.jar:1.5.0-SNAPSHOT]
      9. org.apache.drill.exec.record.AbstractRecordBatch.next(AbstractRecordBatch.java:119)[drill-java-exec-1.5.0-SNAPSHOT.jar:1.5.0-SNAPSHOT]
      10. org.apache.drill.exec.record.AbstractRecordBatch.next(AbstractRecordBatch.java:109)[drill-java-exec-1.5.0-SNAPSHOT.jar:1.5.0-SNAPSHOT]
      11. org.apache.drill.exec.record.AbstractSingleRecordBatch.innerNext(AbstractSingleRecordBatch.java:51)[drill-java-exec-1.5.0-SNAPSHOT.jar:1.5.0-SNAPSHOT]
      12. org.apache.drill.exec.physical.impl.project.ProjectRecordBatch.innerNext(ProjectRecordBatch.java:132)[drill-java-exec-1.5.0-SNAPSHOT.jar:1.5.0-SNAPSHOT]
      13. org.apache.drill.exec.record.AbstractRecordBatch.next(AbstractRecordBatch.java:162)[drill-java-exec-1.5.0-SNAPSHOT.jar:1.5.0-SNAPSHOT]
      14. org.apache.drill.exec.record.AbstractRecordBatch.next(AbstractRecordBatch.java:119)[drill-java-exec-1.5.0-SNAPSHOT.jar:1.5.0-SNAPSHOT]
      15. org.apache.drill.exec.record.AbstractRecordBatch.next(AbstractRecordBatch.java:109)[drill-java-exec-1.5.0-SNAPSHOT.jar:1.5.0-SNAPSHOT]
      16. org.apache.drill.exec.record.AbstractSingleRecordBatch.innerNext(AbstractSingleRecordBatch.java:51)[drill-java-exec-1.5.0-SNAPSHOT.jar:1.5.0-SNAPSHOT]
      17. org.apache.drill.exec.physical.impl.project.ProjectRecordBatch.innerNext(ProjectRecordBatch.java:132)[drill-java-exec-1.5.0-SNAPSHOT.jar:1.5.0-SNAPSHOT]
      18. org.apache.drill.exec.record.AbstractRecordBatch.next(AbstractRecordBatch.java:162)[drill-java-exec-1.5.0-SNAPSHOT.jar:1.5.0-SNAPSHOT]
      19. org.apache.drill.exec.record.AbstractRecordBatch.next(AbstractRecordBatch.java:119)[drill-java-exec-1.5.0-SNAPSHOT.jar:1.5.0-SNAPSHOT]
      20. org.apache.drill.exec.record.AbstractRecordBatch.next(AbstractRecordBatch.java:109)[drill-java-exec-1.5.0-SNAPSHOT.jar:1.5.0-SNAPSHOT]
      21. org.apache.drill.exec.physical.impl.WriterRecordBatch.innerNext(WriterRecordBatch.java:91)[drill-java-exec-1.5.0-SNAPSHOT.jar:1.5.0-SNAPSHOT]
      22. org.apache.drill.exec.record.AbstractRecordBatch.next(AbstractRecordBatch.java:162)[drill-java-exec-1.5.0-SNAPSHOT.jar:1.5.0-SNAPSHOT]
      23. org.apache.drill.exec.record.AbstractRecordBatch.next(AbstractRecordBatch.java:119)[drill-java-exec-1.5.0-SNAPSHOT.jar:1.5.0-SNAPSHOT]
      24. org.apache.drill.exec.record.AbstractRecordBatch.next(AbstractRecordBatch.java:109)[drill-java-exec-1.5.0-SNAPSHOT.jar:1.5.0-SNAPSHOT]
      25. org.apache.drill.exec.record.AbstractSingleRecordBatch.innerNext(AbstractSingleRecordBatch.java:51)[drill-java-exec-1.5.0-SNAPSHOT.jar:1.5.0-SNAPSHOT]
      26. org.apache.drill.exec.physical.impl.project.ProjectRecordBatch.innerNext(ProjectRecordBatch.java:132)[drill-java-exec-1.5.0-SNAPSHOT.jar:1.5.0-SNAPSHOT]
      27. org.apache.drill.exec.record.AbstractRecordBatch.next(AbstractRecordBatch.java:162)[drill-java-exec-1.5.0-SNAPSHOT.jar:1.5.0-SNAPSHOT]
      28. org.apache.drill.exec.physical.impl.BaseRootExec.next(BaseRootExec.java:104)[drill-java-exec-1.5.0-SNAPSHOT.jar:1.5.0-SNAPSHOT]
      29. org.apache.drill.exec.physical.impl.ScreenCreator$ScreenRoot.innerNext(ScreenCreator.java:81)[drill-java-exec-1.5.0-SNAPSHOT.jar:1.5.0-SNAPSHOT]
      30. org.apache.drill.exec.physical.impl.BaseRootExec.next(BaseRootExec.java:94)[drill-java-exec-1.5.0-SNAPSHOT.jar:1.5.0-SNAPSHOT]
      31. org.apache.drill.exec.work.fragment.FragmentExecutor$1.run(FragmentExecutor.java:256)[drill-java-exec-1.5.0-SNAPSHOT.jar:1.5.0-SNAPSHOT]
      32. org.apache.drill.exec.work.fragment.FragmentExecutor$1.run(FragmentExecutor.java:250)[drill-java-exec-1.5.0-SNAPSHOT.jar:1.5.0-SNAPSHOT]
      32 frames
    3. Java RT
      Subject.doAs
      1. java.security.AccessController.doPrivileged(Native Method)[na:1.7.0_45]
      2. javax.security.auth.Subject.doAs(Subject.java:415)[na:1.7.0_45]
      2 frames
    4. Hadoop
      UserGroupInformation.doAs
      1. org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1595)[hadoop-common-2.7.0-mapr-1506.jar:na]
      1 frame
    5. org.apache.drill
      SelfCleaningRunnable.run
      1. org.apache.drill.exec.work.fragment.FragmentExecutor.run(FragmentExecutor.java:250)[drill-java-exec-1.5.0-SNAPSHOT.jar:1.5.0-SNAPSHOT]
      2. org.apache.drill.common.SelfCleaningRunnable.run(SelfCleaningRunnable.java:38)[drill-common-1.5.0-SNAPSHOT.jar:1.5.0-SNAPSHOT]
      2 frames
    6. Java RT
      Thread.run
      1. java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)[na:1.7.0_45]
      2. java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)[na:1.7.0_45]
      3. java.lang.Thread.run(Thread.java:744)[na:1.7.0_45]
      3 frames