org.apache.drill.common.exceptions.UserException: RESOURCE ERROR: One or more nodes ran out of memory while executing the query. [Error Id: 3323fd1c-4b78-42a7-b311-23ee73c7d550 ]

drill-dev | Khurram Faraaz (JIRA) | 11 months ago
  1. 0

    [jira] [Created] (DRILL-4243) CTAS with partition by, results in Out Of Memory

    drill-dev | 11 months ago | Khurram Faraaz (JIRA)
    org.apache.drill.common.exceptions.UserException: RESOURCE ERROR: One or more nodes ran out of memory while executing the query. [Error Id: 3323fd1c-4b78-42a7-b311-23ee73c7d550 ]

    Root Cause Analysis

    1. org.apache.drill.exec.exception.OutOfMemoryException

      Unable to allocate sv2, and not enough batchGroups to spill

      at org.apache.drill.exec.physical.impl.xsort.ExternalSortBatch.newSV2()
    2. org.apache.drill
      FragmentExecutor$1.run
      1. org.apache.drill.exec.physical.impl.xsort.ExternalSortBatch.newSV2(ExternalSortBatch.java:620)[drill-java-exec-1.5.0-SNAPSHOT.jar:1.5.0-SNAPSHOT]
      2. org.apache.drill.exec.physical.impl.xsort.ExternalSortBatch.innerNext(ExternalSortBatch.java:352)[drill-java-exec-1.5.0-SNAPSHOT.jar:1.5.0-SNAPSHOT]
      3. org.apache.drill.exec.record.AbstractRecordBatch.next(AbstractRecordBatch.java:162)[drill-java-exec-1.5.0-SNAPSHOT.jar:1.5.0-SNAPSHOT]
      4. org.apache.drill.exec.record.AbstractRecordBatch.next(AbstractRecordBatch.java:119)[drill-java-exec-1.5.0-SNAPSHOT.jar:1.5.0-SNAPSHOT]
      5. org.apache.drill.exec.record.AbstractRecordBatch.next(AbstractRecordBatch.java:109)[drill-java-exec-1.5.0-SNAPSHOT.jar:1.5.0-SNAPSHOT]
      6. org.apache.drill.exec.record.AbstractSingleRecordBatch.innerNext(AbstractSingleRecordBatch.java:51)[drill-java-exec-1.5.0-SNAPSHOT.jar:1.5.0-SNAPSHOT]
      7. org.apache.drill.exec.physical.impl.svremover.RemovingRecordBatch.innerNext(RemovingRecordBatch.java:94)[drill-java-exec-1.5.0-SNAPSHOT.jar:1.5.0-SNAPSHOT]
      8. org.apache.drill.exec.record.AbstractRecordBatch.next(AbstractRecordBatch.java:162)[drill-java-exec-1.5.0-SNAPSHOT.jar:1.5.0-SNAPSHOT]
      9. org.apache.drill.exec.record.AbstractRecordBatch.next(AbstractRecordBatch.java:119)[drill-java-exec-1.5.0-SNAPSHOT.jar:1.5.0-SNAPSHOT]
      10. org.apache.drill.exec.record.AbstractRecordBatch.next(AbstractRecordBatch.java:109)[drill-java-exec-1.5.0-SNAPSHOT.jar:1.5.0-SNAPSHOT]
      11. org.apache.drill.exec.record.AbstractSingleRecordBatch.innerNext(AbstractSingleRecordBatch.java:51)[drill-java-exec-1.5.0-SNAPSHOT.jar:1.5.0-SNAPSHOT]
      12. org.apache.drill.exec.physical.impl.project.ProjectRecordBatch.innerNext(ProjectRecordBatch.java:132)[drill-java-exec-1.5.0-SNAPSHOT.jar:1.5.0-SNAPSHOT]
      13. org.apache.drill.exec.record.AbstractRecordBatch.next(AbstractRecordBatch.java:162)[drill-java-exec-1.5.0-SNAPSHOT.jar:1.5.0-SNAPSHOT]
      14. org.apache.drill.exec.record.AbstractRecordBatch.next(AbstractRecordBatch.java:119)[drill-java-exec-1.5.0-SNAPSHOT.jar:1.5.0-SNAPSHOT]
      15. org.apache.drill.exec.record.AbstractRecordBatch.next(AbstractRecordBatch.java:109)[drill-java-exec-1.5.0-SNAPSHOT.jar:1.5.0-SNAPSHOT]
      16. org.apache.drill.exec.record.AbstractSingleRecordBatch.innerNext(AbstractSingleRecordBatch.java:51)[drill-java-exec-1.5.0-SNAPSHOT.jar:1.5.0-SNAPSHOT]
      17. org.apache.drill.exec.physical.impl.project.ProjectRecordBatch.innerNext(ProjectRecordBatch.java:132)[drill-java-exec-1.5.0-SNAPSHOT.jar:1.5.0-SNAPSHOT]
      18. org.apache.drill.exec.record.AbstractRecordBatch.next(AbstractRecordBatch.java:162)[drill-java-exec-1.5.0-SNAPSHOT.jar:1.5.0-SNAPSHOT]
      19. org.apache.drill.exec.record.AbstractRecordBatch.next(AbstractRecordBatch.java:119)[drill-java-exec-1.5.0-SNAPSHOT.jar:1.5.0-SNAPSHOT]
      20. org.apache.drill.exec.record.AbstractRecordBatch.next(AbstractRecordBatch.java:109)[drill-java-exec-1.5.0-SNAPSHOT.jar:1.5.0-SNAPSHOT]
      21. org.apache.drill.exec.physical.impl.WriterRecordBatch.innerNext(WriterRecordBatch.java:91)[drill-java-exec-1.5.0-SNAPSHOT.jar:1.5.0-SNAPSHOT]
      22. org.apache.drill.exec.record.AbstractRecordBatch.next(AbstractRecordBatch.java:162)[drill-java-exec-1.5.0-SNAPSHOT.jar:1.5.0-SNAPSHOT]
      23. org.apache.drill.exec.record.AbstractRecordBatch.next(AbstractRecordBatch.java:119)[drill-java-exec-1.5.0-SNAPSHOT.jar:1.5.0-SNAPSHOT]
      24. org.apache.drill.exec.record.AbstractRecordBatch.next(AbstractRecordBatch.java:109)[drill-java-exec-1.5.0-SNAPSHOT.jar:1.5.0-SNAPSHOT]
      25. org.apache.drill.exec.record.AbstractSingleRecordBatch.innerNext(AbstractSingleRecordBatch.java:51)[drill-java-exec-1.5.0-SNAPSHOT.jar:1.5.0-SNAPSHOT]
      26. org.apache.drill.exec.physical.impl.project.ProjectRecordBatch.innerNext(ProjectRecordBatch.java:132)[drill-java-exec-1.5.0-SNAPSHOT.jar:1.5.0-SNAPSHOT]
      27. org.apache.drill.exec.record.AbstractRecordBatch.next(AbstractRecordBatch.java:162)[drill-java-exec-1.5.0-SNAPSHOT.jar:1.5.0-SNAPSHOT]
      28. org.apache.drill.exec.physical.impl.BaseRootExec.next(BaseRootExec.java:104)[drill-java-exec-1.5.0-SNAPSHOT.jar:1.5.0-SNAPSHOT]
      29. org.apache.drill.exec.physical.impl.ScreenCreator$ScreenRoot.innerNext(ScreenCreator.java:81)[drill-java-exec-1.5.0-SNAPSHOT.jar:1.5.0-SNAPSHOT]
      30. org.apache.drill.exec.physical.impl.BaseRootExec.next(BaseRootExec.java:94)[drill-java-exec-1.5.0-SNAPSHOT.jar:1.5.0-SNAPSHOT]
      31. org.apache.drill.exec.work.fragment.FragmentExecutor$1.run(FragmentExecutor.java:256)[drill-java-exec-1.5.0-SNAPSHOT.jar:1.5.0-SNAPSHOT]
      32. org.apache.drill.exec.work.fragment.FragmentExecutor$1.run(FragmentExecutor.java:250)[drill-java-exec-1.5.0-SNAPSHOT.jar:1.5.0-SNAPSHOT]
      32 frames
    3. Java RT
      Subject.doAs
      1. java.security.AccessController.doPrivileged(Native Method)[na:1.7.0_45]
      2. javax.security.auth.Subject.doAs(Subject.java:415)[na:1.7.0_45]
      2 frames
    4. Hadoop
      UserGroupInformation.doAs
      1. org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1595)[hadoop-common-2.7.0-mapr-1506.jar:na]
      1 frame
    5. org.apache.drill
      SelfCleaningRunnable.run
      1. org.apache.drill.exec.work.fragment.FragmentExecutor.run(FragmentExecutor.java:250)[drill-java-exec-1.5.0-SNAPSHOT.jar:1.5.0-SNAPSHOT]
      2. org.apache.drill.common.SelfCleaningRunnable.run(SelfCleaningRunnable.java:38)[drill-common-1.5.0-SNAPSHOT.jar:1.5.0-SNAPSHOT]
      2 frames
    6. Java RT
      Thread.run
      1. java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)[na:1.7.0_45]
      2. java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)[na:1.7.0_45]
      3. java.lang.Thread.run(Thread.java:744)[na:1.7.0_45]
      3 frames