java.lang.RuntimeException: java.lang.ClassNotFoundException: Class org.apache.hadoop.fs.s3native.NativeS3FileSystem not found ...

Google Groups | Richard Grossman | 9 months ago
tip
Click on the to mark the solution that helps you, Samebug will learn from it.
As a community member, you’ll be rewarded for you help.
  1. 0

    Error when indexing using Hortonworks YARN cluster

    Google Groups | 9 months ago | Richard Grossman
    java.lang.RuntimeException: java.lang.ClassNotFoundException: Class org.apache.hadoop.fs.s3native.NativeS3FileSystem not found ...

    Root Cause Analysis

    1. java.lang.RuntimeException

      java.lang.ClassNotFoundException: Class org.apache.hadoop.fs.s3native.NativeS3FileSystem not found ...

      at io.druid.indexer.DetermineHashedPartitionsJob.run()
    2. Druid Hadoop
      HadoopDruidDetermineConfigurationJob.run
      1. io.druid.indexer.DetermineHashedPartitionsJob.run(DetermineHashedPartitionsJob.java:116)[druid-indexing-hadoop-0.9.1.1.jar:0.9.1.1]
      2. io.druid.indexer.JobHelper.runJobs(JobHelper.java:323)[druid-indexing-hadoop-0.9.1.1.jar:0.9.1.1]
      3. io.druid.indexer.HadoopDruidDetermineConfigurationJob.run(HadoopDruidDetermineConfigurationJob.java:91)[druid-indexing-hadoop-0.9.1.1.jar:0.9.1.1]
      3 frames
    3. Druid Indexing
      HadoopIndexTask$HadoopDetermineConfigInnerProcessing.runTask
      1. io.druid.indexing.common.task.HadoopIndexTask$HadoopDetermineConfigInnerProcessing.runTask(HadoopIndexTask.java:291)[druid-indexing-service-0.9.1.1.jar:0.9.1.1]
      1 frame
    4. Java RT
      Method.invoke
      1. sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)[?:1.8.0_101]
      2. sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)[?:1.8.0_101]
      3. sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)[?:1.8.0_101]
      4. java.lang.reflect.Method.invoke(Method.java:498)[?:1.8.0_101]
      4 frames
    5. Druid Indexing
      HadoopTask.invokeForeignLoader
      1. io.druid.indexing.common.task.HadoopTask.invokeForeignLoader(HadoopTask.java:201)[druid-indexing-service-0.9.1.1.jar:0.9.1.1]
      1 frame