org.apache.kafka.connect.errors.ConnectException: Error creating writer for log file hdfs://mynamenode:8020/logs/mytopic/0/log

GitHub | zako | 5 months ago
  1. 0

    Creation of log directory fails because of permission issues when using keytab

    GitHub | 5 months ago | zako
    org.apache.kafka.connect.errors.ConnectException: Error creating writer for log file hdfs://mynamenode:8020/logs/mytopic/0/log
  2. 0

    Hive can't import the flume tweet data to the Warehouse (HDFS)

    Stack Overflow | 2 years ago | user3590417
    org.apache.hadoop.hive.ql.metadata.HiveException: copyFiles: error while checking/creating destination directory!!!
  3. 0

    hive server 2- Exception hive.service.ServiceException: Error setting stage directories

    Stack Overflow | 2 years ago | Aaditya Raj
    org.apache.hive.service.ServiceException: Error setting stage directories
  4. Speed up your debug routine!

    Automated exception search integrated into your IDE

  5. 0

    AccessControlException when writing to HDFS from eclipse on windows

    Stack Overflow | 2 years ago | Arbi
    org.apache.hadoop.security.AccessControlException: Permission denied: user=Arbi, access=WRITE, inode="/tmp":hadoop:supergroup:drwxr-xr-x
  6. 0

    Give permissions for hdfs target directory using JAVA API

    Stack Overflow | 2 years ago
    org.apache.hadoop.security.AccessControlException: Permission denied: user=Srinivas.budida, access=WRITE, inode="/user/hdfs/Test":root:hadoop:-rw-r--r--

    4 unregistered visitors
    Not finding the right solution?
    Take a tour to get the most out of Samebug.

    Tired of useless tips?

    Automated exception search integrated into your IDE

    Root Cause Analysis

    1. org.apache.hadoop.security.AccessControlException

      Permission denied: user=myuser2, access=WRITE, inode="/logs/mytopic/0/log":myuser1:supergroup:-rw-r--r--

      at org.apache.hadoop.hdfs.server.namenode.DefaultAuthorizationProvider.checkFsPermission()
    2. Apache Hadoop HDFS
      ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod
      1. org.apache.hadoop.hdfs.server.namenode.DefaultAuthorizationProvider.checkFsPermission(DefaultAuthorizationProvider.java:281)
      2. org.apache.hadoop.hdfs.server.namenode.DefaultAuthorizationProvider.check(DefaultAuthorizationProvider.java:262)
      3. org.apache.hadoop.hdfs.server.namenode.DefaultAuthorizationProvider.checkPermission(DefaultAuthorizationProvider.java:175)
      4. org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkPermission(FSPermissionChecker.java:152)
      5. org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkPermission(FSNamesystem.java:6590)
      6. org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkPermission(FSNamesystem.java:6572)
      7. org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkPathAccess(FSNamesystem.java:6497)
      8. org.apache.hadoop.hdfs.server.namenode.FSNamesystem.appendFileInternal(FSNamesystem.java:2887)
      9. org.apache.hadoop.hdfs.server.namenode.FSNamesystem.appendFileInt(FSNamesystem.java:3189)
      10. org.apache.hadoop.hdfs.server.namenode.FSNamesystem.appendFile(FSNamesystem.java:3153)
      11. org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.append(NameNodeRpcServer.java:612)
      12. org.apache.hadoop.hdfs.server.namenode.AuthorizationProviderProxyClientProtocol.append(AuthorizationProviderProxyClientProtocol.java:125)
      13. org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.append(ClientNamenodeProtocolServerSideTranslatorPB.java:414)
      14. org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java)
      14 frames
    3. Hadoop
      Server$Handler$1.run
      1. org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:617)
      2. org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1073)
      3. org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2086)
      4. org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2082)
      4 frames
    4. Java RT
      Subject.doAs
      1. java.security.AccessController.doPrivileged(Native Method)
      2. javax.security.auth.Subject.doAs(Subject.java:422)
      2 frames
    5. Hadoop
      Server$Handler.run
      1. org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1693)
      2. org.apache.hadoop.ipc.Server$Handler.run(Server.java:2080)
      2 frames
    6. Java RT
      Constructor.newInstance
      1. sun.reflect.GeneratedConstructorAccessor92.newInstance(Unknown Source)
      2. sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
      3. java.lang.reflect.Constructor.newInstance(Constructor.java:423)
      3 frames
    7. Hadoop
      RemoteException.unwrapRemoteException
      1. org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:106)
      2. org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:73)
      2 frames
    8. Apache Hadoop HDFS
      DistributedFileSystem$4.doCall
      1. org.apache.hadoop.hdfs.DFSClient.callAppend(DFSClient.java:1769)
      2. org.apache.hadoop.hdfs.DFSClient.append(DFSClient.java:1803)
      3. org.apache.hadoop.hdfs.DFSClient.append(DFSClient.java:1796)
      4. org.apache.hadoop.hdfs.DistributedFileSystem$4.doCall(DistributedFileSystem.java:323)
      5. org.apache.hadoop.hdfs.DistributedFileSystem$4.doCall(DistributedFileSystem.java:319)
      5 frames
    9. Hadoop
      FileSystemLinkResolver.resolve
      1. org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81)
      1 frame
    10. Apache Hadoop HDFS
      DistributedFileSystem.append
      1. org.apache.hadoop.hdfs.DistributedFileSystem.append(DistributedFileSystem.java:319)
      1 frame
    11. Hadoop
      FileSystem.append
      1. org.apache.hadoop.fs.FileSystem.append(FileSystem.java:1173)
      1 frame
    12. io.confluent.connect
      HdfsSinkTask.put
      1. io.confluent.connect.hdfs.wal.WALFile$Writer.<init>(WALFile.java:221)
      2. io.confluent.connect.hdfs.wal.WALFile.createWriter(WALFile.java:67)
      3. io.confluent.connect.hdfs.wal.FSWAL.acquireLease(FSWAL.java:73)
      4. io.confluent.connect.hdfs.wal.FSWAL.apply(FSWAL.java:105)
      5. io.confluent.connect.hdfs.TopicPartitionWriter.applyWAL(TopicPartitionWriter.java:441)
      6. io.confluent.connect.hdfs.TopicPartitionWriter.recover(TopicPartitionWriter.java:197)
      7. io.confluent.connect.hdfs.TopicPartitionWriter.write(TopicPartitionWriter.java:227)
      8. io.confluent.connect.hdfs.DataWriter.write(DataWriter.java:234)
      9. io.confluent.connect.hdfs.HdfsSinkTask.put(HdfsSinkTask.java:91)
      9 frames
    13. org.apache.kafka
      WorkerTask.run
      1. org.apache.kafka.connect.runtime.WorkerSinkTask.deliverMessages(WorkerSinkTask.java:370)
      2. org.apache.kafka.connect.runtime.WorkerSinkTask.poll(WorkerSinkTask.java:227)
      3. org.apache.kafka.connect.runtime.WorkerSinkTask.iteration(WorkerSinkTask.java:170)
      4. org.apache.kafka.connect.runtime.WorkerSinkTask.execute(WorkerSinkTask.java:142)
      5. org.apache.kafka.connect.runtime.WorkerTask.doRun(WorkerTask.java:140)
      6. org.apache.kafka.connect.runtime.WorkerTask.run(WorkerTask.java:175)
      6 frames
    14. Java RT
      Thread.run
      1. java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
      2. java.util.concurrent.FutureTask.run(FutureTask.java:266)
      3. java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
      4. java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
      5. java.lang.Thread.run(Thread.java:745)
      5 frames