org.apache.hadoop.security.AccessControlException: Permission denied: user=Menmosyne, access=WRITE, inode="/user/Mnemosyne/.sparkStaging/application_1464874056768_0040":hdfs:hdfs:drwxr-xr-x

Stack Overflow | Mnemosyne | 3 months ago
  1. 0

    Running spark shell on yarn client error

    Stack Overflow | 3 months ago | Mnemosyne
    org.apache.hadoop.security.AccessControlException: Permission denied: user=Menmosyne, access=WRITE, inode="/user/Mnemosyne/.sparkStaging/application_1464874056768_0040":hdfs:hdfs:drwxr-xr-x
  2. 0

    Permission Denied

    GitHub | 8 months ago | xiaolezhu
    org.apache.hadoop.security.AccessControlException: Permission denied: user=tony, access=WRITE, inode="/user/yarn/hbase-staging/partitions_93adef32-3f25-49a0-a32c-c000f6bef025":yarn:hdfs:drwxr-xr-x
  3. 0

    HDP2.2_troubleshoot.md · GitHub

    github.com | 9 months ago
    org.apache.hadoop.security.AccessControlException: Permission denied: user=mapred, access=READ_EXECUTE, inode="/mr-history/tmp/client":client:hdfs:drwxrwx---
  4. Speed up your debug routine!

    Automated exception search integrated into your IDE

  5. 0

    MapRedTask failed when executing Hive mapreduce query from beeline - Hortonworks

    hortonworks.com | 1 year ago
    org.apache.hadoop.security.AccessControlException: Permission denied: user=hive, access=EXECUTE, inode=”/tmp/hive-hive/hive_2013-11-18_12-47-20_879_8044219515320128885-2″:hdfs:hdfs:drwx——
  6. 0

    Tez session has shutdown when running hive import through oozie because of permission denied error - Hortonworks

    hortonworks.com | 6 months ago
    org.apache.hadoop.security.AccessControlException: Permission denied: user=oozie, access=EXECUTE, inode="/tmp/hive/yarn/_tez_session_dir/34917396-071a-4c6d-8890-b7af69bc42fa/hive-hcatalog-core.jar":yarn:hdfs:drwx------ 32056 [Thread-30] INFO org.apache.sqoop.hive.HiveImport - at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.check(FSPermissionChecker.java:319) 2016-05-14 20:16:24,014 INFO [Thread-30] hive.HiveImport (LoggingAsyncSink.java:run(85)) - at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.check(FSPermissionChecker.java:319) 32056 [Thread-30] INFO org.apache.sqoop.hive.HiveImport - at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkTraverse(FSPermissionChecker.java:259) 2016-05-14 20:16:24,014 INFO [Thread-30] hive.HiveImport (LoggingAsyncSink.java:run(85)) - at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkTraverse(FSPermissionChecker.java:259) 32056 [Thread-30] INFO org.apache.sqoop.hive.HiveImport - at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkPermission(FSPermissionChecker.java:205) 2016-05-14 20:16:24,014 INFO [Thread-30] hive.HiveImport (LoggingAsyncSink.java:run(85)) - at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkPermission(FSPermissionChecker.java:205) 32056 [Thread-30] INFO org.apache.sqoop.hive.HiveImport - at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkPermission(FSPermissionChecker.java:190) 2016-05-14 20:16:24,014 INFO [Thread-30] hive.HiveImport (LoggingAsyncSink.java:run(85)) - at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkPermission(FSPermissionChecker.java:190) 32056 [Thread-30] INFO org.apache.sqoop.hive.HiveImport - at org.apache.hadoop.hdfs.server.namenode.FSDirectory.checkPermission(FSDirectory.java:1771) 2016-05-14 20:16:24,014 INFO [Thread-30] hive.HiveImport (LoggingAsyncSink.java:run(85)) - at org.apache.hadoop.hdfs.server.namenode.FSDirectory.checkPermission(FSDirectory.java:1771) 32056 [Thread-30] INFO org.apache.sqoop.hive.HiveImport - at org.apache.hadoop.hdfs.server.namenode.FSDirStatAndListingOp.getFileInfo(FSDirStatAndListingOp.java:108) 2016-05-14 20:16:24,014 INFO [Thread-30] hive.HiveImport (LoggingAsyncSink.java:run(85)) - at org.apache.hadoop.hdfs.server.namenode.FSDirStatAndListingOp.getFileInfo(FSDirStatAndListingOp.java:108) 32056 [Thread-30] INFO org.apache.sqoop.hive.HiveImport - at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getFileInfo(FSNamesystem.java:3866) 2016-05-14 20:16:24,014 INFO [Thread-30] hive.HiveImport (LoggingAsyncSink.java:run(85)) - at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getFileInfo(FSNamesystem.java:3866) 32056 [Thread-30] INFO org.apache.sqoop.hive.HiveImport - at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getFileInfo(NameNodeRpcServer.java:1076) 2016-05-14 20:16:24,014 INFO [Thread-30] hive.HiveImport (LoggingAsyncSink.java:run(85)) - at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getFileInfo(NameNodeRpcServer.java:1076) 32057 [Thread-30] INFO org.apache.sqoop.hive.HiveImport - at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getFileInfo(ClientNamenodeProtocolServerSideTranslatorPB.java:843) 2016-05-14 20:16:24,015 INFO [Thread-30] hive.HiveImport (LoggingAsyncSink.java:run(85)) - at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getFileInfo(ClientNamenodeProtocolServerSideTranslatorPB.java:843) 32057 [Thread-30] INFO org.apache.sqoop.hive.HiveImport - at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) 2016-05-14 20:16:24,015 INFO [Thread-30] hive.HiveImport (LoggingAsyncSink.java:run(85)) - at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) 32057 [Thread-30] INFO org.apache.sqoop.hive.HiveImport - at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:616) 2016-05-14 20:16:24,015 INFO [Thread-30] hive.HiveImport (LoggingAsyncSink.java:run(85)) - at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:616) 32057 [Thread-30] INFO org.apache.sqoop.hive.HiveImport - at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:969) 2016-05-14 20:16:24,015 INFO [Thread-30] hive.HiveImport (LoggingAsyncSink.java:run(85)) - at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:969) 32057 [Thread-30] INFO org.apache.sqoop.hive.HiveImport - at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2151) 2016-05-14 20:16:24,015 INFO [Thread-30] hive.HiveImport (LoggingAsyncSink.java:run(85)) - at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2151) 32057 [Thread-30] INFO org.apache.sqoop.hive.HiveImport - at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2147) 2016-05-14 20:16:24,015 INFO [Thread-30] hive.HiveImport (LoggingAsyncSink.java:run(85)) - at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2147) 32057 [Thread-30] INFO org.apache.sqoop.hive.HiveImport - at java.security.AccessController.doPrivileged(Native Method) 2016-05-14 20:16:24,015 INFO [Thread-30] hive.HiveImport (LoggingAsyncSink.java:run(85)) - at java.security.AccessController.doPrivileged(Native Method) 32057 [Thread-30] INFO org.apache.sqoop.hive.HiveImport - at javax.security.auth.Subject.doAs(Subject.java:422) 2016-05-14 20:16:24,015 INFO [Thread-30] hive.HiveImport (LoggingAsyncSink.java:run(85)) - at javax.security.auth.Subject.doAs(Subject.java:422) 32057 [Thread-30] INFO org.apache.sqoop.hive.HiveImport - at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657) 2016-05-14 20:16:24,015 INFO [Thread-30] hive.HiveImport (LoggingAsyncSink.java:run(85)) - at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657) 32058 [Thread-30] INFO org.apache.sqoop.hive.HiveImport - at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2145) 2016-05-14 20:16:24,016 INFO [Thread-30] hive.HiveImport (LoggingAsyncSink.java:run(85)) - at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2145) 32058 [Thread-30] INFO org.apache.sqoop.hive.HiveImport - 2016-05-14 20:16:24,016 INFO [Thread-30] hive.HiveImport (LoggingAsyncSink.java:run(85)) - 32058 [Thread-30] INFO org.apache.sqoop.hive.HiveImport - at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) 2016-05-14 20:16:24,016 INFO [Thread-30] hive.HiveImport (LoggingAsyncSink.java:run(85)) - at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) 32058 [Thread-30] INFO org.apache.sqoop.hive.HiveImport - at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) 2016-05-14 20:16:24,016 INFO [Thread-30] hive.HiveImport (LoggingAsyncSink.java:run(85)) - at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) 32058 [Thread-30] INFO org.apache.sqoop.hive.HiveImport - at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) 2016-05-14 20:16:24,016 INFO [Thread-30] hive.HiveImport (LoggingAsyncSink.java:run(85)) - at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) 32058 [Thread-30] INFO org.apache.sqoop.hive.HiveImport - at java.lang.reflect.Constructor.newInstance(Constructor.java:422) 2016-05-14 20:16:24,016 INFO [Thread-30] hive.HiveImport (LoggingAsyncSink.java:run(85)) - at java.lang.reflect.Constructor.newInstance(Constructor.java:422) 32058 [Thread-30] INFO org.apache.sqoop.hive.HiveImport - at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:106) 2016-05-14 20:16:24,016 INFO [Thread-30] hive.HiveImport (LoggingAsyncSink.java:run(85)) - at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:106) 32058 [Thread-30] INFO org.apache.sqoop.hive.HiveImport - at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:73) 2016-05-14 20:16:24,016 INFO [Thread-30] hive.HiveImport (LoggingAsyncSink.java:run(85)) - at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:73) 32058 [Thread-30] INFO org.apache.sqoop.hive.HiveImport - at org.apache.hadoop.hdfs.DFSClient.getFileInfo(DFSClient.java:2118) 2016-05-14 20:16:24,016 INFO [Thread-30] hive.HiveImport (LoggingAsyncSink.java:run(85)) - at org.apache.hadoop.hdfs.DFSClient.getFileInfo(DFSClient.java:2118) 32058 [Thread-30] INFO org.apache.sqoop.hive.HiveImport - at org.apache.hadoop.hdfs.DistributedFileSystem$22.doCall(DistributedFileSystem.java:1315) 2016-05-14 20:16:24,016 INFO [Thread-30] hive.HiveImport (LoggingAsyncSink.java:run(85)) - at org.apache.hadoop.hdfs.DistributedFileSystem$22.doCall(DistributedFileSystem.java:1315) 32058 [Thread-30] INFO org.apache.sqoop.hive.HiveImport - at org.apache.hadoop.hdfs.DistributedFileSystem$22.doCall(DistributedFileSystem.java:1311) 2016-05-14 20:16:24,016 INFO [Thread-30] hive.HiveImport (LoggingAsyncSink.java:run(85)) - at org.apache.hadoop.hdfs.DistributedFileSystem$22.doCall(DistributedFileSystem.java:1311) 32058 [Thread-30] INFO org.apache.sqoop.hive.HiveImport - at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) 2016-05-14 20:16:24,016 INFO [Thread-30] hive.HiveImport (LoggingAsyncSink.java:run(85)) - at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) 32059 [Thread-30] INFO org.apache.sqoop.hive.HiveImport - at org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus(DistributedFileSystem.java:1311) 2016-05-14 20:16:24,017 INFO [Thread-30] hive.HiveImport (LoggingAsyncSink.java:run(85)) - at org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus(DistributedFileSystem.java:1311) 32059 [Thread-30] INFO org.apache.sqoop.hive.HiveImport - at org.apache.hadoop.yarn.util.FSDownload.copy(FSDownload.java:253) 2016-05-14 20:16:24,017 INFO [Thread-30] hive.HiveImport (LoggingAsyncSink.java:run(85)) - at org.apache.hadoop.yarn.util.FSDownload.copy(FSDownload.java:253) 32059 [Thread-30] INFO org.apache.sqoop.hive.HiveImport - at org.apache.hadoop.yarn.util.FSDownload.access$000(FSDownload.java:63) 2016-05-14 20:16:24,017 INFO [Thread-30] hive.HiveImport (LoggingAsyncSink.java:run(85)) - at org.apache.hadoop.yarn.util.FSDownload.access$000(FSDownload.java:63) 32059 [Thread-30] INFO org.apache.sqoop.hive.HiveImport - at org.apache.hadoop.yarn.util.FSDownload$2.run(FSDownload.java:361) 2016-05-14 20:16:24,017 INFO [Thread-30] hive.HiveImport (LoggingAsyncSink.java:run(85)) - at org.apache.hadoop.yarn.util.FSDownload$2.run(FSDownload.java:361) 32059 [Thread-30] INFO org.apache.sqoop.hive.HiveImport - at org.apache.hadoop.yarn.util.FSDownload$2.run(FSDownload.java:359) 2016-05-14 20:16:24,017 INFO [Thread-30] hive.HiveImport (LoggingAsyncSink.java:run(85)) - at org.apache.hadoop.yarn.util.FSDownload$2.run(FSDownload.java:359) 32059 [Thread-30] INFO org.apache.sqoop.hive.HiveImport - at java.security.AccessController.doPrivileged(Native Method) 2016-05-14 20:16:24,017 INFO [Thread-30] hive.HiveImport (LoggingAsyncSink.java:run(85)) - at java.security.AccessController.doPrivileged(Native Method) 32059 [Thread-30] INFO org.apache.sqoop.hive.HiveImport - at javax.security.auth.Subject.doAs(Subject.java:422) 2016-05-14 20:16:24,017 INFO [Thread-30] hive.HiveImport (LoggingAsyncSink.java:run(85)) - at javax.security.auth.Subject.doAs(Subject.java:422) 32059 [Thread-30] INFO org.apache.sqoop.hive.HiveImport - at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657) 2016-05-14 20:16:24,017 INFO [Thread-30] hive.HiveImport (LoggingAsyncSink.java:run(85)) - at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657) 32059 [Thread-30] INFO org.apache.sqoop.hive.HiveImport - at org.apache.hadoop.yarn.util.FSDownload.call(FSDownload.java:358) 2016-05-14 20:16:24,017 INFO [Thread-30] hive.HiveImport (LoggingAsyncSink.java:run(85)) - at org.apache.hadoop.yarn.util.FSDownload.call(FSDownload.java:358) 32059 [Thread-30] INFO org.apache.sqoop.hive.HiveImport - at org.apache.hadoop.yarn.util.FSDownload.call(FSDownload.java:62) 2016-05-14 20:16:24,017 INFO [Thread-30] hive.HiveImport (LoggingAsyncSink.java:run(85)) - at org.apache.hadoop.yarn.util.FSDownload.call(FSDownload.java:62) 32059 [Thread-30] INFO org.apache.sqoop.hive.HiveImport - at java.util.concurrent.FutureTask.run(FutureTask.java:266) 2016-05-14 20:16:24,017 INFO [Thread-30] hive.HiveImport (LoggingAsyncSink.java:run(85)) - at java.util.concurrent.FutureTask.run(FutureTask.java:266) 32060 [Thread-30] INFO org.apache.sqoop.hive.HiveImport - at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) 2016-05-14 20:16:24,018 INFO [Thread-30] hive.HiveImport (LoggingAsyncSink.java:run(85)) - at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) 32060 [Thread-30] INFO org.apache.sqoop.hive.HiveImport - at java.util.concurrent.FutureTask.run(FutureTask.java:266) 2016-05-14 20:16:24,018 INFO [Thread-30] hive.HiveImport (LoggingAsyncSink.java:run(85)) - at java.util.concurrent.FutureTask.run(FutureTask.java:266) 32060 [Thread-30] INFO org.apache.sqoop.hive.HiveImport - at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) 2016-05-14 20:16:24,018 INFO [Thread-30] hive.HiveImport (LoggingAsyncSink.java:run(85)) - at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) 32060 [Thread-30] INFO org.apache.sqoop.hive.HiveImport - at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) 2016-05-14 20:16:24,018 INFO [Thread-30] hive.HiveImport (LoggingAsyncSink.java:run(85)) - at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) 32060 [Thread-30] INFO org.apache.sqoop.hive.HiveImport - at java.lang.Thread.run(Thread.java:745) 2016-05-14 20:16:24,018 INFO [Thread-30] hive.HiveImport (LoggingAsyncSink.java:run(85)) - at java.lang.Thread.run(Thread.java:745) 32060 [Thread-30] INFO org.apache.sqoop.hive.HiveImport - Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.security.AccessControlException): Permission denied: user=oozie, access=EXECUTE, inode="/tmp/hive/yarn/_tez_session_dir/34917396-071a-4c6d-8890-b7af69bc42fa/hive-hcatalog-core.jar":yarn:hdfs:drwx------ 2016-05-14 20:16:24,018 INFO [Thread-30] hive.HiveImport (LoggingAsyncSink.java:run(85)) - Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.security.AccessControlException): Permission denied: user=oozie, access=EXECUTE, inode="/tmp/hive/yarn/_tez_session_dir/34917396-071a-4c6d-8890-b7af69bc42fa/hive-hcatalog-core.jar":yarn:hdfs:drwx------ 32060 [Thread-30] INFO org.apache.sqoop.hive.HiveImport - at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.check(FSPermissionChecker.java:319) 2016-05-14 20:16:24,018 INFO [Thread-30] hive.HiveImport (LoggingAsyncSink.java:run(85)) - at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.check(FSPermissionChecker.java:319) 32060 [Thread-30] INFO org.apache.sqoop.hive.HiveImport - at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkTraverse(FSPermissionChecker.java:259) 2016-05-14 20:16:24,018 INFO [Thread-30] hive.HiveImport (LoggingAsyncSink.java:run(85)) - at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkTraverse(FSPermissionChecker.java:259) 32060 [Thread-30] INFO org.apache.sqoop.hive.HiveImport - at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkPermission(FSPermissionChecker.java:205) 2016-05-14 20:16:24,018 INFO [Thread-30] hive.HiveImport (LoggingAsyncSink.java:run(85)) - at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkPermission(FSPermissionChecker.java:205) 32061 [Thread-30] INFO org.apache.sqoop.hive.HiveImport - at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkPermission(FSPermissionChecker.java:190) 2016-05-14 20:16:24,019 INFO [Thread-30] hive.HiveImport (LoggingAsyncSink.java:run(85)) - at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkPermission(FSPermissionChecker.java:190) 32061 [Thread-30] INFO org.apache.sqoop.hive.HiveImport - at org.apache.hadoop.hdfs.server.namenode.FSDirectory.checkPermission(FSDirectory.java:1771) 2016-05-14 20:16:24,019 INFO [Thread-30] hive.HiveImport (LoggingAsyncSink.java:run(85)) - at org.apache.hadoop.hdfs.server.namenode.FSDirectory.checkPermission(FSDirectory.java:1771) 32061 [Thread-30] INFO org.apache.sqoop.hive.HiveImport - at org.apache.hadoop.hdfs.server.namenode.FSDirStatAndListingOp.getFileInfo(FSDirStatAndListingOp.java:108) 2016-05-14 20:16:24,019 INFO [Thread-30] hive.HiveImport (LoggingAsyncSink.java:run(85)) - at org.apache.hadoop.hdfs.server.namenode.FSDirStatAndListingOp.getFileInfo(FSDirStatAndListingOp.java:108) 32061 [Thread-30] INFO org.apache.sqoop.hive.HiveImport - at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getFileInfo(FSNamesystem.java:3866) 2016-05-14 20:16:24,019 INFO [Thread-30] hive.HiveImport (LoggingAsyncSink.java:run(85)) - at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getFileInfo(FSNamesystem.java:3866) 32061 [Thread-30] INFO org.apache.sqoop.hive.HiveImport - at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getFileInfo(NameNodeRpcServer.java:1076) 2016-05-14 20:16:24,019 INFO [Thread-30] hive.HiveImport (LoggingAsyncSink.java:run(85)) - at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getFileInfo(NameNodeRpcServer.java:1076) 32061 [Thread-30] INFO org.apache.sqoop.hive.HiveImport - at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getFileInfo(ClientNamenodeProtocolServerSideTranslatorPB.java:843) 2016-05-14 20:16:24,019 INFO [Thread-30] hive.HiveImport (LoggingAsyncSink.java:run(85)) - at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getFileInfo(ClientNamenodeProtocolServerSideTranslatorPB.java:843) 32061 [Thread-30] INFO org.apache.sqoop.hive.HiveImport - at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) 2016-05-14 20:16:24,019 INFO [Thread-30] hive.HiveImport (LoggingAsyncSink.java:run(85)) - at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) 32061 [Thread-30] INFO org.apache.sqoop.hive.HiveImport - at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:616) 2016-05-14 20:16:24,019 INFO [Thread-30] hive.HiveImport (LoggingAsyncSink.java:run(85)) - at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:616) 32061 [Thread-30] INFO org.apache.sqoop.hive.HiveImport - at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:969) 2016-05-14 20:16:24,019 INFO [Thread-30] hive.HiveImport (LoggingAsyncSink.java:run(85)) - at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:969) 32061 [Thread-30] INFO org.apache.sqoop.hive.HiveImport - at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2151) 2016-05-14 20:16:24,019 INFO [Thread-30] hive.HiveImport (LoggingAsyncSink.java:run(85)) - at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2151) 32061 [Thread-30] INFO org.apache.sqoop.hive.HiveImport - at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2147) 2016-05-14 20:16:24,019 INFO [Thread-30] hive.HiveImport (LoggingAsyncSink.java:run(85)) - at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2147) 32061 [Thread-30] INFO org.apache.sqoop.hive.HiveImport - at java.security.AccessController.doPrivileged(Native Method) 2016-05-14 20:16:24,019 INFO [Thread-30] hive.HiveImport (LoggingAsyncSink.java:run(85)) - at java.security.AccessController.doPrivileged(Native Method) 32062 [Thread-30] INFO org.apache.sqoop.hive.HiveImport - at javax.security.auth.Subject.doAs(Subject.java:422) 2016-05-14 20:16:24,020 INFO [Thread-30] hive.HiveImport (LoggingAsyncSink.java:run(85)) - at javax.security.auth.Subject.doAs(Subject.java:422) 32062 [Thread-30] INFO org.apache.sqoop.hive.HiveImport - at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657) 2016-05-14 20:16:24,020 INFO [Thread-30] hive.HiveImport (LoggingAsyncSink.java:run(85)) - at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657) 32062 [Thread-30] INFO org.apache.sqoop.hive.HiveImport - at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2145) 2016-05-14 20:16:24,020 INFO [Thread-30] hive.HiveImport (LoggingAsyncSink.java:run(85)) - at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2145) 32062 [Thread-30] INFO org.apache.sqoop.hive.HiveImport - 2016-05-14 20:16:24,020 INFO [Thread-30] hive.HiveImport (LoggingAsyncSink.java:run(85)) - 32062 [Thread-30] INFO org.apache.sqoop.hive.HiveImport - at org.apache.hadoop.ipc.Client.call(Client.java:1427) 2016-05-14 20:16:24,020 INFO [Thread-30] hive.HiveImport (LoggingAsyncSink.java:run(85)) - at org.apache.hadoop.ipc.Client.call(Client.java:1427) 32062 [Thread-30] INFO org.apache.sqoop.hive.HiveImport - at org.apache.hadoop.ipc.Client.call(Client.java:1358) 2016-05-14 20:16:24,020 INFO [Thread-30] hive.HiveImport (LoggingAsyncSink.java:run(85)) - at org.apache.hadoop.ipc.Client.call(Client.java:1358) 32062 [Thread-30] INFO org.apache.sqoop.hive.HiveImport - at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:229) 2016-05-14 20:16:24,020 INFO [Thread-30] hive.HiveImport (LoggingAsyncSink.java:run(85)) - at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:229) 32062 [Thread-30] INFO org.apache.sqoop.hive.HiveImport - at com.sun.proxy.$Proxy79.getFileInfo(Unknown Source) 2016-05-14 20:16:24,020 INFO [Thread-30] hive.HiveImport (LoggingAsyncSink.java:run(85)) - at com.sun.proxy.$Proxy79.getFileInfo(Unknown Source) 32062 [Thread-30] INFO org.apache.sqoop.hive.HiveImport - at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getFileInfo(ClientNamenodeProtocolTranslatorPB.java:771) 2016-05-14 20:16:24,020 INFO [Thread-30] hive.HiveImport (LoggingAsyncSink.java:run(85)) - at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getFileInfo(ClientNamenodeProtocolTranslatorPB.java:771) 32062 [Thread-30] INFO org.apache.sqoop.hive.HiveImport - at sun.reflect.GeneratedMethodAccessor25.invoke(Unknown Source) 2016-05-14 20:16:24,020 INFO [Thread-30] hive.HiveImport (LoggingAsyncSink.java:run(85)) - at sun.reflect.GeneratedMethodAccessor25.invoke(Unknown Source) 32062 [Thread-30] INFO org.apache.sqoop.hive.HiveImport - at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) 2016-05-14 20:16:24,020 INFO [Thread-30] hive.HiveImport (LoggingAsyncSink.java:run(85)) - at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) 32063 [Thread-30] INFO org.apache.sqoop.hive.HiveImport - at java.lang.reflect.Method.invoke(Method.java:497) 2016-05-14 20:16:24,021 INFO [Thread-30] hive.HiveImport (LoggingAsyncSink.java:run(85)) - at java.lang.reflect.Method.invoke(Method.java:497) 32063 [Thread-30] INFO org.apache.sqoop.hive.HiveImport - at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:252) 2016-05-14 20:16:24,021 INFO [Thread-30] hive.HiveImport (LoggingAsyncSink.java:run(85)) - at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:252) 32063 [Thread-30] INFO org.apache.sqoop.hive.HiveImport - at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:104) 2016-05-14 20:16:24,021 INFO [Thread-30] hive.HiveImport (LoggingAsyncSink.java:run(85)) - at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:104) 32063 [Thread-30] INFO org.apache.sqoop.hive.HiveImport - at com.sun.proxy.$Proxy80.getFileInfo(Unknown Source) 2016-05-14 20:16:24,021 INFO [Thread-30] hive.HiveImport (LoggingAsyncSink.java:run(85)) - at com.sun.proxy.$Proxy80.getFileInfo(Unknown Source) 32063 [Thread-30] INFO org.apache.sqoop.hive.HiveImport - at org.apache.hadoop.hdfs.DFSClient.getFileInfo(DFSClient.java:2116) 2016-05-14 20:16:24,021 INFO [Thread-30] hive.HiveImport (LoggingAsyncSink.java:run(85)) - at org.apache.hadoop.hdfs.DFSClient.getFileInfo(DFSClient.java:2116) 32063 [Thread-30] INFO org.apache.sqoop.hive.HiveImport - ... 19 more 2016-05-14 20:16:24,021 INFO [Thread-30] hive.HiveImport (LoggingAsyncSink.java:run(85)) - ... 19 more 32063 [Thread-30] INFO org.apache.sqoop.hive.HiveImport - Caused by: Permission denied: user=oozie, access=EXECUTE, inode="/tmp/hive/yarn/_tez_session_dir/34917396-071a-4c6d-8890-b7af69bc42fa/hive-hcatalog-core.jar":yarn:hdfs:drwx------ 2016-05-14 20:16:24,021 INFO [Thread-30] hive.HiveImport (LoggingAsyncSink.java:run(85)) - Caused by: Permission denied: user=oozie, access=EXECUTE, inode="/tmp/hive/yarn/_tez_session_dir/34917396-071a-4c6d-8890-b7af69bc42fa/hive-hcatalog-core.jar":yarn:hdfs:drwx------ 32063 [Thread-30] INFO org.apache.sqoop.hive.HiveImport - at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.check(FSPermissionChecker.java:319) 2016-05-14 20:16:24,021 INFO [Thread-30] hive.HiveImport (LoggingAsyncSink.java:run(85)) - at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.check(FSPermissionChecker.java:319) 32063 [Thread-30] INFO org.apache.sqoop.hive.HiveImport - at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkTraverse(FSPermissionChecker.java:259) 2016-05-14 20:16:24,021 INFO [Thread-30] hive.HiveImport (LoggingAsyncSink.java:run(85)) - at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkTraverse(FSPermissionChecker.java:259) 32063 [Thread-30] INFO org.apache.sqoop.hive.HiveImport - at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkPermission(FSPermissionChecker.java:205) 2016-05-14 20:16:24,021 INFO [Thread-30] hive.HiveImport (LoggingAsyncSink.java:run(85)) - at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkPermission(FSPermissionChecker.java:205) 32063 [Thread-30] INFO org.apache.sqoop.hive.HiveImport - at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkPermission(FSPermissionChecker.java:190) 2016-05-14 20:16:24,021 INFO [Thread-30] hive.HiveImport (LoggingAsyncSink.java:run(85)) - at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkPermission(FSPermissionChecker.java:190) 32063 [Thread-30] INFO org.apache.sqoop.hive.HiveImport - at org.apache.hadoop.hdfs.server.namenode.FSDirectory.checkPermission(FSDirectory.java:1771) 2016-05-14 20:16:24,021 INFO [Thread-30] hive.HiveImport (LoggingAsyncSink.java:run(85)) - at org.apache.hadoop.hdfs.server.namenode.FSDirectory.checkPermission(FSDirectory.java:1771) 32063 [Thread-30] INFO org.apache.sqoop.hive.HiveImport - at org.apache.hadoop.hdfs.server.namenode.FSDirStatAndListingOp.getFileInfo(FSDirStatAndListingOp.java:108) 2016-05-14 20:16:24,021 INFO [Thread-30] hive.HiveImport (LoggingAsyncSink.java:run(85)) - at org.apache.hadoop.hdfs.server.namenode.FSDirStatAndListingOp.getFileInfo(FSDirStatAndListingOp.java:108) 32063 [Thread-30] INFO org.apache.sqoop.hive.HiveImport - at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getFileInfo(FSNamesystem.java:3866) 2016-05-14 20:16:24,021 INFO [Thread-30] hive.HiveImport (LoggingAsyncSink.java:run(85)) - at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getFileInfo(FSNamesystem.java:3866) 32063 [Thread-30] INFO org.apache.sqoop.hive.HiveImport - at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getFileInfo(NameNodeRpcServer.java:1076) 2016-05-14 20:16:24,021 INFO [Thread-30] hive.HiveImport (LoggingAsyncSink.java:run(85)) - at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getFileInfo(NameNodeRpcServer.java:1076) 32064 [Thread-30] INFO org.apache.sqoop.hive.HiveImport - at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getFileInfo(ClientNamenodeProtocolServerSideTranslatorPB.java:843) 2016-05-14 20:16:24,022 INFO [Thread-30] hive.HiveImport (LoggingAsyncSink.java:run(85)) - at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getFileInfo(ClientNamenodeProtocolServerSideTranslatorPB.java:843) 32064 [Thread-30] INFO org.apache.sqoop.hive.HiveImport - at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) 2016-05-14 20:16:24,022 INFO [Thread-30] hive.HiveImport (LoggingAsyncSink.java:run(85)) - at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) 32064 [Thread-30] INFO org.apache.sqoop.hive.HiveImport - at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:616) 2016-05-14 20:16:24,022 INFO [Thread-30] hive.HiveImport (LoggingAsyncSink.java:run(85)) - at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:616) 32064 [Thread-30] INFO org.apache.sqoop.hive.HiveImport - at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:969) 2016-05-14 20:16:24,022 INFO [Thread-30] hive.HiveImport (LoggingAsyncSink.java:run(85)) - at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:969) 32064 [Thread-30] INFO org.apache.sqoop.hive.HiveImport - at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2151) 2016-05-14 20:16:24,022 INFO [Thread-30] hive.HiveImport (LoggingAsyncSink.java:run(85)) - at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2151) 32064 [Thread-30] INFO org.apache.sqoop.hive.HiveImport - at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2147) 2016-05-14 20:16:24,022 INFO [Thread-30] hive.HiveImport (LoggingAsyncSink.java:run(85)) - at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2147) 32064 [Thread-30] INFO org.apache.sqoop.hive.HiveImport - at java.security.AccessController.doPrivileged(Native Method) 2016-05-14 20:16:24,022 INFO [Thread-30] hive.HiveImport (LoggingAsyncSink.java:run(85)) - at java.security.AccessController.doPrivileged(Native Method) 32064 [Thread-30] INFO org.apache.sqoop.hive.HiveImport - at javax.security.auth.Subject.doAs(Subject.java:422) 2016-05-14 20:16:24,022 INFO [Thread-30] hive.HiveImport (LoggingAsyncSink.java:run(85)) - at javax.security.auth.Subject.doAs(Subject.java:422) 32064 [Thread-30] INFO org.apache.sqoop.hive.HiveImport - at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657) 2016-05-14 20:16:24,022 INFO [Thread-30] hive.HiveImport (LoggingAsyncSink.java:run(85)) - at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657) 32064 [Thread-30] INFO org.apache.sqoop.hive.HiveImport - at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2145) 2016-05-14 20:16:24,022 INFO [Thread-30] hive.HiveImport (LoggingAsyncSink.java:run(85)) - at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2145) 32064 [Thread-30] INFO org.apache.sqoop.hive.HiveImport - 2016-05-14 20:16:24,022 INFO [Thread-30] hive.HiveImport (LoggingAsyncSink.java:run(85)) - 32064 [Thread-30] INFO org.apache.sqoop.hive.HiveImport - org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.security.AccessControlException): Permission denied: user=oozie, access=EXECUTE, inode="/tmp/hive/yarn/_tez_session_dir/34917396-071a-4c6d-8890-b7af69bc42fa/hive-hcatalog-core.jar":yarn:hdfs:drwx------ 2016-05-14 20:16:24,022 INFO [Thread-30] hive.HiveImport (LoggingAsyncSink.java:run(85)) - org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.security.AccessControlException): Permission denied: user=oozie, access=EXECUTE, inode="/tmp/hive/yarn/_tez_session_dir/34917396-071a-4c6d-8890-b7af69bc42fa/hive-hcatalog-core.jar":yarn:hdfs:drwx------ 32064 [Thread-30] INFO org.apache.sqoop.hive.HiveImport - at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.check(FSPermissionChecker.java:319) 2016-05-14 20:16:24,022 INFO [Thread-30] hive.HiveImport (LoggingAsyncSink.java:run(85)) - at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.check(FSPermissionChecker.java:319) 32064 [Thread-30] INFO org.apache.sqoop.hive.HiveImport - at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkTraverse(FSPermissionChecker.java:259) 2016-05-14 20:16:24,022 INFO [Thread-30] hive.HiveImport (LoggingAsyncSink.java:run(85)) - at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkTraverse(FSPermissionChecker.java:259) 32064 [Thread-30] INFO org.apache.sqoop.hive.HiveImport - at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkPermission(FSPermissionChecker.java:205) 2016-05-14 20:16:24,022 INFO [Thread-30] hive.HiveImport (LoggingAsyncSink.java:run(85)) - at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkPermission(FSPermissionChecker.java:205) 32065 [Thread-30] INFO org.apache.sqoop.hive.HiveImport - at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkPermission(FSPermissionChecker.java:190)

    Not finding the right solution?
    Take a tour to get the most out of Samebug.

    Tired of useless tips?

    Automated exception search integrated into your IDE

    Root Cause Analysis

    1. org.apache.hadoop.security.AccessControlException

      Permission denied: user=Menmosyne, access=WRITE, inode="/user/Mnemosyne/.sparkStaging/application_1464874056768_0040":hdfs:hdfs:drwxr-xr-x

      at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.check()
    2. Apache Hadoop HDFS
      FSPermissionChecker.checkPermission
      1. org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.check(FSPermissionChecker.java:319)
      2. org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.check(FSPermissionChecker.java:292)
      3. org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkPermission(FSPermissionChecker.java:213)
      3 frames