org.apache.hadoop.hdfs.server.blockmanagement.BlockManager: BLOCK* >>>>>>> processReport: Received first block report from >>>>>>> DatanodeStorage[DS-7989baef-c501-4a7a-b586-0f943444e099,DISK,NORMAL] after >>>>>>> starting up or becoming active. Its block contents are no longer considered >>>>>>> stale >>>>>>> 2015-01-14 11:03:13,966 INFO BlockStateChange: BLOCK* processReport: >>>>>>> from storage DS-7989baef-c501-4a7a-b586-0f943444e099 node >>>>>>> DatanodeRegistration(10.10.10.63, >>>>>>> datanodeUuid=e3c24b88-cb98-4a74-8c5f-fee8dba99898, infoPort=50075, >>>>>>> ipcPort=50020, >>>>>>> storageInfo=lv=-56;cid=CID-46a6e78b-efc4-4dc2-aabe-076bf811d759;nsid=270630615;c=0), >>>>>>> blocks: 0, hasStaleStorages: false, processing time: 11 msecs >>>>>>> 2015-01-14 11:03:38,349 INFO >>>>>>> org.apache.hadoop.hdfs.server.blockmanagement.CacheReplicationMonitor: >>>>>>> Rescanning after 30000 milliseconds >>>>>>> 2015-01-14 11:03:38,350 INFO >>>>>>> org.apache.hadoop.hdfs.server.blockmanagement.CacheReplicationMonitor: >>>>>>> Scanned 0 directive(s) and 0 block(s) in 1 millisecond(s). >>>>>>> 2015-01-14 11:03:57,100 INFO logs: Aliases are enabled >>>>>>> >>>>>>> >>>>>>> Thanks >>>>>>> Mahesh.S >>>>>>> >>>>>>> >>>>>>> On Wed, Jan 14, 2015 at 10:41 AM, Gautam Borad <gborad@gmail.com> >>>>>>> wrote: >>>>>>> >>>>>>>> Hi Mahesh, >>>>>>>> We will need the namenode logs to debug this further. Can you >>>>>>>> restart namenode and paste the logs of that somewhere for us to analyze? >>>>>>>> Thanks. >>>>>>>> >>>>>>>> On Wed, Jan 14, 2015 at 10:31 AM, Mahesh Sankaran < >>>>>>>> sankarmahesh37@gmail.com> wrote: >>>>>>>> >>>>>>>>> Hi Ramesh, >>>>>>>>> >>>>>>>>> I didnt see any exception in the hdfs logs.my >>>>>>>>> problem is agent for hdfs is not created. >>>>>>>>> >>>>>>>>> Regards, >>>>>>>>> Mahesh.S >>>>>>>>> >>>>>>>>> On Tue, Jan 13, 2015 at 8:50 PM, Ramesh Mani < >>>>>>>>> rmani@hortonworks.com> wrote: >>>>>>>>> >>>>>>>>>> Hi Mahesh, >>>>>>>>>> >>>>>>>>>> The error you are seeing in is just a notice that parent >>>>>>>>>> folder of the resource you are creating doesn’t have read permission for >>>>>>>>>> the user whom you are creating the policy. >>>>>>>>>> >>>>>>>>>> when you start the hdfs namenode and secondarynode do you see >>>>>>>>>> any exception in the hdfs logs? >>>>>>>>>> >>>>>>>>>> Regards, >>>>>>>>>> Ramesh >>>>>>>>>> >>>>>>>>>> On Jan 13, 2015, at 4:13 AM, Mahesh Sankaran < >>>>>>>>>> sankarmahesh37@gmail.com> wrote: >>>>>>>>>> >>>>>>>>>> Hi all, >>>>>>>>>> >>>>>>>>>> I successfully configured ranger admin,user sync.now am trying >>>>>>>>>> to configure hdfs plugin.My steps are following, >>>>>>>>>> >>>>>>>>>> 1.Created repository testhdfs. >>>>>>>>>> 2.cd /usr/local >>>>>>>>>> 3.sudo tar zxf ~/dev/ranger/target/ranger-0.4.0-hdfs-plugin.tar.gz >>>>>>>>>> 4.sudo ln -s ranger-0.4.0-hdfs-plugin ranger-hdfs-plugin >>>>>>>>>> 5.cd ranger-hdfs-plugin >>>>>>>>>> 6.vi install.properties >>>>>>>>>> POLICY_MGR_URL=http://IP:6080 <http://ip:6080/> >>>>>>>>>> REPOSITORY_NAME=testhdfs >>>>>>>>>> XAAUDIT.DB.HOSTNAME=localhost >>>>>>>>>> XAAUDIT.DB.DATABASE_NAME=ranger >>>>>>>>>> XAAUDIT.DB.USER_NAME=rangerlogger >>>>>>>>>> XAAUDIT.DB.PASSWORD=rangerlogger >>>>>>>>>> 7.cd /usr/local/hadoop >>>>>>>>>> 8.ln -s /usr/local/hadoop/etc/hadoop conf >>>>>>>>>> 9.export HADOOP_HOME=/usr/local/hadoop >>>>>>>>>> 10.cd /usr/local/ranger-hdfs-plugin >>>>>>>>>> 11../enable-hdfs-plugin.sh >>>>>>>>>> 12.cp /usr/local/hadoop/lib/* >>>>>>>>>> /usr/local/hadoop/share/hadoop/hdfs/lib/ >>>>>>>>>> 13.vi xasecure-audit.xml >>>>>>>>>> <property> >>>>>>>>>> <name>xasecure.audit.jpa.javax.persistence.jdbc.url</name> >>>>>>>>>> <value>jdbc:mysql://localhost/ranger</value> >>>>>>>>>> </property> >>>>>>>>>> <property> >>>>>>>>>> >>>>>>>>>> <name>xasecure.audit.jpa.javax.persistence.jdbc.user</name> >>>>>>>>>> <value>rangerlogger</value> >>>>>>>>>> </property> >>>>>>>>>> <property> >>>>>>>>>> <name>xasecure.audit.jpa.javax.persistence.jdbc.password</name> >>>>>>>>>> <value>rangerlogger</value> >>>>>>>>>> </property> >>>>>>>>>> 14.Restarted hadoop >>>>>>>>>> when i see Ranger Admin Web interface -> Audit -> Agents >>>>>>>>>> agent is not created.Am i missed any steps. >>>>>>>>>> >>>>>>>>>> *NOTE:I am not using HDP.* >>>>>>>>>> >>>>>>>>>> *here is my xa_portal.log* >>>>>>>>>> >>>>>>>>>> 2015-01-13 15:16:45,901 [localhost-startStop-1] INFO >>>>>>>>>> org.springframework.core.io.support.PropertiesLoaderSupport >>>>>>>>>> (PropertiesLoaderSupport.java:177) - Loading properties file from class >>>>>>>>>> path resource [xa_default.properties] >>>>>>>>>> 2015-01-13 15:16:45,932 [localhost-startStop-1] INFO >>>>>>>>>> org.springframework.core.io.support.PropertiesLoaderSupport >>>>>>>>>> (PropertiesLoaderSupport.java:177) - Loading properties file from class >>>>>>>>>> path resource [xa_system.properties] >>>>>>>>>> 2015-01-13 15:16:45,965 [localhost-startStop-1] INFO >>>>>>>>>> org.springframework.core.io.support.PropertiesLoaderSupport >>>>>>>>>> (PropertiesLoaderSupport.java:177) - Loading properties file from class >>>>>>>>>> path resource [xa_custom.properties] >>>>>>>>>> 2015-01-13 15:16:45,978 [localhost-startStop-1] INFO >>>>>>>>>> org.springframework.core.io.support.PropertiesLoaderSupport >>>>>>>>>> (PropertiesLoaderSupport.java:177) - Loading properties file from class >>>>>>>>>> path resource [xa_ldap.properties] >>>>>>>>>> 2015-01-13 15:16:46,490 [localhost-startStop-1] WARN >>>>>>>>>> org.apache.hadoop.util.NativeCodeLoader (NativeCodeLoader.java:62) - >>>>>>>>>> Unable to load native-hadoop library for your platform... using >>>>>>>>>> builtin-java classes where applicable >>>>>>>>>> 2015-01-13 15:16:47,417 [localhost-startStop-1] INFO >>>>>>>>>> org.springframework.core.io.support.PropertiesLoaderSupport >>>>>>>>>> (PropertiesLoaderSupport.java:177) - Loading properties file from class >>>>>>>>>> path resource [db_message_bundle.properties] >>>>>>>>>> 2015-01-13 15:17:13,721 [http-bio-6080-exec-8] INFO >>>>>>>>>> org.apache.ranger.security.listener.SpringEventListener >>>>>>>>>> (SpringEventListener.java:69) - Login Successful:admin | Ip >>>>>>>>>> Address:10.10.10.53 | sessionId=830B2C1BC6F34346950710576AD40A12 >>>>>>>>>> 2015-01-13 15:17:14,362 [http-bio-6080-exec-8] INFO >>>>>>>>>> org.apache.ranger.biz.SessionMgr (SessionMgr.java:334) - admin is a valid >>>>>>>>>> user >>>>>>>>>> 2015-01-13 15:17:14,491 [http-bio-6080-exec-10] INFO >>>>>>>>>> org.apache.ranger.biz.SessionMgr (SessionMgr.java:140) - Login Success: >>>>>>>>>> loginId=admin, sessionId=10, sessionId=830B2C1BC6F34346950710576AD40A12, >>>>>>>>>> requestId=10.10.10.53 >>>>>>>>>> 2015-01-13 15:17:16,517 [http-bio-6080-exec-2] INFO >>>>>>>>>> org.apache.ranger.service.filter.RangerRESTAPIFilter >>>>>>>>>> (RangerRESTAPIFilter.java:246) - Done rearranging. loopCount=0 >>>>>>>>>> 2015-01-13 15:17:16,518 [http-bio-6080-exec-2] INFO >>>>>>>>>> org.apache.ranger.service.filter.RangerRESTAPIFilter >>>>>>>>>> (RangerRESTAPIFilter.java:254) - Loaded 0 API methods. >>>>>>>>>> 2015-01-13 15:27:58,797 [http-bio-6080-exec-10] INFO >>>>>>>>>> org.apache.ranger.rest.UserREST (UserREST.java:186) - >>>>>>>>>> create:nfsnobody@bigdata >>>>>>>>>> 2015-01-13 15:30:32,173 [localhost-startStop-1] INFO >>>>>>>>>> org.springframework.core.io.support.PropertiesLoaderSupport >>>>>>>>>> (PropertiesLoaderSupport.java:177) - Loading properties file from class >>>>>>>>>> path resource [xa_default.properties] >>>>>>>>>> 2015-01-13 15:30:32,179 [localhost-startStop-1] INFO >>>>>>>>>> org.springframework.core.io.support.PropertiesLoaderSupport >>>>>>>>>> (PropertiesLoaderSupport.java:177) - Loading properties file from class >>>>>>>>>> path resource [xa_system.properties] >>>>>>>>>> 2015-01-13 15:30:32,180 [localhost-startStop-1] INFO >>>>>>>>>> org.springframework.core.io.support.PropertiesLoaderSupport >>>>>>>>>> (PropertiesLoaderSupport.java:177) - Loading properties file from class >>>>>>>>>> path resource [xa_custom.properties] >>>>>>>>>> 2015-01-13 15:30:32,180 [localhost-startStop-1] INFO >>>>>>>>>> org.springframework.core.io.support.PropertiesLoaderSupport >>>>>>>>>> (PropertiesLoaderSupport.java:177) - Loading properties file from class >>>>>>>>>> path resource [xa_ldap.properties] >>>>>>>>>> 2015-01-13 15:30:33,049 [localhost-startStop-1] WARN >>>>>>>>>> org.apache.hadoop.util.NativeCodeLoader (NativeCodeLoader.java:62) - >>>>>>>>>> Unable to load native-hadoop library for your platform... using >>>>>>>>>> builtin-java classes where applicable >>>>>>>>>> 2015-01-13 15:30:34,179 [localhost-startStop-1] INFO >>>>>>>>>> org.springframework.core.io.support.PropertiesLoaderSupport >>>>>>>>>> (PropertiesLoaderSupport.java:177) - Loading properties file from class >>>>>>>>>> path resource [db_message_bundle.properties] >>>>>>>>>> 2015-01-13 15:30:44,588 [http-bio-6080-exec-1] INFO >>>>>>>>>> org.apache.ranger.service.filter.RangerRESTAPIFilter >>>>>>>>>> (RangerRESTAPIFilter.java:246) - Done rearranging. loopCount=0 >>>>>>>>>> 2015-01-13 15:30:44,589 [http-bio-6080-exec-1] INFO >>>>>>>>>> org.apache.ranger.service.filter.RangerRESTAPIFilter >>>>>>>>>> (RangerRESTAPIFilter.java:254) - Loaded 0 API methods. >>>>>>>>>> 2015-01-13 15:31:18,236 [http-bio-6080-exec-5] INFO >>>>>>>>>> org.apache.ranger.security.listener.SpringEventListener >>>>>>>>>> (SpringEventListener.java:69) - Login Successful:admin | Ip >>>>>>>>>> Address:10.10.10.53 | sessionId=881E59FF1E0E5F2940A0CECC3826FAA0 >>>>>>>>>> 2015-01-13 15:31:18,270 [http-bio-6080-exec-5] INFO >>>>>>>>>> org.apache.ranger.biz.SessionMgr (SessionMgr.java:334) - admin is a valid >>>>>>>>>> user >>>>>>>>>> 2015-01-13 15:31:18,326 [http-bio-6080-exec-4] INFO >>>>>>>>>> org.apache.ranger.biz.SessionMgr (SessionMgr.java:140) - Login Success: >>>>>>>>>> loginId=admin, sessionId=11, sessionId=881E59FF1E0E5F2940A0CECC3826FAA0, >>>>>>>>>> requestId=10.10.10.53 >>>>>>>>>> 2015-01-13 15:46:42,554 [http-bio-6080-exec-8] INFO >>>>>>>>>> org.apache.ranger.security.listener.SpringEventListener >>>>>>>>>> (SpringEventListener.java:69) - Login Successful:admin | Ip >>>>>>>>>> Address:10.10.10.53 | sessionId=375249EFD0513D997E0BDF64A288DFCD >>>>>>>>>> 2015-01-13 15:46:42,559 [http-bio-6080-exec-8] INFO >>>>>>>>>> org.apache.ranger.biz.SessionMgr (SessionMgr.java:334) - admin is a valid >>>>>>>>>> user >>>>>>>>>> 2015-01-13 15:46:43,858 [http-bio-6080-exec-8] INFO >>>>>>>>>> org.apache.ranger.biz.SessionMgr (SessionMgr.java:140) - Login Success: >>>>>>>>>> loginId=admin, sessionId=12, sessionId=375249EFD0513D997E0BDF64A288DFCD, >>>>>>>>>> requestId=10.10.10.53 >>>>>>>>>> 2015-01-13 15:47:00,201 [http-bio-6080-exec-2] INFO >>>>>>>>>> apache.ranger.hadoop.client.config.BaseClient (BaseClient.java:104) - Init >>>>>>>>>> Login: security not enabled, using username >>>>>>>>>> 2015-01-13 15:47:00,291 [http-bio-6080-exec-2] WARN >>>>>>>>>> org.apache.hadoop.fs.FileSystem (FileSystem.java:327) - "bigdata:9000" is >>>>>>>>>> a deprecated filesystem name. Use "hdfs://bigdata:9000/" instead. >>>>>>>>>> 2015-01-13 15:52:54,052 [http-bio-6080-exec-2] ERROR >>>>>>>>>> org.apache.ranger.db.RangerDaoManager (RangerDaoManager.java:53) - >>>>>>>>>> RangerDaoManager.getEntityManager(loggingPU) >>>>>>>>>> 2015-01-13 16:03:06,816 [http-bio-6080-exec-2] INFO >>>>>>>>>> apache.ranger.hadoop.client.config.BaseClient (BaseClient.java:104) - Init >>>>>>>>>> Login: security not enabled, using username >>>>>>>>>> 2015-01-13 16:03:06,874 [http-bio-6080-exec-2] WARN >>>>>>>>>> org.apache.hadoop.fs.FileSystem (FileSystem.java:327) - "bigdata:9000" is >>>>>>>>>> a deprecated filesystem name. Use "hdfs://bigdata:9000/" instead. >>>>>>>>>> 2015-01-13 16:03:20,740 [http-bio-6080-exec-4] WARN >>>>>>>>>> org.apache.hadoop.fs.FileSystem (FileSystem.java:327) - "bigdata:9000" is >>>>>>>>>> a deprecated filesystem name. Use "hdfs://bigdata:9000/" instead. >>>>>>>>>> 2015-01-13 16:03:20,790 [http-bio-6080-exec-4] WARN >>>>>>>>>> org.apache.hadoop.fs.FileSystem (FileSystem.java:327) - "bigdata:9000" is >>>>>>>>>> a deprecated filesystem name. Use "hdfs://bigdata:9000/" instead. >>>>>>>>>> 2015-01-13 16:03:48,636 [http-bio-6080-exec-4] WARN >>>>>>>>>> org.apache.hadoop.fs.FileSystem (FileSystem.java:327) - "bigdata:9000" is >>>>>>>>>> a deprecated filesystem name. Use "hdfs://bigdata:9000/" instead. >>>>>>>>>> 2015-01-13 16:03:48,680 [http-bio-6080-exec-4] WARN >>>>>>>>>> org.apache.hadoop.fs.FileSystem (FileSystem.java:327) - "bigdata:9000" is >>>>>>>>>> a deprecated filesystem name. Use "hdfs://bigdata:9000/" instead. >>>>>>>>>> 2015-01-13 16:03:51,062 [http-bio-6080-exec-4] WARN >>>>>>>>>> org.apache.hadoop.fs.FileSystem (FileSystem.java:327) - "bigdata:9000" is >>>>>>>>>> a deprecated filesystem name. Use "hdfs://bigdata:9000/" instead. >>>>>>>>>> 2015-01-13 16:03:51,110 [http-bio-6080-exec-4] WARN >>>>>>>>>> org.apache.hadoop.fs.FileSystem (FileSystem.java:327) - "bigdata:9000" is >>>>>>>>>> a deprecated filesystem name. Use "hdfs://bigdata:9000/" instead. >>>>>>>>>> 2015-01-13 16:03:57,174 [http-bio-6080-exec-8] INFO >>>>>>>>>> org.apache.ranger.common.RESTErrorUtil (RESTErrorUtil.java:64) - Request >>>>>>>>>> failed. SessionId=12, loginId=admin, logMessage=Mahesh may not have read >>>>>>>>>> permission on parent folder. Do you want to save this policy? >>>>>>>>>> javax.ws.rs.WebApplicationException >>>>>>>>>> at >>>>>>>>>> org.apache.ranger.common.RESTErrorUtil.createRESTException(RESTErrorUtil.java:55) >>>>>>>>>> at >>>>>>>>>> org.apache.ranger.common.RESTErrorUtil.createRESTException(RESTErrorUtil.java:264) >>>>>>>>>> at >>>>>>>>>> org.apache.ranger.service.XResourceService.checkAccess(XResourceService.java:546) >>>>>>>>>> at >>>>>>>>>> org.apache.ranger.biz.AssetMgr.createXResource(AssetMgr.java:241) >>>>>>>>>> at >>>>>>>>>> org.apache.ranger.rest.AssetREST.createXResource(AssetREST.java:214) >>>>>>>>>> at >>>>>>>>>> org.apache.ranger.rest.AssetREST$$FastClassByCGLIB$$8cffcb6d.invoke(<generated>) >>>>>>>>>> at net.sf.cglib.proxy.MethodProxy.invoke(MethodProxy.java:191) >>>>>>>>>> at >>>>>>>>>> org.springframework.aop.framework.Cglib2AopProxy$CglibMethodInvocation.invokeJoinpoint(Cglib2AopProxy.java:689) >>>>>>>>>> at >>>>>>>>>> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:150) >>>>>>>>>> at >>>>>>>>>> org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:110) >>>>>>>>>> at >>>>>>>>>> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172) >>>>>>>>>> at >>>>>>>>>> org.springframework.aop.framework.Cglib2AopProxy$DynamicAdvisedInterceptor.intercept(Cglib2AopProxy.java:622) >>>>>>>>>> at >>>>>>>>>> org.apache.ranger.rest.AssetREST$$EnhancerByCGLIB$$65ef778b.createXResource(<generated>) >>>>>>>>>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

Searched on Google with the first line of a JAVA stack trace?

We can recommend more relevant solutions and speed up debugging when you paste your entire stack trace with the exception message. Try a sample exception.

Recommended solutions based on your search

Solutions on the web

via apache.org by Unknown author, 1 year ago
=50075, >>>>>>> ipcPort=50020, >>>>>>> storageInfo=lv=-56;cid=CID-46a6e78b-efc4-4dc2-aabe-076bf811d759;nsid=270630615;c=0), >>>>>>> blocks: 0, hasStaleStorages: false, processing time: 11 msecs >>>>>>> 2015-01-14 11:03:38,349 INFO
via incubator-ranger-user by Gautam Borad, 1 year ago
BLOCK* >>>>> processReport: Received first block report from >>>>> DatanodeStorage[DS-7989baef-c501-4a7a-b586-0f943444e099,DISK,NORMAL] after >>>>> starting up or becoming active. Its block contents are no longer considered >>>>> stale >>>>> 2015-01
via incubator-ranger-user by Mahesh Sankaran, 1 year ago
=50075, >>>>>>> ipcPort=50020, >>>>>>> storageInfo=lv=-56;cid=CID-46a6e78b-efc4-4dc2-aabe-076bf811d759;nsid=270630615;c=0), >>>>>>> blocks: 0, hasStaleStorages: false, processing time: 11 msecs >>>>>>> 2015-01-14 11:03:38,349 INFO
via incubator-ranger-user by Mahesh Sankaran, 1 year ago
>>>>>> 2015-01-14 11:03:13,966 INFO BlockStateChange: BLOCK* processReport: >>>>>> from storage DS-7989baef-c501-4a7a-b586-0f943444e099 node >>>>>> DatanodeRegistration(10.10.10.63, >>>>>> datanodeUuid=e3c24b88-cb98-4a74-8c5f-fee8dba99898, infoPort=50075
via incubator-ranger-user by Mahesh Sankaran, 1 year ago
BLOCK* >> processReport: Received first block report from >> DatanodeStorage[DS-7989baef-c501-4a7a-b586-0f943444e099,DISK,NORMAL] after >> starting up or becoming active. Its block contents are no longer considered >> stale >> 2015-01-14 11:03
via incubator-ranger-user by Gautam Borad, 1 year ago
BLOCK* >>> processReport: Received first block report from >>> DatanodeStorage[DS-7989baef-c501-4a7a-b586-0f943444e099,DISK,NORMAL] after >>> starting up or becoming active. Its block contents are no longer considered >>> stale >>> 2015-01-14 11:03
org.apache.hadoop.hdfs.server.blockmanagement.BlockManager: BLOCK* >>>>>>> processReport: Received first block report from >>>>>>> DatanodeStorage[DS-7989baef-c501-4a7a-b586-0f943444e099,DISK,NORMAL] after >>>>>>> starting up or becoming active. Its block contents are no longer considered >>>>>>> stale >>>>>>> 2015-01-14 11:03:13,966 INFO BlockStateChange: BLOCK* processReport: >>>>>>> from storage DS-7989baef-c501-4a7a-b586-0f943444e099 node >>>>>>> DatanodeRegistration(10.10.10.63, >>>>>>> datanodeUuid=e3c24b88-cb98-4a74-8c5f-fee8dba99898, infoPort=50075, >>>>>>> ipcPort=50020, >>>>>>> storageInfo=lv=-56;cid=CID-46a6e78b-efc4-4dc2-aabe-076bf811d759;nsid=270630615;c=0), >>>>>>> blocks: 0, hasStaleStorages: false, processing time: 11 msecs >>>>>>> 2015-01-14 11:03:38,349 INFO >>>>>>> org.apache.hadoop.hdfs.server.blockmanagement.CacheReplicationMonitor: >>>>>>> Rescanning after 30000 milliseconds >>>>>>> 2015-01-14 11:03:38,350 INFO >>>>>>> org.apache.hadoop.hdfs.server.blockmanagement.CacheReplicationMonitor: >>>>>>> Scanned 0 directive(s) and 0 block(s) in 1 millisecond(s). >>>>>>> 2015-01-14 11:03:57,100 INFO logs: Aliases are enabled >>>>>>> >>>>>>> >>>>>>> Thanks >>>>>>> Mahesh.S >>>>>>> >>>>>>> >>>>>>> On Wed, Jan 14, 2015 at 10:41 AM, Gautam Borad <gborad@gmail.com> >>>>>>> wrote: >>>>>>> >>>>>>>> Hi Mahesh, >>>>>>>> We will need the namenode logs to debug this further. Can you >>>>>>>> restart namenode and paste the logs of that somewhere for us to analyze? >>>>>>>> Thanks. >>>>>>>> >>>>>>>> On Wed, Jan 14, 2015 at 10:31 AM, Mahesh Sankaran < >>>>>>>> sankarmahesh37@gmail.com> wrote: >>>>>>>> >>>>>>>>> Hi Ramesh, >>>>>>>>> >>>>>>>>> I didnt see any exception in the hdfs logs.my >>>>>>>>> problem is agent for hdfs is not created. >>>>>>>>> >>>>>>>>> Regards, >>>>>>>>> Mahesh.S >>>>>>>>> >>>>>>>>> On Tue, Jan 13, 2015 at 8:50 PM, Ramesh Mani < >>>>>>>>> rmani@hortonworks.com> wrote: >>>>>>>>> >>>>>>>>>> Hi Mahesh, >>>>>>>>>> >>>>>>>>>> The error you are seeing in is just a notice that parent >>>>>>>>>> folder of the resource you are creating doesn’t have read permission for >>>>>>>>>> the user whom you are creating the policy. >>>>>>>>>> >>>>>>>>>> when you start the hdfs namenode and secondarynode do you see >>>>>>>>>> any exception in the hdfs logs? >>>>>>>>>> >>>>>>>>>> Regards, >>>>>>>>>> Ramesh >>>>>>>>>> >>>>>>>>>> On Jan 13, 2015, at 4:13 AM, Mahesh Sankaran < >>>>>>>>>> sankarmahesh37@gmail.com> wrote: >>>>>>>>>> >>>>>>>>>> Hi all, >>>>>>>>>> >>>>>>>>>> I successfully configured ranger admin,user sync.now am trying >>>>>>>>>> to configure hdfs plugin.My steps are following, >>>>>>>>>> >>>>>>>>>> 1.Created repository testhdfs. >>>>>>>>>> 2.cd /usr/local >>>>>>>>>> 3.sudo tar zxf ~/dev/ranger/target/ranger-0.4.0-hdfs-plugin.tar.gz >>>>>>>>>> 4.sudo ln -s ranger-0.4.0-hdfs-plugin ranger-hdfs-plugin >>>>>>>>>> 5.cd ranger-hdfs-plugin >>>>>>>>>> 6.vi install.properties >>>>>>>>>> POLICY_MGR_URL=http://IP:6080 <http://ip:6080/> >>>>>>>>>> REPOSITORY_NAME=testhdfs >>>>>>>>>> XAAUDIT.DB.HOSTNAME=localhost >>>>>>>>>> XAAUDIT.DB.DATABASE_NAME=ranger >>>>>>>>>> XAAUDIT.DB.USER_NAME=rangerlogger >>>>>>>>>> XAAUDIT.DB.PASSWORD=rangerlogger >>>>>>>>>> 7.cd /usr/local/hadoop >>>>>>>>>> 8.ln -s /usr/local/hadoop/etc/hadoop conf >>>>>>>>>> 9.export HADOOP_HOME=/usr/local/hadoop >>>>>>>>>> 10.cd /usr/local/ranger-hdfs-plugin >>>>>>>>>> 11../enable-hdfs-plugin.sh >>>>>>>>>> 12.cp /usr/local/hadoop/lib/* >>>>>>>>>> /usr/local/hadoop/share/hadoop/hdfs/lib/ >>>>>>>>>> 13.vi xasecure-audit.xml >>>>>>>>>> <property> >>>>>>>>>> <name>xasecure.audit.jpa.javax.persistence.jdbc.url</name> >>>>>>>>>> <value>jdbc:mysql://localhost/ranger</value> >>>>>>>>>> </property> >>>>>>>>>> <property> >>>>>>>>>> >>>>>>>>>> <name>xasecure.audit.jpa.javax.persistence.jdbc.user</name> >>>>>>>>>> <value>rangerlogger</value> >>>>>>>>>> </property> >>>>>>>>>> <property> >>>>>>>>>> <name>xasecure.audit.jpa.javax.persistence.jdbc.password</name> >>>>>>>>>> <value>rangerlogger</value> >>>>>>>>>> </property> >>>>>>>>>> 14.Restarted hadoop >>>>>>>>>> when i see Ranger Admin Web interface -> Audit -> Agents >>>>>>>>>> agent is not created.Am i missed any steps. >>>>>>>>>> >>>>>>>>>> *NOTE:I am not using HDP.* >>>>>>>>>> >>>>>>>>>> *here is my xa_portal.log* >>>>>>>>>> >>>>>>>>>> 2015-01-13 15:16:45,901 [localhost-startStop-1] INFO >>>>>>>>>> org.springframework.core.io.support.PropertiesLoaderSupport >>>>>>>>>> (PropertiesLoaderSupport.java:177) - Loading properties file from class >>>>>>>>>> path resource [xa_default.properties] >>>>>>>>>> 2015-01-13 15:16:45,932 [localhost-startStop-1] INFO >>>>>>>>>> org.springframework.core.io.support.PropertiesLoaderSupport >>>>>>>>>> (PropertiesLoaderSupport.java:177) - Loading properties file from class >>>>>>>>>> path resource [xa_system.properties] >>>>>>>>>> 2015-01-13 15:16:45,965 [localhost-startStop-1] INFO >>>>>>>>>> org.springframework.core.io.support.PropertiesLoaderSupport >>>>>>>>>> (PropertiesLoaderSupport.java:177) - Loading properties file from class >>>>>>>>>> path resource [xa_custom.properties] >>>>>>>>>> 2015-01-13 15:16:45,978 [localhost-startStop-1] INFO >>>>>>>>>> org.springframework.core.io.support.PropertiesLoaderSupport >>>>>>>>>> (PropertiesLoaderSupport.java:177) - Loading properties file from class >>>>>>>>>> path resource [xa_ldap.properties] >>>>>>>>>> 2015-01-13 15:16:46,490 [localhost-startStop-1] WARN >>>>>>>>>> org.apache.hadoop.util.NativeCodeLoader (NativeCodeLoader.java:62) - >>>>>>>>>> Unable to load native-hadoop library for your platform... using >>>>>>>>>> builtin-java classes where applicable >>>>>>>>>> 2015-01-13 15:16:47,417 [localhost-startStop-1] INFO >>>>>>>>>> org.springframework.core.io.support.PropertiesLoaderSupport >>>>>>>>>> (PropertiesLoaderSupport.java:177) - Loading properties file from class >>>>>>>>>> path resource [db_message_bundle.properties] >>>>>>>>>> 2015-01-13 15:17:13,721 [http-bio-6080-exec-8] INFO >>>>>>>>>> org.apache.ranger.security.listener.SpringEventListener >>>>>>>>>> (SpringEventListener.java:69) - Login Successful:admin | Ip >>>>>>>>>> Address:10.10.10.53 | sessionId=830B2C1BC6F34346950710576AD40A12 >>>>>>>>>> 2015-01-13 15:17:14,362 [http-bio-6080-exec-8] INFO >>>>>>>>>> org.apache.ranger.biz.SessionMgr (SessionMgr.java:334) - admin is a valid >>>>>>>>>> user >>>>>>>>>> 2015-01-13 15:17:14,491 [http-bio-6080-exec-10] INFO >>>>>>>>>> org.apache.ranger.biz.SessionMgr (SessionMgr.java:140) - Login Success: >>>>>>>>>> loginId=admin, sessionId=10, sessionId=830B2C1BC6F34346950710576AD40A12, >>>>>>>>>> requestId=10.10.10.53 >>>>>>>>>> 2015-01-13 15:17:16,517 [http-bio-6080-exec-2] INFO >>>>>>>>>> org.apache.ranger.service.filter.RangerRESTAPIFilter >>>>>>>>>> (RangerRESTAPIFilter.java:246) - Done rearranging. loopCount=0 >>>>>>>>>> 2015-01-13 15:17:16,518 [http-bio-6080-exec-2] INFO >>>>>>>>>> org.apache.ranger.service.filter.RangerRESTAPIFilter >>>>>>>>>> (RangerRESTAPIFilter.java:254) - Loaded 0 API methods. >>>>>>>>>> 2015-01-13 15:27:58,797 [http-bio-6080-exec-10] INFO >>>>>>>>>> org.apache.ranger.rest.UserREST (UserREST.java:186) - >>>>>>>>>> create:nfsnobody@bigdata >>>>>>>>>> 2015-01-13 15:30:32,173 [localhost-startStop-1] INFO >>>>>>>>>> org.springframework.core.io.support.PropertiesLoaderSupport >>>>>>>>>> (PropertiesLoaderSupport.java:177) - Loading properties file from class >>>>>>>>>> path resource [xa_default.properties] >>>>>>>>>> 2015-01-13 15:30:32,179 [localhost-startStop-1] INFO >>>>>>>>>> org.springframework.core.io.support.PropertiesLoaderSupport >>>>>>>>>> (PropertiesLoaderSupport.java:177) - Loading properties file from class >>>>>>>>>> path resource [xa_system.properties] >>>>>>>>>> 2015-01-13 15:30:32,180 [localhost-startStop-1] INFO >>>>>>>>>> org.springframework.core.io.support.PropertiesLoaderSupport >>>>>>>>>> (PropertiesLoaderSupport.java:177) - Loading properties file from class >>>>>>>>>> path resource [xa_custom.properties] >>>>>>>>>> 2015-01-13 15:30:32,180 [localhost-startStop-1] INFO >>>>>>>>>> org.springframework.core.io.support.PropertiesLoaderSupport >>>>>>>>>> (PropertiesLoaderSupport.java:177) - Loading properties file from class >>>>>>>>>> path resource [xa_ldap.properties] >>>>>>>>>> 2015-01-13 15:30:33,049 [localhost-startStop-1] WARN >>>>>>>>>> org.apache.hadoop.util.NativeCodeLoader (NativeCodeLoader.java:62) - >>>>>>>>>> Unable to load native-hadoop library for your platform... using >>>>>>>>>> builtin-java classes where applicable >>>>>>>>>> 2015-01-13 15:30:34,179 [localhost-startStop-1] INFO >>>>>>>>>> org.springframework.core.io.support.PropertiesLoaderSupport >>>>>>>>>> (PropertiesLoaderSupport.java:177) - Loading properties file from class >>>>>>>>>> path resource [db_message_bundle.properties] >>>>>>>>>> 2015-01-13 15:30:44,588 [http-bio-6080-exec-1] INFO >>>>>>>>>> org.apache.ranger.service.filter.RangerRESTAPIFilter >>>>>>>>>> (RangerRESTAPIFilter.java:246) - Done rearranging. loopCount=0 >>>>>>>>>> 2015-01-13 15:30:44,589 [http-bio-6080-exec-1] INFO >>>>>>>>>> org.apache.ranger.service.filter.RangerRESTAPIFilter >>>>>>>>>> (RangerRESTAPIFilter.java:254) - Loaded 0 API methods. >>>>>>>>>> 2015-01-13 15:31:18,236 [http-bio-6080-exec-5] INFO >>>>>>>>>> org.apache.ranger.security.listener.SpringEventListener >>>>>>>>>> (SpringEventListener.java:69) - Login Successful:admin | Ip >>>>>>>>>> Address:10.10.10.53 | sessionId=881E59FF1E0E5F2940A0CECC3826FAA0 >>>>>>>>>> 2015-01-13 15:31:18,270 [http-bio-6080-exec-5] INFO >>>>>>>>>> org.apache.ranger.biz.SessionMgr (SessionMgr.java:334) - admin is a valid >>>>>>>>>> user >>>>>>>>>> 2015-01-13 15:31:18,326 [http-bio-6080-exec-4] INFO >>>>>>>>>> org.apache.ranger.biz.SessionMgr (SessionMgr.java:140) - Login Success: >>>>>>>>>> loginId=admin, sessionId=11, sessionId=881E59FF1E0E5F2940A0CECC3826FAA0, >>>>>>>>>> requestId=10.10.10.53 >>>>>>>>>> 2015-01-13 15:46:42,554 [http-bio-6080-exec-8] INFO >>>>>>>>>> org.apache.ranger.security.listener.SpringEventListener >>>>>>>>>> (SpringEventListener.java:69) - Login Successful:admin | Ip >>>>>>>>>> Address:10.10.10.53 | sessionId=375249EFD0513D997E0BDF64A288DFCD >>>>>>>>>> 2015-01-13 15:46:42,559 [http-bio-6080-exec-8] INFO >>>>>>>>>> org.apache.ranger.biz.SessionMgr (SessionMgr.java:334) - admin is a valid >>>>>>>>>> user >>>>>>>>>> 2015-01-13 15:46:43,858 [http-bio-6080-exec-8] INFO >>>>>>>>>> org.apache.ranger.biz.SessionMgr (SessionMgr.java:140) - Login Success: >>>>>>>>>> loginId=admin, sessionId=12, sessionId=375249EFD0513D997E0BDF64A288DFCD, >>>>>>>>>> requestId=10.10.10.53 >>>>>>>>>> 2015-01-13 15:47:00,201 [http-bio-6080-exec-2] INFO >>>>>>>>>> apache.ranger.hadoop.client.config.BaseClient (BaseClient.java:104) - Init >>>>>>>>>> Login: security not enabled, using username >>>>>>>>>> 2015-01-13 15:47:00,291 [http-bio-6080-exec-2] WARN >>>>>>>>>> org.apache.hadoop.fs.FileSystem (FileSystem.java:327) - "bigdata:9000" is >>>>>>>>>> a deprecated filesystem name. Use "hdfs://bigdata:9000/" instead. >>>>>>>>>> 2015-01-13 15:52:54,052 [http-bio-6080-exec-2] ERROR >>>>>>>>>> org.apache.ranger.db.RangerDaoManager (RangerDaoManager.java:53) - >>>>>>>>>> RangerDaoManager.getEntityManager(loggingPU) >>>>>>>>>> 2015-01-13 16:03:06,816 [http-bio-6080-exec-2] INFO >>>>>>>>>> apache.ranger.hadoop.client.config.BaseClient (BaseClient.java:104) - Init >>>>>>>>>> Login: security not enabled, using username >>>>>>>>>> 2015-01-13 16:03:06,874 [http-bio-6080-exec-2] WARN >>>>>>>>>> org.apache.hadoop.fs.FileSystem (FileSystem.java:327) - "bigdata:9000" is >>>>>>>>>> a deprecated filesystem name. Use "hdfs://bigdata:9000/" instead. >>>>>>>>>> 2015-01-13 16:03:20,740 [http-bio-6080-exec-4] WARN >>>>>>>>>> org.apache.hadoop.fs.FileSystem (FileSystem.java:327) - "bigdata:9000" is >>>>>>>>>> a deprecated filesystem name. Use "hdfs://bigdata:9000/" instead. >>>>>>>>>> 2015-01-13 16:03:20,790 [http-bio-6080-exec-4] WARN >>>>>>>>>> org.apache.hadoop.fs.FileSystem (FileSystem.java:327) - "bigdata:9000" is >>>>>>>>>> a deprecated filesystem name. Use "hdfs://bigdata:9000/" instead. >>>>>>>>>> 2015-01-13 16:03:48,636 [http-bio-6080-exec-4] WARN >>>>>>>>>> org.apache.hadoop.fs.FileSystem (FileSystem.java:327) - "bigdata:9000" is >>>>>>>>>> a deprecated filesystem name. Use "hdfs://bigdata:9000/" instead. >>>>>>>>>> 2015-01-13 16:03:48,680 [http-bio-6080-exec-4] WARN >>>>>>>>>> org.apache.hadoop.fs.FileSystem (FileSystem.java:327) - "bigdata:9000" is >>>>>>>>>> a deprecated filesystem name. Use "hdfs://bigdata:9000/" instead. >>>>>>>>>> 2015-01-13 16:03:51,062 [http-bio-6080-exec-4] WARN >>>>>>>>>> org.apache.hadoop.fs.FileSystem (FileSystem.java:327) - "bigdata:9000" is >>>>>>>>>> a deprecated filesystem name. Use "hdfs://bigdata:9000/" instead. >>>>>>>>>> 2015-01-13 16:03:51,110 [http-bio-6080-exec-4] WARN >>>>>>>>>> org.apache.hadoop.fs.FileSystem (FileSystem.java:327) - "bigdata:9000" is >>>>>>>>>> a deprecated filesystem name. Use "hdfs://bigdata:9000/" instead. >>>>>>>>>> 2015-01-13 16:03:57,174 [http-bio-6080-exec-8] INFO >>>>>>>>>> org.apache.ranger.common.RESTErrorUtil (RESTErrorUtil.java:64) - Request >>>>>>>>>> failed. SessionId=12, loginId=admin, logMessage=Mahesh may not have read >>>>>>>>>> permission on parent folder. Do you want to save this policy? >>>>>>>>>> javax.ws.rs.WebApplicationException >>>>>>>>>> at >>>>>>>>>> org.apache.ranger.common.RESTErrorUtil.createRESTException(RESTErrorUtil.java:55) >>>>>>>>>> at >>>>>>>>>> org.apache.ranger.common.RESTErrorUtil.createRESTException(RESTErrorUtil.java:264) >>>>>>>>>> at >>>>>>>>>> org.apache.ranger.service.XResourceService.checkAccess(XResourceService.java:546) >>>>>>>>>> at >>>>>>>>>> org.apache.ranger.biz.AssetMgr.createXResource(AssetMgr.java:241) >>>>>>>>>> at >>>>>>>>>> org.apache.ranger.rest.AssetREST.createXResource(AssetREST.java:214) >>>>>>>>>> at >>>>>>>>>> org.apache.ranger.rest.AssetREST$$FastClassByCGLIB$$8cffcb6d.invoke(<generated>) >>>>>>>>>> at net.sf.cglib.proxy.MethodProxy.invoke(MethodProxy.java:191) >>>>>>>>>> at >>>>>>>>>> org.springframework.aop.framework.Cglib2AopProxy$CglibMethodInvocation.invokeJoinpoint(Cglib2AopProxy.java:689) >>>>>>>>>> at >>>>>>>>>> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:150) >>>>>>>>>> at >>>>>>>>>> org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:110) >>>>>>>>>> at >>>>>>>>>> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172) >>>>>>>>>> at >>>>>>>>>> org.springframework.aop.framework.Cglib2AopProxy$DynamicAdvisedInterceptor.intercept(Cglib2AopProxy.java:622) >>>>>>>>>> at >>>>>>>>>> org.apache.ranger.rest.AssetREST$$EnhancerByCGLIB$$65ef778b.createXResource(<generated>) >>>>>>>>>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at java.lang.reflect.Method.invoke(Method.java:606)

Users with the same issue

You are the first who have seen this exception.

Write tip

Know the solutions? Share your knowledge to help other developers to debug faster.