org.jets3t.service.S3ServiceException: S3 GET failed for '/' XML Error Message: <?xml version="1.0" encoding="UTF-8"?><Error><Code>AccessDenied</Code><Message>Access Denied</Message><RequestId>F65D3BD163B09A32</RequestId><HostId>ZtiXv13HgHoKWETh9zwoAyO7E0TAHNMDmcXmRSpr6561i+93RT7jK6QSq/ZakvFr</HostId></Error>

Pentaho BI Platform Tracking | Eduardo Costa | 5 years ago
  1. 0

    I'm trying to use PDI to read from files stored in Amazon S3, but (obviously) I don't want to add master keys to the step. Using Amazon IAM, I can create a PDI user to access only the files it needs. I created the user (with its own keys), gave the permissions, tested the access with other tools, but "S3 CSV Input" step refuses to work. The error is "S3 GET failed for '/'". This means PDI is either trying to access my bucket list or trying to list the bucket contents. Considering that I'm telling it the exact file key to access, it should NOT do either of that things. Stacktrace is: {noformat} ERROR 13-03 11:31:11,528 - S3 CSV Input - Unexpected error trying to verify S3 settings : ERROR 13-03 11:31:11,528 - S3 CSV Input - org.jets3t.service.S3ServiceException: S3 GET failed for '/' XML Error Message: <?xml version="1.0" encoding="UTF-8"?><Error><Code>AccessDenied</Code><Message>Access Denied</Message><RequestId>F65D3BD163B09A32</RequestId><HostId>ZtiXv13HgHoKWETh9zwoAyO7E0TAHNMDmcXmRSpr6561i+93RT7jK6QSq/ZakvFr</HostId></Error> at org.jets3t.service.impl.rest.httpclient.RestS3Service.performRequest(RestS3Service.java:392) at org.jets3t.service.impl.rest.httpclient.RestS3Service.performRestGet(RestS3Service.java:727) at org.jets3t.service.impl.rest.httpclient.RestS3Service.listAllBucketsImpl(RestS3Service.java:1010) at org.jets3t.service.S3Service.listAllBuckets(S3Service.java:1329) at org.pentaho.di.trans.steps.s3csvinput.S3CsvInput.init(S3CsvInput.java:560) at org.pentaho.di.trans.step.StepInitThread.run(StepInitThread.java:52) at java.lang.Thread.run(Thread.java:722) {noformat} Also, update the [KettleException on line 654|https://github.com/pentaho/pentaho-kettle/blob/master/engine/src/org/pentaho/di/trans/steps/textfileoutput/TextFileOutput.java#L654], to show more detail from the caught exception (e.getCause().toString()). The second issue helps when there's a permissions issue returned from S3, that would otherwise not be seen without the use of an IDE debugger.

    Pentaho BI Platform Tracking | 5 years ago | Eduardo Costa
    org.jets3t.service.S3ServiceException: S3 GET failed for '/' XML Error Message: <?xml version="1.0" encoding="UTF-8"?><Error><Code>AccessDenied</Code><Message>Access Denied</Message><RequestId>F65D3BD163B09A32</RequestId><HostId>ZtiXv13HgHoKWETh9zwoAyO7E0TAHNMDmcXmRSpr6561i+93RT7jK6QSq/ZakvFr</HostId></Error>
  2. 0

    I'm trying to use PDI to read from files stored in Amazon S3, but (obviously) I don't want to add master keys to the step. Using Amazon IAM, I can create a PDI user to access only the files it needs. I created the user (with its own keys), gave the permissions, tested the access with other tools, but "S3 CSV Input" step refuses to work. The error is "S3 GET failed for '/'". This means PDI is either trying to access my bucket list or trying to list the bucket contents. Considering that I'm telling it the exact file key to access, it should NOT do either of that things. Stacktrace is: {noformat} ERROR 13-03 11:31:11,528 - S3 CSV Input - Unexpected error trying to verify S3 settings : ERROR 13-03 11:31:11,528 - S3 CSV Input - org.jets3t.service.S3ServiceException: S3 GET failed for '/' XML Error Message: <?xml version="1.0" encoding="UTF-8"?><Error><Code>AccessDenied</Code><Message>Access Denied</Message><RequestId>F65D3BD163B09A32</RequestId><HostId>ZtiXv13HgHoKWETh9zwoAyO7E0TAHNMDmcXmRSpr6561i+93RT7jK6QSq/ZakvFr</HostId></Error> at org.jets3t.service.impl.rest.httpclient.RestS3Service.performRequest(RestS3Service.java:392) at org.jets3t.service.impl.rest.httpclient.RestS3Service.performRestGet(RestS3Service.java:727) at org.jets3t.service.impl.rest.httpclient.RestS3Service.listAllBucketsImpl(RestS3Service.java:1010) at org.jets3t.service.S3Service.listAllBuckets(S3Service.java:1329) at org.pentaho.di.trans.steps.s3csvinput.S3CsvInput.init(S3CsvInput.java:560) at org.pentaho.di.trans.step.StepInitThread.run(StepInitThread.java:52) at java.lang.Thread.run(Thread.java:722) {noformat} Also, update the [KettleException on line 654|https://github.com/pentaho/pentaho-kettle/blob/master/engine/src/org/pentaho/di/trans/steps/textfileoutput/TextFileOutput.java#L654], to show more detail from the caught exception (e.getCause().toString()). The second issue helps when there's a permissions issue returned from S3, that would otherwise not be seen without the use of an IDE debugger.

    Pentaho BI Platform Tracking | 5 years ago | Eduardo Costa
    org.jets3t.service.S3ServiceException: S3 GET failed for '/' XML Error Message: <?xml version="1.0" encoding="UTF-8"?><Error><Code>AccessDenied</Code><Message>Access Denied</Message><RequestId>F65D3BD163B09A32</RequestId><HostId>ZtiXv13HgHoKWETh9zwoAyO7E0TAHNMDmcXmRSpr6561i+93RT7jK6QSq/ZakvFr</HostId></Error>
  3. 0

    Exception when getting a list of buckets on s3 using Jets3t

    Stack Overflow | 3 years ago | Nischal Hp
    org.jets3t.service.S3ServiceException: Request Error: java.lang.ClassCastException: java.lang.Long cannot be cast to java.lang.Integer
  4. Speed up your debug routine!

    Automated exception search integrated into your IDE

  5. 0

    NoClassDefFoundError

    Google Groups | 8 years ago | rob
    org.jets3t.service.S3ServiceException: S3 GET connection failed for '/'
  6. 0

    NoClassDefFoundError... which .jar?

    experts-exchange.com | 1 year ago
    org.jets3t.service.S3ServiceException: S3 GET connection failed for '/'

    Not finding the right solution?
    Take a tour to get the most out of Samebug.

    Tired of useless tips?

    Automated exception search integrated into your IDE

    Root Cause Analysis

    1. org.jets3t.service.S3ServiceException

      S3 GET failed for '/' XML Error Message: <?xml version="1.0" encoding="UTF-8"?><Error><Code>AccessDenied</Code><Message>Access Denied</Message><RequestId>F65D3BD163B09A32</RequestId><HostId>ZtiXv13HgHoKWETh9zwoAyO7E0TAHNMDmcXmRSpr6561i+93RT7jK6QSq/ZakvFr</HostId></Error>

      at org.jets3t.service.impl.rest.httpclient.RestS3Service.performRequest()
    2. JetS3t
      S3Service.listAllBuckets
      1. org.jets3t.service.impl.rest.httpclient.RestS3Service.performRequest(RestS3Service.java:392)
      2. org.jets3t.service.impl.rest.httpclient.RestS3Service.performRestGet(RestS3Service.java:727)
      3. org.jets3t.service.impl.rest.httpclient.RestS3Service.listAllBucketsImpl(RestS3Service.java:1010)
      4. org.jets3t.service.S3Service.listAllBuckets(S3Service.java:1329)
      4 frames
    3. org.pentaho.di
      StepInitThread.run
      1. org.pentaho.di.trans.steps.s3csvinput.S3CsvInput.init(S3CsvInput.java:560)
      2. org.pentaho.di.trans.step.StepInitThread.run(StepInitThread.java:52)
      2 frames
    4. Java RT
      Thread.run
      1. java.lang.Thread.run(Thread.java:722)
      1 frame