org.apache.hadoop.fs.s3a.AWSS3IOException: getFileStatus on s3a://landsat-pds/scene_list.gz: com.amazonaws.services.s3.model.AmazonS3Exception: Moved Permanently (Service: Amazon S3; Status Code: 301; Error Code: 301 Moved Permanently; Request ID: 68FA0CDF257E8E88), S3 Extended Request ID: ZrrcD+fiQ/H3B945SNuLm69beK1rfa/CcL0Zwg6QN+837odqsH067OM2ctBZ8qRlaUqnQ3brl7U=: Moved Permanently (Service: Amazon S3; Status Code: 301; Error Code: 301 Moved Permanently; Request ID: 68FA0CDF257E8E88)

Apache's JIRA Issue Tracker | Steve Loughran | 9 months ago
tip
Do you know that we can give you better hits? Get more relevant results from Samebug’s stack trace search.
  1. 0

    It'd be easier to work out what's happening when s3a calls against different endpoints fail if the 301 exceptions forwarded up included the URL in the header which (presumably) says where things moved to

    Apache's JIRA Issue Tracker | 9 months ago | Steve Loughran
    org.apache.hadoop.fs.s3a.AWSS3IOException: getFileStatus on s3a://landsat-pds/scene_list.gz: com.amazonaws.services.s3.model.AmazonS3Exception: Moved Permanently (Service: Amazon S3; Status Code: 301; Error Code: 301 Moved Permanently; Request ID: 68FA0CDF257E8E88), S3 Extended Request ID: ZrrcD+fiQ/H3B945SNuLm69beK1rfa/CcL0Zwg6QN+837odqsH067OM2ctBZ8qRlaUqnQ3brl7U=: Moved Permanently (Service: Amazon S3; Status Code: 301; Error Code: 301 Moved Permanently; Request ID: 68FA0CDF257E8E88)
  2. 0

    It'd be easier to work out what's happening when s3a calls against different endpoints fail if the 301 exceptions forwarded up included the URL in the header which (presumably) says where things moved to

    Apache's JIRA Issue Tracker | 9 months ago | Steve Loughran
    org.apache.hadoop.fs.s3a.AWSS3IOException: getFileStatus on s3a://landsat-pds/scene_list.gz: com.amazonaws.services.s3.model.AmazonS3Exception: Moved Permanently (Service: Amazon S3; Status Code: 301; Error Code: 301 Moved Permanently; Request ID: 68FA0CDF257E8E88), S3 Extended Request ID: ZrrcD+fiQ/H3B945SNuLm69beK1rfa/CcL0Zwg6QN+837odqsH067OM2ctBZ8qRlaUqnQ3brl7U=: Moved Permanently (Service: Amazon S3; Status Code: 301; Error Code: 301 Moved Permanently; Request ID: 68FA0CDF257E8E88)
  3. 0

    GitHub comment 2965#270215227

    GitHub | 3 months ago | bradkarels
    org.apache.hadoop.fs.s3a.AWSS3IOException: getFileStatus on dd/: com.amazonaws.services.s3.model.AmazonS3Exception: Bad Request (Service: Amazon S3; Status Code: 400; Error Code: 400 Bad Request; Request ID: null), S3 Extended Request ID: null: Bad Request (Service: Amazon S3; Status Code: 400; Error Code: 400 Bad Request; Request ID: null)
  4. Speed up your debug routine!

    Automated exception search integrated into your IDE

    Root Cause Analysis

    1. org.apache.hadoop.fs.s3a.AWSS3IOException

      getFileStatus on s3a://landsat-pds/scene_list.gz: com.amazonaws.services.s3.model.AmazonS3Exception: Moved Permanently (Service: Amazon S3; Status Code: 301; Error Code: 301 Moved Permanently; Request ID: 68FA0CDF257E8E88), S3 Extended Request ID: ZrrcD+fiQ/H3B945SNuLm69beK1rfa/CcL0Zwg6QN+837odqsH067OM2ctBZ8qRlaUqnQ3brl7U=: Moved Permanently (Service: Amazon S3; Status Code: 301; Error Code: 301 Moved Permanently; Request ID: 68FA0CDF257E8E88)

      at org.apache.hadoop.fs.s3a.S3AUtils.translateException()
    2. Apache Hadoop Amazon Web Services support
      S3AFileSystem.getFileStatus
      1. org.apache.hadoop.fs.s3a.S3AUtils.translateException(S3AUtils.java:127)
      2. org.apache.hadoop.fs.s3a.S3AUtils.translateException(S3AUtils.java:69)
      3. org.apache.hadoop.fs.s3a.S3AFileSystem.getFileStatus(S3AFileSystem.java:1459)
      4. org.apache.hadoop.fs.s3a.S3AFileSystem.getFileStatus(S3AFileSystem.java:113)
      4 frames
    3. Hadoop
      FileSystem.globStatus
      1. org.apache.hadoop.fs.Globber.getFileStatus(Globber.java:64)
      2. org.apache.hadoop.fs.Globber.doGlob(Globber.java:269)
      3. org.apache.hadoop.fs.Globber.glob(Globber.java:148)
      4. org.apache.hadoop.fs.FileSystem.globStatus(FileSystem.java:1697)
      4 frames
    4. Apache Hadoop Amazon Web Services support
      S3AFileSystem.globStatus
      1. org.apache.hadoop.fs.s3a.S3AFileSystem.globStatus(S3AFileSystem.java:1912)
      1 frame
    5. Hadoop
      FileInputFormat.singleThreadedListStatus
      1. org.apache.hadoop.mapred.FileInputFormat.singleThreadedListStatus(FileInputFormat.java:266)
      1 frame